Examtopics

Professional Data Engineer
  • Topic 1 Question 315

    You are using Workflows to call an API that returns a 1KB JSON response, apply some complex business logic on this response, wait for the logic to complete, and then perform a load from a Cloud Storage file to BigQuery. The Workflows standard library does not have sufficient capabilities to perform your complex logic, and you want to use Python's standard library instead. You want to optimize your workflow for simplicity and speed of execution. What should you do?

    • Create a Cloud Composer environment and run the logic in Cloud Composer.

    • Create a Dataproc cluster, and use PySpark to apply the logic on your JSON file.

    • Invoke a Cloud Function instance that uses Python to apply the logic on your JSON file.

    • Invoke a subworkflow in Workflows to apply the logic on your JSON file.


    シャッフルモード