A data engineer needs to deploy a complex pipeline. The stages of the pipeline must run scripts, but only fully managed and serverless services can be used.
A.
Deploy AWS Glue jobs and workflows. Use AWS Glue to run the jobs and workflows on a schedule.
B.
Use Amazon MWAA to build and schedule the pipeline.
C.
Deploy the script to EC2. Use EventBridge to schedule it.
D.
Use AWS Glue DataBrew and EventBridge to run on a schedule.
AWS Glue is a fully managed and serverless ETL platform that supports scripts in PySpark or Python shell jobs.
Workflows in Glue orchestrate multiple job stages without infrastructure management.
“Use AWS Glue Workflows to build and orchestrate complex multi-stage ETL pipelines using serverless AWS Glue jobs.”
– Ace the AWS Certified Data Engineer - Associate Certification - version 2 - apple.pdf
This meets the “serverless only” and “runs scripts” requirements precisely.
Contribute your Thoughts:
Chosen Answer:
This is a voting comment (?). You can switch to a simple comment. It is better to Upvote an existing comment if you don't have anything to add.
Submit