Summer Certification Special Limited Time 70% Discount Offer - Ends in 0d 00h 00m 00s - Coupon code: force70

Databricks Certified Data Engineer Associate Exam Databricks-Certified-Data-Engineer-Associate Question # 58 Topic 6 Discussion

Databricks Certified Data Engineer Associate Exam Databricks-Certified-Data-Engineer-Associate Question # 58 Topic 6 Discussion

Databricks-Certified-Data-Engineer-Associate Exam Topic 6 Question 58 Discussion:
Question #: 58
Topic #: 6

A data engineering team needs to integrate two data sources into Databricks:

    Clickstream events: 5,000 events per second from an Apache Kafka topic

    Customer master data: Only changed records every four hours from a Snowflake database

The solution must process clickstream data with latency under 30 seconds and prevent reprocessing customer master data that has not changed.

Which ingestion approach meets these requirements?


A.

Use Structured Streaming for Kafka and a Lakeflow Connect managed connector with incremental processing for Snowflake.


B.

Use a non-incremental Snowflake connector, fetch all data every four hours, and apply MERGE operations.


C.

Use spark.readStream() with Kafka and query Snowflake hourly using a time-based filter.


D.

Use Structured Streaming for Kafka and a Lakeflow Connect connector with a full refresh for Snowflake.


Get Premium Databricks-Certified-Data-Engineer-Associate Questions

Contribute your Thoughts:


Chosen Answer:
This is a voting comment (?). It is better to Upvote an existing comment if you don't have anything to add.