A data engineering team needs to integrate two data sources into Databricks:
Clickstream events: 5,000 events per second from an Apache Kafka topic
Customer master data: Only changed records every four hours from a Snowflake database
The solution must process clickstream data with latency under 30 seconds and prevent reprocessing customer master data that has not changed.
Which ingestion approach meets these requirements?
Submit