A data engineer is designing a Bronze-to-Silver pipeline on the Databricks Data Intelligence Platform. The source system sends daily CSV files, and new optional columns are added over time.
The engineer needs a storage format and table capabilities that provide all of the following:
Writes that do not conform to the defined schema are rejected.
The schema can evolve to include new optional columns without manually recreating the table.
Previous table versions can be queried for debugging and auditing.
Which solution fulfills these requirements?
Submit