2 posts — Delta Lake is the optimized storage layer that provides the foundation for storing data and tables in the Databricks Lakehouse Platform. Delta Lake is open source software that extends Parquet data files with a file-based transaction log for ACID transactions and scalable metadata handling. Delta Lake was developed for tight integration with Structured Streaming, allowing you to easily use a single copy of data for both batch and streaming operations, providing incremental processing at scale.
Databricks announced the v3.0 of Delta Lake. Apart from the bells and whistles, it has one powerful feature: Support for Apache Hudi and Iceberg. When used in the right place, the support for Hudi and Iceberg can unlock many opportunities.
Delta Lake has been an absolute pleasure to work with for the last couple of years, and it solved plenty of ongoing issues with data lakes using the Delta file format. Now it becomes more powerful in its third version and evolution.
Design awesome data platforms using Microsoft Fabric
