Dipankar Mazumdar is currently the Director of Developer Advocacy at Cloudera, where he leads global developer initiatives focused on lakehouse architectures and generative AI. Previously, he held developer advocacy roles at Dremio, Onehouse, and Qlik, contributing to open source projects such as Apache Iceberg, Apache Hudi, and XTable, among others. For most of his career, Dipankar has worked at the intersection of data engineering and AI. He has also contributed to O'Reilly's Apache Iceberg: The Definitive Guide and has spoken at numerous conferences, including Databricks Data + AI, Netflix Engineering, ApacheCon, Scale By the Bay, and Data Day Texas, among others. Vinoth Govindarajan is a seasoned data expert and staff software engineer at Apple Inc., where he spearheads data platforms using open-source technologies like Iceberg, Spark, Trino, and Flink. Before this, he worked on designing incremental ETL frameworks for real-time data processing at Uber. He is a dedicated contributor to the open source community in projects such as Apache Hudi and dbt-spark. As a thought leader, Vinoth has shared his expertise through speaking engagements at conferences such as dbt Coalesce and Hudi OSS community meet-ups. He has published numerous blogs on building open lakehouses. Holding a bachelor's degree in information technology, Vinoth has also authored multiple research papers published in journals like IEEE.

• Table of ContentsOpen Data Lakehouse: A New Architectural ParadigmTransactional Capabilities of the LakehouseApache Iceberg Deep DiveApache Hudi Deep DiveDelta Lake Deep DiveCatalog and Metadata ManagementInteroperability in LakehousesPerformance Optimization and Tuning in a LakehouseData Governance and Security in LakehousesEvaluating and Selecting Open Table FormatsReal-World Applications and Learnings

Dipankar Mazumdar is currently the Director of Developer Advocacy at Cloudera, where he leads global developer initiatives focused on lakehouse architectures and generative AI. Previously, he held developer advocacy roles at Dremio, Onehouse, and Qlik, contributing to open source projects such as Apache Iceberg, Apache Hudi, and XTable, among others. For most of his career, Dipankar has worked at the intersection of data engineering and AI. He has also contributed to O'Reilly's Apache Iceberg: The Definitive Guide and has spoken at numerous conferences, including Databricks Data + AI, Netflix Engineering, ApacheCon, Scale By the Bay, and Data Day Texas, among others. Vinoth Govindarajan is a seasoned data expert and staff software engineer at Apple Inc., where he spearheads data platforms using open-source technologies like Iceberg, Spark, Trino, and Flink. Before this, he worked on designing incremental ETL frameworks for real-time data processing at Uber. He is a dedicated contributor to the open source community in projects such as Apache Hudi and dbt-spark. As a thought leader, Vinoth has shared his expertise through speaking engagements at conferences such as dbt Coalesce and Hudi OSS community meet-ups. He has published numerous blogs on building open lakehouses. Holding a bachelor's degree in information technology, Vinoth has also authored multiple research papers published in journals like IEEE.

• Table of ContentsOpen Data Lakehouse: A New Architectural ParadigmTransactional Capabilities of the LakehouseApache Iceberg Deep DiveApache Hudi Deep DiveDelta Lake Deep DiveCatalog and Metadata ManagementInteroperability in LakehousesPerformance Optimization and Tuning in a LakehouseData Governance and Security in LakehousesEvaluating and Selecting Open Table FormatsReal-World Applications and Learnings

Dipankar Mazumdar is currently the Director of Developer Advocacy at Cloudera, where he leads global developer initiatives focused on lakehouse architectures and generative AI. Previously, he held developer advocacy roles at Dremio, Onehouse, and Qlik, contributing to open source projects such as Apache Iceberg, Apache Hudi, and XTable, among others. For most of his career, Dipankar has worked at the intersection of data engineering and AI. He has also contributed to O'Reilly's Apache Iceberg: The Definitive Guide and has spoken at numerous conferences, including Databricks Data + AI, Netflix Engineering, ApacheCon, Scale By the Bay, and Data Day Texas, among others. Vinoth Govindarajan is a seasoned data expert and staff software engineer at Apple Inc., where he spearheads data platforms using open-source technologies like Iceberg, Spark, Trino, and Flink. Before this, he worked on designing incremental ETL frameworks for real-time data processing at Uber. He is a dedicated contributor to the open source community in projects such as Apache Hudi and dbt-spark. As a thought leader, Vinoth has shared his expertise through speaking engagements at conferences such as dbt Coalesce and Hudi OSS community meet-ups. He has published numerous blogs on building open lakehouses. Holding a bachelor's degree in information technology, Vinoth has also authored multiple research papers published in journals like IEEE.

• Table of ContentsOpen Data Lakehouse: A New Architectural ParadigmTransactional Capabilities of the LakehouseApache Iceberg Deep DiveApache Hudi Deep DiveDelta Lake Deep DiveCatalog and Metadata ManagementInteroperability in LakehousesPerformance Optimization and Tuning in a LakehouseData Governance and Security in LakehousesEvaluating and Selecting Open Table FormatsReal-World Applications and Learnings