Modern Data Lakehouse

Module 27 · Applied

The open-source & vendor landscape

Databricks, Snowflake, Dremio, Starburst and friends, plus a fully open-source stack you can run yourself.

In plain words

Beyond the three clouds are vendor platforms (Databricks, Snowflake, Dremio and more) and fully open-source stacks you run yourself. This module maps equivalent pieces across all of them, so you can read any architecture diagram.

Helps to take first

Words you'll meet

This module is in production

Here's what it will cover.

Centrepiece

A lakehouse 'Rosetta stone': swap one architecture between AWS, GCP, Azure, vendors and pure open source and see each block change

You will understand

  • Vendor platforms and what they add
  • Open-source stack: MinIO, Iceberg, Polaris/Nessie, Spark, Trino, Airflow, Superset
  • Lock-in, portability and cost considerations
  • Mapping equivalent services across clouds

Formats

Build & connectAnimated infographicCheckpoints