Module 25 · Applied

Lakehouse on Google Cloud

GCS, BigLake, BigQuery, Dataproc, Dataflow and Dataplex, assembled.

In plain words

Google Cloud's version of the lakehouse centres on Cloud Storage, BigLake and BigQuery. You'll assemble a design and compare tables that BigQuery manages with open Iceberg tables.

Helps to take first

Catalogs: the source of truth How engines read a lakehouse

Words you'll meet

Object storage Catalog Query engine

This module is in production

Here's what it will cover.

Centrepiece

Assemble a Google Cloud lakehouse and compare BigQuery-managed vs open Iceberg tables

You will understand

Storage: GCS; BigLake and BigQuery tables for Apache Iceberg
Catalog and governance: BigLake metastore, Dataplex
Compute: BigQuery, Dataproc (Spark), Dataflow
Ingestion: Datastream, Pub/Sub

Formats

Build & connectLive simulationCheckpoints