Module 17 · Core

Governance, security & privacy

Access control, credential vending, lineage, and deleting personal data from immutable files.

In plain words

Data about people needs rules: who can see what, how long it's kept, and how to erase it on request. That's tricky when files are immutable and old versions linger. This module walks through access control and privacy obligations like India's DPDP Act.

Helps to take first

Catalogs: the source of truth

Words you'll meet

Catalog Retention period VACUUM Time travel

This module is in production

Here's what it will cover.

Centrepiece

Follow one customer's personal data through the lakehouse, then handle their erasure request and find every snapshot and file that still holds it

You will understand

Table, row and column-level access control
Credential vending and storage-level security
Encryption, auditing and lineage
Right-to-erasure (DPDP/GDPR) on immutable storage

Formats

Scroll storyFix the problemCheckpoints