01
Lakehouse & Medallion Foundations
Start here
3 lessons
▸
- 1.1What a Lakehouse ishtml md
- 1.2Databricks architecture at a glancehtml md
- 1.3Medallion architecturehtml md
02
Delta Lake — the storage foundation
Core
4 lessons · 1📓
▸
- 2.1Delta tables & the transaction loghtml md
- 2.2MERGE (upserts), INSERT OVERWRITE, CREATE OR REPLACE and CTAS.html md
- 2.3Table & column properties; managed vshtml md
- 2.4Time travelhtml md 📓
03
Delta Lake Optimization & Performance
Tune
4 lessons · 1📓
▸
- 3.1OPTIMIZE (compaction) and Z-ORDER to collocate related data.html md
- 3.2Liquid Clusteringhtml md
- 3.3VACUUM to remove unused files; data versioning and time-travel UNDO.html md
- 3.4Deep vs shallow CLONE; Predictive Optimizationhtml md 📓
04
Ingestion — Auto Loader, COPY INTO & Lakeflow Connect
Load
4 lessons · 1📓
▸
- 4.1Auto Loader (cloudFiles)html md
- 4.2COPY INTO for simpler, idempotent batch loads.html md
- 4.3Lakeflow Connect managed connectors (Salesforce, Workday, ServiceNow,html md
- 4.4Database/CDC ingestion, REST API & JSON sources, and streaming ingestihtml md 📓
05
Lakeflow Spark Declarative Pipelines (SDP)
Transform · was DLT
4 lessons · 1📓
▸
- 5.1Declarative pipelineshtml md
- 5.2Streaming tables, materialized views, flows, and external sinks (Kafkahtml md
- 5.3Data-quality Expectations to validate, drop or quarantine bad rows.html md
- 5.4AUTO CDC for Slowly Changing Dimensions (SCD Type 1 & 2); parametrizedhtml md 📓
06
Lakeflow Designer — visual & no-code pipelines
No-code · NEW
3 lessons
▸
- 6.1Build transformation workflows on a drag-and-drop canvashtml md
- 6.2Built-in operators for filtering, aggregating, joining and reshaping dhtml md
- 6.3Generate or update transformations with natural-language prompts (Genihtml md
07
Lakeflow Jobs — orchestration
Schedule · was Workflows
3 lessons · 1📓
▸
- 7.1Jobs & taskshtml md
- 7.2Control flowhtml md
- 7.3Schedules, event triggers and CRON; retries, monitoring, notificationshtml md 📓
08
Unity Catalog — Governance, Security & ABAC
Govern
5 lessons · 1📓
▸
- 8.1The 3-level namespace catalog.schema.table; Volumes for files; discovehtml md
- 8.2Access controlhtml md
- 8.3Data-level securityhtml md
- 8.4Attribute-Based Access Control (ABAC)html md
- 8.5Unity Catalog Functionshtml md 📓
09
Delta Sharing & Lakehouse Federation
Share & query
2 lessons · 1📓
▸
10
Databricks SQL — Warehouses, Genie & BI
Analytics
4 lessons · 1📓
▸
- 10.1SQL Warehouseshtml md
- 10.2SQL editor, parameterized queries, CTEs and query snippets; query cachhtml md
- 10.3SQL Alerts, scheduled queries and AI/BI Dashboards.html md
- 10.4Databricks Geniehtml md 📓
11
Production Engineering — CI/CD with DABs
Ship it
3 lessons · 1📓
▸
- 11.1Databricks Asset Bundles (DABs)html md
- 11.2Git integration with Databricks Repos / Git Folders for source controlhtml md
- 11.3Databricks Connect for local-IDE development against a remote cluster.html md 📓
12
Certification Prep — DE Associate exam
Capstone
3 lessons
▸
- 12.1Map your skills to the Databricks Certified Data Engineer Associate exhtml md
- 12.2Practice with full-length exams and review weak areas before you book.html md
- 12.3Latest exam updates emphasize Lakeflow naming, data-level security (rohtml md