Databricks Lakehouse PlatformDatabricks Training

Build modern data engineering, analytics and AI solutions on the Databricks Lakehouse Platform, and prepare for Databricks certification exams.

Book an appointment Call 847-350-9034

Hands-on labsReal-world projectsCertification prep

What you will learn

Skills covered across the course.

Data engineering

Manage clusters, run ETL/ELT with PySpark and use Delta Lake for reliable storage.

Analytics and streaming

Build SQL dashboards and real-time streaming pipelines.

Machine learning

Develop models using MLflow and Databricks ML.

Governance

Unity Catalog governance and security.

End-to-end pipelines

Pipeline development with Workflows and DLT.

Certification

Preparation for Databricks certification exams.

Detailed course content

Modules from the platform basics to projects.

1. Introduction to Databricks

✓What is Databricks? Key features and benefits✓Databricks vs Hadoop vs AWS EMR✓Lakehouse architecture✓Workspaces, users, groups, notebooks, pricing, cluster types

2. Workspace and environment setup

✓Navigating the UI, notebooks (Python, SQL, Scala)✓Repos and Git integration✓Databricks File System (DBFS), mount points✓Databricks Utilities (DBUtils)

3. Clusters and compute

✓Standard, High Concurrency, Single Node clusters✓Setup, autoscaling, spot instances✓Jobs, job clusters and pools for cost optimization✓Cluster policies and security

4. Data engineering

✓ETL vs ELT, reading and writing ADLS/S3/GCS✓Transformations with PySpark✓Delta Lake essentials: ACID, time travel, vacuum✓Auto Loader and data pipelines with Workflows

5. Databricks SQL and BI

✓SQL Warehouses, analytical queries, dashboards✓Materialized views and querying Delta tables✓Performance optimization and query caching✓Connecting Power BI and Tableau

6. Delta Lake deep dive

✓Delta architecture, schema enforcement and evolution✓Delta Live Tables (DLT)✓Medallion architecture (Bronze, Silver, Gold)✓Optimize, Z-Order and SCD Type 1/2

7. Machine learning and AI

✓ML runtime, Feature Store, MLflow tracking✓AutoML and building ML pipelines✓Model deployment and serving✓TensorFlow, PyTorch, Scikit-Learn integration

8. GenAI and LLMs

✓Databricks MosaicML, training and fine-tuning LLMs✓Foundation models (Dolly 2.0, DBRX)✓Vector Search and RAG pipelines✓Building AI apps and integrating LLMs into data workflows

9. Streaming

✓Structured Streaming overview✓Auto Loader streaming ingestion✓Event Hub / Kafka integration✓Real-time dashboards, streaming Delta tables, late data and watermarks

10. Governance and security

✓Unity Catalog and the permission model✓Row-level and column-level security✓Token management and SCIM✓Data lineage, audit logs and Delta Sharing

11. DevOps and CI/CD

✓GitHub / Azure DevOps integration, CI/CD for notebooks✓Databricks Asset Bundles✓Dev, Test and Prod environments✓Terraform and monitoring jobs, alerts, clusters

Real-world projects

✓Hands-on real-world projects

Support and salient features

Career support and classroom features that come with the course.

Staffing support

✓Resume preparation✓Mock interview preparation✓Phone interview preparation✓Face to face interview preparation✓Project and technology preparation✓Internship with internal project work✓Externship with client project work

Our salient features

✓Hands-on labs and homework✓Group discussion and case study✓Course project work✓Regular quiz and exam✓Regular support beyond the classroom✓Students can re-take the class at no cost✓Dedicated conference rooms for group project work✓Live streaming for remote students✓Video recording to catch up on a missed class

Ready to learn Databricks?

Call 847-350-9034 or book an appointment to talk about this course and funding options.Book an appointment Call 847-350-9034 Education grant program

What you will learn

Skills covered across the course.

Data engineering

Manage clusters, run ETL/ELT with PySpark and use Delta Lake for reliable storage.

Analytics and streaming

Build SQL dashboards and real-time streaming pipelines.

Machine learning

Develop models using MLflow and Databricks ML.

Governance

Unity Catalog governance and security.

End-to-end pipelines

Pipeline development with Workflows and DLT.

Certification

Preparation for Databricks certification exams.

Detailed course content

Modules from the platform basics to projects.1

Introduction to Databricks

✓What is Databricks? Key features and benefits✓Databricks vs Hadoop vs AWS EMR✓Lakehouse architecture✓Workspaces, users, groups, notebooks, pricing, cluster types2

Workspace and environment setup

✓Navigating the UI, notebooks (Python, SQL, Scala)✓Repos and Git integration✓Databricks File System (DBFS), mount points✓Databricks Utilities (DBUtils)3

Clusters and compute

✓Standard, High Concurrency, Single Node clusters✓Setup, autoscaling, spot instances✓Jobs, job clusters and pools for cost optimization✓Cluster policies and security4

Data engineering

✓ETL vs ELT, reading and writing ADLS/S3/GCS✓Transformations with PySpark✓Delta Lake essentials: ACID, time travel, vacuum✓Auto Loader and data pipelines with Workflows5

Databricks SQL and BI

✓SQL Warehouses, analytical queries, dashboards✓Materialized views and querying Delta tables✓Performance optimization and query caching✓Connecting Power BI and Tableau6

Delta Lake deep dive

✓Delta architecture, schema enforcement and evolution✓Delta Live Tables (DLT)✓Medallion architecture (Bronze, Silver, Gold)✓Optimize, Z-Order and SCD Type 1/27

Machine learning and AI

✓ML runtime, Feature Store, MLflow tracking✓AutoML and building ML pipelines✓Model deployment and serving✓TensorFlow, PyTorch, Scikit-Learn integration8

GenAI and LLMs

✓Databricks MosaicML, training and fine-tuning LLMs✓Foundation models (Dolly 2.0, DBRX)✓Vector Search and RAG pipelines✓Building AI apps and integrating LLMs into data workflows9

Streaming

✓Structured Streaming overview✓Auto Loader streaming ingestion✓Event Hub / Kafka integration✓Real-time dashboards, streaming Delta tables, late data and watermarks10

Governance and security

✓Unity Catalog and the permission model✓Row-level and column-level security✓Token management and SCIM✓Data lineage, audit logs and Delta Sharing11

DevOps and CI/CD

✓GitHub / Azure DevOps integration, CI/CD for notebooks✓Databricks Asset Bundles✓Dev, Test and Prod environments✓Terraform and monitoring jobs, alerts, clusters12