Intermediate Level

Spark Streaming - Stream Processing in Lakehouse

★ 4.8 (300 learners) 60 hrs total 6 modules

Microsoft Azure Databricks Apache Spark Unity Catalog

Only 4 seats left · Next batch starts 29 Aug 2026

Download Curriculum

60 hrs: of content
6 modules: in curriculum
16 projects: hands-on builds
Intermediate: difficulty

Curriculum covers

Frameworks you'll master

4 tools & frameworks

Microsoft Azure Databricks Apache Spark Unity Catalog

Course Curriculum

6 modules · 60 hours · 24 live sessions

Setup our environment 1 sessions

Spark Development Environments
Setup your Databricks Community Cloud Environment
Working in Databricks Workspace

Getting Started with Spark Streaming 3 sessions

Batch processing to stream processing
Your Spark application Applying Best Practice
Your first streaming application Implementing Stream
Stream Processing Model in Spark
Create Another Streaming Application
Stream Triggers
Incremental Batch Processing
Streaming Sources and Sinks
Creating Chain of Streams

Kafka for Data Engineers 3 sessions

An Introduction to Kafka
Creating Kafka Cluster in Cloud
Kafka Core Concepts
Producing Data to Kafka Topic
Consuming Data from Kafka Topic
Working with Kafka Topic Data
How to Implement Idempotence
Working with Kafka Sink

Streaming Aggregates and State Management 3 sessions

Streaming Aggregates and State Store
Incremental Aggregates and Update Mode
Spark Streaming Output Modes
Stateful Vs Stateless Aggregation
Implementing Stateless Streaming Aggregation
Timebound Stateful Tumbling Window Aggregation
Watermarking and State Store Cleanup
Sliding Window Aggregates

Working with Databricks Platform 5 sessions

Introduction to Databricks
Creating Azure Free Account
Azure Portal Overview
Creating Azure Databricks Service
Introduction to Azure Databricks Workspace
Azure Databricks Architecture
Creating Azure Databricks Cluster
Introduction to Databricks Notebooks
Notebooks Magic Commands and Utilities
Databricks Notebooks Utilities
Introduction to Databricks Unity Catalog
Introduction to Databricks Workflow Jobs
Introduction to Databricks Rest API
Introduction to Databricks CLI

Capstone Project – Implementing RealTime Project in Lakehouse 9 sessions

Project Scope and Background
Taking out the operational requirement
Storage Design
Implement Data Security
Implement Resource Policies
Decouple Data Ingestion
Design Bronze Layer
Design Silver and Gold Layer
Setup your source control
Setup your environment
Create a development workspace
Create and Configure Storage Layer
Create Unity Catalog Metastore
Create Catalog and External Locations
Start Coding
Test your code
Load historical data
Ingest into bronze layer
Process the silver layer
Handling multiple updates
Implementing Gold Layer
Creating a run script
Preparing for Integration testing
Creating Test Data Producer
Creating Integration Test for Batch mode
Creating Integration Test for Stream mode
Implementing CI CD Pipeline
Develop Build Pipeline
Develop Release Pipeline
Creating Databricks CLI Script

Download Full Curriculum

Batch Schedule

⚡ Seats filling fast — only 4 remaining across all batches

Available Batches
Batch Type	Schedule	Duration	Next Start Date	Availability
Weekend	Sat & Sun, 10am–1pm	10 weeks	29 Aug 2026	Available
Weekday	Mon–Fri, 7–9pm	8 weeks	31 Aug 2026	Available
Fast-track	Mon–Sun, 6 hours/day	2 weeks	7 Sept 2026	Only 4 seats left

Ready to Get Started?

Download the curriculum to see every module, batch dates and fees. Book a free 30-minute session with our advisors to get your questions answered.

Book Free Demo

Download the Full Curriculum

See every module, capstone project, and tool covered — free, instant access.

Similar Courses You Might Like

View Course →

Data Engineering

data engineering

AWS GLUE Lambda Certification

★ 4.8 · 300 learners · Intermediate

Starts 8 Aug 2026 · ~1–2 months

View Course →

Data Engineering

data engineering

Databricks - Master Databricks for Data Engineers

★ 4.8 · 300 learners · Intermediate

Starts 15 Aug 2026 · ~1–2 months

View Course →

Data Engineering

data engineering

Databricks Certified Data Engineer Associate

★ 4.8 · 300 learners · Intermediate

Starts 22 Aug 2026 · ~1–2 months

View Course →

Data Engineering

data engineering

Databricks Certified Data Engineer Professional

★ 4.8 · 300 learners · Advanced

Starts 29 Aug 2026 · ~1–2 months

Book Free Demo