Coming Soon
Intermediate
Advanced Data Engineering & Pipeline Architecture
Designed explicitly for forward-thinking Data Engineers, this comprehensive course teaches you how to master the transition from traditional, sluggish data repositories to a modern, lightning-fast Data Lakehouse architecture. You will get hands-on experience orchestrating real-time streaming and batch ingestion pipelines , refining data tiers using the robust Medallion framework (Bronze, Silver, Gold) , and leveraging advanced file formats like Apache Hudi and Parquet with Snappy compression to ensure absolute system performance.
Recommended Course Audience
Pre-Required Skills
-
Experience: 2+ years of experience in Data Engineering, Database Administration (DBA), or Cloud Architecture.
-
Core Technical Skills: Proficient with SQL; foundational familiarity with Python or Scala; basic understanding of distributed computing concepts.
-
Systems Exposure: Prior experience with ETL/ELT concepts, cloud storage (e.g., AWS S3, Azure Blob), and relational databases.
Course Highlights
4 modulesCore Concepts: Mastering batch and streaming data capture mechanics. Understanding structural boundaries between legacy databases and modern ingestion layers.
Core Concepts: Storage optimization, data landing zones, and moving from raw, unstructured dumps to organized repositories.
Core Concepts: Enterprise data persistence, ACID-compliant lakehouse transactions, and building scalable feature tables.
Core Concepts: High-volume data transformation, parallel compute clustering, and downstream data movement.
$699.00
This course is coming soon. Enrollment is not yet open.
Level
:
Intermediate
Modules
:
4
Duration
:
20 hours