Foundations: Bridging from Legacy DW & ETL
Part 1: Theory & Foundations
Part 1 opens the course here because every later decision in this guide — which architecture pattern to reach for, which table format to bet on, whether a pipeline needs to stream — is a special case of trade-offs this group establishes first: what a consistency guarantee actually promises, what workload you’re really building for, and how fast data genuinely needs to move. These nine topics take a reader who already thinks in terms of a warehouse, a nightly ETL job, and a normalized schema, and rebuild that intuition one layer at a time: the physics underneath any data system (ACID/BASE/CAP), the architectural styles and workload types built on top of it, the modeling and pipeline patterns that move data through it, and finally the concrete cloud tooling, migration patterns, and career judgment needed to put it all into practice. By the end of this group, the foundational vocabulary and decision instincts for the rest of the course are in place.
mindmap
root((Foundations: Bridging from Legacy DW & ETL))
ACID, BASE & the CAP Theorem
CAP / PACELC
Data Architecture Tenets & Styles
Monolithic vs Distributed vs Cloud
OLTP vs OLAP
Data Modeling & Normalization Refresher
Legacy ETL to Modern ELT
Batch, NRT & RT Processing
Robust pipeline design
AWS, Azure & Hybrid/Multi-Cloud Tooling
Migrating Legacy Warehouse to Cloud
Strangler-fig cutover
Choosing Architecture & Career Path
See also: Consistency in Practice: Read-After-Write on Object Storage and Should This Be Streaming At All? build directly on the ACID/BASE/CAP topic in this group; Deciding Under Uncertainty extends the migration topic’s requirements-and-constraints framing into a full decision model.
Topics
| ← Previous: Home | Next: ACID, BASE & the CAP Theorem: The Physics Underneath Every Data System → | |:—|—:|
Table of contents
- ACID, BASE & the CAP Theorem: The Physics Underneath Every Data System
- Data Architecture Tenets & Styles: Monolithic, Distributed, Cloud
- OLTP vs OLAP: Transactional vs Analytical Workloads
- Data Modeling, Database Types & Normalization Refresher
- From Legacy ETL to Modern ELT: Bridging Talend & Informatica-Style Tools
- Batch, Near-Real-Time & Real-Time Processing: Building Robust Pipelines
- AWS, Azure & Hybrid/Multi-Cloud Tooling for Data Professionals
- Migrating a Legacy Warehouse to the Cloud: Patterns & Pitfalls
- Choosing an Architecture & the Road to Becoming a Data Architect