Foundations: Bridging from Legacy DW & ETL

Part 1: Theory & Foundations

Part 1 opens the course here because every later decision in this guide — which architecture pattern to reach for, which table format to bet on, whether a pipeline needs to stream — is a special case of trade-offs this group establishes first: what a consistency guarantee actually promises, what workload you’re really building for, and how fast data genuinely needs to move. These nine topics take a reader who already thinks in terms of a warehouse, a nightly ETL job, and a normalized schema, and rebuild that intuition one layer at a time: the physics underneath any data system (ACID/BASE/CAP), the architectural styles and workload types built on top of it, the modeling and pipeline patterns that move data through it, and finally the concrete cloud tooling, migration patterns, and career judgment needed to put it all into practice. By the end of this group, the foundational vocabulary and decision instincts for the rest of the course are in place.

mindmap
  root((Foundations: Bridging from Legacy DW & ETL))
    ACID, BASE & the CAP Theorem
      CAP / PACELC
    Data Architecture Tenets & Styles
      Monolithic vs Distributed vs Cloud
    OLTP vs OLAP
    Data Modeling & Normalization Refresher
    Legacy ETL to Modern ELT
    Batch, NRT & RT Processing
      Robust pipeline design
    AWS, Azure & Hybrid/Multi-Cloud Tooling
    Migrating Legacy Warehouse to Cloud
      Strangler-fig cutover
    Choosing Architecture & Career Path

See also: Consistency in Practice: Read-After-Write on Object Storage and Should This Be Streaming At All? build directly on the ACID/BASE/CAP topic in this group; Deciding Under Uncertainty extends the migration topic’s requirements-and-constraints framing into a full decision model.

Topics


| ← Previous: Home | Next: ACID, BASE & the CAP Theorem: The Physics Underneath Every Data System → | |:—|—:|


Table of contents


Back to top

Independent, self-authored data architecture field notes.

This site uses Just the Docs, a documentation theme for Jekyll.