Hands-on Tutorials

Part 8: Hands-on Tutorials

Part 8 comes last because everything before it was building the judgment to know which AWS service combination a given problem calls for — this Part hands you ten real, currently-live tutorials to go build with that judgment instead of reading more prose about it. These aren’t concept pages: each one is a short pointer to an official AWS walkthrough or reference repo, annotated with what it concretely builds and which earlier concept group it puts into practice.

Taken together, the ten tutorials trace the same layers the rest of the course covered — storage and table formats, ingestion and CDC, transformation, streaming, orchestration, mesh governance, and AI-ready serving — but as deployable infrastructure instead of diagrams. Work through the ones that map to the concepts you’re least confident about; there’s no required order.

mindmap
  root((Hands-on Tutorials))
    Serverless Data Lake with Glue, S3 & Athena
    Stream CDC into S3 with AWS DMS
    Transactional Lake with Iceberg & EMR Serverless
    Apache Hudi Data Lake on EMR
    dbt Transformations in Redshift
    NRT Analytics with Redshift Streaming & Kinesis
    Data Mesh with Lake Formation Tag-Based Access
    Orchestrate ETL with MWAA
    Multimodal RAG with Bedrock Knowledge Bases
    AWS Samples Data Mesh Reference (DataZone)

Tutorials

# Tutorial What it builds
1 Serverless Data Lake Analytics with AWS Glue, S3 & Athena Build a serverless data lake: crawl S3 with Glue, catalog it, and query it with Athena.
2 Stream CDC into an S3 Data Lake in Parquet with AWS DMS Stream ongoing database changes into a lake in Parquet format using AWS Database Migration Service.
3 Transactional Data Lake with Apache Iceberg, EMR Serverless & Athena Add ACID transactions, schema evolution, and time travel to an S3 data lake with Iceberg.
4 Build Your Apache Hudi Data Lake on Amazon EMR Run upserts and incremental pulls against a lakehouse table using Hudi on EMR.
5 Manage Data Transformations with dbt in Amazon Redshift Model and transform warehouse data as version-controlled SQL using dbt against Redshift.
6 Near-Real-Time Analytics with Redshift Streaming Ingestion & Kinesis Ingest and analyze a live event stream directly into Redshift via Kinesis Data Streams.
7 Data Mesh at Scale with AWS Lake Formation Tag-Based Access Control Share and govern data products across accounts/domains using Lake Formation’s data-mesh pattern.
8 Orchestrate an End-to-End ETL Pipeline with S3, Glue, Redshift Serverless & MWAA Schedule and monitor a multi-step pipeline as a DAG using managed Airflow (MWAA).
9 Multimodal RAG with Amazon Bedrock Data Automation & Knowledge Bases Ground an LLM’s answers in your own documents using Bedrock Knowledge Bases and a vector store.
10 AWS Samples: Data Mesh Reference Architecture (DataZone, CDK & CloudFormation) A deployable reference implementation of a data-mesh architecture on AWS, straight from AWS’s official samples org.

| ← Previous: Capstone: Designing and Defending an AI-Ready Platform to the Board | Next: Serverless Data Lake Analytics with AWS Glue, S3 & Athena → | |:—|—:|


Table of contents


Back to top

Independent, self-authored data architecture field notes.

This site uses Just the Docs, a documentation theme for Jekyll.