Track

Data Architecture Design

How the pieces of a data platform fit together and where each one actually runs. Every design starts with a full-size diagram, then explains the run flow, each component's job, the configuration files and how to describe the design in an interview.

3 chapters ~1.5 hours Snowflake · dbt · Airflow · AWS · Linux Level: intermediate → advanced

Designs

How to read the diagrams

Colour / markMeaning
AFTealAirflow: orchestration and its runtime
dbtOrangedbt and the build/release path (code, CI/CD, Ansible)
SFBlueSnowflake: storage, compute and access control
—Grey arrowsData flow or a network connection
Numbered circlesMatch the numbered steps under each diagram
Dashed outlineA network boundary (VPC, private network)

Use ⤢ Full screen on any diagram to see it at full size. On a phone, scroll the diagram sideways.