Data Warehousing
Build a real warehouse on Linux and Docker, from an OLTP source to reporting views, orchestrated by Airflow.
- SQL Server 2022
- Kimball
- SCD2
- Columnstore
- Airflow
Engineering Professional
I design, build and run the data platforms that businesses depend on: high-throughput pipelines, well-modelled warehouses, and the trusted numbers that reports and AI systems are built on. I'm a certified engineer, and every tutorial here comes from a working lab I built myself on AWS, so you see real code and real results. Alongside data, I write about power electronics for renewable energy.
The platform, end to end
The data and AI tracks each cover one layer of a modern data platform, following the data from the source system to the people and AI systems that use it. Select a layer to open its track.
Power Electronics is a separate engineering track, outside the data platform.
Learning tracks
Every track goes past "getting started": how the technology works internally, why it behaves the way it does, and how to use it in real systems.
Build a real warehouse on Linux and Docker, from an OLTP source to reporting views, orchestrated by Airflow.
Understand the engine first, then learn to program it with Jinja, macros, dispatch and custom materializations.
Turn warehouse tables into a Power BI model that every report can trust, kept as code in git.
A complete platform on Snowflake: incremental loads from SQL Server, dbt Silver, Gold and a Sales data mart, reconciled and run by Airflow.
Reference architectures and production deployments, drawn as full-size diagrams.
Practical statistics for everyday decisions, taught entirely with real oil and energy data.
Build, evaluate and operate AI systems on top of a governed data platform, not as stand-alone demos.
The electronics inside renewable energy converters: switches, converter circuits, drivers, magnetics and thermal design.
Expertise
Each area links to the chapters where I build it step by step, so you can check the work, not just read a list of skills.
Shown in Dimensional Modelling · Loading Dimensions · Performance
Shown in dbt Core Internals · Custom Materializations · Capstone
Shown in Orchestration · Data Quality Gate · Run, Fail & Re-run
Shown in Measure Architecture · Advanced Patterns · Model as Code
Shown in Reference Architecture · EKS Deployment · The Lab
Shown in Hypothesis Testing · Regression · Test Chooser
Shown in Setting Up Snowflake · Extract & Load · Sales Data Mart · Reconciliation
Shown in the new AI & AI Systems Engineering track: chapters are being written.
Shown in Semiconductor Switches · Switching, PWM & Losses · DC-DC Converters
Built on a real lab
The code, numbers and screenshots come from a lab I run on a virtual machine in AWS: real loads, real failures and real re-runs.
Where to start
Each track stands on its own, so you can start wherever your work is.