Editor's top Apache Airflow books
1Data Pipelines with Apache Airflow
Bas P. Harenslak & Julian Rutger de Ruiter · Manning · 510 pages
The canonical Airflow book — written by engineers who built and maintained production Airflow deployments. Covers DAG design patterns, operators, testing strategies, and production deployment in depth. The chapters on DAG design and avoiding common pitfalls are required reading for anyone building Airflow pipelines that will run reliably at scale.
Apache Airflow Books for Beginners
1Data Pipelines Pocket Reference
James Densmore · O'Reilly · 180 pages
A short, dense reference on pipeline design decisions — batch vs. streaming, build vs. buy, orchestration patterns — written by a data engineering director who has built pipelines at Wayfair and HubSpot. Good for the "why" behind Airflow DAG design choices, not the "how" of Airflow syntax itself.
Intermediate & Advanced Apache Airflow Books
6Data Pipelines with Apache Airflow
Bas P. Harenslak & Julian Rutger de Ruiter · Manning · 510 pages
The canonical Airflow book — written by engineers who built and maintained production Airflow deployments. Covers DAG design patterns, operators, testing strategies, and production deployment in depth. The chapters on DAG design and avoiding common pitfalls are required reading for anyone building Airflow pipelines that will run reliably at scale.
Fundamentals of Data Engineering
Joe Reis & Matt Housley · O'Reilly Media · 446 pages
The best high-level treatment of the data engineering landscape, with strong coverage of orchestration's role in the modern data stack. Airflow is discussed in context alongside dbt, Spark, and warehouse tooling — this book provides the strategic thinking that turns Airflow proficiency into data engineering architecture judgement.
97 Things Every Data Engineer Should Know
ed. Tobias Macey · O'Reilly
Short essays from engineers at Twitter, Stitch Fix, and Capital One on pipeline reliability, data lineage, and orchestration war stories. Useful for picking up the operational judgement that Airflow's own docs don't teach — dip into it rather than reading start to finish.
Data Engineering with Python
Paul Crickard · Packt · 357 pages
Builds a complete pipeline using Airflow to orchestrate ingestion, transformation, and loading alongside Kafka and cloud storage — useful for seeing Airflow wired into a full stack rather than as an isolated tool.
Designing Data-Intensive Applications
Martin Kleppmann · O'Reilly · 662 pages
Not about orchestration directly, but the batch-processing and idempotency chapters explain why DAG tasks need to be designed as retry-safe and deterministic — the property that separates reliable Airflow pipelines from brittle ones.
Streaming Systems
Tyler Akidau, Slava Chernyak & Reuven Lax · O'Reilly · 351 pages
Useful once your Airflow DAGs need to coordinate with a streaming layer — the watermark and windowing concepts explain why "just schedule it more often" isn't the same as real orchestration of streaming data.
Apache Airflow resources