Introducing Airflow 3.2
From The Data Flowcast: Mastering Apache Airflow ® for Data Engineering and AI by Astronomer
April 9, 2026 · 26 min · Season 1 · Episode 76
About this episode
The episode introduces Airflow 3.2 and discusses its updates for data pipeline operations.
We introduce Airflow 3.2 and its updates for teams that build and operate data pipelines. Astronomer ’s Head of Customer Education, Marc Lamberti , and Senior Manager of Developer Relations, Kenten Danas , break down what’s new, from asset partitioning to Async Python tasks and DAG versioning. They explore how these updates improve scheduling, performance and observability in production workflows. Key Takeaways: 00:00 Introduction. 02:10 Airflow 3 architecture separates workers from the metadata database. 03:05 Plugin versioning and UI-based backfills simplify operations. 06:20 Asset partitioning enables granular, partition-level scheduling. 07:15 Triggering DAGs on partitions instead of full datasets. 11:05 Deferrable operators reduce worker slot usage. 12:00 Async operators reduce database pressure and overhead. 14:10 Async improves throughput, not single task speed. 22:20 Inlets and outlets improve asset lineage visibility. 23:00 DAG version markers show changes directly in the UI. Resources Mentioned: Marc Lamberti https://www.linkedin.com/in/marclamberti/ Apache Airflow https://airflow.apache.org/ Astronomer | LinkedIn https://www.linkedin.com/company/astronomer/…
People in this episode
Host: Marc Lamberti
Guest: Kenten Danas
Topics covered
- Airflow updates
- data pipelines
- Async Python tasks
- DAG versioning
- performance improvements
Keywords
- Airflow 3.2
- data pipelines
- asset partitioning
- Async Python tasks
- DAG versioning
- scheduling
- performance
- observability
Mentioned in this episode
Organizations: Astronomer, Apache Airflow
Products: Airflow 3.2
More episodes of The Data Flowcast: Mastering Apache Airflow ® for Data Engineering and AI
- Managing a Customer Analytics Platform with Airflow at Skimlinks · June 11, 2026 · 23 min
- Building a custom Tableau provider for Airflow at JLR · June 4, 2026 · 21 min
- Orchestrating 2,000 Airflow pipelines at Luiza Labs with Mateus Ferreira · May 28, 2026 · 33 min
- Enhancing DAGs for Data Processing with William Orgertrice III at Cargill · May 21, 2026 · 26 min
- Getting Into Data Engineering with Shrividya Hegde, Data and AI Engineer · May 14, 2026 · 28 min
- Orchestrating DBT With Cosmos and Airflow with Filip Kunčar at ShipMonk Product Development · May 7, 2026 · 25 min
Explore listener stats, chart rankings, contacts and more on the The Data Flowcast: Mastering Apache Airflow ® for Data Engineering and AI podcast page.