Enhancing DAGs for Data Processing with William Orgertrice III at Cargill
From The Data Flowcast: Mastering Apache Airflow ® for Data Engineering and AI by Astronomer
May 21, 2026 · 26 min · Season 1 · Episode 80
About this episode
William Orgertrice III discusses DAG design and monitoring practices for data processing at Cargill.
In the data engineering world, the difference between a pipeline that works and one that's truly production-ready often comes down to a handful of deliberate decisions. William Orgertrice III , Data Engineer at Cargill , joins us to share the DAG design and monitoring practices he presented at Airflow Summit 2025 and how his team is rolling out Airflow across 60+ internal teams as part of Cargill's new Minerva data platform. Key Takeaways: 00:00 Introduction. 01:45 Cargill is one of the largest privately owned companies in the US, operating across 70 countries and serving 125+ markets. 03:45 William's team on the Cargill Data Platform supports 60+ internal teams, providing data products that drive decisions across finance, inventory and operations. 05:10 Cargill chose Airflow as a core component of its new Minerva data platform to replace older ETL tooling with a more supportable, observable stack. 06:26 Native SLA sensors and dependency management were specific features that made Airflow the right fit for Cargill's batch ingestion pipelines. 09:00 Cargill is running Airflow through Astronomer as their managed solution, with some teams already in production. 13:22 Every task in a…
People in this episode
Guest: William Orgertrice III
Topics covered
- data engineering
- Apache Airflow
- DAG design
- data processing
- Cargill
- data platform
Keywords
- DAG
- data pipeline
- Airflow Summit
- data products
- ETL tooling
- SLA sensors
- dependency management
Mentioned in this episode
Organizations: Cargill, Airflow, Astronomer, Minerva
Places: US
More episodes of The Data Flowcast: Mastering Apache Airflow ® for Data Engineering and AI
- Managing a Customer Analytics Platform with Airflow at Skimlinks · June 11, 2026 · 23 min
- Building a custom Tableau provider for Airflow at JLR · June 4, 2026 · 21 min
- Orchestrating 2,000 Airflow pipelines at Luiza Labs with Mateus Ferreira · May 28, 2026 · 33 min
- Getting Into Data Engineering with Shrividya Hegde, Data and AI Engineer · May 14, 2026 · 28 min
- Orchestrating DBT With Cosmos and Airflow with Filip Kunčar at ShipMonk Product Development · May 7, 2026 · 25 min
- Building Airflow CTL with Buğra Öztürk at Mollie · April 30, 2026 · 20 min
Explore listener stats, chart rankings, contacts and more on the The Data Flowcast: Mastering Apache Airflow ® for Data Engineering and AI podcast page.