Orchestrating DBT With Cosmos and Airflow with Filip Kunčar at ShipMonk Product Development
From The Data Flowcast: Mastering Apache Airflow ® for Data Engineering and AI by Astronomer
May 7, 2026 · 25 min · Season 1 · Episode 80
About this episode
The episode discusses how ShipMonk built its data orchestration layer on Airflow and the benefits it brings to developer teams and products.
We explore how a third-party logistics platform built its entire data orchestration layer on Airflow, and what that makes possible for developer teams and merchant-facing products alike. Filip Kunčar , Platform Director at ShipMonk Product Development , discusses migrating from a closed source tool to Airflow, orchestrating dbt with both Cosmos and the BashOperator and using Airflow to power customer-facing data delivery. Key Takeaways: 00:00 Introduction. 01:07 ShipMonk is a third-party logistics company guaranteeing two-day delivery across the US. The data platform team's mission is to lower cognitive load for developers working with data. 05:13 ShipMonk migrated to Airflow in 2022, moving away from a closed-source UI-based tool, driven by the need for a code-first approach, open source extensibility and broad cloud provider support. 10:02 The team uses Cosmos for developer-facing visibility and lineage and BashOperator for internal pipelines where runtime performance matters. 12:20 Switching from Cosmos to the BashOperator for a frequently running pipeline reduced runtime from over 15 minutes to three minutes. 13:14 Because the full dbt chain runs…
People in this episode
Guest: Filip Kunčar
Topics covered
- data orchestration
- Airflow
- dbt
- logistics
- developer tools
- data delivery
Keywords
- data orchestration
- Airflow
- dbt
- Cosmos
- BashOperator
- logistics
- data delivery
Mentioned in this episode
Organizations: ShipMonk Product Development, Airflow, Cosmos, BashOperator
Places: US
More episodes of The Data Flowcast: Mastering Apache Airflow ® for Data Engineering and AI
- Managing a Customer Analytics Platform with Airflow at Skimlinks · June 11, 2026 · 23 min
- Building a custom Tableau provider for Airflow at JLR · June 4, 2026 · 21 min
- Orchestrating 2,000 Airflow pipelines at Luiza Labs with Mateus Ferreira · May 28, 2026 · 33 min
- Enhancing DAGs for Data Processing with William Orgertrice III at Cargill · May 21, 2026 · 26 min
- Getting Into Data Engineering with Shrividya Hegde, Data and AI Engineer · May 14, 2026 · 28 min
- Building Airflow CTL with Buğra Öztürk at Mollie · April 30, 2026 · 20 min
Explore listener stats, chart rankings, contacts and more on the The Data Flowcast: Mastering Apache Airflow ® for Data Engineering and AI podcast page.