Using Plugins To Customize Airflow at Ponder Labs with Egor Tarasenko

Using Plugins To Customize Airflow at Ponder Labs with Egor Tarasenko

From The Data Flowcast: Mastering Apache Airflow ® for Data Engineering and AI by Astronomer

March 5, 2026 · 28 min · Season 1 · Episode 71

About this episode

Egor Tarasenko discusses how Ponder Labs customizes Apache Airflow for educational organizations using plugins and AI-powered tools.

In this episode, we explore how teams scale Apache Airflow in complex environments and what it takes to make orchestration work across many stakeholders. We look at real-world challenges around visibility, ownership and predictability as data platforms grow. Egor Tarasenko , Data and AI Engineer at Ponder Labs , joins us to share how Ponder Labs customizes Airflow for education organizations using plugins, event-driven architectures and AI-powered tooling. He explains how his team supports large charter school networks and why structure, consistency and extensibility become critical at scale. Key Takeaways: 00:00 Introduction. 01:21 Ponder Labs helps education organizations bring data from many systems together so it becomes useful for teachers, school leaders and administrators. 03:10 Airflow serves as the backbone for orchestrating ingestion, transformation and reverse ETL across client data platforms. 05:43 Everything is triggered from Airflow to maintain dependency, visibility and a single operational picture. 09:05 Managing hundreds of DAGs requires a focus on structure, visibility and consistency across teams. 09:51 Treating DAGs like APIs helps teams scale without needing…

People in this episode

Guest: Egor Tarasenko

Topics covered

  • Apache Airflow
  • data orchestration
  • education technology
  • plugins
  • AI-powered tooling
  • data visibility
  • scalability

Keywords

  • Apache Airflow
  • plugins
  • data orchestration
  • AI tooling
  • education organizations
  • scalability
  • data visibility

Mentioned in this episode

Organizations: Ponder Labs, Apache Airflow, charter school networks, education organizations

More episodes of The Data Flowcast: Mastering Apache Airflow ® for Data Engineering and AI

Explore listener stats, chart rankings, contacts and more on the The Data Flowcast: Mastering Apache Airflow ® for Data Engineering and AI podcast page.