DuckDB, AI, and the Future of Data Engineering
From Data Engineering Central Podcast by Data Engineering in Real Life
March 18, 2026 · 1h 0m
About this episode
In this episode, Matt Martin discusses the evolution and future of data engineering, focusing on tools like DuckDB and the impact of AI.
In this episode, I sit down with Matt Martin , Staff Engineer, data architect, ETL practitioner, and author of a new book on DuckDB coming soon, to talk about the past, present, and future of data engineering . Matt has spent decades building and architecting data platforms across technologies such as SQL Server, Oracle, DB2, Hadoop, Redshift, and BigQuery , and now focuses on modern tools such as DuckDB and single-node analytics . We discuss how the data industry has evolved, what actually makes data platforms succeed, and where tools like DuckDB, Polars, Databricks, and Snowflake fit into the future of analytics. We also dive into the impact of AI on coding and data engineering , and whether distributed compute clusters will remain dominant — or if more workloads will move toward high-performance single-node systems . Topics Covered * Matt’s early career and journey into data engineering * The evolution of data warehousing and ETL frameworks * Traditional enterprise data systems vs modern cloud platforms * DuckDB and the rise of single-node analytics * Polars vs DuckDB: where each tool shines * Databricks vs Snowflake * AI-assisted coding and its impact on engineers * The…
People in this episode
Host: Data Engineering in Real Life
Guest: Matt Martin
Topics covered
- data engineering
- DuckDB
- AI impact
- single-node analytics
- data platforms
- ETL frameworks
- data warehousing
Keywords
- DuckDB
- data engineering
- AI
- single-node analytics
- ETL
- data platforms
- Polars
- Databricks
- Snowflake
Mentioned in this episode
Organizations: SQL Server, Oracle, DB2, Hadoop, Redshift, BigQuery
Products: DuckDB, Polars, Databricks, Snowflake
More episodes of Data Engineering Central Podcast
- From Failure to AWS: What Actually Makes a Great Engineer · June 10, 2026 · 52 min
- How Real Data Engineers Think (Beyond Tools and Hype) · June 3, 2026 · 49 min
- Data, AI, and DuckDB · May 27, 2026 · 50 min
- Why I Left Facebook to Work for Myself · May 20, 2026 · 53 min
- Academic → CTO: What Actually Matters in Data (Matthew Housley) · May 13, 2026 · 56 min
- AI Isn’t Replacing Curious Developers · May 6, 2026 · 1h 4m
Explore listener stats, chart rankings, contacts and more on the Data Engineering Central Podcast podcast page.