The Architect of Scale: Ion Stoica on Open Source, AI, and the Future of Data
From The Data T by Armon Petrossian and Satish Jayanthi
July 3, 2025 · 36 min · Season 3 · Episode 28
About this episode
Ion Stoica discusses his career and insights on open source, AI, and the future of data.
Ion Stoica is a professor of computer science at UC Berkeley, Co-Founder and Executive Chairman of Databricks, and a key architect of the Apache Spark project. Most recently, he’s the Co-Founder of Anyscale, which leverages the open source Ray framework developed in-lab to enable scalable AI workloads, much like Spark revolutionized large-scale data processing. In this episode of The Data T , we chat with Stoica about his illustrious career, how his obsession with solving hard technical problems led him from networking research to peer-to-peer video, Apache Spark, and ultimately Databricks. He recounts turning Spark’s open-source momentum into a successful enterprise business, crediting speed of execution and targeted hiring for the company’s rise and urging founders to move fast and recruit experienced operators early. Stoica warns that tomorrow’s workloads will demand vertically integrated, multi-accelerator systems. Optimistic yet realistic about AI, he sees reliability and “human-in-the-loop” workflows as today’s gating factors and advises data professionals to embrace continuous learning as the industry accelerates. Hosted by Armon Petrossian and Satish Jayanthi, co-founders…
People in this episode
Hosts: Armon Petrossian, Satish Jayanthi
Guest: Ion Stoica
Topics covered
- Apache Spark
- open source
- AI infrastructure
- data processing
- entrepreneurship
- scalable workloads
Keywords
- Ion Stoica
- Apache Spark
- Databricks
- Anyscale
- AI workloads
- open source
- data professionals
- continuous learning
Mentioned in this episode
Organizations: UC Berkeley, Databricks, Apache Spark, Anyscale, Ray, Coalesce
More episodes of The Data T
- Durable Growth in the Age of AI: Data & Marketing Lessons From Scaling Braze · April 21, 2026 · 48 min
- Gleb Mezhanskiy on Rewriting the Migration Playbook with AI · October 30, 2025 · 42 min
- The AI-Ready Data Team with Erik Duffield · October 14, 2025 · 45 min
- How AI Made Data Governance Sexy with Pierre Jr Cliche · September 8, 2025 · 44 min
- Mid-Year Reality Check: Data Predictions With Mike Palmer · August 4, 2025 · 46 min
- Model as You Go: A New Take on BI · June 9, 2025 · 41 min
Explore listener stats, chart rankings, contacts and more on the The Data T podcast page.