GPU versus CPU: What is engineering really doing for us

About this episode

The episode explores the divide between CPU and GPU in engineering, discussing the role of engineering in software reliability and innovative hiring strategies.

Share Episode                     We sit down with Jaikumar Ganesh, Head of Engineering at AnyScale , to explore the intricacies of heterogeneous compute. He unpacks the growing CPU/GPU divide, detailing how ML pipelines require precise orchestration — using CPUs for data reading and writing while leveraging expensive, massive-die GPUs for chunking and embedding.           Warren brings the insight that, with AI agents rapidly changing how software is created, building is now a requirement of the business-focused team. And our guest shares how sales and marketing departments are increasingly using tools like Cursor and Claude to develop their own workflow automations. We discuss the challenges that this shift begs: what is engineering really doing for us?           JK emphasizes that the core responsibility of the engineering organization is reliability. While anyone can generate code, running stable production software requires the deep "battle scars", robust observability, and meticulous release…

People in this episode

Hosts: Warren Parad, Will Button

Guest: Jaikumar Ganesh

Topics covered

• GPU
• CPU
• engineering
• AI
• hiring strategies
• software development

Keywords

• GPU
• CPU
• engineering
• AI agents
• hiring strategies
• software reliability
• ML pipelines

Mentioned in this episode

Organizations: AnyScale

More episodes of Adventures in DevOps

• DR: Staying resilient in the cloud · June 5, 2026 · 1h 5m
• Eat your security vegetables · May 29, 2026 · 59 min
• Automatic Data Pipelining: One More Turtle Ahead · May 15, 2026 · 40 min
• The Human Value Versus AI Legacy Code · May 11, 2026 · 1h 5m
• Who needs a server? · May 1, 2026 · 55 min
• How to build a monolith the right way · April 24, 2026 · 45 min