GPUs, Kubernetes & AI Infrastructure Realities
From Virtually Speaking Podcast by Virtually Speaking Podcast
May 22, 2026 · 19 min · Episode 599
About this episode
The episode discusses the intersection of Kubernetes, virtualization, and AI infrastructure, focusing on the challenges and considerations for running AI workloads.
At KubeCon 2026, Pete Flecha and John Nicholson sit down with VMware by Broadcom’s Frank Denneman to explore one of the biggest infrastructure conversations happening in AI today: should Kubernetes workloads run on bare metal or virtualized infrastructure? The discussion dives deep into how AI workloads are changing infrastructure design, why Kubernetes and virtualization are becoming increasingly connected, and how technologies like DRS and Dynamic Resource Allocation (DRA) are evolving to support modern GPU-intensive environments. Frank explains the operational, security, and resource management challenges organizations face as AI adoption accelerates — especially when dealing with expensive GPU clusters, multi-tenant AI workloads, and the rise of AI agents. Topics include: Why virtualization still matters for Kubernetes and AI GPU scheduling, topology awareness, and resource isolation DRA (Dynamic Resource Allocation) in Kubernetes AI infrastructure efficiency and GPU utilization Security and isolation for AI agents and workloads Token governance and AI operational guardrails Lessons learned from decades of virtualization applied to AI infrastructure If you’re trying to…
People in this episode
Hosts: Pete Flecha, John Nicholson
Guest: Frank Denneman
Topics covered
- Kubernetes
- AI infrastructure
- virtualization
- GPU workloads
- resource management
- security
- Dynamic Resource Allocation
Keywords
- Kubernetes
- AI workloads
- GPU clusters
- virtualization
- resource allocation
- security
- infrastructure design
Mentioned in this episode
Organizations: VMware by Broadcom
More episodes of Virtually Speaking Podcast
- eBPF, Cilium, and the Future of Kubernetes Networking with Isovalent & VKS · June 12, 2026 · 14 min
- Networking for VCF 9.1: Simplifying Private Cloud Networking · June 9, 2026 · 51 min
- The Art of Troubleshooting: Solving Complex IT Problems Together · June 5, 2026 · 17 min
- Real-World VCF 9 Migrations: What Actually Works · June 2, 2026 · 10 min
- From VMUG to Career Growth: The Power of Community · May 29, 2026 · 24 min
- What Enterprises Get Wrong About Kubernetes · May 20, 2026 · 12 min
Explore listener stats, chart rankings, contacts and more on the Virtually Speaking Podcast podcast page.