Kubernetes, Compliance, and Control: The Operational Backbone of AI Sovereignty

About this episode

Steven Watt discusses practical paths to achieving AI sovereignty for organizations, emphasizing the importance of self-managed infrastructure and Kubernetes.

Summary  In this episode of the AI Engineering Podcast, Steven Watt, leader of the Office of the CTO at Red Hat, discusses practical paths to achieving AI sovereignty for organizations. He shares his two-decade experience in AI, highlighting how governments are building GPU platforms and protected data hubs to maintain control over AI workloads. Steve emphasizes why self-managed infrastructure is becoming a strategic necessity as companies outgrow cloud costs and require tighter control over models, data, and compliance. The conversation explores the operational substrate for AI sovereignty, including Kubernetes as the scale-out backbone for LLM serving, bridging the gap with PyTorch ecosystems, observability and policy for non-deterministic systems, and emerging security needs such as confidential inference and agentic identity. They also discuss model and hardware optionality (GPUs, CPUs, and new accelerators), the growing demand for energy-efficient inference, and the importance of open models and post-training to create durable differentiation. Steve identifies access to GPUs as the biggest gap hindering sovereign AI adoption today, emphasizing the need for broad access…

People in this episode

Host: Tobias Macey

Guest: Steven Watt

Topics covered

• AI sovereignty
• Kubernetes
• GPU platforms
• data compliance
• energy-efficient inference
• open models
• AI infrastructure

Keywords

• AI sovereignty
• Kubernetes
• GPU access
• data compliance
• energy efficiency
• open models
• infrastructure

Mentioned in this episode

Organizations: Red Hat

Products: Kubernetes, PyTorch, GPUs, CPUs, accelerators

Places: AI sovereignty, cloud, societal triad

More episodes of AI Engineering Podcast

• From Blind Spots to Observability: Operationalizing LLM Apps with OpenLit · February 15, 2026 · 51 min
• Taming Voice Complexity with Dynamic Ensembles at Modulate · February 8, 2026 · 59 min
• GPU Clouds, Aggregators, and the New Economics of AI Compute · January 27, 2026 · 46 min
• The Future of Dev Experience: Spotify’s Playbook for Organization‑Scale AI · January 20, 2026 · 56 min
• Generative AI Meets Accessibility: Benchmarks, Breakthroughs, and Blind Spots with Joe Devon · January 5, 2026 · 56 min
• Beyond the Chatbot: Practical Frameworks for Agentic Capabilities in SaaS · December 29, 2025 · 54 min