LLM-D, with Clayton Coleman and Rob Shaw

LLM-D, with Clayton Coleman and Rob Shaw

From Kubernetes Podcast from Google by Abdel Sghiouar, Kaslin Fields

August 20, 2025 · 53 min · Episode 258

About this episode

The episode features Clayton Coleman and Rob Shaw discussing Kubernetes, AI/ML workloads, and the vLLM project.

Guests are Clayton Coleman and Rob Shaw. Clayton is a Core contributor to Kubernetes, the containerized cluster manager, and founding architect for OpenShift, the open source platform as a service. Clayton helped launch the shift to cloud native applications and the platforms that enable them. At Google my mission is to make Kubernetes and GKE the best place to run workloads, especially accelerated AI/ML workloads, and especially especially very large model inference at scale with the inference gateway and llm-d. Rob Shaw is an Engineering Director at Redhat and is a contributor to the vLLM project. Do you have something cool to share? Some questions? Let us know: - web: kubernetespodcast.com - mail: kubernetespodcast@google.com - twitter: @kubernetespod - bluesky: @kubernetespodcast.com News of the week Kubernetes 1.34 is expected to release end of August Kubecrash.io: A platform Eng conference with a purpose CNCF top 30 project of 2025 Links from the interview LLM-D KubeCon EU 25 Keynote: LLM-Aware Load Balancing in Kubernetes WG Serving vLLM Disaggregated Prefilling LWS: LeaderWorkerSet

People in this episode

Hosts: Abdel Sghiouar, Kaslin Fields

Guests: Clayton Coleman, Rob Shaw

Topics covered

  • Kubernetes
  • AI/ML workloads
  • cloud native applications
  • vLLM project
  • KubeCon EU

Keywords

  • Kubernetes
  • AI
  • ML
  • vLLM
  • cloud native
  • OpenShift
  • GKE
  • KubeCon

Mentioned in this episode

Organizations: Kubernetes, OpenShift, Google, Redhat, vLLM

Products: GKE, LLM-D, Kubecrash.io

More episodes of Kubernetes Podcast from Google

Explore listener stats, chart rankings, contacts and more on the Kubernetes Podcast from Google podcast page.