Is Docker Building the Best AI Stack?

Is Docker Building the Best AI Stack?

From DevOps and Docker Talk: Cloud Native Interviews and Tooling by Bret Fisher

August 12, 2025 · 1h 8m · Episode 186

About this episode

Bret and Nirmal discuss Docker's AI toolkit with Michael Irwin, exploring its features and integrations.

Bret and Nirmal are joined by Michael Irwin to discuss Docker's comprehensive AI toolkit, covering everything from local model deployment to cloud-based container orchestration across multiple interconnected tools and services. 🙌 The Agentic DevOps Guild has launched! It's a training + community + mentorship program for engineers wanting to learn the latest CI/CD automation and dive into Agentic DevOps. Meetups are happening now, with new course videos dropping every few weeks. Join the Guild and become your team's leader in AI for infrastructure automation https://www.bretfisher.com/theguild 🍾 We run through almost the entire Docker AI ecosystem, including the Model Runner for hosting open-source models locally or remotely, the Hub model catalog, Gordon AI chatbot integration within Docker Desktop and CLI, how MCP toolkit and catalog enable seamless tool integration with local AI systems, Docker's open-source MCP gateway for managing these connections, plus Docker's new Offload service for running containers and models entirely in Docker Cloud and much, much more! ★Show Links★ Docker Model Runner Gordon AI Blog Post Docker Offload Docker Gen AI Catalog Docker MCP Catalog and…

People in this episode

Hosts: Bret Fisher, Nirmal Mehta

Guest: Michael Irwin

Topics covered

  • AI
  • Docker
  • Cloud Computing
  • Container Orchestration
  • DevOps

Keywords

  • local model deployment
  • cloud-based container orchestration
  • Docker AI ecosystem
  • Model Runner
  • Gordon AI chatbot
  • MCP toolkit
  • Docker Offload service

Sponsors

Agentic DevOps Guild

Mentioned in this episode

Products: Agentic DevOps, the Model Runner, Hub, Gordon, Docker Desktop, MCP, Docker Cloud, Docker Model Runner, Gordon AI, Docker Offload

More episodes of DevOps and Docker Talk: Cloud Native Interviews and Tooling

Explore listener stats, chart rankings, contacts and more on the DevOps and Docker Talk: Cloud Native Interviews and Tooling podcast page.