Episode 20: First Boot, First Inference

Episode 20: First Boot, First Inference

From The IT Guy Show by Eric Hendricks

March 31, 2026 · 53 min

About this episode

Eric Hendricks discusses the hidden costs of configuring Linux for GPU workloads with guest Damen Knight.

In this episode of The IT Guy Show, Eric sits down with Damen Knight, CIQ Sr. Principal Automation Engineer, to talk about something every AI team knows but nobody budgets for: the hidden cost of configuring Linux for GPU workloads. Together they dig into why general-purpose Linux distributions were never really built for AI, what actually happens when you spend 30 to 60 minutes per node doing manual CUDA setup, and why a "pre-installed" stack and a "validated" stack are two very different things. From driver conflicts and framework dependency failures to the CIQ Linux Kernel (CLK) and NVIDIA authorization, this episode covers the infrastructure decisions that determine whether your AI program ships fast or gets stuck in configuration hell. Whether you're an ML engineer tired of fighting CUDA every time a kernel update drops, a sysadmin managing a growing GPU fleet, or a tech leader wondering why production AI is harder than it should be, this one is for you. Welcome to The IT Guy Show, your go-to destination for all things tech with Eric, your friendly neighborhood IT guy! Join Eric as he shares his wealth of knowledge, insights, and experiences gained from years of working in…

People in this episode

Host: Eric Hendricks

Guest: Damen Knight

Topics covered

  • AI infrastructure
  • Linux configuration
  • GPU workloads
  • CUDA setup
  • Machine Learning
  • Tech leadership

Keywords

  • AI
  • Linux
  • GPU
  • CUDA
  • configuration
  • machine learning
  • infrastructure

Mentioned in this episode

Organizations: CIQ

Products: CUDA, CIQ Linux Kernel (CLK), NVIDIA

More episodes of The IT Guy Show

Explore listener stats, chart rankings, contacts and more on the The IT Guy Show podcast page.