Episode 20: First Boot, First Inference
About this episode
Eric Hendricks discusses the hidden costs of configuring Linux for GPU workloads with guest Damen Knight.
In this episode of The IT Guy Show, Eric sits down with Damen Knight, CIQ Sr. Principal Automation Engineer, to talk about something every AI team knows but nobody budgets for: the hidden cost of configuring Linux for GPU workloads. Together they dig into why general-purpose Linux distributions were never really built for AI, what actually happens when you spend 30 to 60 minutes per node doing manual CUDA setup, and why a "pre-installed" stack and a "validated" stack are two very different things. From driver conflicts and framework dependency failures to the CIQ Linux Kernel (CLK) and NVIDIA authorization, this episode covers the infrastructure decisions that determine whether your AI program ships fast or gets stuck in configuration hell. Whether you're an ML engineer tired of fighting CUDA every time a kernel update drops, a sysadmin managing a growing GPU fleet, or a tech leader wondering why production AI is harder than it should be, this one is for you. Welcome to The IT Guy Show, your go-to destination for all things tech with Eric, your friendly neighborhood IT guy! Join Eric as he shares his wealth of knowledge, insights, and experiences gained from years of working in…
More episodes of The IT Guy Show
- Episode 19: The Problem with Subscriptions
- Episode 18: Wayland and My eX-11 | The IT Guy Show 018
- Episode 17: Reality-based Approach to LinkedIn Jobs
- Episode 16: When the Layoff Comes
- Episode 15: DevLife with Chris DeMars
- Episode 14: Life as a SysAdmin with Nate Lager
Explore listener stats, chart rankings, contacts and more on the The IT Guy Show podcast page.