117. Multi-Terabyte GPUs the Only Answer for AI Scaling
About this episode
The episode discusses the sustainability of multi-terabyte GPUs for enterprise AI and explores various architectural and optimization strategies.
Are multi-terabyte GPUs and massive frontier models really the answer to enterprise AI, or are we hitting a hard wall of soaring memory costs and power constraints? In this episode of the Tech Field Day Podcast, host Alastair Cooke sits down with technical experts Ron Pagani Jr., Andy Banta, and Brian Martin to examine whether brute-force hardware scaling remains sustainable. The panel debates scale-up vs. scale-out architectures, emphasizing how smart software optimizations—such as persistent KV caching (MinIO MemKV, Solidigm) and intelligent data layers (CTERA)—can eliminate redundant GPU computation and lower costs. They also explore agentic microservices, power and cooling bottlenecks, and why right-sizing AI models for production is critical for achieving real-world enterprise ROI. Panelists: Andy Banta , Consultant Brian Martin , AI and Data Center Lead at Signal65 Ron Pagani Jr. , Founder of Open Technology Partners Hosts: Tom Hollingsworth , Event Lead for Tech Field Day Alastair Cooke , Event Lead at Tech Field Day Stephen Foskett , President and Organizer of Tech Field Day…
Topics covered
- AI scaling
- multi-terabyte GPUs
- enterprise AI
- hardware scaling
- software optimizations
- power constraints
- data layers
More episodes of Tech Field Day Podcast
- SPOTLIGHT: Data Centers Need to be Multi-Tenant presented by Netris
- SPOTLIGHT: Networks Need to Drive Themselves presented by HPE
- SPOTLIGHT: Enterprise Networks Are Embracing Open Options Presented by Cisco
- 113. Optimizing Existing Hardware with Smart Software is the Only Way to Survive the AI Boom
- 112. Trillion Dollar AI Hype is Just Tech Groundhog Day
Explore listener stats, chart rankings, contacts and more on the Tech Field Day Podcast podcast page.