Enterprise AI Search, RAG & Agents at Scale with Vectara

About this episode

The episode discusses the evolution of enterprise RAG, vector databases, and AI agents in modern private AI environments with insights from Vectara.

At KubeCon 2026, Jad El-Zein and Frank Denneman sit down with Jeff Chapman from Vectara to discuss how enterprise RAG, vector databases, and AI agents are evolving inside modern private AI environments. The conversation explores how Vectara integrates with VMware Private AI Foundation and VMware Cloud Foundation to help organizations scale AI applications securely across millions of documents while maintaining role-based access control, multimodal ingestion, and sovereign data protections. They also dive into enterprise search, hallucination prevention, citations, agent orchestration, long-running AI agents, GPU efficiency, and why on-prem AI infrastructure is becoming increasingly important for enterprises building production AI systems. Topics include: Enterprise RAG vs traditional search Vector databases and multimodal AI Role-based access control for AI AI agents and orchestration Sovereign AI and air-gapped environments GPU utilization and scaling AI workloads VMware Private AI Foundation integration On-prem AI economics and token costs #KubeCon #AI #PrivateAI #VMware #VCF #RAG #Agents #Kubernetes #VectorDatabase #EnterpriseAI

People in this episode

Hosts: Jad El-Zein, Frank Denneman

Guest: Jeff Chapman

Topics covered

• Enterprise RAG
• vector databases
• AI agents
• role-based access control
• multimodal ingestion
• sovereign data protections
• on-prem AI infrastructure

Keywords

• Enterprise RAG
• AI agents
• vector databases
• role-based access control
• GPU efficiency
• on-prem AI economics
• KubeCon

Mentioned in this episode

Organizations: Vectara, VMware, VMware Private AI Foundation, VMware Cloud Foundation

More episodes of Virtually Speaking Podcast

• eBPF, Cilium, and the Future of Kubernetes Networking with Isovalent & VKS · June 12, 2026 · 14 min
• Networking for VCF 9.1: Simplifying Private Cloud Networking · June 9, 2026 · 51 min
• The Art of Troubleshooting: Solving Complex IT Problems Together · June 5, 2026 · 17 min
• Real-World VCF 9 Migrations: What Actually Works · June 2, 2026 · 10 min
• From VMUG to Career Growth: The Power of Community · May 29, 2026 · 24 min
• GPUs, Kubernetes & AI Infrastructure Realities · May 22, 2026 · 19 min