Unlocking AI Vector Databases with James Luan, Zilliz CPO | EP 130

About this episode

In this episode, Demetri Panici interviews James Luan about the impact of AI on engineering workflows and the significance of vector databases.

Subscribe to AI Agents Podcast Channel: https://link.jotform.com/subscribe-to-podcast In this episode of the AI Agents Podcast, host Demetri Panici sits down with James Luan from Zilliz to talk about how AI is already changing the day to day work of engineers. James explains why coding agents are already taking over parts of his workflow, how vector databases became a core building block for modern AI systems, and why retrieval still matters even in a world obsessed with bigger models. They also get into the real mechanics behind RAG, hallucinations, MCP, long term memory for agents, and the challenges of building production grade AI systems that can search, reason, and scale reliably. If you want a practical conversation about where agent infrastructure is going and what engineers should actually pay attention to, this episode is worth watching. ▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬ ⏰ TIMESTAMPS: 00:00 – AI is already taking parts of engineering work 01:03 – James Luan’s background and first AI moments 07:07 – Why Zilliz was built and how vector databases fit in 16:58 – Long term memory, agent search, and reasoning workflows 21:37 – MCP, tooling limits, and real world…

People in this episode

Host: Demetri Panici

Guest: James Luan

Topics covered

• AI
• vector databases
• engineering
• coding agents
• production systems
• retrieval

Keywords

• AI agents
• vector databases
• engineering
• coding agents
• retrieval
• long term memory
• production systems

Mentioned in this episode

Organizations: Zilliz

More episodes of AI Agents Podcast

• Aydin Mirzaee Fellow.app - AI Agents That 10x Your Productivity · June 12, 2026 · 43 min
• ChatGPT Workspace Agents: Automating Workflows with AI Integrations and Memory | EP 140 · May 15, 2026 · 37 min
• Inside AI Healthcare: Addiction Recovery, Workflow Automation, and the Future of Patient Care | EP 139 · May 7, 2026 · 36 min
• Inside Classify: Contextual Intelligence, AI Agents, and the Hidden Layer Powering the Web | EP 138 · May 1, 2026 · 54 min
• Why AI Hype Is Always Wrong (And What Actually Happens) | EP 137 · April 29, 2026 · 53 min
• AI Agents for Workflow Automation | EP 136 · April 24, 2026 · 38 min