AI Agents Have a Memory Problem (And You're Probably Making It Worse)

About this episode

Richmond Alake discusses the challenges of AI agent memory and the importance of proper database solutions.

Coding Chats Episode 79 - Richmond Alake, Director of AI Developer Experience at Oracle, joins John to discuss agent memory — how AI agents store, retrieve, and adapt to information. He argues that developers building memory on flat files are naively reinventing the database, and that once you factor in concurrency, security, and scalability, a proper database is inevitable. The conversation covers the full memory stack and how Oracle's AI database keeps embeddings and data together without shipping sensitive information to external providers. The pair also explore why memory is the most universally relatable concept in AI, the history of how neuroscience shaped LLMs, and the problem of Catastrophic Forgetting that still haunts models today. A sharp AGI debate lands on a sobering point: an LLM is just a function — tokens in, tokens out — and most AI engineers are unknowingly rediscovering solutions that database engineers spent decades building. Chapters 00:00 — What Is Agent Memory and How Does It Work? 05:00 — File System vs Database: Which Should You Use for Agent Memory? 09:00 — Why Building on Files Means You'll Reinvent the Database 13:00 — How Oracle Is Meeting AI…

People in this episode

Host: John Crickett

Guest: Richmond Alake

Topics covered

• AI agents
• memory
• databases
• Catastrophic Forgetting
• AGI
• neuroscience
• developer experience

Keywords

• AI agents
• memory problem
• databases
• Catastrophic Forgetting
• Oracle
• developer experience
• neuroscience
• LLMs

Mentioned in this episode

Organizations: Oracle

More episodes of Coding Chats

• Startup Advisor Secrets: Hiring, CTOs & Going From POC to Product · May 28, 2026 · 24 min
• I got into computers to avoid people then they put me in charge of them! · May 14, 2026 · 49 min
• The Death of Writing Code: OpenAI's Engineer on the Rise of Harness Engineering · May 7, 2026 · 50 min
• LLM as a Judge: Why Your AI Might Be Marking Its Own Homework · April 30, 2026 · 1h 7m
• Let it crash! How Erlang and BEAM build bullet proof software · April 23, 2026 · 37 min
• AI writes it. You own it. Don't ship AI slop · April 16, 2026 · 56 min