Moving Beyond RAG with Precomputed Context
About this episode
Jörg Schad discusses advancements in retrieval technology and the concept of precomputed context in AI systems.
Retrieval has become one of the central problems in building useful AI systems. The standard approach to grounding a model in one’s own data has been retrieval augmented generation, or RAG, where an agent searches a vector database for relevant information at query time. That pattern works, but it has limitations, such as retrieving information that’s not truly relevant, repeating the same lookup work on every query, and producing inconsistent answers to the same question. Pinecone is a vector database that’s widely used to power semantic search and RAG at scale. The team recently developed Nexus, which is a knowledge engine that reframes context as a first-class, precomputed asset rather than something reassembled on the fly. The approach borrows the database concept of a materialized view, and curates context once into a versioned artifact that carries its own schema, metadata, permissions, and lineage. Jörg Schad is the VP of Engineering at Pinecone. In this episode, he joins Kevin Ball for an in-depth conversation about the frontier of retrieval technology. They discuss precompiled context, how context artifacts are curated and versioned much like code, how…
More episodes of Software Engineering Daily
- A Rust Framework to Simplify Distributed Systems
- SED News: The NVIDIA-Hugging Face Deal, China’s Proxy Economy, the Open Weight Surge
- The Death of Online Anonymity
- TypeScript 7 and What Comes Next
- The Gap Between AI Spending and AI Value
- AI and the New Global Security Landscape
Explore listener stats, chart rankings, contacts and more on the Software Engineering Daily podcast page.