
The episode discusses RAGU, a modular GraphRAG engine that improves knowledge graph construction using a compact domain-adapted LLM.
🤗 Upvotes: 115 | cs.CL, cs.AI Authors: Mikhail Komarov, Ivan Bondarenko, Stanislav Shtuka, Oleg Sedukhin, Roman Shuvalov, Yana Dementyeva, Matvey Solovyov, Nikolay O. Nikitin Title: RAGU: A Multi-Step GraphRAG Engine with a Compact Domain-Adapted LLM Arxiv: http://arxiv.org/abs/2607.11683v1 Abstract: Graph retrieval-augmented generation (GraphRAG) enhances large language models with structured knowledge, yet existing systems construct knowledge graphs in a single extraction pass, producing noisy entities and brittle retrieval. RAGU, an open-source modular GraphRAG engine, addresses this by separating extraction from consolidation: entities and relations pass through two-stage typed extraction, DBSCAN-backed deduplication, LLM summarization, and Leiden community detection. A key insight motivates a compact extractor: the skills an in-pipeline LLM needs - comprehension, extraction, reasoning over context - are language skills that grow only weakly with model size, unlike factual world knowledge. Accordingly, we train Meno-Lite-0.1, a 7B model optimized for language skills, which outperforms Qwen2.5-32B on knowledge-graph construction (+12.5% relative harmonic mean) and matches it…
Explore listener stats, chart rankings, contacts and more on the Daily Paper Cast podcast page.