66 - Scaling LLMOps | Avi Lumelsky (Oligo)

66 - Scaling LLMOps | Avi Lumelsky (Oligo)

April 11, 2026 · 29 min · Season 1 · Episode 66

About this episode

The episode discusses real-world use cases of LLMOps, focusing on vulnerability detection and malicious command detection, along with optimization strategies.

Two real-world use cases are covered: CVE Enrichment for open-source vulnerability detection and real-time Malicious Command Detection, along with practical tips on cost optimization, prompt caching, and open-source vs. commercial model trade-offs.

More episodes of LangTalks

Explore listener stats, chart rankings, contacts and more on the LangTalks podcast page.