Operationalizing AI Agents: From Experimentation to Production // Databricks Roundtable
From MLOps.community by Demetrios
March 30, 2026 · 1h 1m
About this episode
The episode discusses the challenges of deploying AI agents at scale and explores new approaches required for generative and agent-based systems.
Databricks Roundtable episode: Operationalizing AI Agents: From Experimentation to Production. Join the Community: https://go.mlops.community/YTJoinIn Get the newsletter: https://go.mlops.community/YTNewsletter MLOps GPU Guide: https://go.mlops.community/gpuguide Big shout-out to Databricks for the collaboration! // Abstract This panel discusses the real-world challenges of deploying AI agents at scale. The conversation explores technical and operational barriers that slow production adoption, including reliability, cost, governance, and security. The panelists also examine how LLMOps, AIOps, and AgentOps differ from traditional MLOps, and why new approaches are required for generative and agent-based systems. Finally, experts define success criteria for GenAI frameworks, with a focus on robust evaluation, observability, and continuous monitoring across development and staging environments. // Bio Samraj Moorjani Samraj is a software engineer working on the Agent Quality team. Previously, Samraj worked at Meta on ads/product classification research and AppLovin on MLOps. Samraj graduated with a BS+MS in Computer Science from UIUC, advised by Professor Hari Sundaram, where he…
People in this episode
Host: Demetrios
Guest: Samraj Moorjani
Topics covered
- AI Agents
- MLOps
- LLMOps
- AIOps
- AgentOps
- Generative AI
- Deployment
- Production
Keywords
- Databricks
- collaboration
- production adoption
- reliability
- cost
- governance
- security
- evaluation
- observability
- continuous monitoring
Mentioned in this episode
Products: AIOps, AgentOps, AppLovin, Databricks
Books & works: Operationalizing AI Agents: From Experimentation to Production, Master's degree
Places: St. Louis
More episodes of MLOps.community
- MCP, Agents & the $40M Bet on Multiplayer AI · June 12, 2026 · 1h 21m
- From Single-Player to Multi-Player: Operating AI Agents at Scale · June 9, 2026 · 56 min
- The Control-vs-Magic Spectrum Building Agents · June 5, 2026 · 43 min
- Logs Are All You Need: Rethinking Observability with AI Agents · June 2, 2026 · 47 min
- AI Is Fast. AI Projects Are Slow. Let's Fix That. · May 29, 2026 · 57 min
- Architecting Modern AI Systems: Platforms, Agents, and Integration · May 28, 2026 · 57 min
Explore listener stats, chart rankings, contacts and more on the MLOps.community podcast page.