Production LLMs with Vaishnavi Gudur
From RunAs Radio by Richard Campbell
May 13, 2026 · 35 min · Episode 1036
About this episode
Richard Campbell interviews Vaishnavi Gudur about the complexities of production-grade large language models and their application in Microsoft Teams.
What does a production-grade large language model look like? While at NDC Sydney, Richard talked with Vaishnavi Gudur from Microsoft about her work scaling LLMs for Teams transcriptions, summaries, and more! Vaishnavi discusses the underlying complexities of operating the Teams LLM infrastructure for a large array of customers across different countries and regulatory regimes. Data sovereignty also plays a large role: different countries have specific rules on where data must reside and how it can be accessed. As the scale increases and the tail gets longer, the rules set gets more complex! Lots of great thinking about what LLMs look like in a production environment.
People in this episode
Host: Richard Campbell
Guest: Vaishnavi Gudur
Topics covered
- large language models
- data sovereignty
- Teams transcriptions
- scaling LLMs
- production environment
Keywords
- production LLMs
- Microsoft Teams
- data regulations
- transcriptions
- summaries
Mentioned in this episode
Organizations: Microsoft
Places: NDC Sydney
More episodes of RunAs Radio
- How Machine Learning Fails with Megan Robertson · June 10, 2026 · 37 min
- Data API Builder and SQL MCP with Jerry Nixon · June 3, 2026 · 37 min
- Team Productivity using Loop with Karinne Bessette · May 27, 2026 · 36 min
- UEFI Secure Boot with Richard Hicks · May 20, 2026 · 38 min
- Securing Active Directory with Spencer Alessi · May 6, 2026 · 37 min
- M365 Copilot vs Claude Cowork with Sharon Weaver · April 29, 2026 · 39 min
Explore listener stats, chart rankings, contacts and more on the RunAs Radio podcast page.