Building reliable and proactive agentic systems at scale: how Shopify’s reflexive AI culture was instrumental in their development of Sidekick w/ Andrew McNamara #258
About this episode
Andrew McNamara discusses the development of Shopify's Sidekick and the importance of reliability and user feedback in building agentic systems.
Andrew McNamara, Director of Applied Machine Learning @ Shopify, joins the ELC podcast to share insights on building agentic platforms at scale, like Sidekick, that must keep reliability for its users at the forefront. Andrew describes the building philosophy behind Shopify and what it means to cultivate a culture of prototype-first while prioritizing hiring early-stage talent. We cover Sidekick’s development journey and how user feedback impacted its product vision, why evaluation is so important for determining ground truth sets, and the benefit of user-driven use cases. Andrew also dissects how they went about making product design decisions, such as building proactive agents and identifying subagent specializations.
Topics covered
- AI culture
- agentic systems
- product development
- user feedback
- machine learning
- reliability
More episodes of The Engineering Leadership Podcast
- Redefining profit, centering human flourishing, and building an incorruptible mission-driven roadmap w/ Eric Ries #260
- Affirm’s AI-native transformation & how it’s driving operational excellence w/ Geddes Munson #259
Explore listener stats, chart rankings, contacts and more on the The Engineering Leadership Podcast podcast page.