Lessons from Building AI Agents with Rafal Wilinski

About this episode

Rafal Wilinski shares insights on integrating AI tools into applications and the lessons learned from his experience in AI development.

Today we're talking with one of our favorite engineers, Rafal Wilinski. Rafal has been on the cutting edge of AI development in the last few years as he has led AI teams at Zapier and Vendr. Rafal walks us through the hard-won lessons about actually integrating AI tools into the applications you're building. One of the hardest things in integrating these AI tools is how to ensure you're getting better and not regressing as you improve your prompts and upgrade your models. He shows how using evals is one part of the story along with deeply investigating customer signals to see how they are or aren't succeeding with AI. Along the way, we also talk about RAG, his favorite models, his AI development toolset, and why Poland has been killing it lately. Check it out and be sure to follow Rafal if you want to learn more on building with AI.

People in this episode

Guest: Rafal Wilinski

Topics covered

• AI development
• integrating AI tools
• customer signals
• AI models
• RAG
• AI development toolset

Keywords

• AI agents
• integration
• customer success
• evals
• AI models
• RAG
• AI tools

Mentioned in this episode

Organizations: Zapier, Vendr

Places: Poland

More episodes of Software Huddle

• AI and Proactive Reliability with Kolton Andrus · April 8, 2026 · 55 min
• Making Data Agent Ready with Andre Elizondo · March 27, 2026 · 52 min
• Exponential Engineers with Ashmeet Sidana · January 9, 2026 · 53 min
• Powered by Neurons with Ewelina Kurtys · September 16, 2025 · 43 min
• Building a High-Ownership Engineering Culture with Matt Watson · August 5, 2025 · 52 min
• Building CI for the age of AI Agents with Aayush Shah · July 22, 2025 · 1h 4m