How To Build a Hybrid AI System with Any-LLM (ft Nathan Brake)

About this episode

This episode features Nathan Brake discussing the Any-LLM platform and its applications in optimizing AI with open-source models.

Join the Tool Use Discord: https://discord.gg/PnEGyXpjaX Are you looking to optimize your AI applications with the best open source Large Language Models? This week, we explore open source AI, rapid model switching, and local self-hosting with Nathan Break, a Machine Learning Engineer at Mozilla AI and the creator of Any-LLM. Any-LLM is an open-source Python SDK that allows developers to seamlessly talk to any LLM provider through a single, unified interface. Nathan demonstrates how developers can instantly swap between cloud-hosted AI providers and local models like Llamafile by changing just a single line of code. We dive into the growing capabilities of smaller, cost-effective models, how to reduce your API expenses, and the security benefits of running local AI on your own hardware. Nathan also introduces the Any-LLM Platform, a secure vault for managing API keys that tracks your token usage and enforces budget limits without ever accessing your prompt data. Finally, we check out Porch Songs, Nathan's open-source application that leverages LLMs to rewrite the lyrics of popular songs while maintaining their original rhyme schemes and chord charts. Check out the projects…

People in this episode

Host: Mike Bird

Guest: Nathan Brake

Topics covered

• open source AI
• Large Language Models
• model switching
• local self-hosting
• API management

Keywords

• Any-LLM
• open source AI
• Large Language Models
• API management
• local models

Mentioned in this episode

Organizations: Mozilla AI

Products: Any-LLM, Llamafile, Porch Songs

More episodes of Tool Use - AI Conversations

• Hermes Agent has won. Here's why · April 14, 2026 · 35 min
• How To Make Your Websites Fully Autonomous (ft rtrvr) · March 17, 2026 · 42 min
• How To Make Your A.I. Product Go Viral (ft Mano Tsiris) · March 10, 2026 · 47 min
• AI Sovereignty - Control Your Entire AI architecture (ft Max McCrea) · February 24, 2026 · 1h 6m
• Do You Need A Vector Database in 2026? (ft Arjun Patel) · February 17, 2026 · 59 min
• Fine-Tune Your Own A.I. Video Model (ft. Greg Schoeninger) · February 10, 2026 · 43 min