About this episode

James and Frank discuss the advantages of running AI coding models locally compared to in the cloud, exploring various tools and practical takeaways.

In this episode James and Frank dive into running AI coding models locally versus in the cloud—BYOK/Open Router, VS Code’s chat/agent harness, model runners (Olama, vLLM), and the practicality of 27B models on a 3090 using 4‑bit quantization. They share hands-on takeaways—how recent engineering (MT/MTPLX) boosts inference to usable token rates, when auto model selection makes sense, cost and hardware trade‑offs, and why local models can liberate your workflow while still needing smarter, unified tooling. Follow Us Frank: Twitter , Blog , GitHub James: Twitter , Blog , GitHub Merge Conflict: Twitter , Facebook , Website , Chat on Discord Music : Amethyst Seer - Citrine by Adventureface ⭐⭐ Review Us ⭐⭐ Machine transcription available on http://mergeconflict.fm Support Merge Conflict

More episodes of Merge Conflict

• 517: Plan First, Think Less: Save Tokens, Improve Code · June 1, 2026 · 35 min
• 516: Evolving Agent Session Management · May 25, 2026 · 43 min
• 515: Mini-LED, IPS, and the Great Monitor Rabbit Hole · May 18, 2026 · 44 min

Explore listener stats, chart rankings, contacts and more on the Merge Conflict podcast page.