About this episode

This episode discusses the transition of language models from cloud to local devices by 2026 and the engineering advancements that made it possible.

Send us Fan Mail By 2026, language models have moved off the cloud and onto the device in your pocket. What was a research demonstration two years ago is now a routine engineering capability, and the centre of gravity for artificial intelligence has begun to migrate from distant data centres to local silicon. The episode traces the four engineering moves that made this possible. Quantization, which shrinks a model by storing its parameters with less precision. Optimized key-value caches, whic...

More episodes of Embedded AI - Intelligence at the Deep Edge

• Who is Liable for Onboard AI? · May 31, 2026 · 24 min
• A chip that controls a balancing propeller on seven microwatts · May 13, 2026 · 15 min

Explore listener stats, chart rankings, contacts and more on the Embedded AI - Intelligence at the Deep Edge podcast page.