This episode discusses advancements in model compression, the backlash against new data centers, and the automotive industry's shift away from dealerships.
Hi everyone – welcome to your 3 Shifts Edition [AI-generated audio version]. First, compressed 1-bit models like PrismML’s Bonsai are showing it’s possible to be competitive in performance while being 14x smaller, 8x faster, and 4-5x more energy-efficient. These models can run locally on edge devices (e.g. phones, laptops, wearables) for inference. Next, data centers are facing a broad backlash that is driving policymakers – such as in Maine – to put a freeze on new data-center construction. ...