Inference engineering and the real-world deployment of LLMs, with Philip Kiely
About this episode
Patrick McKenzie and Philip Kiely discuss the inference stack and the real-world deployment of LLMs.
Patrick McKenzie (patio11) and Philip Kiely, early employee at Baseten, discuss the inference stack: the critical layer of software and hardware that sits between a model’s weights and a user’s prompt. They cover inference engineering, how intermediate layers are evolving over a technical stack that is changing every six months, and how sophisticated organizations are actually consuming LLMs beyond just writing their questions into chatbot apps. – Full transcript available here: www.complexsystemspodcast.com/inference-engineering-with-philip-kiely/ – Presenting Sponsors: Mercury , Meter, & Granola Complex Systems is presented by Mercury —radically better banking for founders. Mercury offers the best wire experience anywhere: fast, reliable, and free for domestic U.S. wires, so you can stay focused on growing your business. Apply online in minutes at mercury.com . Networking infrastructure has a way of accumulating technical debt faster than almost anything else in IT. Meter handles the full stack (wired, wireless, and cellular) as a single integrated solution: designed, deployed, and managed end-to-end so there's only one vendor to call when something goes wrong. Visit…
Sponsors
Mercury, Meter, Granola
More episodes of Complex Systems with Patrick McKenzie (patio11)
- The honey badger of payments
- Cash received is not revenue earned
- Your bank balance isn’t in the bank, and other alchemy
- Payroll, pins, and punch cards
- Delve into compliance theatre
- Understanding consumer debt collections: the underbelly of finance
Explore listener stats, chart rankings, contacts and more on the Complex Systems with Patrick McKenzie (patio11) podcast page.