A Rust Framework to Simplify Distributed Systems
About this episode
Joe Hellerstein discusses how database concepts can simplify distributed programming using the Rust framework Hydro.
A Rust Framework to Simplify Distributed Systems Building software that runs across many machines is notoriously difficult. Developers have to grapple with problems such as race conditions, partial failures, and message ordering. Notably, one category of distributed software has largely escaped these burdens. A distributed database can spread a single query across thousands of machines, handling the coordination, failure recovery, and ordering internally. This raises a natural question of why general-purpose distributed programming can’t feel the same way. This is a highly practical problem at AWS , because the reliability of cloud infrastructure depends on getting distributed systems right at massive scale. Joe Hellerstein spent thirty years as a database and distributed systems researcher at UC Berkeley, where he pioneered much of the foundational thinking on applying database ideas to distributed programming. He is now at AWS, where he works to bring his research into production through Hydro, which is a Rust framework to bring declarative queries to general-purpose distributed programming. In this episode, Joe joins Sean Falconer to discuss how ideas from the database…
More episodes of Software Engineering Daily
- SED News: The NVIDIA-Hugging Face Deal, China’s Proxy Economy, the Open Weight Surge
- Moving Beyond RAG with Precomputed Context
- The Death of Online Anonymity
- TypeScript 7 and What Comes Next
- The Gap Between AI Spending and AI Value
- AI and the New Global Security Landscape
Explore listener stats, chart rankings, contacts and more on the Software Engineering Daily podcast page.