Lossy self-improvement

Lossy self-improvement

From Interconnects by Nathan Lambert

March 22, 2026 · 13 min

About this episode

The episode discusses the rapid advancements in AI, particularly focusing on recursive self-improvement and the impact of language models on engineering and research jobs.

Fast takeoff, the singularity, and recursive self-improvement (RSI) are all top of mind in AI circles these days. There are elements of truth to them in what’s happening in the AI industry. Two, maybe three, labs are consolidating as an oligopoly with access to the best AI models (and the resources to build the next ones). The AI tools of today are abruptly transforming engineering and research jobs. AI research is becoming much easier in many ways. The technical problems that need to be solved to scale training large language models even further are formidable. Super-human coding assistants making these approachable is breaking a lot of former claims of what building these things entailed. Together this is setting us up for a year (or more) of rapid progress at the cutting edge of AI. We’re also at a time where language models are already extremely good. They’re in fact good enough for plenty of extremely valuable knowledge-work tasks. Language models taking another big step is hard to imagine — it’s unclear which tasks they’re going to master this year outside of code and CLI-based computer-use. There will be some new ones! These capabilities unlock new styles of working…

People in this episode

Host: Nathan Lambert

Topics covered

  • AI development
  • recursive self-improvement
  • language models
  • engineering transformation
  • knowledge work
  • economic impact

Keywords

  • AI
  • recursive self-improvement
  • language models
  • engineering
  • knowledge work
  • super-human coding assistants
  • economic impact

Mentioned in this episode

Organizations: AI, AI industry, language models, engineering, research, super-human coding assistants, CLI-based computer-use

More episodes of Interconnects

Explore listener stats, chart rankings, contacts and more on the Interconnects podcast page.