“AIs can now often do massive easy-to-verify SWE tasks” by Ryan Greenblatt

About this episode

Ryan Greenblatt discusses updates on AI timelines and the expected performance of AIs on software engineering tasks.

Subtitle: I've updated towards substantially shorter timelines. I’ve recently updated towards substantially shorter AI timelines and much faster progress in some areas.1 The largest updates I’ve made are (1) an almost 2x higher probability of full AI R&D automation by EOY 2028 (I’m now a bit below 30%2 while I was previously expecting around 15%; my guesses are pretty reflectively unstable) and (2) I expect much stronger short-term performance on massive and pretty difficult but easy-and-cheap-to-verify software engineering (SWE) tasks that don’t require that much novel ideation3 . For instance, I expect that by EOY 2026, AIs will have a 50%-reliability4 time horizon of years to decades on reasonably difficult easy-and-cheap-to-verify SWE tasks that don’t require much ideation (while the high reliability—for instance, 90%—time horizon will be much lower, more like hours or days than months, though this will be very sensitive to the task distribution). In this post, I’ll explain why I’ve made these updates, what I now expect, and implications of this update. I’ll refer to “Easy-and-cheap-to-verify SWE tasks” as ES tasks and to “ES tasks that don’t require much ideation (as in…

People in this episode

Host: Ryan Greenblatt

Topics covered

• AI timelines
• software engineering
• automation
• technology

Keywords

• AI R&D automation
• easy-and-cheap-to-verify tasks
• short-term performance
• ES tasks
• ESNI tasks

More episodes of Redwood Research Blog

• “A taxonomy of barriers to trading with early misaligned AIs” by Alexa Pan · April 21, 2026 · 2h 6m
• “Introducing LinuxArena” by Tyler · April 20, 2026 · 9 min
• “Current AIs seem pretty misaligned to me” by Ryan Greenblatt · April 15, 2026 · 1h 5m
• “Anthropic repeatedly accidentally trained against the CoT, demonstrating inadequate processes” by Alex Mallen, Ryan Greenblatt · April 14, 2026 · 12 min
• “Logit ROCs: Monitor TPR is linear in FPR in logit space” by Kerrick Staley, Aryan Bhatt, Julian Stastny · April 12, 2026 · 28 min
• “If Mythos actually made Anthropic employees 4x more productive, I would radically shorten my timelines” by Ryan Greenblatt · April 11, 2026 · 13 min