
Neel Nanda reviews Anthropic's global workspace paper, highlighting its insights on cognitive space in models.
The below is a public review Anthropic asked me to write for their new global workspace paper. I recommend at least skimming their paper first. TLDR: I think this is a fantastic paper - it presents compelling evidence for some kind of "cognitive space" in models, that is used as a "working memory" for intermediate variables during a forward pass, shows that J-Lens is a useful technique for accessing this space. I believe these key claims.I believe J-Lens will be a useful (but limited) to...
Guest: Neel Nanda
Organizations: Anthropic
Products: J-Lens
Books & works: global workspace paper
Explore listener stats, chart rankings, contacts and more on the LessWrong (Curated & Popular) podcast page.