AISN #66: AISN #66: Evaluating Frontier Models, New Gemini and Claude, Preemption is Back
About this episode
The episode discusses the new AI Dashboard, recent frontier models from Google and Anthropic, and a renewed push for preemptive state AI regulations.
Welcome to the AI Safety Newsletter by the Center for AI Safety. We discuss developments in AI and AI safety. No technical background required.. Welcome to the AI Safety Newsletter by the Center for AI Safety. We discuss developments in AI and AI safety. No technical background required. In this edition we discuss the new AI Dashboard, recent frontier models from Google and Anthropic, and a revived push to preempt state AI regulations. Listen to the AI Safety Newsletter for free on Spotify or Apple Podcasts. CAIS Releases the AI Dashboard for Frontier Performance CAIS launched its AI Dashboard, which evaluates frontier AI systems on capability and safety benchmarks. The dashboard also tracks the industry's overall progression toward broader milestones such as AGI, automation of remote labor, and full self-driving. How the dashboard works. The AI Dashboard features three leaderboards—one for text, one for vision, and one for risks—where frontier models are ranked according to their average score across a battery of benchmarks. Because CAIS evaluates models directly across a wide range of tasks, the dashboard provides apples-to-apples comparisons of how different frontier models…
More episodes of AI Safety Newsletter
- AISN #71: Cyberattacks & Datacenter Moratorium Bill
- AISN #70: AI Layoffs and Automated Warfare
- AISN #69: Department of War, Anthropic, and National Security
- AISN #68: Moltbook Exposes Risky AI Behavior
- AISN #67: Trump’s preemption order, H200s go to China, and new frontier AI from OpenAI and DeepSeek
- AISN #65: Measuring Automation and Superintelligence Moratorium Letter
Explore listener stats, chart rankings, contacts and more on the AI Safety Newsletter podcast page.