AI Tokens Problem - Solvable!

AI Tokens Problem - Solvable!

From The Didi & Lital Show by pod617.com

June 5, 2026 · 30 min · Episode 173

About this episode

Didi and Lital discuss the challenges and solutions related to soaring AI token costs and productivity measurement in AI development.

Didi and Lital open with casual sports talk (NBA, NHL, World Cup traffic) before returning to a cliffhanger about soaring AI token costs. They cite Marc Benioff saying Salesforce will pay Anthropic $300M in tokens for coding, and discuss Microsoft pausing Anthropic use after exhausting its AI budget. They argue costs are driven by energy/physics and by developers running many parallel agents, making outcome measurement crucial so token spend aligns with valuable work rather than performative usage. They describe organizational resistance ("Luddites") and poor prompting/problem decomposition ("one-liners"), stressing the need for core computer science thinking. They predict new solutions: on-prem/local models, company-built data centers, and software “broker” layers to route tasks to the right models and enforce policy. They describe building such a layer for security SOC triage to reduce alerts to ~2% needing humans, and discuss tradeoffs between general models for innovation and cheaper specialized models for repetitive tasks. They close noting rapid startup exits in this space. Topics 00:24 Sports Rants 02:43 World Cup Traffic 03:43 AI Token Shock 07:59 Measuring AI…

People in this episode

Hosts: Didi, Lital

Topics covered

  • AI token costs
  • productivity measurement
  • organizational resistance
  • AI model optimization
  • startup exits

Keywords

  • AI tokens
  • productivity
  • cost optimization
  • organizational resistance
  • specialized models
  • general models
  • startup exits

Mentioned in this episode

Organizations: Salesforce, Anthropic, Microsoft

More episodes of The Didi & Lital Show

Explore listener stats, chart rankings, contacts and more on the The Didi & Lital Show podcast page.