Do AI Tokenomics Matter More Than Model Benchmarks? with Chris Potts
Open the permanent podcast page
Show: The TWIML AI Podcast
Host / guest: Sam Charrington
Focus: Applied Generative AI for Knowledge Workers
Date: September 9, 2026
Duration: 59:29 · No episode time limit
Topics: AI economics, evaluation, token efficiency, AI fluency
Summary: Stanford professor Christopher Potts joins Sam Charrington to examine whether growing token consumption is producing proportional value, why benchmarks alone can hide economic tradeoffs, and how AI fluency and iterative human interaction affect outcomes.
Why it matters: It gives knowledge workers and AI leaders a practical lens for evaluating AI beyond benchmark scores: measure the value produced per unit of model effort, and distinguish capability gains from simply spending more inference.
Connection to the brief: The episode complements today’s Microsoft measurement story by connecting outcome measurement to model economics, token use, and the limits of benchmark-only comparisons.
Original commentary: Useful for consulting and training on AI ROI: add token/compute efficiency as a cost dimension alongside task completion, output quality, human review effort, and business outcomes.
Coverage: Selected in the preferred preceding-48-hour window; no older fallback was required.
Evidence: Practitioner analysis. Publisher page and Apple Podcasts confirm episode identity and September 9 release. Apple lists 59m; a podcast directory reports 3,569 seconds, used here as the exact runtime. Podcast duration is not capped.
Listen / watch: TWIML · Apple Podcasts