Lex Fridman Podcast
Nathan Lambert and Sebastian Raschka are machine learning researchers, engineers, and educators. Nathan is the post-training lead at the Allen Institute for AI (Ai2) and the author of The RLHF Book. Sebastian Raschka is the author of Build a Large Language Model (From Scratch) and Build a Reasoning Model (From Scratch).
Thank you for listening ❤ Check out our sponsors: https://lexfridman.com/sponsors/ep490-sc
See below for timestamps, transcript, and to give feedback, submit questions, contact Lex, etc.
Transcript:
https://lexfridman.com/ai-sota-2026-transcript
CONTACT LEX:
Feedback – give feedback to Lex: https://lexfridman.com/survey
AMA – submit questions, videos or call-in: https://lexfridman.com/ama
Hiring – join our team: https://lexfridman.com/hiring
Other – other ways to get in touch: https://lexfridman.com/contact
SPONSORS:
To support this podcast, check out our sponsors & get discounts:
Box: Intelligent content management platform.
Go to https://box.com/ai
Quo: Phone system (calls, texts, contacts) for businesses.
Go to https://quo.com/lex
UPLIFT Desk: Standing desks and office ergonomics.
Go to https://upliftdesk.com/lex
Fin: AI agent for customer service.
Go to https://fin.ai/lex
Shopify: Sell stuff online.
Go to https://shopify.com/lex
CodeRabbit: AI-powered code reviews.
Go to https://coderabbit.ai/lex
LMNT: Zero-sugar electrolyte drink mix.
Go to https://drinkLMNT.com/lex
Perplexity: AI-powered answer engine.
Go to https://perplexity.ai/
OUTLINE:
(00:00) – Introduction
(01:39) – Sponsors, Comments, and Reflections
(16:29) – China vs US: Who wins the AI race?
(25:11) – ChatGPT vs Claude vs Gemini vs Grok: Who is winning?
(36:11) – Best AI for coding
(43:02) – Open Source vs Closed Source LLMs
(54:41) – Transformers: Evolution of LLMs since 2019
(1:02:38) – AI Scaling Laws: Are they dead or still holding?
(1:18:45) – How AI is trained: Pre-training, Mid-training, and Post-training
(1:51:51) – Post-training explained: Exciting new research directions in LLMs
(2:12:43) – Advice for beginners on how to get into AI development & research
(2:35:36) – Work culture in AI (72+ hour weeks)
(2:39:22) – Silicon Valley bubble
(2:43:19) – Text diffusion models and other new research directions
(2:49:01) – Tool use
(2:53:17) – Continual learning
(2:58:39) – Long context
(3:04:54) – Robotics
(3:14:04) – Timeline to AGI
(3:21:20) – Will AI replace programmers?
(3:39:51) – Is the dream of AGI dying?
(3:46:40) – How AI will make money?
(3:51:02) – Big acquisitions in 2026
(3:55:34) – Future of OpenAI, Anthropic, Google DeepMind, xAI, Meta
(4:08:08) – Manhattan Project for AI
(4:14:42) – Future of NVIDIA, GPUs, and AI compute clusters
(4:22:48) – Future of human civilization
#410 – Ben Shapiro vs Destiny Debate: Politics, Jan 6, Israel, Ukraine & Wokeism
Ben Shapiro is a conservative political commentator, host of The Ben Shapiro Show, co-founder of The Daily Wire, and author of The Authoritarian Moment and other books. Steven Bonnell, aka Destiny, is a liberal political…
#409 – Matthew Cox: FBI Most Wanted Con Man – $55 Million in Bank Fraud
Matthew Cox is a former con man who served 13 years in federal prison for bank fraud, mortgage fraud, and identity theft. He is the author of many books, including his memoir Shark in the…
#408 – Tal Wilkenfeld: Music, Guitar, Bass, Jeff Beck, Prince, and Leonard Cohen
Tal Wilkenfeld is a singer-songwriter, bassist, and guitarist. She has performed with legendary artists including Jeff Beck, Prince, Incubus, Eric Clapton, Herbie Hancock, Mick Jagger, Rod Stewart, Hans Zimmer, Pharrell Williams, and many more. Please…
#407 – Guillaume Verdon: Beff Jezos, E/acc Movement, Physics, Computation & AGI
Guillaume Verdon (aka Beff Jezos on Twitter) is a physicist, quantum computing researcher, and founder of e/acc (effective accelerationism) movement. Please support this podcast by checking out our sponsors: – LMNT: https://drinkLMNT.com/lex to get free…
#406 – Teddy Atlas: Mike Tyson, Cus D’Amato, Boxing, Loyalty, Fear & Greatness
Teddy Atlas is boxing trainer to 18 world champions, ESPN boxing commentator, and host of podcast THE FIGHT with Teddy Atlas. Please support this podcast by checking out our sponsors: – Notion: https://notion.com/lex – Babbel:…
#405 – Jeff Bezos: Amazon and Blue Origin
Jeff Bezos is the founder of Amazon and Blue Origin. Thank you for listening ❤ Please support this podcast by checking out our sponsors: – Notion: https://notion.com/lex – Policygenius: https://policygenius.com/lex – MasterClass: https://masterclass.com/lexpod to get…
#404 – Lee Cronin: Controversial Nature Paper on Evolution of Life and Universe
Lee Cronin is a chemist at University of Glasgow. Please support this podcast by checking out our sponsors: – NetSuite: http://netsuite.com/lex to get free product tour – BetterHelp: https://betterhelp.com/lex to get 10% off – Shopify:…
#403 – Lisa Randall: Dark Matter, Theoretical Physics, and Extinction Events
Lisa Randall is a theoretical physicist at Harvard. Please support this podcast by checking out our sponsors: – Babbel: https://babbel.com/lexpod and use code Lexpod to get 55% off – Notion: https://notion.com – SimpliSafe: https://simplisafe.com/lex to…
#402 – Michael Malice: Thanksgiving Pirate Special
Michael Malice is a political thinker, podcaster, author, and anarchist. Please support this podcast by checking out our sponsors: – Policygenius: https://www.policygenius.com/ – MasterClass: https://masterclass.com/lexpod to get 15% off – Shopify: https://shopify.com/lex to get $1…
#401 – John Mearsheimer: Israel-Palestine, Russia-Ukraine, China, NATO, and WW3
John Mearsheimer is an international relations scholar at University of Chicago. He is one of the most influential and controversial thinkers in the world on the topics of war and power. Please support this podcast…