Lex Fridman Podcast
Nathan Lambert and Sebastian Raschka are machine learning researchers, engineers, and educators. Nathan is the post-training lead at the Allen Institute for AI (Ai2) and the author of The RLHF Book. Sebastian Raschka is the author of Build a Large Language Model (From Scratch) and Build a Reasoning Model (From Scratch).
Thank you for listening ❤ Check out our sponsors: https://lexfridman.com/sponsors/ep490-sc
See below for timestamps, transcript, and to give feedback, submit questions, contact Lex, etc.
Transcript:
https://lexfridman.com/ai-sota-2026-transcript
CONTACT LEX:
Feedback – give feedback to Lex: https://lexfridman.com/survey
AMA – submit questions, videos or call-in: https://lexfridman.com/ama
Hiring – join our team: https://lexfridman.com/hiring
Other – other ways to get in touch: https://lexfridman.com/contact
SPONSORS:
To support this podcast, check out our sponsors & get discounts:
Box: Intelligent content management platform.
Go to https://box.com/ai
Quo: Phone system (calls, texts, contacts) for businesses.
Go to https://quo.com/lex
UPLIFT Desk: Standing desks and office ergonomics.
Go to https://upliftdesk.com/lex
Fin: AI agent for customer service.
Go to https://fin.ai/lex
Shopify: Sell stuff online.
Go to https://shopify.com/lex
CodeRabbit: AI-powered code reviews.
Go to https://coderabbit.ai/lex
LMNT: Zero-sugar electrolyte drink mix.
Go to https://drinkLMNT.com/lex
Perplexity: AI-powered answer engine.
Go to https://perplexity.ai/
OUTLINE:
(00:00) – Introduction
(01:39) – Sponsors, Comments, and Reflections
(16:29) – China vs US: Who wins the AI race?
(25:11) – ChatGPT vs Claude vs Gemini vs Grok: Who is winning?
(36:11) – Best AI for coding
(43:02) – Open Source vs Closed Source LLMs
(54:41) – Transformers: Evolution of LLMs since 2019
(1:02:38) – AI Scaling Laws: Are they dead or still holding?
(1:18:45) – How AI is trained: Pre-training, Mid-training, and Post-training
(1:51:51) – Post-training explained: Exciting new research directions in LLMs
(2:12:43) – Advice for beginners on how to get into AI development & research
(2:35:36) – Work culture in AI (72+ hour weeks)
(2:39:22) – Silicon Valley bubble
(2:43:19) – Text diffusion models and other new research directions
(2:49:01) – Tool use
(2:53:17) – Continual learning
(2:58:39) – Long context
(3:04:54) – Robotics
(3:14:04) – Timeline to AGI
(3:21:20) – Will AI replace programmers?
(3:39:51) – Is the dream of AGI dying?
(3:46:40) – How AI will make money?
(3:51:02) – Big acquisitions in 2026
(3:55:34) – Future of OpenAI, Anthropic, Google DeepMind, xAI, Meta
(4:08:08) – Manhattan Project for AI
(4:14:42) – Future of NVIDIA, GPUs, and AI compute clusters
(4:22:48) – Future of human civilization
#350 – Betül Kaçar: Origin of Life, Ancient DNA, Panspermia, and Aliens
Betül Kaçar is an astrobiologist at University of Wisconsin. Please support this podcast by checking out our sponsors: – House of Macadamias: https://houseofmacadamias.com/lex and use code LEX to get 20% off your first order –…
#349 – Bhaskar Sunkara: The Case for Socialism
Bhaskar Sunkara is a democratic socialist, political writer, founding editor of Jacobin, president of The Nation, and author of The Socialist Manifesto. Please support this podcast by checking out our sponsors: – House of Macadamias:…
#348 – Nathalie Cabrol: Search for Alien Life
Nathalie Cabrol is an astrobiologist at the SETI Institute, directing the Carl Sagan Center for the Study of Life in the Universe. Please support this podcast by checking out our sponsors: – True Classic Tees:…
#347 – Michael Malice: Christmas Special
Michael Malice is a political thinker, podcaster, author, and anarchist. Please support this podcast by checking out our sponsors: – House of Macadamias: https://houseofmacadamias.com/lex and use code LEX to get 20% of your first order…
#346 – Ed Calderon: Mexican Drug Cartels
Ed Calderon is a security specialist who worked on counter-narcotics and organized crime investigation in Mexico. Please support this podcast by checking out our sponsors: – Policygenius: https://www.policygenius.com/ – Bambee: https://bambee.com and use code LEX…
#345 – Coffeezilla: SBF, FTX, Fraud, Scams, Fake Gurus, Money, Fame, and Power
Coffeezilla is a journalist and investigator on YouTube who exposes financial frauds, scams, and fake gurus. Please support this podcast by checking out our sponsors: – Rocket Money: https://rocketmoney.com/lex – Eight Sleep: https://www.eightsleep.com/lex to get…
#344 – Noam Brown: AI vs Humans in Poker and Games of Strategic Negotiation
Noam Brown is a research scientist at FAIR, Meta AI, co-creator of AI that achieved superhuman level performance in games of No-Limit Texas Hold’em and Diplomacy. Please support this podcast by checking out our sponsors:…
#343 – Roger Gracie: Greatest Jiu Jitsu Competitor of All Time
Roger Gracie is a legendary jiu jitsu competitor and MMA fighter. Please support this podcast by checking out our sponsors: – Bambee: https://bambee.com and use code LEX to get free HR audit – Mizzen+Main: https://mizzenandmain.com…
#342 – Todd Howard: Skyrim, Elder Scrolls 6, Fallout, and Starfield
Todd Howard is a legendary video game designer at Bethesda Game Studios. He led the development of the Elder Scrolls series and the Fallout series, and an upcoming game Starfield. Please support this podcast by…
#341 – Guido van Rossum: Python and the Future of Programming
Guido van Rossum is the creator of Python programming language. Please support this podcast by checking out our sponsors: – GiveDirectly: https://givedirectly.org/lex to get gift matched up to $1000 – Eight Sleep: https://www.eightsleep.com/lex to get…