Lex Fridman Podcast
Nathan Lambert and Sebastian Raschka are machine learning researchers, engineers, and educators. Nathan is the post-training lead at the Allen Institute for AI (Ai2) and the author of The RLHF Book. Sebastian Raschka is the author of Build a Large Language Model (From Scratch) and Build a Reasoning Model (From Scratch).
Thank you for listening ❤ Check out our sponsors: https://lexfridman.com/sponsors/ep490-sc
See below for timestamps, transcript, and to give feedback, submit questions, contact Lex, etc.
Transcript:
https://lexfridman.com/ai-sota-2026-transcript
CONTACT LEX:
Feedback – give feedback to Lex: https://lexfridman.com/survey
AMA – submit questions, videos or call-in: https://lexfridman.com/ama
Hiring – join our team: https://lexfridman.com/hiring
Other – other ways to get in touch: https://lexfridman.com/contact
SPONSORS:
To support this podcast, check out our sponsors & get discounts:
Box: Intelligent content management platform.
Go to https://box.com/ai
Quo: Phone system (calls, texts, contacts) for businesses.
Go to https://quo.com/lex
UPLIFT Desk: Standing desks and office ergonomics.
Go to https://upliftdesk.com/lex
Fin: AI agent for customer service.
Go to https://fin.ai/lex
Shopify: Sell stuff online.
Go to https://shopify.com/lex
CodeRabbit: AI-powered code reviews.
Go to https://coderabbit.ai/lex
LMNT: Zero-sugar electrolyte drink mix.
Go to https://drinkLMNT.com/lex
Perplexity: AI-powered answer engine.
Go to https://perplexity.ai/
OUTLINE:
(00:00) – Introduction
(01:39) – Sponsors, Comments, and Reflections
(16:29) – China vs US: Who wins the AI race?
(25:11) – ChatGPT vs Claude vs Gemini vs Grok: Who is winning?
(36:11) – Best AI for coding
(43:02) – Open Source vs Closed Source LLMs
(54:41) – Transformers: Evolution of LLMs since 2019
(1:02:38) – AI Scaling Laws: Are they dead or still holding?
(1:18:45) – How AI is trained: Pre-training, Mid-training, and Post-training
(1:51:51) – Post-training explained: Exciting new research directions in LLMs
(2:12:43) – Advice for beginners on how to get into AI development & research
(2:35:36) – Work culture in AI (72+ hour weeks)
(2:39:22) – Silicon Valley bubble
(2:43:19) – Text diffusion models and other new research directions
(2:49:01) – Tool use
(2:53:17) – Continual learning
(2:58:39) – Long context
(3:04:54) – Robotics
(3:14:04) – Timeline to AGI
(3:21:20) – Will AI replace programmers?
(3:39:51) – Is the dream of AGI dying?
(3:46:40) – How AI will make money?
(3:51:02) – Big acquisitions in 2026
(3:55:34) – Future of OpenAI, Anthropic, Google DeepMind, xAI, Meta
(4:08:08) – Manhattan Project for AI
(4:14:42) – Future of NVIDIA, GPUs, and AI compute clusters
(4:22:48) – Future of human civilization
#280 – Cristiano Amon: Qualcomm CEO
Cristiano Amon is the CEO of Qualcomm, world-leader in 5G wireless communication and computation systems inside premium Android phones and other robots. Please support this podcast by checking out our sponsors: – Scale: https://scale.com/lex –…
#279 – Alien Debate: Sara Walker and Lee Cronin
Sara Walker is an astrobiologist and theoretical physicist. Lee Cronin is a chemist. This is a conversation and debate about alien life and alien civilizations. Please support this podcast by checking out our sponsors: –…
#278 – Skye Fitzgerald: Hunger, War, and Human Suffering
Skye Fitzgerald is a two-time Oscar-nominated documentary filmmaker, his films include Hunger Ward, Lifeboat, and 50 Feet from Syria. Please support this podcast by checking out our sponsors: – Notion: https://notion.com/startups to get up to…
#277 – Andrew Huberman: Focus, Stress, Relationships, and Friendship
Andrew Huberman is a neuroscientist at Stanford and host of the Huberman Lab Podcast. Please support this podcast by checking out our sponsors: – Brave: https://brave.com/lex – LMNT: https://drinkLMNT.com/lex to get free sample pack –…
#276 – Michael Saylor: Bitcoin, Inflation, and the Future of Money
Michael Saylor is the CEO of MicroStrategy and a prominent holder and proponent of Bitcoin. Please support this podcast by checking out our sponsors: – Scale: https://scale.com/lex – Coinbase: https://coinbase.com/lex to get $10 in free…
#275 – Rick Rubin: Legendary Music Producer
Rick Rubin is one of the greatest music producers of all time, working with many of the greats including Beastie Boys, Eminem, Metallica, LL Cool J, Kanye West, Slayer, Tom Petty, Johnny Cash, Dixie Chicks,…
#274 – Karl Deisseroth: Depression, Schizophrenia, and Psychiatry
Karl Deisseroth is a professor of bioengineering, psychiatry, and behavioral sciences at Stanford University. Please support this podcast by checking out our sponsors: – BiOptimizers: http://www.magbreakthrough.com/lex to get 10% off – BetterHelp: https://betterhelp.com/lex to get…
#273 – Chris Blattman: War and Violence
Chris Blattman is a professor at the University of Chicago studying the causes and consequences of violence and war. Please support this podcast by checking out our sponsors: – Truebill: https://truebill.com/lex – Mizzen+Main: https://mizzenandmain.com and…
#272 – Brett Johnson: US Most Wanted Cybercriminal
Brett Johnson was a US Most Wanted cybercriminal, called the Original Internet Godfather by US Secret Service for building the the first organized cybercrime community called ShadowCrew, which was the precursor to today’s darknet and…
#271 – Ariel Ekblaw: Space Colonization and Self-Assembling Space Megastructures
Ariel Ekblaw is the director of the MIT Space Exploration Initiative. Please support this podcast by checking out our sponsors: – BetterHelp: https://betterhelp.com/lex to get 10% off – Coinbase: https://coinbase.com/lex to get $10 in free…