Lex Fridman Podcast
Nathan Lambert and Sebastian Raschka are machine learning researchers, engineers, and educators. Nathan is the post-training lead at the Allen Institute for AI (Ai2) and the author of The RLHF Book. Sebastian Raschka is the author of Build a Large Language Model (From Scratch) and Build a Reasoning Model (From Scratch).
Thank you for listening ❤ Check out our sponsors: https://lexfridman.com/sponsors/ep490-sc
See below for timestamps, transcript, and to give feedback, submit questions, contact Lex, etc.
Transcript:
https://lexfridman.com/ai-sota-2026-transcript
CONTACT LEX:
Feedback – give feedback to Lex: https://lexfridman.com/survey
AMA – submit questions, videos or call-in: https://lexfridman.com/ama
Hiring – join our team: https://lexfridman.com/hiring
Other – other ways to get in touch: https://lexfridman.com/contact
SPONSORS:
To support this podcast, check out our sponsors & get discounts:
Box: Intelligent content management platform.
Go to https://box.com/ai
Quo: Phone system (calls, texts, contacts) for businesses.
Go to https://quo.com/lex
UPLIFT Desk: Standing desks and office ergonomics.
Go to https://upliftdesk.com/lex
Fin: AI agent for customer service.
Go to https://fin.ai/lex
Shopify: Sell stuff online.
Go to https://shopify.com/lex
CodeRabbit: AI-powered code reviews.
Go to https://coderabbit.ai/lex
LMNT: Zero-sugar electrolyte drink mix.
Go to https://drinkLMNT.com/lex
Perplexity: AI-powered answer engine.
Go to https://perplexity.ai/
OUTLINE:
(00:00) – Introduction
(01:39) – Sponsors, Comments, and Reflections
(16:29) – China vs US: Who wins the AI race?
(25:11) – ChatGPT vs Claude vs Gemini vs Grok: Who is winning?
(36:11) – Best AI for coding
(43:02) – Open Source vs Closed Source LLMs
(54:41) – Transformers: Evolution of LLMs since 2019
(1:02:38) – AI Scaling Laws: Are they dead or still holding?
(1:18:45) – How AI is trained: Pre-training, Mid-training, and Post-training
(1:51:51) – Post-training explained: Exciting new research directions in LLMs
(2:12:43) – Advice for beginners on how to get into AI development & research
(2:35:36) – Work culture in AI (72+ hour weeks)
(2:39:22) – Silicon Valley bubble
(2:43:19) – Text diffusion models and other new research directions
(2:49:01) – Tool use
(2:53:17) – Continual learning
(2:58:39) – Long context
(3:04:54) – Robotics
(3:14:04) – Timeline to AGI
(3:21:20) – Will AI replace programmers?
(3:39:51) – Is the dream of AGI dying?
(3:46:40) – How AI will make money?
(3:51:02) – Big acquisitions in 2026
(3:55:34) – Future of OpenAI, Anthropic, Google DeepMind, xAI, Meta
(4:08:08) – Manhattan Project for AI
(4:14:42) – Future of NVIDIA, GPUs, and AI compute clusters
(4:22:48) – Future of human civilization
#190 – Jordan Ellenberg: Mathematics of High-Dimensional Shapes and Geometries
Jordan Ellenberg is a mathematician and author of Shape and How Not to Be Wrong. Please support this podcast by checking out our sponsors: – Secret Sauce: https://wondery.com/shows/secret-sauce/ – ExpressVPN: https://expressvpn.com/lexpod and use code LexPod…
#189 – David Sinclair: Extending the Human Lifespan Beyond 100 Years
David Sinclair is a geneticist at Harvard and author of Lifespan. Please support this podcast by checking out our sponsors: – Onnit: https://lexfridman.com/onnit to get up to 10% off – Clear: https://clearme.com/lexpod and use code…
#188 – Vitalik Buterin: Ethereum 2.0
Vitalik Buterin is the co-founder of Ethereum. Please support this podcast by checking out our sponsors: – Athletic Greens: https://athleticgreens.com/lex and use code LEX to get 1 month of fish oil – Magic Spoon: https://magicspoon.com/lex…
#187 – Frank Wilczek: Physics of Quarks, Dark Matter, Complexity, Life & Aliens
Frank Wilczek is a Nobel Prize winning physicist at MIT. Please support this podcast by checking out our sponsors: – The Information: https://theinformation.com/lex to get 75% off first month – NetSuite: http://netsuite.com/lex to get free…
#186 – Bryan Johnson: Kernel Brain-Computer Interfaces
Bryan Johnson is the founder and CEO of Kernel, OS Fund, and previously Braintree. Please support this podcast by checking out our sponsors: – Four Sigmatic: https://foursigmatic.com/lex and use code LexPod to get up to…
#185 – Sam Harris: Consciousness, Free Will, Psychedelics, AI, UFOs, and Meaning
Sam Harris is an author, podcaster, and philosopher. Please support this podcast by checking out our sponsors: – National Instruments (NI): https://www.ni.com/perspectives – Belcampo: https://belcampo.com/lex and use code LEX to get 20% off first order…
#184 – Katherine de Kleer: Planets, Moons, and Asteroids in Our Solar System
Katherine de Kleer is a professor of Planetary Science and Astronomy at Caltech. Please support this podcast by checking out our sponsors: – Fundrise: https://fundrise.com/lex – Blinkist: https://blinkist.com/lex and use code LEX to get 25%…
#183 – Po-Shen Loh: Mathematics, Math Olympiad, Combinatorics & Contact Tracing
Po-Shen Loh is a mathematician at CMU and coach of the USA International Math Olympiad team. Please support this podcast by checking out our sponsors: – The Jordan Harbinger Show: https://jordanharbinger.com/lex/ – Onnit: https://lexfridman.com/onnit –…
#182 – John Danaher: The Path to Mastery in Jiu Jitsu, Grappling, Judo, and MMA
John Danaher is a coach, scholar, and educator of jiu jitsu, submission grappling, judo, MMA, and the martial arts. Please support this podcast by checking out our sponsors: – Onnit: https://lexfridman.com/onnit – SimpliSafe: https://simplisafe.com/lex and…
#181 – Sergey Nazarov: Chainlink, Smart Contracts, and Oracle Networks
Sergey Nazarov is the Co-Founder of Chainlink, a decentralized oracle network that provides data to smart contracts. Please support this podcast by checking out our sponsors: – Wine Access: https://wineaccess.com/lex to get 20% off first…