Lex Fridman Podcast
Nathan Lambert and Sebastian Raschka are machine learning researchers, engineers, and educators. Nathan is the post-training lead at the Allen Institute for AI (Ai2) and the author of The RLHF Book. Sebastian Raschka is the author of Build a Large Language Model (From Scratch) and Build a Reasoning Model (From Scratch).
Thank you for listening ❤ Check out our sponsors: https://lexfridman.com/sponsors/ep490-sc
See below for timestamps, transcript, and to give feedback, submit questions, contact Lex, etc.
Transcript:
https://lexfridman.com/ai-sota-2026-transcript
CONTACT LEX:
Feedback – give feedback to Lex: https://lexfridman.com/survey
AMA – submit questions, videos or call-in: https://lexfridman.com/ama
Hiring – join our team: https://lexfridman.com/hiring
Other – other ways to get in touch: https://lexfridman.com/contact
SPONSORS:
To support this podcast, check out our sponsors & get discounts:
Box: Intelligent content management platform.
Go to https://box.com/ai
Quo: Phone system (calls, texts, contacts) for businesses.
Go to https://quo.com/lex
UPLIFT Desk: Standing desks and office ergonomics.
Go to https://upliftdesk.com/lex
Fin: AI agent for customer service.
Go to https://fin.ai/lex
Shopify: Sell stuff online.
Go to https://shopify.com/lex
CodeRabbit: AI-powered code reviews.
Go to https://coderabbit.ai/lex
LMNT: Zero-sugar electrolyte drink mix.
Go to https://drinkLMNT.com/lex
Perplexity: AI-powered answer engine.
Go to https://perplexity.ai/
OUTLINE:
(00:00) – Introduction
(01:39) – Sponsors, Comments, and Reflections
(16:29) – China vs US: Who wins the AI race?
(25:11) – ChatGPT vs Claude vs Gemini vs Grok: Who is winning?
(36:11) – Best AI for coding
(43:02) – Open Source vs Closed Source LLMs
(54:41) – Transformers: Evolution of LLMs since 2019
(1:02:38) – AI Scaling Laws: Are they dead or still holding?
(1:18:45) – How AI is trained: Pre-training, Mid-training, and Post-training
(1:51:51) – Post-training explained: Exciting new research directions in LLMs
(2:12:43) – Advice for beginners on how to get into AI development & research
(2:35:36) – Work culture in AI (72+ hour weeks)
(2:39:22) – Silicon Valley bubble
(2:43:19) – Text diffusion models and other new research directions
(2:49:01) – Tool use
(2:53:17) – Continual learning
(2:58:39) – Long context
(3:04:54) – Robotics
(3:14:04) – Timeline to AGI
(3:21:20) – Will AI replace programmers?
(3:39:51) – Is the dream of AGI dying?
(3:46:40) – How AI will make money?
(3:51:02) – Big acquisitions in 2026
(3:55:34) – Future of OpenAI, Anthropic, Google DeepMind, xAI, Meta
(4:08:08) – Manhattan Project for AI
(4:14:42) – Future of NVIDIA, GPUs, and AI compute clusters
(4:22:48) – Future of human civilization
#420 – Annie Jacobsen: Nuclear War, CIA, KGB, Aliens, Area 51, Roswell & Secrecy
Annie Jacobsen is an investigative journalist and author of “Nuclear War: A Scenario” and many other books on war, weapons, government secrecy, and national security. Please support this podcast by checking out our sponsors: –…
#419 – Sam Altman: OpenAI, GPT-5, Sora, Board Saga, Elon Musk, Ilya, Power & AGI
Sam Altman is the CEO of OpenAI, the company behind GPT-4, ChatGPT, Sora, and many other state-of-the-art AI technologies. Please support this podcast by checking out our sponsors: – Cloaked: https://cloaked.com/lex and use code LexPod…
#418 – Israel-Palestine Debate: Finkelstein, Destiny, M. Rabbani & Benny Morris
Norman Finkelstein and Benny Morris are historians. Mouin Rabbani is a Middle East analyst. Steven Bonnell (aka Destiny) is a political livestreamer. Please support this podcast by checking out our sponsors: – ExpressVPN: https://expressvpn.com/lexpod to…
#417 – Kimbal Musk: The Art of Cooking, Tesla, SpaceX, Zip2, and Family
Kimbal Musk is a chef, entrepreneur, and author of The Kitchen Cookbook: Cooking for Your Community. Please support this podcast by checking out our sponsors: – Eight Sleep: https://eightsleep.com/lex to get special savings – ExpressVPN:…
#416 – Yann Lecun: Meta AI, Open Source, Limits of LLMs, AGI & the Future of AI
Yann LeCun is the Chief AI Scientist at Meta, professor at NYU, Turing Award winner, and one of the most influential researchers in the history of AI. Please support this podcast by checking out our…
#415 – Serhii Plokhy: History of Ukraine, Russia, Soviet Union, KGB, Nazis & War
Serhii Plokhy is a Ukrainian historian at Harvard University, director of the Ukrainian Research Institute, and an author of many books on history of Eastern Europe, including his latest book The Russo-Ukrainian War: The Return…
#414 – Tucker Carlson: Putin, Navalny, Trump, CIA, NSA, War, Politics & Freedom
Tucker Carlson is a highly-influential political commentator. You can watch and listen to him on the Tucker Carlson Network and the Tucker Carlson Podcast. Please support this podcast by checking out our sponsors: – ZipRecruiter:…
#413 – Bill Ackman: Investing, Financial Battles, Harvard, DEI, X & Free Speech
Bill Ackman is an investor who has led some of the biggest and controversial financial trades in history. He is founder and CEO of Pershing Square Capital Management. Please support this podcast by checking out…
#412 – Marc Raibert: Boston Dynamics and the Future of Robotics
Marc Raibert is founder and former long-time CEO of Boston Dynamics, and recently Executive Director of the newly-created Boston Dynamics AI Institute. Please support this podcast by checking out our sponsors: – HiddenLayer: https://hiddenlayer.com/lex –…
#411 – Omar Suleiman: Palestine, Gaza, Oct 7, Israel, Resistance, Faith & Islam
Omar Suleiman is a Palestinian-American Muslim scholar, civil rights leader, and President of the Yaqeen Institute for Islamic Research. Please support this podcast by checking out our sponsors: – Shopify: https://shopify.com/lex to get $1 per…