Lex Fridman Podcast
Nathan Lambert and Sebastian Raschka are machine learning researchers, engineers, and educators. Nathan is the post-training lead at the Allen Institute for AI (Ai2) and the author of The RLHF Book. Sebastian Raschka is the author of Build a Large Language Model (From Scratch) and Build a Reasoning Model (From Scratch).
Thank you for listening ❤ Check out our sponsors: https://lexfridman.com/sponsors/ep490-sc
See below for timestamps, transcript, and to give feedback, submit questions, contact Lex, etc.
Transcript:
https://lexfridman.com/ai-sota-2026-transcript
CONTACT LEX:
Feedback – give feedback to Lex: https://lexfridman.com/survey
AMA – submit questions, videos or call-in: https://lexfridman.com/ama
Hiring – join our team: https://lexfridman.com/hiring
Other – other ways to get in touch: https://lexfridman.com/contact
SPONSORS:
To support this podcast, check out our sponsors & get discounts:
Box: Intelligent content management platform.
Go to https://box.com/ai
Quo: Phone system (calls, texts, contacts) for businesses.
Go to https://quo.com/lex
UPLIFT Desk: Standing desks and office ergonomics.
Go to https://upliftdesk.com/lex
Fin: AI agent for customer service.
Go to https://fin.ai/lex
Shopify: Sell stuff online.
Go to https://shopify.com/lex
CodeRabbit: AI-powered code reviews.
Go to https://coderabbit.ai/lex
LMNT: Zero-sugar electrolyte drink mix.
Go to https://drinkLMNT.com/lex
Perplexity: AI-powered answer engine.
Go to https://perplexity.ai/
OUTLINE:
(00:00) – Introduction
(01:39) – Sponsors, Comments, and Reflections
(16:29) – China vs US: Who wins the AI race?
(25:11) – ChatGPT vs Claude vs Gemini vs Grok: Who is winning?
(36:11) – Best AI for coding
(43:02) – Open Source vs Closed Source LLMs
(54:41) – Transformers: Evolution of LLMs since 2019
(1:02:38) – AI Scaling Laws: Are they dead or still holding?
(1:18:45) – How AI is trained: Pre-training, Mid-training, and Post-training
(1:51:51) – Post-training explained: Exciting new research directions in LLMs
(2:12:43) – Advice for beginners on how to get into AI development & research
(2:35:36) – Work culture in AI (72+ hour weeks)
(2:39:22) – Silicon Valley bubble
(2:43:19) – Text diffusion models and other new research directions
(2:49:01) – Tool use
(2:53:17) – Continual learning
(2:58:39) – Long context
(3:04:54) – Robotics
(3:14:04) – Timeline to AGI
(3:21:20) – Will AI replace programmers?
(3:39:51) – Is the dream of AGI dying?
(3:46:40) – How AI will make money?
(3:51:02) – Big acquisitions in 2026
(3:55:34) – Future of OpenAI, Anthropic, Google DeepMind, xAI, Meta
(4:08:08) – Manhattan Project for AI
(4:14:42) – Future of NVIDIA, GPUs, and AI compute clusters
(4:22:48) – Future of human civilization
#290 – Dan Reynolds: Imagine Dragons
Dan Reynolds is the lead singer of Imagine Dragons, one of the most popular bands in the world. Please support this podcast by checking out our sponsors: – Brave: https://brave.com/lex – Mizzen+Main: https://mizzenandmain.com and use…
#289 – Stephen Kotkin: Putin, Zelenskyy, and War in Ukraine
Stephen Kotkin is a historian specializing in Stalin and Soviet history. Please support this podcast by checking out our sponsors: – Lambda: https://lambdalabs.com/lex – Scale: https://scale.com/lex – Athletic Greens: https://athleticgreens.com/lex and use code LEX to…
#288 – Sarma Melngailis: Bad Vegan
Sarma Melngailis is a chef and restauranteur who was the subject of the Netflix documentary Bad Vegan: Fame, Fraud, Fugitives. Please support this podcast by checking out our sponsors: – Mailgun: https://lexfridman.com/mailgun – BiOptimizers: http://www.magbreakthrough.com/lex…
#287 – Bobby Lee: Comedy, Skyrim, Sex Robots, Love, Fame, and Power
Bobby Lee is a comedian and co-host of TigerBelly and Bad Friends podcasts. Please support this podcast by checking out our sponsors: – Brave: https://brave.com/lex – GiveWell: https://www.givewell.org/ and use code LEX – Linode: https://linode.com/lex…
#286 – Oliver Stone: Vladimir Putin and War in Ukraine
Oliver Stone is a filmmaker with 3 Oscar wins and 11 Oscar nominations. His films include Platoon, Wall Street, Born on the Fourth of July, Scarface, JFK, Nixon, Alexander, W, Snowden, and documentaries where he…
#285 – Glenn Loury: Race, Racism, Identity Politics, and Cancel Culture
Glenn Loury is a professor of economics and social sciences at Brown University, and a prominent podcaster and social critic who speaks and writes about race, inequality, and social policy. Please support this podcast by…
#284 – Saifedean Ammous: Bitcoin, Anarchy, and Austrian Economics
Saifedean Ammous is an Austrian economist and author of The Bitcoin Standard and The Fiat Standard. Please support this podcast by checking out our sponsors: – GiveWell: https://www.givewell.org/ and use code LEX – Scale: https://scale.com/lex…
#283 – Chris Mason: Space Travel, Colonization, and Long-Term Survival in Space
Chris Mason is a professor of genomics, physiology, and biophysics at Cornell, doing research on the long-term effects of space on the human body. He is the author of The Next 500 Years: Engineering Life…
#282 – David Buss: Sex, Dating, Relationships, and Sex Differences
David Buss is an evolutionary psychologist at UT Austin. He is one of the founders of the field of evolutionary psychology. His current research is on sex differences in mate selection, mate attraction, infidelity, and…
#281 – Grimes: Music, AI, and the Future of Humanity
Grimes is a musician, artist, singer, songwriter, producer, and director. Please support this podcast by checking out our sponsors: – Brave: https://brave.com/lex – Novo: https://novo.co/lex – Lambda: https://lambdalabs.com/lex – Public Goods: https://publicgoods.com/lex and use code…