Lex Fridman Podcast
Nathan Lambert and Sebastian Raschka are machine learning researchers, engineers, and educators. Nathan is the post-training lead at the Allen Institute for AI (Ai2) and the author of The RLHF Book. Sebastian Raschka is the author of Build a Large Language Model (From Scratch) and Build a Reasoning Model (From Scratch).
Thank you for listening ❤ Check out our sponsors: https://lexfridman.com/sponsors/ep490-sc
See below for timestamps, transcript, and to give feedback, submit questions, contact Lex, etc.
Transcript:
https://lexfridman.com/ai-sota-2026-transcript
CONTACT LEX:
Feedback – give feedback to Lex: https://lexfridman.com/survey
AMA – submit questions, videos or call-in: https://lexfridman.com/ama
Hiring – join our team: https://lexfridman.com/hiring
Other – other ways to get in touch: https://lexfridman.com/contact
SPONSORS:
To support this podcast, check out our sponsors & get discounts:
Box: Intelligent content management platform.
Go to https://box.com/ai
Quo: Phone system (calls, texts, contacts) for businesses.
Go to https://quo.com/lex
UPLIFT Desk: Standing desks and office ergonomics.
Go to https://upliftdesk.com/lex
Fin: AI agent for customer service.
Go to https://fin.ai/lex
Shopify: Sell stuff online.
Go to https://shopify.com/lex
CodeRabbit: AI-powered code reviews.
Go to https://coderabbit.ai/lex
LMNT: Zero-sugar electrolyte drink mix.
Go to https://drinkLMNT.com/lex
Perplexity: AI-powered answer engine.
Go to https://perplexity.ai/
OUTLINE:
(00:00) – Introduction
(01:39) – Sponsors, Comments, and Reflections
(16:29) – China vs US: Who wins the AI race?
(25:11) – ChatGPT vs Claude vs Gemini vs Grok: Who is winning?
(36:11) – Best AI for coding
(43:02) – Open Source vs Closed Source LLMs
(54:41) – Transformers: Evolution of LLMs since 2019
(1:02:38) – AI Scaling Laws: Are they dead or still holding?
(1:18:45) – How AI is trained: Pre-training, Mid-training, and Post-training
(1:51:51) – Post-training explained: Exciting new research directions in LLMs
(2:12:43) – Advice for beginners on how to get into AI development & research
(2:35:36) – Work culture in AI (72+ hour weeks)
(2:39:22) – Silicon Valley bubble
(2:43:19) – Text diffusion models and other new research directions
(2:49:01) – Tool use
(2:53:17) – Continual learning
(2:58:39) – Long context
(3:04:54) – Robotics
(3:14:04) – Timeline to AGI
(3:21:20) – Will AI replace programmers?
(3:39:51) – Is the dream of AGI dying?
(3:46:40) – How AI will make money?
(3:51:02) – Big acquisitions in 2026
(3:55:34) – Future of OpenAI, Anthropic, Google DeepMind, xAI, Meta
(4:08:08) – Manhattan Project for AI
(4:14:42) – Future of NVIDIA, GPUs, and AI compute clusters
(4:22:48) – Future of human civilization
#270 – David Wolpe: Judaism
David Wolpe is a Rabbi of Sinai Temple in Los Angeles. Please support this podcast by checking out our sponsors: – Mizzen+Main: https://mizzenandmain.com and use code LEX to get $35 off – Linode: https://linode.com/lex to…
#269 – Lee Cronin: Origin of Life, Aliens, Complexity, and Consciousness
Lee Cronin is a chemist at the University of Glasgow. Please support this podcast by checking out our sponsors: – Paperspace: https://gradient.run/lex to get $15 credit – Athletic Greens: https://athleticgreens.com/lex and use code LEX to…
#268 – Robert Proctor: Nazi Science and Ideology
Robert Proctor is a historian of science at Stanford University. Please support this podcast by checking out our sponsors: – Theragun: https://therabody.com/lex to get 30 day trial – BetterHelp: https://betterhelp.com/lex to get 10% off –…
#267 – Mark Zuckerberg: Meta, Facebook, Instagram, and the Metaverse
Mark Zuckerberg is CEO of Meta, formerly Facebook. Please support this podcast by checking out our sponsors: – Paperspace: https://gradient.run/lex to get $15 credit – Coinbase: https://coinbase.com/lex to get $5 in free Bitcoin – InsideTracker:…
#266 – Nicole Perlroth: Cybersecurity and the Weapons of Cyberwar
Nicole Perlroth is a cybersecurity journalist and author. Please support this podcast by checking out our sponsors: – Linode: https://linode.com/lex to get $100 free credit – InsideTracker: https://insidetracker.com/lex and use code Lex25 to get 25%…
#265 – Devon Larratt: Arm Wrestling
Devon Larratt is a professional arm wrestler, widely considered to be one of the best of all time. Please support this podcast by checking out our sponsors: – Allform: https://allform.com/lex to get 20% off –…
#264 – Tim Urban: Elon Musk, Neuralink, AI, Aliens, and the Future of Humanity
Tim Urban is the author and illustrator of the popular blog ‘Wait But Why’. Please support this podcast by checking out our sponsors: – Audible: https://audible.com/lex to get $9.95 a month for 6 months –…
#263 – John Abramson: Big Pharma
John Abramson is faculty at Harvard Medical School and a family physician for over two decades. He’s the author of the new book Sickening about how big pharma broke American healthcare and how we can…
#262 – Garry Nolan: UFOs and Aliens
Garry Nolan is a professor at Stanford University School of Medicine. His research is in microbiology, immunology, bio-computation, and analysis of UFO artifacts, materials, and reports of UFO encounters. Please support this podcast by checking…
#261 – Philip Goff: Consciousness, Panpsychism, and the Philosophy of Mind
Philip Goff is a philosopher of mind and consciousness at Durham University and author of Galileo’s Error. Please support this podcast by checking out our sponsors: – InsideTracker: https://insidetracker.com/lex and use code Lex25 to get…