Lex Fridman Podcast
Nathan Lambert and Sebastian Raschka are machine learning researchers, engineers, and educators. Nathan is the post-training lead at the Allen Institute for AI (Ai2) and the author of The RLHF Book. Sebastian Raschka is the author of Build a Large Language Model (From Scratch) and Build a Reasoning Model (From Scratch).
Thank you for listening ❤ Check out our sponsors: https://lexfridman.com/sponsors/ep490-sc
See below for timestamps, transcript, and to give feedback, submit questions, contact Lex, etc.
Transcript:
https://lexfridman.com/ai-sota-2026-transcript
CONTACT LEX:
Feedback – give feedback to Lex: https://lexfridman.com/survey
AMA – submit questions, videos or call-in: https://lexfridman.com/ama
Hiring – join our team: https://lexfridman.com/hiring
Other – other ways to get in touch: https://lexfridman.com/contact
SPONSORS:
To support this podcast, check out our sponsors & get discounts:
Box: Intelligent content management platform.
Go to https://box.com/ai
Quo: Phone system (calls, texts, contacts) for businesses.
Go to https://quo.com/lex
UPLIFT Desk: Standing desks and office ergonomics.
Go to https://upliftdesk.com/lex
Fin: AI agent for customer service.
Go to https://fin.ai/lex
Shopify: Sell stuff online.
Go to https://shopify.com/lex
CodeRabbit: AI-powered code reviews.
Go to https://coderabbit.ai/lex
LMNT: Zero-sugar electrolyte drink mix.
Go to https://drinkLMNT.com/lex
Perplexity: AI-powered answer engine.
Go to https://perplexity.ai/
OUTLINE:
(00:00) – Introduction
(01:39) – Sponsors, Comments, and Reflections
(16:29) – China vs US: Who wins the AI race?
(25:11) – ChatGPT vs Claude vs Gemini vs Grok: Who is winning?
(36:11) – Best AI for coding
(43:02) – Open Source vs Closed Source LLMs
(54:41) – Transformers: Evolution of LLMs since 2019
(1:02:38) – AI Scaling Laws: Are they dead or still holding?
(1:18:45) – How AI is trained: Pre-training, Mid-training, and Post-training
(1:51:51) – Post-training explained: Exciting new research directions in LLMs
(2:12:43) – Advice for beginners on how to get into AI development & research
(2:35:36) – Work culture in AI (72+ hour weeks)
(2:39:22) – Silicon Valley bubble
(2:43:19) – Text diffusion models and other new research directions
(2:49:01) – Tool use
(2:53:17) – Continual learning
(2:58:39) – Long context
(3:04:54) – Robotics
(3:14:04) – Timeline to AGI
(3:21:20) – Will AI replace programmers?
(3:39:51) – Is the dream of AGI dying?
(3:46:40) – How AI will make money?
(3:51:02) – Big acquisitions in 2026
(3:55:34) – Future of OpenAI, Anthropic, Google DeepMind, xAI, Meta
(4:08:08) – Manhattan Project for AI
(4:14:42) – Future of NVIDIA, GPUs, and AI compute clusters
(4:22:48) – Future of human civilization
#250 – Peter Wang: Python and the Source Code of Humans, Computers, and Reality
Peter Wang is the co-founder & CEO of Anaconda and one of the most impactful leaders and developers in the Python community. Also, he is a physicist and philosopher. Please support this podcast by checking…
#249 – Albert Bourla: Pfizer CEO
Albert Bourla is the Chairman and CEO of Pfizer. Please support this podcast by checking out our sponsors: – Notion: https://notion.com/startups to get up to $1000 off team plan – Calm: https://calm.com/lex to get 40%…
#248 – Norman Naimark: Genocide, Stalin, Hitler, Mao, and Absolute Power
Norman Naimark is a historian at Stanford, specializing in the history of genocide. Please support this podcast by checking out our sponsors: – Coinbase: https://coinbase.com/lex to get $5 in free Bitcoin – Quip: https://getquip.com/lex to…
#247 – Jamie Metzl: Lab Leak Theory
Jamie Metzl is an author specializing in topics of genetic engineering, biotechnology, and geopolitics. Please support this podcast by checking out our sponsors: – Mizzen+Main: https://mizzenandmain.com and use code LEX to get $35 off –…
#246 – Peter Woit: Theories of Everything and Why String Theory is Not Even Wrong
Peter Woit is a theoretical physicist, mathematician, critic of string theory, and author of the popular science blog Not Even Wrong. Please support this podcast by checking out our sponsors: – The Prisoner Wine Company:…
#245 – Tom Brands: Iowa Wrestling
Tom Brands is an Olympic and World Champion in freestyle wrestling and the head wrestling coach at the University of Iowa. Please support this podcast by checking out our sponsors: – FightCamp: https://joinfightcamp.com/lex to get…
#244 – Robert Crews: Afghanistan, Taliban, Bin Laden, and War in the Middle East
Robert Crews is a historian at Stanford, specializing in Afghanistan, Russia, Islam, Central Asia, and South Asia. Please support this podcast by checking out our sponsors: – MUDWTR: https://mudwtr.com/lex and use code LEX to get…
#243 – Kevin Systrom: Instagram
Kevin Systrom is the co-founder and former CEO of Instagram. Please support this podcast by checking out our sponsors: – Theragun: https://therabody.com/lex to get 30 day trial – NI: https://www.ni.com/perspectives – GiveWell: https://www.givewell.org/ and use…
#242 – Ben Askren: Wrestling and MMA
Ben Askren is a wrestler and MMA fighter, former Bellator and ONE Championship welterweight champion, a two-time NCAA wrestling champion and four-time finalist. Please support this podcast by checking out our sponsors: – Notion: https://notion.com/startups…
#241 – Boris Sofman: Waymo, Cozmo, Self-Driving Cars, and the Future of Robotics
Boris Sofman is the Senior Director Of Engineering and Head of Trucking at Waymo, formerly the Google Self-Driving Car project. He was also the CEO and co-founder of Anki, a home robotics company. Please support…