Lex Fridman Podcast
Nathan Lambert and Sebastian Raschka are machine learning researchers, engineers, and educators. Nathan is the post-training lead at the Allen Institute for AI (Ai2) and the author of The RLHF Book. Sebastian Raschka is the author of Build a Large Language Model (From Scratch) and Build a Reasoning Model (From Scratch).
Thank you for listening ❤ Check out our sponsors: https://lexfridman.com/sponsors/ep490-sc
See below for timestamps, transcript, and to give feedback, submit questions, contact Lex, etc.
Transcript:
https://lexfridman.com/ai-sota-2026-transcript
CONTACT LEX:
Feedback – give feedback to Lex: https://lexfridman.com/survey
AMA – submit questions, videos or call-in: https://lexfridman.com/ama
Hiring – join our team: https://lexfridman.com/hiring
Other – other ways to get in touch: https://lexfridman.com/contact
SPONSORS:
To support this podcast, check out our sponsors & get discounts:
Box: Intelligent content management platform.
Go to https://box.com/ai
Quo: Phone system (calls, texts, contacts) for businesses.
Go to https://quo.com/lex
UPLIFT Desk: Standing desks and office ergonomics.
Go to https://upliftdesk.com/lex
Fin: AI agent for customer service.
Go to https://fin.ai/lex
Shopify: Sell stuff online.
Go to https://shopify.com/lex
CodeRabbit: AI-powered code reviews.
Go to https://coderabbit.ai/lex
LMNT: Zero-sugar electrolyte drink mix.
Go to https://drinkLMNT.com/lex
Perplexity: AI-powered answer engine.
Go to https://perplexity.ai/
OUTLINE:
(00:00) – Introduction
(01:39) – Sponsors, Comments, and Reflections
(16:29) – China vs US: Who wins the AI race?
(25:11) – ChatGPT vs Claude vs Gemini vs Grok: Who is winning?
(36:11) – Best AI for coding
(43:02) – Open Source vs Closed Source LLMs
(54:41) – Transformers: Evolution of LLMs since 2019
(1:02:38) – AI Scaling Laws: Are they dead or still holding?
(1:18:45) – How AI is trained: Pre-training, Mid-training, and Post-training
(1:51:51) – Post-training explained: Exciting new research directions in LLMs
(2:12:43) – Advice for beginners on how to get into AI development & research
(2:35:36) – Work culture in AI (72+ hour weeks)
(2:39:22) – Silicon Valley bubble
(2:43:19) – Text diffusion models and other new research directions
(2:49:01) – Tool use
(2:53:17) – Continual learning
(2:58:39) – Long context
(3:04:54) – Robotics
(3:14:04) – Timeline to AGI
(3:21:20) – Will AI replace programmers?
(3:39:51) – Is the dream of AGI dying?
(3:46:40) – How AI will make money?
(3:51:02) – Big acquisitions in 2026
(3:55:34) – Future of OpenAI, Anthropic, Google DeepMind, xAI, Meta
(4:08:08) – Manhattan Project for AI
(4:14:42) – Future of NVIDIA, GPUs, and AI compute clusters
(4:22:48) – Future of human civilization
Lex Solo #3 – In Memory of My Grandmother
My attempt to find the words to honor my grandmother, an amazing woman who is responsible for much of who I am, who taught me how to be a man, taught me about strength, about…
#121 – Eugenia Kuyda: Friendship with an AI Companion
Eugenia Kuyda co-founder of Replika, an AI companion. Please check out our sponsors to get a discount and to support this podcast: – Dollar Shave Club: https://dollarshaveclub.com/lex – DoorDash: download app & use code LEX…
Lex Solo #2 – The Future of Neuralink
My thoughts on 8 possible long-term futures of Neuralink after attending the August 2020 progress update. This is a solo episode #2 of the podcast. Hopefully it’s interesting to some folks. The aim is for…
#120 – François Chollet: Measures of Intelligence
François Chollet is an AI researcher at Google and creator of Keras. Support this podcast by supporting our sponsors (and get discount): – Babbel: https://babbel.com and use code LEX – MasterClass: https://masterclass.com/lex – Cash App:…
#119 – David Eagleman: Neuroplasticity and the Livewired Brain
David Eagleman is a neuroscientist at Stanford. Support this podcast by supporting our sponsors: – Athletic Greens: https://athleticgreens.com/lex – BetterHelp: https://betterhelp.com/lex – Cash App: download app & use code “LexPodcast” Episode links: David’s Website: https://www.eagleman.com/…
New Name: Lex Fridman Podcast
New podcast name. New Russian hitman thumbnail. Everything else stays the same. AI is still my passion, but this gives me a bit more freedom to talk to interesting folks from all over. Thanks for…
#118 – Grant Sanderson: Math, Manim, Neural Networks & Teaching with 3Blue1Brown
Grant Sanderson is a math educator and creator of 3Blue1Brown. Support this podcast by supporting our sponsors: – Dollar Shave Club: https://dollarshaveclub.com/lex – DoorDash: download app & use code LEX – Cash App: download app…
#117 – Sheldon Solomon: Death and Meaning
Sheldon Solomon is a social psychologist, a philosopher, co-developer of Terror Management Theory, co-author of The Worm at the Core. Please support this channel by supporting our sponsors: – Blinkist: https://blinkist.com/lex – ExpressVPN at https://www.expressvpn.com/lexpod –…
#116 – Sara Seager: Search for Planets and Life Outside Our Solar System
Sara Seager is a planetary scientist at MIT, known for her work on the search for exoplanets. Support this podcast by supporting our sponsors. Click links, get discount: – Public Goods at https://publicgoods.com/lex and use…
#115 – Dileep George: Brain-Inspired AI
Dileep George is a researcher at the intersection of neuroscience and artificial intelligence, co-founder of Vicarious, formerly co-founder of Numenta. From the early work on Hierarchical temporal memory to Recursive Cortical Networks to today, Dileep’s…