a16z Podcast
AI models feel smarter than their real-world impact. They ace benchmarks, yet still struggle with reliability, strange bugs, and shallow generalization. Why is there such a gap between what they can do on paper and in practice
In this episode from The Dwarkesh Podcast, Dwarkesh talks with Ilya Sutskever, cofounder of SSI and former OpenAI chief scientist, about what is actually blocking progress toward AGI. They explore why RL and pretraining scale so differently, why models outperform on evals but underperform in real use, and why human style generalization remains far ahead.
Ilya also discusses value functions, emotions as a built-in reward system, the limits of pretraining, continual learning, superintelligence, and what an AI driven economy could look like.
Resources:
Transcript: https://www.dwarkesh.com/p/ilya-sutsk…
Apple Podcasts: https://podcasts.apple.com/us/podcast…
Spotify: https://open.spotify.com/episode/7naO…
Stay Updated:
If you enjoyed this episode, be sure to like, subscribe, and share with your friends!
Find a16z on X: https://x.com/a16z
Find a16z on LinkedIn: https://www.linkedin.com/company/a16z
Listen to the a16z Podcast on Spotify: https://open.spotify.com/show/5bC65RDvs3oxnLyqqvkUYX
Listen to the a16z Podcast on Apple Podcasts: https://podcasts.apple.com/us/podcast/a16z-podcast/id842818711
Follow our host: https://x.com/eriktorenberg
Please note that the content here is for informational purposes only; should NOT be taken as legal, business, tax, or investment advice or be used to evaluate any investment or security; and is not directed at any investors or potential investors in any a16z fund. a16z and its affiliates may maintain investments in the companies discussed. For more details please see a16z.com/disclosures](http://a16z.com/disclosures.
Stay Updated:
Find a16z on X
Find a16z on LinkedIn
Listen to the a16z Show on Spotify
Listen to the a16z Show on Apple Podcasts
Follow our host: https://twitter.com/eriktorenberg
Please note that the content here is for informational purposes only; should NOT be taken as legal, business, tax, or investment advice or be used to evaluate any investment or security; and is not directed at any investors or potential investors in any a16z fund. a16z and its affiliates may maintain investments in the companies discussed. For more details please see a16z.com/disclosures.
Hosted by Simplecast, an AdsWizz company. See pcm.adswizz.com for information about our collection and use of personal data for advertising.

All about the Coronavirus
This episode of 16 Minutes on the news from a16z is all about the recent coronavirus outbreak — or rather, a new type of coronavirus called 2019-nCoV for 2019 novel coronavirus. Since it’s an ongoing…
The Truth about 1000 True Fans + Pricing Our Attention
The idea of “1000 true fans” — first proposed by Kevin Kelly in 2008 and later updated for Tools of Titans — argued that to be a successful creator, you don’t need millions of customers…
Writers Writing, Readers Reading, Creators Creating
We’ve been financing good writing with bad advertising — and “attention monsters” (to quote Craig Mod) for way too long. So what happens when the technology for creators finally falls into place? We’re finally starting…
What’s Next for the Internet?
How can we evolve the web for a better future? Has the web become a mature platform — or are we still in the early days of knowing what it can do and what role…
Controlling AI
AI can do a lot of specific tasks as well as, or even better than, humans can — for example, it can more accurately classify images, more efficiently process mail, and more logically manipulate a…
Food, Drugs, and Tech—100 Years of Public Health
The federal agency known as the FDA, or the Food and Drug Administration, was born over 100 years ago—at the turn of the industrial revolution, in a time of enormous upheaval and change, and rapidly…
On Pharma Trends and Big Company Innovation
How does the world’s largest producer of medicines in terms of volume balance the science and the business of innovation? How does an enterprise at such vast scale make decisions about what to build vs.…
Personal Genomics: Where Are We, Really?
This is a turn of the decade (and January-themed) look backward/ look forward into personal genomics, given recent and past retrospective and prospective pieces in the media on the promise, and perils, of the ability…
Why We Should Be Optimistic About the Future
Many skeptics thought the internet would never reach mass adoption, but today it’s shaping global culture, is integral to our lives — and it’s just the beginning. In this conversation from our 2019 innovation summit,…
What to Know about CFIUS
When innovation and capital go global, so do restrictions on trade, foreign investment, and more. Over the past couple years, U.S. policymakers have expanded the scope of the Committee on Foreign Investment in the U.S.…