a16z Podcast
AI models feel smarter than their real-world impact. They ace benchmarks, yet still struggle with reliability, strange bugs, and shallow generalization. Why is there such a gap between what they can do on paper and in practice
In this episode from The Dwarkesh Podcast, Dwarkesh talks with Ilya Sutskever, cofounder of SSI and former OpenAI chief scientist, about what is actually blocking progress toward AGI. They explore why RL and pretraining scale so differently, why models outperform on evals but underperform in real use, and why human style generalization remains far ahead.
Ilya also discusses value functions, emotions as a built-in reward system, the limits of pretraining, continual learning, superintelligence, and what an AI driven economy could look like.
Resources:
Transcript: https://www.dwarkesh.com/p/ilya-sutsk…
Apple Podcasts: https://podcasts.apple.com/us/podcast…
Spotify: https://open.spotify.com/episode/7naO…
Stay Updated:
If you enjoyed this episode, be sure to like, subscribe, and share with your friends!
Find a16z on X: https://x.com/a16z
Find a16z on LinkedIn: https://www.linkedin.com/company/a16z
Listen to the a16z Podcast on Spotify: https://open.spotify.com/show/5bC65RDvs3oxnLyqqvkUYX
Listen to the a16z Podcast on Apple Podcasts: https://podcasts.apple.com/us/podcast/a16z-podcast/id842818711
Follow our host: https://x.com/eriktorenberg
Please note that the content here is for informational purposes only; should NOT be taken as legal, business, tax, or investment advice or be used to evaluate any investment or security; and is not directed at any investors or potential investors in any a16z fund. a16z and its affiliates may maintain investments in the companies discussed. For more details please see a16z.com/disclosures](http://a16z.com/disclosures.
Stay Updated:
Find a16z on X
Find a16z on LinkedIn
Listen to the a16z Show on Spotify
Listen to the a16z Show on Apple Podcasts
Follow our host: https://twitter.com/eriktorenberg
Please note that the content here is for informational purposes only; should NOT be taken as legal, business, tax, or investment advice or be used to evaluate any investment or security; and is not directed at any investors or potential investors in any a16z fund. a16z and its affiliates may maintain investments in the companies discussed. For more details please see a16z.com/disclosures.
Hosted by Simplecast, an AdsWizz company. See pcm.adswizz.com for information about our collection and use of personal data for advertising.
AI in B2B
Consumer software may have adopted and incorporated AI ahead of enterprise software, where the data is more proprietary, and the market is a few thousand companies not hundreds of millions of smartphone users. But recently…
Free Software and Open Source Business
Today, despite the critical importance of open source to software, it’s still seen by some as blasphemous to make money as an open source business. In this podcast, Armon Dadgar, Cofounder and CTO of HashiCorp;…
Of Emojis and Innovation
This rerun podcast (first recorded in 2015, now being rerun as one of our evergreen classics/ favorites) — is ALL about emoji. But it’s really about how innovation really comes about: through the tension between…
The Environment, Capitalism, Technology
It used to be that the only way for humanity to grow — and progress — was through destroying the environment. Sure, the Industrial Revolution brought about the growth of our economies, our population, our…
16 Minutes on the News #10: Amazon Healthcare, Oculus VR/AR, Google Quantum Supremacy?
Our news podcast, 16 Minutes — where we quickly cover the top headlines of the week, the a16z way (why are these topics in the news; what’s real, what’s hype from our vantage point of…
New Business Models for Gaming, Collaboration, Creativity
The combination of cloud, social, and mobile took gaming beyond a small base of just console- and PC-gamers to a massive player base. But the underlying business model — the concept of “free-to-play”, built on…
16 Minutes on the News #9: All the Recent Phone Hacks
This is episode #9 of our news show, 16 Minutes, where we quickly cover recent headlines of the week, the a16z way — why they’re in the news; why they matter from our vantage point…
a16z Podcast: The Biology of Pain
What is the nature of physical pain? Why do we even experience it? Is there one type, or many? Do people experience pain differently? What is happening in our brains and our bodies when we…
16 Minutes on the News #8: Apple Camera, Services; Wearables – Where are We
with @benedictevans @vijaypande and @smc90 This is episode #8 of our news show, 16 Minutes, where we quickly cover recent headlines of the week, the a16z way — why they’re in the news; why they…
a16z Podcast: How to Pay for Healthcare Based on Health
There’s been a lot of talk about the need for our healthcare system to shift away from volume and fee-for-service, where you pay by appointment, procedure, etc, to value-based care, where you pay for both…
