a16z Podcast
Vishal Misra returns to explain his latest research on how LLMs actually work under the hood. He walks through experiments showing that transformers update their predictions in a precise, mathematically predictable way as they process new information, explains why this still doesn’t mean they’re conscious, and describes what’s actually required for AGI: the ability to keep learning after training and the move from pattern matching to understanding cause and effect.
Resources:
Follow Vishal Misra on X: https://x.com/vishalmisra
Follow Martin Casado on X: https://x.com/martin_casado
Stay Updated:
Find a16z on YouTube: YouTube
Find a16z on X
Find a16z on LinkedIn
Listen to the a16z Show on Spotify
Listen to the a16z Show on Apple Podcasts
Follow our host: https://twitter.com/eriktorenberg
Please note that the content here is for informational purposes only; should NOT be taken as legal, business, tax, or investment advice or be used to evaluate any investment or security; and is not directed at any investors or potential investors in any a16z fund. a16z and its affiliates may maintain investments in the companies discussed. For more details please see a16z.com/disclosures.
Hosted by Simplecast, an AdsWizz company. See pcm.adswizz.com for information about our collection and use of personal data for advertising.

-
The Quest for AGI: Q*, Self-Play, and Synthetic Data
One topic at the center of the AI universe this week is a potential breakthrough called Q*. Little has been revealed about this OpenAI project, other than its likely relationship to solving certain grade-school mathematical…
-
Financial Freedom, Company Building, More with David Marcus
with @davidmarcus @smc90 This wide-ranging conversation covers company building, big to small — including what cadence and when is the right “time” to ship; the relationship between centralization, decentralization, platforms, and financial freedom; moving from…
-
When Business is Battle: Inside the Boardrooms of the CEOs that Survived the Storm
Taking a company from idea to household name is always difficult. But the past few years presented challenges that caught even the most-seasoned CEOs off guard. In this episode, you’ll hear from two CEOs that…
-
The Worlds She Sees with Godmother of AI, Fei-Fei Li
Fei-Fei Li, PhD, Professor in the Computer Science Department at Stanford University, and Co-Director of Stanford’s Human-Centered AI Institute, joins Bio + Health founding partner Vijay Pande. In this candid conversation, Li unfolds her transformation…
-
From Sims to Sapiens: Crafting Reality with Code
Is it possible to construct a virtual society that authentically replicates human behavior? AI Town, a virtual town experiment where AI residents live, interact, and engage, provides valuable insights into the future of AI’s believability…
-
Fintech Fuels Global Payments
Software crosses borders effortlessly. The globalization of money, however, is considerably more challenging. This is especially true for multinational businesses, which grapple with managing multiple accounts in diverse currencies, navigating costly foreign exchange rates, and…
-
The Techno-Optimist Manifesto with Marc Andreessen and Ben Horowitz
Subscribe to The Ben & Marc Show on Apple Podcasts: https://bit.ly/3SdsfNt Subscribe to The Ben & Marc Show on Spotify: https://spoti.fi/3SclPOr Read the full manifesto: https://a16z.com/the-techno-optimist-manifesto/ This past week, Marc released his new vision for…
-
A New Era of VR: From the Court to the Classroom
As VR technology inches forward, completely new experiences loom on the horizon. In today’s episode, we expose listeners to the very real-world use cases already present on these devices, from fitness to education. First up…
-
When Will AI Hit the Enterprise? Ben Horowitz and Ali Ghodsi Discuss
Today’s episode continues our coverage from a16z’s recent AI Revolution event. You’ll hear directly from a16z cofounder Ben Horowitz and Databricks cofounder and CEO, Ali Ghodsi as they answer questions around AI and the enterprise,…
-
When AI and Genomics Collide
Today’s episode continues our coverage from a16z’s recent AI Revolution event. You’ll hear a16z Bio & Health GP Vijay Pande speak with Daphne Koller about the fascinating convergence of machine learning and genomics – two…
