a16z Podcast
Vishal Misra returns to explain his latest research on how LLMs actually work under the hood. He walks through experiments showing that transformers update their predictions in a precise, mathematically predictable way as they process new information, explains why this still doesn’t mean they’re conscious, and describes what’s actually required for AGI: the ability to keep learning after training and the move from pattern matching to understanding cause and effect.
Resources:
Follow Vishal Misra on X: https://x.com/vishalmisra
Follow Martin Casado on X: https://x.com/martin_casado
Stay Updated:
Find a16z on YouTube: YouTube
Find a16z on X
Find a16z on LinkedIn
Listen to the a16z Show on Spotify
Listen to the a16z Show on Apple Podcasts
Follow our host: https://twitter.com/eriktorenberg
Please note that the content here is for informational purposes only; should NOT be taken as legal, business, tax, or investment advice or be used to evaluate any investment or security; and is not directed at any investors or potential investors in any a16z fund. a16z and its affiliates may maintain investments in the companies discussed. For more details please see a16z.com/disclosures.
Hosted by Simplecast, an AdsWizz company. See pcm.adswizz.com for information about our collection and use of personal data for advertising.

-
The Electrification of Everything: From Sky to Sea
Demand for electric cars is booming. More than 10 million electric cars were sold worldwide in 2022, and consumer behavior is changing as more people embrace alternative and sustainable modes of mobility. While the electrification…
-
The Future of Cheese
Today’s episode is with Magi Richani, founder and CEO of Nobell Foods. She is joined by a16z Bio + Health general partner Vijay Pande. Together, they talk about the details of engineering plants to create…
-
The Rise of the Exponential Organization
Many companies today are grappling with a few things: an economic downturn, potential layoffs and restructuring, and trying to keep up with the latest tech trends… all while still maintaining a growth trajectory. In this…
-
How Fintech is Reshaping Our $4T Healthcare Industry
In this episode, you’ll hear directly from 6 founders trying to reinvent the healthcare system with the help of Fintech. They’re tackling everything from the lack of price transparency, the complexity of billing, getting clinics…
-
Embedding AI: The Questions Every CEO is Asking
2022 was a breakout year for AI. While machine learning had already been integrated into applications for millions of users, for many, these tools still felt like their first real-world encounter with AI. As AI…
-
When Two Giants Intersect: Healthcare Meets Fintech
Most people don’t need a reminder of the state of healthcare in America. But it’s not just the consumer that’s hurting. Medical debt is increasing, billions are lost in unpaid claims, hospitals are in the…
-
From Promise to Reality: Inside a16z’s Data and AI Forum
Nvidia’s CEO Jensen Huang declared in a recent keynote, “we are in the iPhone moment of AI.” This special episode will give you an inside look into a16z’s Data and AI Forum, hosted the day…
-
Beyond Avatars: How AI is Reshaping Online Identity
In a recent episode, we delved into the first wave of technology that was used to create digital influencers like ‘Lil Miquela back in 2016. Fast forward to today, we’re presented with a whole new…
-
Insights from the Frontlines of Consumer Tech
There is arguably nothing that impacts our daily lives more than consumer technology. This technology can drive our ability to change careers, build an audience, or feel understood. And in this episode, listeners get a…
-
Marketing web3: Audience, Community, More
with @amandacassatt @kimbatronic @smc90 All about marketing, and web3 — not just for marketers already in or seeking to enter web3, but also anyone doing community marketing/ community management, devrel (developer relations); or simply doing…
