a16z Podcast
Vishal Misra returns to explain his latest research on how LLMs actually work under the hood. He walks through experiments showing that transformers update their predictions in a precise, mathematically predictable way as they process new information, explains why this still doesn’t mean they’re conscious, and describes what’s actually required for AGI: the ability to keep learning after training and the move from pattern matching to understanding cause and effect.
Resources:
Follow Vishal Misra on X: https://x.com/vishalmisra
Follow Martin Casado on X: https://x.com/martin_casado
Stay Updated:
Find a16z on YouTube: YouTube
Find a16z on X
Find a16z on LinkedIn
Listen to the a16z Show on Spotify
Listen to the a16z Show on Apple Podcasts
Follow our host: https://twitter.com/eriktorenberg
Please note that the content here is for informational purposes only; should NOT be taken as legal, business, tax, or investment advice or be used to evaluate any investment or security; and is not directed at any investors or potential investors in any a16z fund. a16z and its affiliates may maintain investments in the companies discussed. For more details please see a16z.com/disclosures.
Hosted by Simplecast, an AdsWizz company. See pcm.adswizz.com for information about our collection and use of personal data for advertising.

-
NFTs, Explained
Given all the activity and interest recently around crypto and web3, as well as in upcoming holidays and art events, we’re re-running our episode all about NFTs (from March 2021) — where we covered everything…
-
Play-to-Earn Gaming and How Work is Evolving in Web3
In today’s episode we’re talking about an emerging model of gaming called play to earn, in which players can make actual money based on how much time and effort they put into a game. Play…
-
On container ships, supply chains, and the physical world
“Beyond the Meme: Ever Given, Supply Chains, and the Physical World” — by Ryan Petersen (June 2021). Bio + essay details/ originally appeared at: https://future.a16z.com/beyond-the-meme-ever-given-supply-chains-and-the-physical-world/ More read-alouds at: https://a16z.com/tag/read-alouds/
-
Crypto Security and the New Web3 Mindsets for Users
Today’s episode is all about crypto security — that is, the new mindsets and the new strategies for storing crypto assets safely while also allowing holders control and access. As a reminder, none of the…
-
Cloud Wars and Company Wars: Play Nice But Win
There are lots of challenges in being public while trying to innovate, and limits to being a private company as well; but it’s rare to see a company go public then private then back to…
-
Uncontrolled Spread: Science, Policy, Institutions, Infrastructure
There’s no question technology played a huge role in the recent/current pandemic, including especially in the plug-and-play engineering and incredibly fast development behind the mRNA vaccines… But is there an even bigger role for the…
-
Systems Leadership for Disruptors and Incumbents
There’s been a false dichotomy in technology and management lore over the past decade, between “brain” and “brawn”, digital and physical, independence and interdependence, software culture versus industrial culture… or so observes Stanford Graduate School…
-
NFT Use Cases, Today and Tomorrow
Recently, a16z and the Stanford Center for Blockchain Research hosted the NFT Virtual Summit, which brought together leading thinkers and builders on the topic of NFTs, or non-fungible tokens — these tokens are enabling new…
-
Man, Mosquito, Malaria Vaccine
Playing out against the backdrop of a global pandemic (including recent massive surges in regions around the world) is the news that came out a week ago that a candidate “malaria vaccine becomes first to…
-
Crypto, an Oral Essay
This is a special episode of the a16z podcast — it’s an audio history, told through the voices of the a16z crypto team, about what crypto is, how it really works, and why it matters.…
