a16z Podcast
Vishal Misra returns to explain his latest research on how LLMs actually work under the hood. He walks through experiments showing that transformers update their predictions in a precise, mathematically predictable way as they process new information, explains why this still doesn’t mean they’re conscious, and describes what’s actually required for AGI: the ability to keep learning after training and the move from pattern matching to understanding cause and effect.
Resources:
Follow Vishal Misra on X: https://x.com/vishalmisra
Follow Martin Casado on X: https://x.com/martin_casado
Stay Updated:
Find a16z on YouTube: YouTube
Find a16z on X
Find a16z on LinkedIn
Listen to the a16z Show on Spotify
Listen to the a16z Show on Apple Podcasts
Follow our host: https://twitter.com/eriktorenberg
Please note that the content here is for informational purposes only; should NOT be taken as legal, business, tax, or investment advice or be used to evaluate any investment or security; and is not directed at any investors or potential investors in any a16z fund. a16z and its affiliates may maintain investments in the companies discussed. For more details please see a16z.com/disclosures.
Hosted by Simplecast, an AdsWizz company. See pcm.adswizz.com for information about our collection and use of personal data for advertising.

-
Next-Gen Gaming: AI Souls, Real-time Culture, Personalized Avatars
Over 3,700 companies applied to a16z’s SPEEDRUN. In this episode, we meet the founders pushing the boundaries of what games can be. From the fusion of traditional gaming elements with modern tech-twists, a16z General Partner…
-
Why America Must Lead in AI Investment with Senator Young (R-IN)
Senator Todd Young (R-IN) speaks with a16z General Partner Martin Casado about the importance of open innovation and American leadership in AI, and why we need to support AI research at all levels — from…
-
Game On: Marc Andreessen & Andrew Chen Talk Creative Computers
The gaming industry stands as a pioneer of cutting-edge technologies, ushering in innovations like GPUs, virtual and augmented reality, physics engines, and immersive multiplayer experiences. In this episode, a16z cofounder Marc Andreessen and Andrew Chen,…
-
Inside the Department of Defense and its Vision for the Future
From air-defining radar and electronic systems that helped the Allies win World War II, the origins of Silicon Valley are deeply rooted in government and defense. In today’s episode, we get the chance to revisit…
-
Politics & the Future of Tech with Marc Andreessen and Ben Horowitz
“If America is going to be America in the next one hundred years, we have to get this right.” – Ben Horowitz This week on “The Ben & Marc Show”, a16z co-founders Ben Horowitz and…
-
The Real Price of Healthcare with Mark Cuban
From judging inventions on “Shark Tank” to reshaping the image of NBA ownership, Mark Cuban is known for many things. In this chat with a16z General Partner David Ulevitch, he discusses the importance of entrepreneurship…
-
Devoting Your Life to Reinventing a Broken System
At the a16z LP Summit, we brought hundreds of our limited partners and portfolio founders together in Las Vegas. The event was truly overflowing with stories of how founders are challenging the status quo and…
-
Bringing AI to the Masses with Adam D’Angelo
Generative AI has initiated a transformative shift, reshaping our world in unprecedented ways. In a16z’s AI Revolution series, we engage some of the most impactful builders in the field of AI discussing and debating where…
-
A Nuclear Comeback: Are New Reactors the Answer?
Nuclear energy accounts for 20% of the electricity in the United States, but remarkably, 2023 marked the commissioning of the U.S.’s first new nuclear reactor in over three decades. The past few years have been…
-
Intelligence in the Age of AI with new CTO of the CIA
Artificial intelligence has taken the world by storm. But despite the hype around personalized avatars or podcast language translation, artificial intelligence is not only impacting the creative spheres; in fact it’s hard to find an…
