a16z Podcast
Vishal Misra returns to explain his latest research on how LLMs actually work under the hood. He walks through experiments showing that transformers update their predictions in a precise, mathematically predictable way as they process new information, explains why this still doesn’t mean they’re conscious, and describes what’s actually required for AGI: the ability to keep learning after training and the move from pattern matching to understanding cause and effect.
Resources:
Follow Vishal Misra on X: https://x.com/vishalmisra
Follow Martin Casado on X: https://x.com/martin_casado
Stay Updated:
Find a16z on YouTube: YouTube
Find a16z on X
Find a16z on LinkedIn
Listen to the a16z Show on Spotify
Listen to the a16z Show on Apple Podcasts
Follow our host: https://twitter.com/eriktorenberg
Please note that the content here is for informational purposes only; should NOT be taken as legal, business, tax, or investment advice or be used to evaluate any investment or security; and is not directed at any investors or potential investors in any a16z fund. a16z and its affiliates may maintain investments in the companies discussed. For more details please see a16z.com/disclosures.
Hosted by Simplecast, an AdsWizz company. See pcm.adswizz.com for information about our collection and use of personal data for advertising.
-
Human Data is Key to AI: Alex Wang from Scale AI
What if the key to unlocking AI’s full potential lies not just in algorithms or compute, but in data? In this episode, a16z General Partner David George sits down with Alex Wang, founder and CEO…
-
The Frontier of Spatial Intelligence with Fei-Fei Li
Fei-Fei Li and Justin Johnson are pioneers in AI. While the world has only recently witnessed a surge in consumer AI, our guests have long been laying the groundwork for innovations that are transforming industries…
-
Apple’s Big Reveals, OpenAI’s Multi-Step Models, and Firefly Does Video
This week in consumer tech: Apple’s big reveals, OpenAI’s multi-step reasoning, and Adobe Firefly’s video model. Olivia Moore and Justine Moore, Partners on the a16z Consumer team, break down the latest announcements and how these…
-
Grand Challenges in Healthcare AI
Vijay Pande, founding general partner, and Julie Yoo, general partner at a16z Bio + Health, come together to discuss the grand challenges facing healthcare AI today. The talk through the implications of AI integration in…
-
Governing democracy, the internet, and boardrooms
with @NoahRFeldman, @ahall_research, @rhhackett Welcome to web3 with a16z. I’m Robert Hackett and today we have a special episode about governance in many forms — from nation states to corporate boards to internet services and…
-
It’s Time to Build in Healthcare
Half of prescribed medications are never taken, and 88% of Americans are metabolically unhealthy. Despite spending 20% of our GDP on healthcare—twice that of any other developed nation—our outcomes still lag behind. In this episode,…
-
Latin America: A Tech Powerhouse?
Latin America is emerging as a tech powerhouse, but it’s not a one-size-fits-all market. In this episode, we explore why what works in Argentina won’t necessarily fly in Brazil or Mexico, and how companies are…
-
The SSN Breach: What Now?
In this episode, we cover the recent data breach of nearly 3B records, including a significant number of social security numbers. Joining us to discuss are security experts Joel de la Garza and Naftali Harris.…
-
Building Innovation Hubs: The UK & Beyond
This episode from Web3 with a16z Crypto, is all about innovation on a global scale, exploring both ecosystem and individual talent levels. We examine what works and what doesn’t, how certain regions evolve into startup…
-
The Olympics of Talent: France’s Tech Boom
Once criticized for lacking ambition, French founders are now aiming to create the world’s largest companies. With a thriving ecosystem attracting talent from across Europe and the US, France is becoming a major player on…