a16z Podcast
Vishal Misra returns to explain his latest research on how LLMs actually work under the hood. He walks through experiments showing that transformers update their predictions in a precise, mathematically predictable way as they process new information, explains why this still doesn’t mean they’re conscious, and describes what’s actually required for AGI: the ability to keep learning after training and the move from pattern matching to understanding cause and effect.
Resources:
Follow Vishal Misra on X: https://x.com/vishalmisra
Follow Martin Casado on X: https://x.com/martin_casado
Stay Updated:
Find a16z on YouTube: YouTube
Find a16z on X
Find a16z on LinkedIn
Listen to the a16z Show on Spotify
Listen to the a16z Show on Apple Podcasts
Follow our host: https://twitter.com/eriktorenberg
Please note that the content here is for informational purposes only; should NOT be taken as legal, business, tax, or investment advice or be used to evaluate any investment or security; and is not directed at any investors or potential investors in any a16z fund. a16z and its affiliates may maintain investments in the companies discussed. For more details please see a16z.com/disclosures.
Hosted by Simplecast, an AdsWizz company. See pcm.adswizz.com for information about our collection and use of personal data for advertising.
-
Taking the Pulse on Medical Device Security
Many don’t realize we even need to think about the possibility of security hacks when it comes to things like pacemakers, insulin pumps, and more. But when bits and bytes meet flesh and blood, security…
-
Journal Club: A New Path to Antibiotic Resistance
Ever since the discovery of antibiotics, microbiologists have worried about and studied how bacteria acquire resistance to these drugs. Adding to the complexity of this problem is the fact that it is not always clear…
-
Cybercrime, Incorporated
A dive into the sociological, operational, and tactical realities of this murky underworld, Lusthaus and de la Garza discuss who the players are, what they are motivated by, and specialize in—as well as how basic…
-
How Transparent Pricing Drives Healthcare Change
Dr. Marty Makary—surgical oncologist at Johns Hopkins University School of Medicine, and health policy and innovation expert—has long been a passionate advocate for transparent pricing in the healthcare system. We don’t talk enough (or really…
-
Preserving Digital History: How to Close the Web’s ‘Memory Hole’
More than 98% of the information on the web is lost within 20 years, and huge gaps exist in our digital and cultural history. Zoran Basich and Alex Pruden of a16z talk to Brewster Kahle…
-
Alex Honnold on Human Performance (part 2) – Climbing and Entrepreneurship
In part 1 of our series on human performance, we looked at the limits of human potential in climbing and other sports – and how we push those limits through technology and training. In this…
-
Alex Honnold on Human Performance (part 1) – Where’s the Limit?
Is there a limit to what humans can do? And if so, how do you know when you’ve reached it? Welcome to part one of a two-part series on human performance with professional rock climber…
-
Why We Shouldn’t Fear AI in Healthcare
“Why We Shouldn’t Fear the ‘Black Box’ of AI (in Healthcare and Everywhere)” by Vijay Pande. First published in the New York Times, January 2018. You can also find and share this article at a16z.com/aidoctor
-
When One App Rules Them All: The Case of WeChat and Mobile in China
“When One App Rules Them All: The Case of WeChat and Mobile in China” by Connie Chan. First published August 2015. You can also find and share this essay at a16z.com/mobilefirstchina
-
Every Company Is a Fintech Company
“Why Every Company Will Be a Fintech Company — The Next Era of Financial Services and the ‘AWS Phase’ for Fintech” by Angela Strange. You can also find and share this essay at a16z.com/fintecheverywhere …