a16z Podcast
Vishal Misra returns to explain his latest research on how LLMs actually work under the hood. He walks through experiments showing that transformers update their predictions in a precise, mathematically predictable way as they process new information, explains why this still doesn’t mean they’re conscious, and describes what’s actually required for AGI: the ability to keep learning after training and the move from pattern matching to understanding cause and effect.
Resources:
Follow Vishal Misra on X: https://x.com/vishalmisra
Follow Martin Casado on X: https://x.com/martin_casado
Stay Updated:
Find a16z on YouTube: YouTube
Find a16z on X
Find a16z on LinkedIn
Listen to the a16z Show on Spotify
Listen to the a16z Show on Apple Podcasts
Follow our host: https://twitter.com/eriktorenberg
Please note that the content here is for informational purposes only; should NOT be taken as legal, business, tax, or investment advice or be used to evaluate any investment or security; and is not directed at any investors or potential investors in any a16z fund. a16z and its affiliates may maintain investments in the companies discussed. For more details please see a16z.com/disclosures.
Hosted by Simplecast, an AdsWizz company. See pcm.adswizz.com for information about our collection and use of personal data for advertising.
-
How to Make Better Decisions
Can you get better at decision-making with practice? Many founders, investors, and builders must make many critical decisions, big and small, every day, and improving the quality of your decision-making process can become a big…
-
Learning from Open Source Communities
What can we learn from the evolution of open source communities and how might they be applied to online communities and the creator economy today? Author Nadia Asparouhova joins host Sonal Choksi to talk about…
-
The Art and Science of Moderating Discussions
Whether it’s moderating a live panel discussion, managing your (virtual) All Hands meeting, or even guiding a cross-functional team to a decision in an important meeting, mastering the art of helping a group communicate is…
-
Tiktok’s Algorithm and Creativity Network Effects
What does the success of TikTok’s algorithmically-driven product tell us about the future of creators and the creator economy, product design, and innovation within video? In this cross-over archive episode from our tech news podcast,…
-
From Research to Startup, There and Back Again
In this episode from December 2018, Hennessy, currently the chairman of Alphabet as well as Turing Award-winning computer scientist, joins a16z co-founder Marc Andreessen, a16z general partner Martin Casado, and host Sonal Choksi for a…
-
Crisis Communications 101
In this hallway-style conversation with a16z’s Margit Wennmachers, longtime operating partner for Marketing, and Kim Milosevich, CMO for a16z crypto, open up the black box of crisis communications with Sonal Choksi and explore the process and…
-
All About Synthetic Biology
Over the last 20 years, the idea of “designing biology” has gone from science fiction to just science, as the field of synthetic biology has exploded, with applications from therapeutics to manufacturing and more. In…
-
Mining the Data for Cobalt
In this episode from July 2019, Kurt House, CEO and co-founder of Kobold Metals, John Thompson, professor of earth and geosciences at Cornell; and Connie Chan, a16z general partner for consumer, talk with editorial partner…
-
Applying AI in B2B
In this episode from October 2019, People.AI founder and CEO Oleg Rogynskyy and a16z partner Peter Lauten discuss with Das Rush about what the rise of AI in B2B means for enterprises, workers, and startups.…
-
More from Less: The Environment, Capitalism, and Technology
In this episode from October 2019, a16z co-founder Marc Andreessen and former a16z podcast showrunner Sonal Choksi bring on MIT economist and bestselling author Andrew McAfee to discuss why the lessons of human growth in…