a16z Podcast
Vishal Misra returns to explain his latest research on how LLMs actually work under the hood. He walks through experiments showing that transformers update their predictions in a precise, mathematically predictable way as they process new information, explains why this still doesn’t mean they’re conscious, and describes what’s actually required for AGI: the ability to keep learning after training and the move from pattern matching to understanding cause and effect.
Resources:
Follow Vishal Misra on X: https://x.com/vishalmisra
Follow Martin Casado on X: https://x.com/martin_casado
Stay Updated:
Find a16z on YouTube: YouTube
Find a16z on X
Find a16z on LinkedIn
Listen to the a16z Show on Spotify
Listen to the a16z Show on Apple Podcasts
Follow our host: https://twitter.com/eriktorenberg
Please note that the content here is for informational purposes only; should NOT be taken as legal, business, tax, or investment advice or be used to evaluate any investment or security; and is not directed at any investors or potential investors in any a16z fund. a16z and its affiliates may maintain investments in the companies discussed. For more details please see a16z.com/disclosures.
Hosted by Simplecast, an AdsWizz company. See pcm.adswizz.com for information about our collection and use of personal data for advertising.
-
From Silicon Valley to the Pentagon: The Future of Defense Innovation
The last few decades have been a period of transition for defense. An increasing number of startups have begun to rival large defense primes, the industry has gradually become a calculus of both hardware and…
-
What is American Dynamism?
American Dynamism. A term coined by a16z General Partner, Katherine Boyle, two years ago, when she and David Ulevitch founded the firm’s American Dynamism investing practice. Beyond a sector or movement, American Dynamism embodies innovation,…
-
The Quest for True Signal: How Zynga Spotted Mobile
You might recognize the name Mark Pincus but we almost guarantee you recognize the game Farmville. Mark Pincus is the founder and longtime CEO of Zynga, known for its massive global franchise of games, including…
-
Beyond Uncanny Valley: Breaking Down Sora
In early 2024, the notion of high fidelity, believable AI-generated video seemed a distant future to many. Yet, a mere few weeks into the year, OpenAI unveiled Sora, its new state of the art text-to-video…
-
Fraying Wires: The Decentralization of the Electric Grid
The electric grid needs an update. In this explainer, a16z Partner Ryan McEntush discusses the escalating complexity of the grid, unveils its vulnerabilities, and traces the evolutionary path that has led us to this point.…
-
Fixing Higher Education & New Startup Opportunities with Marc and Ben
“The Ben & Marc Show” features a16z’s co-founders Ben Horowitz & Marc Andreessen. In this episode, Marc and Ben continue their in-depth exploration of the current education system. While Part I of their discussion unpacked…
-
Read Write Own: A New Era
with @cdixon @rhhackett Welcome to the web3 with a16z crypto podcast. I’m Robert Hackett, an editor here at a16z crypto, and I’m here with Chris Dixon, founding partner of a16z crypto and author of the…
-
The What, Who, and When with IPOs
In 2022 and 2023, US IPOs hit decade lows after the record high of 2021. Now, in 2024, will the IPO window reopen? In this episode, we revisit a conversation with Jeff Jordan, former CEO…
-
Jobs of the Future
(00:00) – The Future of Jobs (03:15) – Job growth over the last 80 years (05:06) – The shelf-life of jobs (09:11) – Education trends (12:25) – The importance of learning the foundations (17:18) –…
-
Introducing Raising Health: Fireside Chat with Sean Duffy
Big news from a16z: Bio Eats World, our sibling show from a16z Bio+Health, is now Raising Health! We’re excited to share Raising Health’s first episode here where Sean Duffy, cofounder and CEO of Omada Health,…