a16z Podcast
Vishal Misra returns to explain his latest research on how LLMs actually work under the hood. He walks through experiments showing that transformers update their predictions in a precise, mathematically predictable way as they process new information, explains why this still doesn’t mean they’re conscious, and describes what’s actually required for AGI: the ability to keep learning after training and the move from pattern matching to understanding cause and effect.
Resources:
Follow Vishal Misra on X: https://x.com/vishalmisra
Follow Martin Casado on X: https://x.com/martin_casado
Stay Updated:
Find a16z on YouTube: YouTube
Find a16z on X
Find a16z on LinkedIn
Listen to the a16z Show on Spotify
Listen to the a16z Show on Apple Podcasts
Follow our host: https://twitter.com/eriktorenberg
Please note that the content here is for informational purposes only; should NOT be taken as legal, business, tax, or investment advice or be used to evaluate any investment or security; and is not directed at any investors or potential investors in any a16z fund. a16z and its affiliates may maintain investments in the companies discussed. For more details please see a16z.com/disclosures.
Hosted by Simplecast, an AdsWizz company. See pcm.adswizz.com for information about our collection and use of personal data for advertising.
-
Tracking the Trends: AI, WebRTC, Crypto, and Full Stack Startups
Today’s episode is a conversation about four big trends in the tech world. Any one of these trends would be notable on its own, but we cover all four in this hallway-style chat, as a16z…
-
How to Decide, Convey vs. Convince, & More
It seems like investors are especially obsessed with the psychology of decision making — high stakes, after all — but all kinds of decisions, whether in life or business — like dating, product management, what…
-
Fintech for Gen Z and Millennials
Millennials and Gen Z have been hard-hit by the one-two punch of the 2008 and 2020 financial crises. That experience has radically shaped their approach to finances and their mindset around credit and debt. This…
-
Degrading Drugs for Problem Proteins: Journal Club now on Bio Eats World (ep 2)
Welcome to the second episode of Bio Eats World, a brand new podcast all about how biology is technology. Bio is breaking out of the lab and clinic and into our daily lives — on…
-
The Biology of Aging: Introducing Bio Eats World (ep 1)
Welcome to the first episode of Bio Eats World, a brand new podcast all about how biology is technology. Bio is breaking out of the lab and clinic and into our daily lives — on…
-
TikTok & Beyond: The Algorithm Question, The Future of Product
With the U.S. tech partnership for TikTok being finalized, what happens if source code is excluded (and more specifically, the For You Page algorithm), given China’s revised export controls? But more broadly — well beyond…
-
The New Fan Club: Creators, Fans, and the Power of Markets (& Crypto)
Today’s episode, part two in our two-part series on the Creator Economy, focuses on the new potential revenue streams and fan-engagement models opened up by emerging decentralized technology. It’s a new type of fan club,…
-
So You Want to Launch a Newsletter: Tips From Substack Writers
This episode, part one in a two-part series on the Creator Economy, explores the process and economics behind creating an independent newsletter. In this candid conversation, host Lauren Murrow talks with four Substack writers—an artist,…
-
Designing a Culture of Reinvention
Since Netflix started in the late 90s as a DVD-by-mail rental service competing with Blockbuster, it has completely reinvented itself… twice – first, when it went from DVD rental to video streaming platform, and then…
-
Heroes & Myths in Entrepreneurship — Guy Raz
“I’m in a movie, but it’s the wrong movie.” For better or for worse, we tell the story of entrepreneurs as one of the mythical hero’s journey: that’s there’s a call, a test (multiple tests!),…