a16z Podcast
Vishal Misra returns to explain his latest research on how LLMs actually work under the hood. He walks through experiments showing that transformers update their predictions in a precise, mathematically predictable way as they process new information, explains why this still doesn’t mean they’re conscious, and describes what’s actually required for AGI: the ability to keep learning after training and the move from pattern matching to understanding cause and effect.
Resources:
Follow Vishal Misra on X: https://x.com/vishalmisra
Follow Martin Casado on X: https://x.com/martin_casado
Stay Updated:
Find a16z on YouTube: YouTube
Find a16z on X
Find a16z on LinkedIn
Listen to the a16z Show on Spotify
Listen to the a16z Show on Apple Podcasts
Follow our host: https://twitter.com/eriktorenberg
Please note that the content here is for informational purposes only; should NOT be taken as legal, business, tax, or investment advice or be used to evaluate any investment or security; and is not directed at any investors or potential investors in any a16z fund. a16z and its affiliates may maintain investments in the companies discussed. For more details please see a16z.com/disclosures.
Hosted by Simplecast, an AdsWizz company. See pcm.adswizz.com for information about our collection and use of personal data for advertising.
-
Carbon Solutions Now and Next: From Biomass to Mineralization
In this episode, we tackle three carbon removal projects of varying scale, business models, and technical challenges. Biomass pyrolysis via Charm Industrial An electrochemical process via Travertine Mineralization via 44.01 We cover these companies through…
-
Ben Horowitz and Brian Armstrong on Building and Overcoming the Hard Things
If you’ve been following the news, you’ve probably heard of the recent FTX scandal. While there’s much still unknown, in this episode we get the unique opportunity to hear from Brian Armstrong – co-founder and…
-
Building a Marketplace for Carbon
In part 1 of our carbon removal series, we talked to Nan Ransohoff — Head of Climate at Stripe — about what it might take to jumpstart the market of carbon removal solutions. But what…
-
The Economics of Carbon Removal with Nan Ransohoff
What happens when there’s demand for a solution that doesn’t quite exist yet? Today, we bring on Nan Ransohoff to talk about this exact problem as it relates to carbon removal, and how Frontier —…
-
Ryan Petersen on Rearchitecting the Supply Chain
In today’s episode, we have a special treat. Flexport’s co-CEO and Founder, Ryan Petersen, chats with a16z Growth Editor Das Rush. They start with the question of why Ryan has chosen – of all the…
-
Neal Stephenson on The Future of the Metaverse
When Neal Stephenson coined “the metaverse” three decades ago, his book Snow Crash was found on the shelves of “science fiction”. While the book remains in that category, many of its concepts are now found…
-
The Factory of the Future with Chris Power
Today, we have an episode with Chris Power, the founder and CEO of Hadrian. Hadrian is a company trying to build the most efficient factories on the planet. In this conversation, we’ll introduce the audience…
-
Balaji Srinivasan on The Network State
In this episode, we’ll explore the concept of The Network State with Balaji Srinivasan. As the world becomes more digital, it also becomes more distributed. This is obvious on the individual level – how you…
-
Why Technology Still Matters with Marc Andreessen
With much coverage of technology lined with pessimism, the a16z Podcast returns to highlight the bright side of technology, alongside the founders building it. But before featuring the solutions in progress, we wanted to explore…
-
The Data Highway Above with Privateer’s Steve Wozniak, Alex Fielding, and Dr. Moriba Jah
Many people consider space to be the next frontier and equally an infinite horizon to explore. But the reality is that not all “space” is the same and there are strategic zones that don’t only…