a16z Podcast
Vishal Misra returns to explain his latest research on how LLMs actually work under the hood. He walks through experiments showing that transformers update their predictions in a precise, mathematically predictable way as they process new information, explains why this still doesn’t mean they’re conscious, and describes what’s actually required for AGI: the ability to keep learning after training and the move from pattern matching to understanding cause and effect.
Resources:
Follow Vishal Misra on X: https://x.com/vishalmisra
Follow Martin Casado on X: https://x.com/martin_casado
Stay Updated:
Find a16z on YouTube: YouTube
Find a16z on X
Find a16z on LinkedIn
Listen to the a16z Show on Spotify
Listen to the a16z Show on Apple Podcasts
Follow our host: https://twitter.com/eriktorenberg
Please note that the content here is for informational purposes only; should NOT be taken as legal, business, tax, or investment advice or be used to evaluate any investment or security; and is not directed at any investors or potential investors in any a16z fund. a16z and its affiliates may maintain investments in the companies discussed. For more details please see a16z.com/disclosures.
Hosted by Simplecast, an AdsWizz company. See pcm.adswizz.com for information about our collection and use of personal data for advertising.
-
On Monetizing Community with Patreon Cofounder Sam Yam
It’s clear from the growth of Patreon, Substack, TikTok, Clubhouse and many more that the power of the Creator Economy continues to build. These platforms share one thing in common: They all enable independent creators to…
-
The Creator Economy: NFTs and Beyond
In today’s episode of the a16z Podcast, we’re talking about the Creator Economy, and how NFTs (but not just NFTS!) are making it possible for artists, musicians, videogamers, game developers, and writers to create entirely…
-
All about NFTs
This episode is all about NFTs. It seems like nothing has caught on and spread into mainstream interest like NFTs, where one hears everything from “I’ve never seen anything like this before” to “is this…
-
The Next Wave of Marketplace Startups
In the tech world, marketplaces are a hot topic. That term—marketplace—encompasses a huge swath of services we use every day, from grocery delivery to online shopping to remote learning. How have marketplace dynamics changed since…
-
The Third Vaccine, and Vaccine Choice
https://a16z.com/2021/03/15/16-minutes-58-the-johnson-johnson-vaccine-and-covid-efficacy-rates/
-
Companies & Culture: What You Do Is Who You Are
This podcast — which was recorded at the Computer History Museum in a live event, before the pandemic (first published in December 2019) is all about how companies create culture: A lot’s changed… and a…
-
Boss Talk with Ben Horowitz
Boss Talk is a weekly live show on Clubhouse, where a16z cofounder Ben Horowitz and Databricks CEO Ali Ghodsi discuss CEO stuff, leadership stuff, management stuff… you know, boss stuff. Here we share the second…
-
All About Ransomware
In just the last couple years, ransomware has grown into a multibillion dollar industry. It has evolved from taking systems and servers hostage to stealing data, and it has proven capable of shutting down global…
-
One on One with Marc and Ben
On social audio app Clubhouse, Marc Andreessen and Ben Horowitz are hosting a new live show called “One on One with A and Z”, where they go deep on questions submitted via Twitter. The show…
-
Amazon Narratives: Memos, Working Backwards from Release, More
When you hear stories about Amazon’s “invention machine” — which led to a company with not just one or two products but several successful diverse lines of business — we often hear about things like:…