a16z Podcast
Vishal Misra returns to explain his latest research on how LLMs actually work under the hood. He walks through experiments showing that transformers update their predictions in a precise, mathematically predictable way as they process new information, explains why this still doesn’t mean they’re conscious, and describes what’s actually required for AGI: the ability to keep learning after training and the move from pattern matching to understanding cause and effect.
Resources:
Follow Vishal Misra on X: https://x.com/vishalmisra
Follow Martin Casado on X: https://x.com/martin_casado
Stay Updated:
Find a16z on YouTube: YouTube
Find a16z on X
Find a16z on LinkedIn
Listen to the a16z Show on Spotify
Listen to the a16z Show on Apple Podcasts
Follow our host: https://twitter.com/eriktorenberg
Please note that the content here is for informational purposes only; should NOT be taken as legal, business, tax, or investment advice or be used to evaluate any investment or security; and is not directed at any investors or potential investors in any a16z fund. a16z and its affiliates may maintain investments in the companies discussed. For more details please see a16z.com/disclosures.
Hosted by Simplecast, an AdsWizz company. See pcm.adswizz.com for information about our collection and use of personal data for advertising.
-
On Food As Medicine (A Holiday Snack)
What happens if we treat food as a medicine in the healthcare system: How, where, and who (pays)? What role can technology play in increasing access, distribution, and more? General partner Julie Yoo talks with…
-
Crypto Creators: On Art Galleries to ‘Tokenized’ Collectibles
This episode features Q&As with two artists who are exploring crypto-powered auction sites and marketplaces – this is part of our ongoing series on the creator economy. The big picture is that emerging “tokenization” models,…
-
What to Know about Those Vaccines
A vaccine for COVID seems to be (almost) here… or is it? What’s hype/ what’s real beyond the headlines (and beyond the press release), when it comes to the announcement last week from Pfizer and…
-
The Social Serendipity of Cloud Gaming
True cloud-native games—those exclusive to and solely playable within the cloud—are poised to revolutionize gameplay and unlock new avenues of hyper-personalized storytelling and socializing. It’s a vision that, though steadily advancing, is still in its…
-
The Great Data Debate
Lakes v. warehouses, analytics v. AI/ML, SQL v. everything else… As the technical capabilities of data lakes and data warehouses converge, are the separate tools and teams that run AI/ML and analytics converging as well?…
-
How to Moderate Talks, Panels, Meetings, More (Virtual and Beyond!)
How to moderate good, productive discussions and navigate tricky conversations is top of mind — whether doing a panel, conducting a live event, presenting a talk (or hosting a podcast), managing (and even just participating…
-
Textiles as Tech, Science, Math, Culture… or Civilization
“The most profound technologies are those that disappear. They weave themselves into the fabric of everyday life until they’re indistinguishable from it.” That quote from computer scientist Mark Weiser is from a 1991 paper where…
-
Data Alone Is Not Enough: The Evolution of Data Architectures
Data, data, data – it’s long been a buzzword in the industry, whether big data, streaming data, data analytics, data science, even AI & machine learning — but data alone is not enough: it takes…
-
Designing for, Marketing to, and Partnering With Gen Z
Gen Z—those born between 1995 and 2010—now makes up 35 percent of the population and represent $143 billion dollars in spending power. This episode is all about how brands can better understand, collaborate with, and…
-
The Present Future of Audio: Talk, Music, Video, Interactivity
We’ve already talked a lot about podcasting, both evolution of the industry as well as the form, but where are we going with the future of audio, more broadly? Can we borrow from the present…