a16z Podcast
Vishal Misra returns to explain his latest research on how LLMs actually work under the hood. He walks through experiments showing that transformers update their predictions in a precise, mathematically predictable way as they process new information, explains why this still doesn’t mean they’re conscious, and describes what’s actually required for AGI: the ability to keep learning after training and the move from pattern matching to understanding cause and effect.
Resources:
Follow Vishal Misra on X: https://x.com/vishalmisra
Follow Martin Casado on X: https://x.com/martin_casado
Stay Updated:
Find a16z on YouTube: YouTube
Find a16z on X
Find a16z on LinkedIn
Listen to the a16z Show on Spotify
Listen to the a16z Show on Apple Podcasts
Follow our host: https://twitter.com/eriktorenberg
Please note that the content here is for informational purposes only; should NOT be taken as legal, business, tax, or investment advice or be used to evaluate any investment or security; and is not directed at any investors or potential investors in any a16z fund. a16z and its affiliates may maintain investments in the companies discussed. For more details please see a16z.com/disclosures.
Hosted by Simplecast, an AdsWizz company. See pcm.adswizz.com for information about our collection and use of personal data for advertising.
-
Read-Alouds, Continued
Today we’re continuing a series we started a while ago of read-alouds (for more context on the why and why now check out episode #500 on how we podcast!). The first was episode #544 in…
-
Journal Club: Revisiting Eroom’s Law
Eroom’s Law is Moore’s Law spelled backwards. It’s a term that was coined in a Nature Reviews Drug Discovery article by researchers at Sanford Bernstein and describes the exponential decrease in biopharma research and development…
-
Preventing Pandemics with Genomic Epidemiology
The COVID-19 pandemic has increased the visibility of scientists and the scientific process to the broader public; suddenly, scientists working on virology and infectious disease dynamics have seen their public profiles rapidly expand. One such…
-
Journal Club: Therapeutic Video Game on Trial
In this episode of the a16z bio journal club, we cover one of the key clinical trials that supported the recent FDA approval of the first prescription video game. The game was developed by Akili…
-
Gross Margins, Early to Late: What They Do (and Don’t) Tell You
Gross margins are essentially a company’s revenue from products and services minus the costs to deliver those products and services to customers, and it’s one of the most important financial metrics a startup can track.…
-
Gross Margins, Early to Late: What They Do (and Don’t) Tell You
Gross margins are essentially a company’s revenue from products and services minus the costs to deliver those products and services to customers, and it’s one of the most important financial metrics a startup can track.…
-
Building Products for Power Users
As more digital natives have entered the workplace, they have brought with them the expectation that their software should both be a joy to use and allow them to be power users. That is, users…
-
Building Products for Power Users
As more digital natives have entered the workplace, they have brought with them the expectation that their software should both be a joy to use and allow them to be power users. That is, users…
-
Journal Club: Building a Better Chloroplast
In this episode of the a16z bio Journal Club, bio deal team partner Judy Savitskaya and Lauren Richardson discuss research that aims to enhance the efficiency of photosynthesis and carbon fixation. These two processes are…
-
Real Estate in a Pandemic: Renters and Landlords (Part 2)
This episode is the second in a two-part series that examines the pandemic’s impact on real estate. Part 1 focused on prospective home buyers, sellers, and existing homeowners. This episode, Part 2, addresses renters and…