a16z Podcast
Inferact is a new AI infrastructure company founded by the creators and core maintainers of vLLM. Its mission is to build a universal, open-source inference layer that makes large AI models faster, cheaper, and more reliable to run across any hardware, model architecture, or deployment environment. Together, they broke down how modern AI models are actually run in production, why “inference” has quietly become one of the hardest problems in AI infrastructure, and how the open-source project vLLM emerged to solve it. The conversation also looked at why the vLLM team started Inferact and their vision for a universal inference layer that can run any model, on any chip, efficiently.
Follow Matt Bornstein on X: https://twitter.com/BornsteinMatt
Follow Simon Mo on X: https://twitter.com/simon_mo_
Follow Woosuk Kwon on X: https://twitter.com/woosuk_k
Follow vLLM on X: https://twitter.com/vllm_project
Stay Updated:
Find a16z on X
Find a16z on LinkedIn
Listen to the a16z Show on Spotify
Listen to the a16z Show on Apple Podcasts
Follow our host: https://twitter.com/eriktorenberg
Please note that the content here is for informational purposes only; should NOT be taken as legal, business, tax, or investment advice or be used to evaluate any investment or security; and is not directed at any investors or potential investors in any a16z fund. a16z and its affiliates may maintain investments in the companies discussed. For more details please see a16z.com/disclosures.
Hosted by Simplecast, an AdsWizz company. See pcm.adswizz.com for information about our collection and use of personal data for advertising.
-
Best Clips of 2022
We’ve had some incredible guests join us on the a16z podcast this year, ranging from moonshot entrepreneurs, to top creators, to some of the most forward thinking technologists – all of which are busy shaping…
-
Pay Without Borders with Deel, GitLab, and Safetywing
The predecessor to the office was Florence’s Uffizi Gallery – an admin building to the Medici mercantile empire. That was in… 1560. In the centuries to come, work was revolutionized, with perhaps the most well-known…
-
Carbon Solutions Now and Next: From Biomass to Mineralization
In this episode, we tackle three carbon removal projects of varying scale, business models, and technical challenges. Biomass pyrolysis via Charm Industrial An electrochemical process via Travertine Mineralization via 44.01 We cover these companies through…
-
Ben Horowitz and Brian Armstrong on Building and Overcoming the Hard Things
If you’ve been following the news, you’ve probably heard of the recent FTX scandal. While there’s much still unknown, in this episode we get the unique opportunity to hear from Brian Armstrong – co-founder and…
-
Building a Marketplace for Carbon
In part 1 of our carbon removal series, we talked to Nan Ransohoff — Head of Climate at Stripe — about what it might take to jumpstart the market of carbon removal solutions. But what…
-
The Economics of Carbon Removal with Nan Ransohoff
What happens when there’s demand for a solution that doesn’t quite exist yet? Today, we bring on Nan Ransohoff to talk about this exact problem as it relates to carbon removal, and how Frontier —…
-
Ryan Petersen on Rearchitecting the Supply Chain
In today’s episode, we have a special treat. Flexport’s co-CEO and Founder, Ryan Petersen, chats with a16z Growth Editor Das Rush. They start with the question of why Ryan has chosen – of all the…
-
Neal Stephenson on The Future of the Metaverse
When Neal Stephenson coined “the metaverse” three decades ago, his book Snow Crash was found on the shelves of “science fiction”. While the book remains in that category, many of its concepts are now found…
-
The Factory of the Future with Chris Power
Today, we have an episode with Chris Power, the founder and CEO of Hadrian. Hadrian is a company trying to build the most efficient factories on the planet. In this conversation, we’ll introduce the audience…
-
Balaji Srinivasan on The Network State
In this episode, we’ll explore the concept of The Network State with Balaji Srinivasan. As the world becomes more digital, it also becomes more distributed. This is obvious on the individual level – how you…