a16z Podcast
Inferact is a new AI infrastructure company founded by the creators and core maintainers of vLLM. Its mission is to build a universal, open-source inference layer that makes large AI models faster, cheaper, and more reliable to run across any hardware, model architecture, or deployment environment. Together, they broke down how modern AI models are actually run in production, why “inference” has quietly become one of the hardest problems in AI infrastructure, and how the open-source project vLLM emerged to solve it. The conversation also looked at why the vLLM team started Inferact and their vision for a universal inference layer that can run any model, on any chip, efficiently.
Follow Matt Bornstein on X: https://twitter.com/BornsteinMatt
Follow Simon Mo on X: https://twitter.com/simon_mo_
Follow Woosuk Kwon on X: https://twitter.com/woosuk_k
Follow vLLM on X: https://twitter.com/vllm_project
Stay Updated:
Find a16z on X
Find a16z on LinkedIn
Listen to the a16z Show on Spotify
Listen to the a16z Show on Apple Podcasts
Follow our host: https://twitter.com/eriktorenberg
Please note that the content here is for informational purposes only; should NOT be taken as legal, business, tax, or investment advice or be used to evaluate any investment or security; and is not directed at any investors or potential investors in any a16z fund. a16z and its affiliates may maintain investments in the companies discussed. For more details please see a16z.com/disclosures.
Hosted by Simplecast, an AdsWizz company. See pcm.adswizz.com for information about our collection and use of personal data for advertising.
-
AI Will Save The World with Marc Andreessen and Martin Casado
This week, a16z’s own cofounder Marc Andreessen published a nearly 7,000-word article that aimed to dispel fears over AI’s risks to our humanity – both real and imagined. Instead, Marc elaborates on how AI can…
-
The Hard Things About Scaling: Executive Hiring with Ben Horowitz and Ali Ghodsi
The holy grail of company building is finding product-market fit. But what most people don’t tell you is that once you’ve found it, product-market fit brings its own set of challenges, particularly when it comes…
-
The Electrification of Everything: From Sky to Sea
Demand for electric cars is booming. More than 10 million electric cars were sold worldwide in 2022, and consumer behavior is changing as more people embrace alternative and sustainable modes of mobility. While the electrification…
-
The Future of Cheese
Today’s episode is with Magi Richani, founder and CEO of Nobell Foods. She is joined by a16z Bio + Health general partner Vijay Pande. Together, they talk about the details of engineering plants to create…
-
The Rise of the Exponential Organization
Many companies today are grappling with a few things: an economic downturn, potential layoffs and restructuring, and trying to keep up with the latest tech trends… all while still maintaining a growth trajectory. In this…
-
How Fintech is Reshaping Our $4T Healthcare Industry
In this episode, you’ll hear directly from 6 founders trying to reinvent the healthcare system with the help of Fintech. They’re tackling everything from the lack of price transparency, the complexity of billing, getting clinics…
-
Embedding AI: The Questions Every CEO is Asking
2022 was a breakout year for AI. While machine learning had already been integrated into applications for millions of users, for many, these tools still felt like their first real-world encounter with AI. As AI…
-
When Two Giants Intersect: Healthcare Meets Fintech
Most people don’t need a reminder of the state of healthcare in America. But it’s not just the consumer that’s hurting. Medical debt is increasing, billions are lost in unpaid claims, hospitals are in the…
-
From Promise to Reality: Inside a16z’s Data and AI Forum
Nvidia’s CEO Jensen Huang declared in a recent keynote, “we are in the iPhone moment of AI.” This special episode will give you an inside look into a16z’s Data and AI Forum, hosted the day…
-
Beyond Avatars: How AI is Reshaping Online Identity
In a recent episode, we delved into the first wave of technology that was used to create digital influencers like ‘Lil Miquela back in 2016. Fast forward to today, we’re presented with a whole new…