a16z Podcast
In this episode, a16z GP Martin Casado sits down with Sherwin Wu, Head of Engineering for the OpenAI Platform, to break down how OpenAI organizes its platform across models, pricing, and infrastructure, and how it is shifting from a single general-purpose model to a portfolio of specialized systems, custom fine-tuning options, and node-based agent workflows.
They get into why developers tend to stick with a trusted model family, what builds that trust, and why the industry moved past the idea of one model that can do everything. Sherwin also explains the evolution from prompt engineering to context design and how companies use OpenAI’s fine-tuning and RFT APIs to shape model behavior with their own data.
Highlights from the conversation include:
• How OpenAI balances a horizontal API platform with vertical products like ChatGPT
• The evolution from Codex to the Composer model
• Why usage-based pricing works and where outcome-based pricing breaks
• What the Harmonic Labs and Rockset acquisitions added to OpenAI’s agent work
• Why the new agent builder is deterministic, node based, and not free roaming
Resources:
Follow Sherwin on X: https://x.com/sherwinwu
Follow Martin on X: https://x.com/martin_casado
Stay Updated:
If you enjoyed this episode, be sure to like, subscribe, and share with your friends!
Find a16z on X: https://x.com/a16z
Find a16z on LinkedIn: https://www.linkedin.com/company/a16z
Listen to the a16z Podcast on Spotify: https://open.spotify.com/show/5bC65RDvs3oxnLyqqvkUYX
Listen to the a16z Podcast on Apple Podcasts: https://podcasts.apple.com/us/podcast/a16z-podcast/id842818711
Follow our host: https://x.com/eriktorenberg
Please note that the content here is for informational purposes only; should NOT be taken as legal, business, tax, or investment advice or be used to evaluate any investment or security; and is not directed at any investors or potential investors in any a16z fund. a16z and its affiliates may maintain investments in the companies discussed. For more details please see http://a16z.com/disclosures
Stay Updated:
Find a16z on X
Find a16z on LinkedIn
Listen to the a16z Podcast on Spotify
Listen to the a16z Podcast on Apple Podcasts
Follow our host: https://twitter.com/eriktorenberg
Please note that the content here is for informational purposes only; should NOT be taken as legal, business, tax, or investment advice or be used to evaluate any investment or security; and is not directed at any investors or potential investors in any a16z fund. a16z and its affiliates may maintain investments in the companies discussed. For more details please see a16z.com/disclosures.
Hosted by Simplecast, an AdsWizz company. See pcm.adswizz.com for information about our collection and use of personal data for advertising.
-
Working, Making, Creating in Public… and Private
We’re living in an unprecedented era of online collaboration, coordination, and creation. All kinds of people are coming together — whether in an open source project or company, an R&D initiative, a department in a…
-
GPT-3: What’s Hype, What’s Real on the Latest in AI
In this episode — cross posted from our 16 Minutes show feed — we cover all the buzz around GPT-3, the pre-trained machine learning model from OpenAI that’s optimized to do a variety of natural-language…
-
Taking the Pulse on Medical Device Security
Many don’t realize we even need to think about the possibility of security hacks when it comes to things like pacemakers, insulin pumps, and more. But when bits and bytes meet flesh and blood, security…
-
Journal Club: A New Path to Antibiotic Resistance
Ever since the discovery of antibiotics, microbiologists have worried about and studied how bacteria acquire resistance to these drugs. Adding to the complexity of this problem is the fact that it is not always clear…
-
Cybercrime, Incorporated
A dive into the sociological, operational, and tactical realities of this murky underworld, Lusthaus and de la Garza discuss who the players are, what they are motivated by, and specialize in—as well as how basic…
-
How Transparent Pricing Drives Healthcare Change
Dr. Marty Makary—surgical oncologist at Johns Hopkins University School of Medicine, and health policy and innovation expert—has long been a passionate advocate for transparent pricing in the healthcare system. We don’t talk enough (or really…
-
Preserving Digital History: How to Close the Web’s ‘Memory Hole’
More than 98% of the information on the web is lost within 20 years, and huge gaps exist in our digital and cultural history. Zoran Basich and Alex Pruden of a16z talk to Brewster Kahle…
-
Alex Honnold on Human Performance (part 2) – Climbing and Entrepreneurship
In part 1 of our series on human performance, we looked at the limits of human potential in climbing and other sports – and how we push those limits through technology and training. In this…
-
Alex Honnold on Human Performance (part 1) – Where’s the Limit?
Is there a limit to what humans can do? And if so, how do you know when you’ve reached it? Welcome to part one of a two-part series on human performance with professional rock climber…
-
Why We Shouldn’t Fear AI in Healthcare
“Why We Shouldn’t Fear the ‘Black Box’ of AI (in Healthcare and Everywhere)” by Vijay Pande. First published in the New York Times, January 2018. You can also find and share this article at a16z.com/aidoctor