a16z Podcast
In this episode, a16z GP Martin Casado sits down with Sherwin Wu, Head of Engineering for the OpenAI Platform, to break down how OpenAI organizes its platform across models, pricing, and infrastructure, and how it is shifting from a single general-purpose model to a portfolio of specialized systems, custom fine-tuning options, and node-based agent workflows.
They get into why developers tend to stick with a trusted model family, what builds that trust, and why the industry moved past the idea of one model that can do everything. Sherwin also explains the evolution from prompt engineering to context design and how companies use OpenAI’s fine-tuning and RFT APIs to shape model behavior with their own data.
Highlights from the conversation include:
• How OpenAI balances a horizontal API platform with vertical products like ChatGPT
• The evolution from Codex to the Composer model
• Why usage-based pricing works and where outcome-based pricing breaks
• What the Harmonic Labs and Rockset acquisitions added to OpenAI’s agent work
• Why the new agent builder is deterministic, node based, and not free roaming
Resources:
Follow Sherwin on X: https://x.com/sherwinwu
Follow Martin on X: https://x.com/martin_casado
Stay Updated:
If you enjoyed this episode, be sure to like, subscribe, and share with your friends!
Find a16z on X: https://x.com/a16z
Find a16z on LinkedIn: https://www.linkedin.com/company/a16z
Listen to the a16z Podcast on Spotify: https://open.spotify.com/show/5bC65RDvs3oxnLyqqvkUYX
Listen to the a16z Podcast on Apple Podcasts: https://podcasts.apple.com/us/podcast/a16z-podcast/id842818711
Follow our host: https://x.com/eriktorenberg
Please note that the content here is for informational purposes only; should NOT be taken as legal, business, tax, or investment advice or be used to evaluate any investment or security; and is not directed at any investors or potential investors in any a16z fund. a16z and its affiliates may maintain investments in the companies discussed. For more details please see http://a16z.com/disclosures
Stay Updated:
Find a16z on X
Find a16z on LinkedIn
Listen to the a16z Podcast on Spotify
Listen to the a16z Podcast on Apple Podcasts
Follow our host: https://twitter.com/eriktorenberg
Please note that the content here is for informational purposes only; should NOT be taken as legal, business, tax, or investment advice or be used to evaluate any investment or security; and is not directed at any investors or potential investors in any a16z fund. a16z and its affiliates may maintain investments in the companies discussed. For more details please see a16z.com/disclosures.
Hosted by Simplecast, an AdsWizz company. See pcm.adswizz.com for information about our collection and use of personal data for advertising.
-
Designing a Culture of Reinvention
In this episode from September 2020, originally recorded for the Commonwealth Club of California, Netflix CEO and co-founder Reed Hasting talks about his new book “No Rules Rules: Netflix and the Culture of Reinvention” with…
-
The Basics of Growth Marketing: Engagement & Retention
After achieving product-market fit and starting to gain users, how do startups then avoid the “leaky bucket” problem of losing users as quickly as they gained them? By focusing on user engagement and retention, startups…
-
The Basics of Growth Marketing: User Acquisition
Once known as “growth hacking”, the concept of Growth has now evolved into an entire discipline that spans marketing, product management, user experience, and more. Why? After achieving product-market fit, startups need to capitalize quickly…
-
The Great Data Debate
Over a decade after the idea of “big data” was first born, data has become the central nervous system for decision-making in organizations of all sizes. But the modern data stack is evolving and which…
-
Principles for Work and Life
In the face of great uncertainty, how do you make decisions? Can you really apply the lessons of the past to the present and the future, to navigate seemingly new situations and get what you…
-
How the Internet Happened
In his book (and podcast), Brian McCullough chronicles the history and evolution of the internet — from college kids in a basement and the dot-com boom, to the applications built on top of it and…
-
Technologies & Threads Through the Fabric of Our Lives
original episode notes and transcript here: https://future.a16z.com/podcasts/textiles-technology-science-math-cultures-civilization/ Longtime podcast showrunner (2014-2022), primary host, and editor Sonal Chokshi shares three best-of episodes as she shifts gears and the show goes on hiatus until relaunched with a…
-
Innovating and Deciding, for Companies and People
original episode notes and transcript here: https://future.a16z.com/podcasts/innovating-in-bets/ Longtime podcast showrunner (2014-2022), primary host, and editor Sonal Chokshi shares three best-of episodes as she shifts gears and the show goes on hiatus until relaunched with a…
-
Geo-engineering and the Power of Narrative
original episode notes and transcript here: https://future.a16z.com/podcasts/pleistocenepark-geoengineering-iceagebiome/ Longtime podcast showrunner (2014-2022), primary host, and editor Sonal Chokshi shares three best-of episodes as she shifts gears and the show goes on hiatus until relaunched with a…
-
M&A, Before and After: What Founders Need to Know
Welcome to the a16z podcast. Today we’re talking about the mindsets and frameworks founders should know about when navigating the mergers and acquisitions or M&A process, both before and after – including how to think…