Jobs of the Future, Harnessing Earth Observation, & Gaming Tech Advances

AI transcript
0:00:06 How do companies take the magic that happened when we all got up at 5 a.m. and
0:00:13 watched SpaceX catch a massive multi-storey rocket with chopsticks? Yeah.
0:00:18 Terabytes and terabytes come down from orbit every single day, soon to be
0:00:23 probably petabytes. We’re talking about job creation for a whole class of folks
0:00:27 that don’t necessarily need a degree to participate. All the technology exists
0:00:32 today to have that experience in an amazing, intuitive way, and yet it
0:00:36 doesn’t exist. What is the next generation water treatment engineer look
0:00:41 like? It’s someone that knows their way around the robot. In a matter of days,
0:00:48 we’ll say goodbye to 2024 and start 2025. It’s hard to believe. It’s been 25 years
0:00:53 since Y2K, 21 years since Facebook was founded, and even nearly 10 years since
0:00:57 OpenAI was brought to life. So if it feels like things are moving quickly,
0:01:02 you’re not alone. That’s why every year we ask our partners, who are meeting
0:01:05 every day with the people building our future, what they think is in store for
0:01:10 the following year. Last year, we predicted a new age of maritime
0:01:14 exploration, programming medicine’s final frontier, AI through schemes that
0:01:20 never end, democratizing miracle drugs, and on deck this year, we’ll be exploring
0:01:24 infrastructure, independence, and hyper centers. Super staffing for healthcare.
0:01:29 Regulation will become code. And throughout this four-part series, you’ll hear
0:01:34 from all over A16Z, including American Dynamism, healthcare, fintech, games, and
0:01:39 more. However, if you’d like to see the full list of 50 big ideas, head on over
0:01:46 to A16Z.com/bigideas. As a reminder, the content here is for informational
0:01:50 purposes only. Should not be taken as legal, business, tax, or investment advice,
0:01:54 or be used to evaluate any investment or security, and is not directed at any
0:01:59 investors or potential investors in any A16Z fund. Please note that A16Z and its
0:02:02 affiliates may also maintain investments in the companies discussed in this
0:02:09 podcast. For more details, including a link to our investments, please see A16Z.com/disposures.
0:02:19 Today, we focus on the increasingly interesting intersection of hardware and
0:02:24 software. Up first, we’re seeing a renaissance in technical disciplines that
0:02:28 cross the hardware software chasm. The robots are coming. Someone will have to
0:02:33 build, train, and service them. That was Aaron Price-Raid, a general partner on the
0:02:39 American Dynamism team. And here’s Aaron’s big idea. In the 2000s and 2010s, if you
0:02:44 weren’t coding, it seemed like you’d get left behind. The number of computer
0:02:48 science majors exploded while degree programs like mechanical engineering and
0:02:53 electrical engineering shrunk on a relative basis. Now we’re beginning to
0:02:57 see a crucial shift amid the push to reshore manufacturing, the mass
0:03:02 retirement of skilled workers across unsexy industries like water treatment,
0:03:08 commercial HVAC, and oil and gas, and the rise of autonomy across defense,
0:03:13 enterprise, and consumer applications. People are building physical things again.
0:03:18 It’s really exciting to see, and that’s going to require this full-stack skill set
0:03:22 of people who can cross the hardware software chasm. So I think we’ve really
0:03:28 seen over the last two decades a mass migration of engineers to the software
0:03:33 and computer industry. And what I think we’re going to see is huge demand for
0:03:38 engineers in areas like electrical engineering, mechanical engineering,
0:03:42 controls engineering, are going to be in really high demand over the coming year
0:03:49 as industries from defense to industrials, manufacturing, even things like HVAC
0:03:54 and water treatment are looking for people that are really ready to wrestle
0:03:59 with and bring AI software into these really complex hardware contexts.
0:04:03 Over the last few decades, we have seen a lot of people migrate to software,
0:04:07 and now maybe we’re seeing a shift. Can you speak to the macro trends that are
0:04:11 really underpinning that? I think the last 20 to 25 years has really been the
0:04:17 software’s eating the world, not to steal our own tagline, but it’s really true.
0:04:21 Most of the growth in the economy came from the software industry.
0:04:25 So with first the rise of software as a service, and then more recently
0:04:29 the kind of explosion of AI, the skill sets that have really been in demand
0:04:35 have been software focused. But with the kind of very recent crossing of the chasm
0:04:40 from software to hardware, there’s huge demand for engineers that can both speak
0:04:44 software and speak hardware. Yeah, and as we do feel this pivot back,
0:04:48 are you seeing that in the data when it comes to the degrees that people are
0:04:52 getting? Are people no longer getting software engineering degrees at the same
0:04:56 clip and maybe choosing to take a mechanical engineering degree, for example?
0:05:00 We’re not seeing that necessarily yet in degree programs, but we’re seeing that
0:05:04 in the demand in companies, and so I think that’s going to filter out into
0:05:09 what people end up studying in school. So the highest demand jobs in our portfolio
0:05:15 today, other than perhaps AI engineers, are people who have full stack
0:05:19 hardware and software experience, whether it’s mechanical, electrical, etc.
0:05:24 And what we’re finding is that actually those companies are having to go
0:05:28 outside of traditional tech feeder schools in order to find that talent.
0:05:34 So we’re actually seeing an interesting rise of schools like Georgia Tech,
0:05:38 Colorado School of Mines, University of Michigan. Some of these really hardcore
0:05:41 engineering programs are really coming into talent pipelines for some of our
0:05:44 top-tier tech companies in the portfolio, which is really interesting.
0:05:47 So interesting, and let’s actually touch on that specifically, this idea of
0:05:51 us needing all of these new kinds of engineers, some of them previously
0:05:55 existed, but there seems to be a gap, and there’s this question of who’s going
0:05:58 to train these people? Is it the four-year degree program? Is it something
0:06:01 different? There’s definitely a spectrum, and I would
0:06:04 frankly really credit Elon Musk, both from the SpaceX and Tesla perspective,
0:06:08 with a lot for really training up engineers that have fluency in hardware and
0:06:13 software. As more companies that are building physical things grow, companies
0:06:18 like Skydio and Andrel and others are really taking on that mantle and
0:06:22 training a new generation of full stack engineers that are really comfortable
0:06:26 and fluent across hardware and software. I do think the university systems or
0:06:32 some sort of education system has to catch up. I expect that schools like
0:06:35 Stanford and MIT have great engineering departments outside of computer
0:06:40 science programs. I’m hopeful that those programs will continue to grow as the
0:06:44 demand in the market continues to grow. And then I also think it’s not just
0:06:47 engineers with four-year degrees that are going to be valuable. Like we’re
0:06:52 talking about job creation for a whole class of folks that don’t necessarily
0:06:57 need a degree to participate in this sort of reshoring AI or autonomy-driven
0:07:02 hardware economy. So technicians who will help service
0:07:06 and test robots on the manufacturing floor. That is a
0:07:10 well-paid, secure job of the future, I think. Another example
0:07:14 that we’re really excited about is robotic tele-operation. So you have someone
0:07:18 remotely operating a robot in an environment where maybe it’s dangerous
0:07:22 or hard to get to or just really difficult to staff humans.
0:07:26 It’s really difficult doing robot tele-operation. It’s a valuable skill set.
0:07:29 I expect that there’ll be an entire kind of class
0:07:33 of jobs related to that arising over the next few years. And again, that’s an
0:07:36 example of something you don’t need a four-year degree to get really good at
0:07:39 robot tele-op, but it’s a very valuable skill if you do it.
0:07:43 Yeah, and there’s no current university degree that would offer that, right?
0:07:47 Are there any other jobs, new jobs, that stand out that maybe we don’t even see
0:07:50 quite yet? I think that when you look at, for example,
0:07:54 the recent results that came out about the TSMC factory in Arizona,
0:07:58 the governor, Katie Hobbs, has introduced a big apprenticeship program
0:08:04 where they’re helping to train new semiconductor manufacturing employees
0:08:07 alongside folks who have come over from TSMC. So
0:08:11 with kind of the rollout of the CHIPs Act, I expect as CHIP manufacturing comes
0:08:14 back to the U.S., that it’s an entire class of jobs that we just have
0:08:18 literally never had here. Maybe we did for five years in the 60s right at the
0:08:21 beginning of the industry, and I expect reshoring we’ll see a lot of those
0:08:25 coming back. I think another example more in the
0:08:31 industrial sector is you have lots of industries that hired people
0:08:36 when they all modernized roughly in the 80s. So there’s a large class of its oil
0:08:40 and gas, its water treatment, its chemical
0:08:43 engineering and HVAC. There’s a class of these heavy
0:08:48 industries that introduce a lot of new equipment and
0:08:52 new ways of operating in the late 80s, hired a whole bunch of people
0:08:55 to work on it, and then essentially never really had to hire
0:08:59 anyone else. They’re great jobs, there’s low turnover, they’re well paid,
0:09:03 and now we’re seeing kind of mass retirement across some of these
0:09:07 heavy industries, and companies really looking to incorporate
0:09:10 more autonomous kind of control systems in the way they manage some of these
0:09:14 processes, but there’s no one to operate them.
0:09:18 So what is the next generation water treatment engineer look like? It’s
0:09:20 someone that knows their way around a robot,
0:09:24 the control system, a PCB board, they’re going to have to know their way around
0:09:28 sensor data, and they’re going to have to be able to understand how all of that
0:09:31 integrates together to be able to troubleshoot when things go wrong.
0:09:34 So huge opportunities in some of these industries where we’re just seeing
0:09:38 massive labor gaps over the coming, I don’t know, three to five years.
0:09:42 Wow, and that’s pretty soon actually. Yes, it’s happening now.
0:09:45 Yeah, and so that sounds like an incoming shortage. Are there any other
0:09:48 shortages as we think about the supply and demand? Maybe not so much of
0:09:53 completely new jobs, but existing jobs. The thing that really stands out in our
0:09:57 portfolio, especially when you look across industries like aerospace,
0:10:03 defense, robotics, it’s this notion of a full stack
0:10:07 engineer, and I don’t mean a full stack software engineer. I’m talking about a
0:10:11 full stack hardware engineer. So someone that
0:10:14 can write some code, they can write some firmware,
0:10:21 they can fiddle around with electronics, maybe design of really simple sort of
0:10:25 PCB board with components, figure out how it fits in
0:10:29 a mechanical system, sort of troubleshoot when things go wrong.
0:10:33 There are just very few people who have that kind of end-to-end skill set, and
0:10:36 many of these industries are still relatively
0:10:40 early on their robotics or autonomy journey, so there’s still a lot of
0:10:44 iteration to go around. Things aren’t fixed in time.
0:10:47 So the biggest demand that we’re seeing in our portfolio
0:10:51 is that fluency across multiple different domains that includes
0:10:55 hardware or software. So it’s not necessarily
0:10:58 that you need to be the literal world’s best
0:11:02 electrical engineer and have a PhD in electrical engineering.
0:11:06 It’s more that you’re flexible and comfortable and familiar
0:11:11 moving across different parts of the stack, you’re able to unblock yourself,
0:11:15 and you’re really able to try things and implement things yourself
0:11:18 as all of these companies are figuring out what
0:11:22 the next generation of hardware systems looks like. Fascinating, and as we think
0:11:26 about closing that gap, right, producing more of these people who are
0:11:29 full stack in the hardware sense, what do you think is needed? And let me
0:11:33 preface by giving the example of we saw this wave of software engineers over
0:11:37 the last few decades, and that was pulled by the market in many
0:11:39 senses. You had these large companies like the
0:11:43 Fang companies providing a lot of really impressive benefits for these people
0:11:46 to come in, and it became the kind of job that everyone wanted
0:11:50 for a period. Do we need the same kind of, you could say,
0:11:54 marketing, are there other effects that you think need to influence the larger
0:11:58 system? I think a lot of it will be market-driven.
0:12:07 It’s also about capitalizing on this sort of romantic desire to build stuff
0:12:13 that I think is in the air right now. So how do companies take the magic
0:12:19 that happened when we all got up at 5 a.m. and watched SpaceX
0:12:25 catch a massive multi-story rocket with chopsticks in the air?
0:12:30 That’s so cool. And I think that companies that can figure out how to
0:12:37 translate that feeling into pulling people who might otherwise
0:12:43 go down a safer route of, “Oh, I’m an ML researcher, so I’m going to go work on
0:12:47 LLMs because I know I can go get a really big paycheck
0:12:51 at one of these research labs. I’m a smart person and I’m going to go
0:12:55 code a chatbot.” I think it’s up to these companies that are
0:13:00 building in these hard and gritty spaces where it is harder because
0:13:04 having to worry about hardware is harder than dealing with software alone.
0:13:07 But if they can pull that talent and inspire people
0:13:11 to really get into the guts of what does it mean to deploy a model on a physical
0:13:15 system and what is the complexity and challenge in that, I think
0:13:19 it’s like capturing the lightning in a bottle that exists in the moment right
0:13:22 now and turning that into early movement from the pure
0:13:26 software or pure AI industries. We’re already seeing this with larger
0:13:31 robotics labs that have gotten well funded over the last 12 months or so.
0:13:35 They’re managing to pull really incredible talent. I think the companies like
0:13:42 Andrel and Waymo and Skydio and others are pulling incredible talent still.
0:13:45 And that’s going to hopefully translate into more and more
0:13:50 18-year-olds being inspired to take a mechanical engineering class
0:13:54 or build a robot rather than just study pure software like they maybe have
0:13:57 been for the last decade. Only since you just mentioned the kind of
0:14:00 18-year-olds who would be starting their skilled journey
0:14:06 from scratch, do you also think that the folks who are older who have maybe gone
0:14:09 through their career already partially, is there a role for them to play in the
0:14:13 re-skilling and entering the workforce maybe for a second time?
0:14:17 Yeah, for sure. I think I see the rise of
0:14:23 autonomy and the benefit that’s going to bring to the labor market in terms of
0:14:27 manufacturing jobs in the United States, in terms of
0:14:31 high-skilled technical work replacing low-skilled
0:14:36 labor, huge job market opportunities. Like how to manage that training process
0:14:39 and training pipeline, I think it’s going to take a lot of different forms
0:14:45 whether it’s apprenticeship programs, tele-operation, outposts, I think we’re
0:14:48 going to see a whole bunch of different things emerge, but for people who are
0:14:52 curious and like to build and are highly technical,
0:14:56 even if that doesn’t mean that they’ve gotten a college degree. Electricians,
0:15:00 for example, like there’s a huge shortage of electricians in places like
0:15:03 Texas and Georgia, etc. I think I was talking to
0:15:07 someone from Microsoft recently who said that as they were standing up some of
0:15:10 their new data center work in Georgia, they employed
0:15:14 at one time one-third of the registered electrician
0:15:17 state which is crazy. A third?
0:15:23 A third. So there’s just a huge dearth in some of these skilled trades that are
0:15:27 going to become really important as the AI and autonomy expands across the
0:15:31 United States. Absolutely. And even in your big idea, you cover
0:15:35 so much ground, all kinds of jobs, all kinds of industries, whether it’s mining
0:15:38 or energy or things like autonomous vehicles.
0:15:42 Everything physical that we interact with or even everything physical
0:15:45 that affects our life that we don’t even know about
0:15:48 is going to be impacted by autonomy over the next decade and that’s a lot of
0:15:52 jobs to fill. Is there any particular area within
0:15:55 that that you think is especially important to get right?
0:16:03 I think that it’s really important that we figure out how to
0:16:08 build things again in the United States at scale in production
0:16:11 and I don’t think that’s going to happen
0:16:15 with the way sort of labor economics work globally.
0:16:19 If a huge part of the way we manufacture in the future
0:16:24 is not driven by autonomy and it’s kind of a chicken and egg problem like we
0:16:28 need the robots to build the factories
0:16:32 and we need the factories to build the robots because right now
0:16:36 all the components for robotic arms, everything that might go into an
0:16:39 autonomous factory is all coming from Shenzhen.
0:16:42 So how do we start bootstrapping this supply chain
0:16:46 native to the United States or the U.S. and our allies so that we’re
0:16:50 less fundamentally, existentially reliant on another
0:16:55 power? But we have to start somewhere and I think it’s going to take people who
0:16:59 really want to build and get stuck in and don’t mind
0:17:04 the hairy complexity of having to deal with AI that doesn’t quite work and
0:17:07 hardware that doesn’t quite work and supply chains that aren’t quite ready
0:17:11 but are willing to just tackle that problem vertically head on
0:17:15 to do it. Absolutely and this was a big idea for 2025 so as we
0:17:19 prepare to start that journey, what are you looking out for? What are you
0:17:23 thinking about? What do you hope to see? I hope to see
0:17:28 more founders and teams that are willing and ready
0:17:34 to tackle this problem head on vertically. So they’re not outsourcing
0:17:38 their hardware, they’re not outsourcing their supply chain
0:17:41 but they’re really recognizing that in order to
0:17:44 build something new here in the U.S. they have to figure out
0:17:48 all of those things and have to develop skill sets across
0:17:52 all of those categories and become kind of generalists.
0:17:55 I think something Elon Musk has done really well not to just be you know an
0:17:58 Elon shill on here but it’s something he’s done really well
0:18:02 to really own the kind of end-to-end supply chain for
0:18:06 birthing something into the world and I think we need more of that in founding
0:18:09 teams. We hope to see many more founding
0:18:12 teams in 2025 crossing that hardware software
0:18:15 chasm. One frontier with a flurry of activity
0:18:19 is space with the number of earth observation satellites doubled in the
0:18:22 last five years from 500 to over a thousand.
0:18:25 There’s more data than ever downlinked to the earth and it is easier than ever to
0:18:29 access imagery although still far too difficult. That was
0:18:32 Millen, I’m an engineering fellow on the American Dynamism team.
0:18:36 Millen thinks there’s an opportunity in 2025 to harness all this earth
0:18:39 observation data. My big idea is really around
0:18:42 building verticalized earth observation tools.
0:18:45 There’s been a lot of work over the last decade or so
0:18:49 to actually get a lot of earth observation sensors and set up the
0:18:52 infrastructure to send pixels down to earth from space which is really a
0:18:55 remarkable task. For 2025 I’m really excited to see
0:18:58 entrepreneurs build verticalized solutions that go into different
0:19:01 industries and actually solve customer problems.
0:19:04 There has been a boom in earth observation satellites going up.
0:19:08 What’s really driving that growth? I think first off is launch costs and
0:19:11 access to space. In decades previously
0:19:15 it was very very difficult and expensive to send satellites up to orbit.
0:19:18 These days it’s honestly getting as easy as sort of like a bus service with
0:19:21 things like SpaceX’s transport or launch service.
0:19:25 The cost per kilogram of satellites getting to orbit has really really come down.
0:19:29 Also architecturally satellites have changed a lot in the last few decades.
0:19:34 They’re no longer sort of school bus sized $100 million per unit
0:19:38 satellites. They’ve come down to the sizes of a loaf of bread and so
0:19:41 with that you get a lot of proliferated sensors. You get a lot of coverage over
0:19:44 the earth and costs have really remarkably come down and then I think
0:19:47 the last thing I would point to is communications infrastructure.
0:19:50 There’s been a lot of work to set up ground stations and
0:19:53 to actually have satellites communicate with each other
0:19:57 in space to have a more efficient way to send pixels down to the earth.
0:20:00 And so as we think about those economics and if the economics have come down so
0:20:04 much on getting the satellite up there, how does that ultimately ladder to the
0:20:07 applications that can be built and the economics around that?
0:20:11 To me it’s a really exciting positive flywheel here. The more satellites you have
0:20:14 up there, the more pixels that are collected of the earth’s surface
0:20:17 every single day, there become more products that you can actually build
0:20:20 and more use cases that you can unlock. Price has sort of come down and that
0:20:23 allows and unlocks entrepreneurs to really
0:20:26 cheaply solve problems for the entire earth at once.
0:20:30 Since we’re talking about economics, maybe you can give listeners a sense of
0:20:34 what those are, like how much does it cost for us to get this data, process it,
0:20:36 or for real end applications to be made.
0:20:39 So the unfortunate answer is that it depends a little bit. Broadly there’s
0:20:42 actually a huge amount of freely open
0:20:47 data. So NASA’s Landsat program provides free open data for the entire earth.
0:20:51 The European Space Agency has Sentinel, which also provides free data.
0:20:54 And then there’s a lot of commercial companies as well who provide medium
0:20:57 resolution. The prices range in the sort of dollar to
0:21:01 five dollars per kilometer squared. And so that’s really not too
0:21:04 expensive. And then it tends to be more expensive
0:21:08 as you go up into the high resolution 30 and 10 centimeters per pixel.
0:21:11 But those are typically for more specialized use cases.
0:21:14 And I think it’s not very well known that even could be this cheap.
0:21:18 And there’s a whole suite of archive data that goes back years and years from
0:21:20 these companies who have collected data from orbit
0:21:24 every single day for years and years. That’s a goldmine waiting to be
0:21:28 really leveraged. And we’ve seen different private entities, public entities,
0:21:32 governments, universities really pour in resources to get a lot of this data.
0:21:37 But speaking of the applications that in some cases do already exist, what are
0:21:40 some of those? There have been some really, really exciting
0:21:43 applications so far. I think agriculture is one of the ones that
0:21:46 is sort of most talked about. Farmers across the world are really
0:21:49 using earth observation data to monitor their crops, predict
0:21:53 crop yields, understand ways that they need to irrigate or fertilize their
0:21:56 crops to really produce better outputs here. So I think that’s really, really
0:22:00 exciting, especially as we face food shortages across the world.
0:22:03 Other applications include defense, governments across the world use it to
0:22:07 monitor things like troop movements, ships and ports,
0:22:11 and fleets of their equipment across the world. Energy use as well.
0:22:14 There’s a lot of interesting work that can be done in forecasting clouds
0:22:18 and large-scale grids and looking at how much solar production will happen
0:22:22 on any given day, planning of utility solar farms, like looking at land and
0:22:25 where you can actually place utility solar farms.
0:22:29 Obviously, this is your big idea for 2025. Why do you think this maybe has been
0:22:33 underexplored to date earth observation in particular?
0:22:37 I think it’s really, really difficult. And I think that it’s not so easy to
0:22:40 work with the data. Companies are making it a lot easier these days.
0:22:43 It’s sort of a new thing that you can even go on to a website and buy an image
0:22:47 through a portal. You used to only be able to talk to a salesperson
0:22:50 to be able to do that. There’s a lot of open source work. There’s a lot of
0:22:54 companies chewing off different parts of the puzzle. The main thing in my eyes
0:22:57 that I’m looking forward in the next year to two years
0:23:01 is entrepreneurs actually going into specific industries and really taking
0:23:04 solutions vertically. So in one sense, if you take something like
0:23:07 SpaceX and they have Starlink and they’re the ones who
0:23:11 create the satellite, put it up there, and then also sell the data
0:23:14 that people can use. Are you basically saying that you expect to see more of
0:23:19 that specific solutions for, let’s say, like you said, agriculture or energy
0:23:21 instead of one company putting the satellite up there and then
0:23:26 other companies in the middle distributing that data, processing it, etc?
0:23:29 It has traditionally been hard for incumbents and natural satellite
0:23:34 manufacturers to go into industries like agriculture and really get granular
0:23:37 in terms of solving problems. Just an example of that would be like
0:23:41 automating any sort of farming equipment. It’s hard for an existing earth
0:23:45 observation player to go really, really vertical all the way
0:23:49 straight from orbit to the farm. And right now that’s traditionally
0:23:52 stopped somewhere around providing analytics or insights.
0:23:55 But I’m looking for in the future to actually provide automation.
0:23:59 And maybe we can drive a lot of that farm equipment, for instance, or
0:24:04 actually irrigate fields directly through a closed loop earth observation.
0:24:08 Maybe a follow up there is we’ve obviously seen a bunch of machine learning
0:24:12 and AI tools come up in this last few years. Does that change the game in
0:24:16 terms of being able to parse data, process it, make sense of it
0:24:19 for these verticalized players, for example? Or how does that really reshape
0:24:24 the ecosystem? Certainly, yeah. I mean terabytes and terabytes come down
0:24:27 from orbit every single day, soon to be probably petabytes.
0:24:29 And we don’t have enough humans on the earth to actually look at all those
0:24:32 images. So we really need advanced techniques here. And I think
0:24:36 there’s been some exciting progress here. A really famous example a couple years
0:24:40 ago where a company actually found the Chinese spy balloon
0:24:44 through training their model with AI prediction of exactly what the balloon
0:24:47 might look like. Okay. And they were able to sort through
0:24:50 pictures of the entire U.S. taking like over days and days and actually
0:24:54 track down the source of the spy balloon for the first time. So we really can’t
0:24:58 do that with humans. And I think new use cases like this will
0:25:01 be unlocked every year or so. And as we think about the roadblocks or the
0:25:04 challenges that may be on the road to us, really
0:25:07 this earth observation economy, you could say, proliferating.
0:25:11 What are those? One of the most pressing is how difficult it is to work with the
0:25:15 data. I think right now typically it still requires specialized knowledge of
0:25:20 orbits and different types of sensors and how they are calibrated and
0:25:24 correlated. And I think it’s not so easy to apply techniques from one
0:25:27 earth observation constellation to another right now.
0:25:30 We almost might need some sort of middleware here where we can abstract away
0:25:34 the nuances of each earth observation constellation and make
0:25:38 datasets that are really sensor agnostic for non-space engineers to use.
0:25:42 Changing this from a very specialized climate scientist, GIS scientist to any
0:25:46 sort of ML engineer can start to use these techniques.
0:25:49 What about regulation? I mean, I think about maybe regulation mostly impacting
0:25:52 the satellites that go up there, but maybe you could give us a wider
0:25:57 perspective of is regulation hindering us at all, whether it is to get the
0:26:00 satellites up there or utilize the data, proliferate it, etc.
0:26:03 Yeah, there’s been a lot of exciting regulation changes recently. I think
0:26:07 most famously NOAA agency lowered the restriction
0:26:10 for the maximum commercial resolution from 30 centimeters per pixel
0:26:14 to 10 centimeters per pixel very recently. So this kind of unlocks
0:26:17 a lot more higher resolution products and there’s a whole suite
0:26:21 of applications that you can start to target. On the imagery sort of side, I
0:26:24 think that there’s been a lot of conversation about licensing
0:26:28 and different data sort of rights. Right now there’s a lot of complex contracts
0:26:33 where customers will buy exclusivity and there’ll be 24 hours where nobody else
0:26:36 can access an image. Yeah, and it really hinders
0:26:39 folks that are trying to build products with daily applications or daily
0:26:42 monitoring. So I think licensing and opening up
0:26:46 archive data and making it easier and less restrictive to use could be a good
0:26:49 regulation change as well. Where are you looking
0:26:53 next year and what applications in particular do you find really exciting
0:26:57 as we look toward the future? I’m really excited honestly about the
0:27:00 energy sector. I think that’s one of the main areas that we can really make a
0:27:04 difference with earth observation data. We already touched on predictive analytics
0:27:07 for solar farms. There’s a lot of work with renewable wind
0:27:10 sources as well. So I’m just looking for entrepreneurs to take earth observation
0:27:14 and really solve our most pressing challenges with these new data sets.
0:27:17 Speaking of new data sets, we’re at a unique juncture
0:27:21 where we finally have the data and technology to build entirely digital
0:27:25 worlds. But also these virtual simulations are
0:27:30 increasingly having a direct impact on what we can do in the physical world.
0:27:33 Android leverages game engines for defense simulations.
0:27:37 Tesla creates virtual worlds for autonomous systems.
0:27:42 BMW is incorporating AR in future heads-up display systems.
0:27:46 Matterport revolutionizes real estate with virtual walkthroughs.
0:27:51 That was Troy Kerwin, partner on the games team at A16Z.
0:27:56 And here’s his big idea. The big idea is games are essentially virtual
0:28:00 simulations. And those virtual simulations have
0:28:03 been designed for fun over the last couple decades.
0:28:07 But increasingly we’re going to be seeing them used in the real world
0:28:11 for all kinds of use cases, whether it’s training and learning and development
0:28:16 or training grounds for robotics and other autonomous systems
0:28:21 or visualization to allow folks to see things come to life in real-time 3D.
0:28:24 Amazing. And I love this prediction because we’ve actually seen
0:28:27 versions of this from the past and this idea that
0:28:31 we all have games in the gaming industry to thank for a bunch of
0:28:34 technologies that exist outside of gaming. So can we talk about those of the
0:28:38 last couple decades maybe? And also are there any that you think
0:28:42 maybe are overlooked? Everyone references GPUs today as maybe one
0:28:44 example, but are there others?
0:28:47 Totally. People forget that NVIDIA was a gaming company.
0:28:51 Almost all of the revenue in the early years was for gaming graphics cards.
0:28:56 These new processing units for computationally intense and matrix
0:28:59 multiplications, which were great for rendering images and
0:29:04 animations and videos, but then we soon found that it was useful for
0:29:07 things like cryptocurrency mining and of course now
0:29:10 feels like everything, digital biology. The idea of this accelerated computing
0:29:14 is now being used just everywhere. Totally. And I was looking back at
0:29:20 some of NVIDIA’s earliest websites and the headline was The Future is 3D.
0:29:25 And it’s so funny that 25 years later, while it’s been slower than one would
0:29:29 have hoped for this real-time 3D to intersect with all these other
0:29:32 industries, and we’ll talk a little bit about why we think now is the right time,
0:29:37 but if we go back, the 90s was about text on the internet.
0:29:41 The 2000s was about images. The 2010s was about video.
0:29:45 And we feel pretty strongly that the 2020s is going to be about
0:29:49 interactive 3D and gaming technology being used in the enterprise.
0:29:52 Super interesting. And maybe just to take a step back,
0:29:55 why is it that games or the gaming industry and the technologies that are
0:29:59 derived from that, why is that a crucible for innovation?
0:30:04 I mean, Jensen said himself that he allowed consumer spend to fund the R&D
0:30:08 to bring it to what it is today. And I think that that’s an interesting lens
0:30:12 to think about gaming technology. In the gaming industry,
0:30:15 technology innovations are celebrated.
0:30:19 It’s new technology, whether it’s new platforms or new
0:30:24 features or evolutions that allow new game designs to emerge and flourish.
0:30:27 And at the end of the day, the gaming community, both players and developers,
0:30:31 it’s a hacker mentality. And so it’s no surprise that’s where
0:30:35 big breakthroughs have emerged in the past and we’re going to see them continue to emerge.
0:30:38 Yeah. And some of those breakthroughs aren’t always obvious as breakthroughs.
0:30:42 A good example is multiplayer, right? Multiplayer has existed forever in gaming.
0:30:45 And then it took a while for that to really penetrate,
0:30:49 or really companies were built off the idea of multiplayer.
0:30:50 You take something like Figma, right?
0:30:53 So on that note, today in the gaming industry,
0:30:57 there’s still lots of innovation happening that maybe again in a decade or so,
0:31:00 we’ll see elsewhere. And so let’s talk about those tailwinds.
0:31:03 You talk about three in your big idea. Maybe you can just talk about each one
0:31:05 and how you’re seeing that reshape.
0:31:10 Before A6CZ, I was at Unity for close to five years and got a front row seat to
0:31:15 seeing how all these various industries were beginning to experiment with
0:31:18 real-time 3D for some of the things that I talked about before,
0:31:23 whether it’s like visualization for architects to be able to walk through
0:31:29 their design before it’s constructed. And they can see if there’s errors or other sort of
0:31:31 imperfections that they wish they had known when they were designing,
0:31:37 or for automotive manufacturers, they use real-time 3D for also the design,
0:31:42 but also virtual test driving. And now the sort of heads-up displays that you see,
0:31:46 and Rivian is powered by Unreal, BMW is powered by Unity.
0:31:52 And then there’s the virtual training, whether it’s for heavy machinery operations,
0:31:58 or other operations tasks. But some of the bottlenecks for a lot of these
0:32:03 use cases that seem so obvious are really some of the same constraints that game
0:32:07 developers have faced. And so it’s bottlenecks on the content creation side.
0:32:12 Within a game studio, more than half of the spend goes towards creation of the assets
0:32:17 and the art and the content that goes into these virtual simulations.
0:32:20 And the same is true for these non-gaming use cases,
0:32:24 except they don’t have 3D artists on staff to build those.
0:32:29 And so now when we have AI for asset generation, whether it’s images or audio,
0:32:33 or now 3D assets, it makes that so much easier.
0:32:37 So that’s one. The second is for 3D capture techniques.
0:32:41 So of course, for a lot of these non-gaming use cases,
0:32:46 they want to capture the physical world as it’s built and as it’s seen.
0:32:48 There is a correct version, in a way.
0:32:51 Yes. And there’s been technologies in the past that have allowed this,
0:32:56 things like photogrammetry, or in the case of Matterport, for instance,
0:32:59 where it’s basically just a 360 degree image,
0:33:04 but you can’t actually interact with the environment the same way you can with a video game.
0:33:10 Well, now with newer technologies, NER for neural radiance fields of a couple years ago,
0:33:14 and more recently, other radiance fields technologies like Gaussian splatting,
0:33:20 which allow consumers to capture in a much more efficient manner.
0:33:22 And it’s photorealistic, lifelike.
0:33:24 And it’s immediate, right, in terms of the capture?
0:33:28 Exactly. And so it allows these use cases to be unlocked.
0:33:32 So that’s the second. And then the third is for some of these non-gaming use cases,
0:33:36 this is where we’re going to see the prevalence of VEXR,
0:33:40 and being able to, going back to the construction or architecture,
0:33:45 but put on a headset and see how the BIM model overlays on the construction site,
0:33:52 or for medical surgery, simulation, or other use cases like this.
0:33:57 And as we have better headsets later with eye tracking and other amazing technologies,
0:34:00 there’s still lots to come in terms of development there.
0:34:02 But I think that’s going to unlock some of these.
0:34:05 Absolutely. And as we talk about all three of those talents,
0:34:08 so again, the content creation, the capture that you mentioned,
0:34:13 and then the devices, it feels like each one of those has their own cost curve.
0:34:17 And we’re traversing down that cost curve pretty quickly across all three.
0:34:18 Can you speak to the economics there?
0:34:21 I mean, you touched on it a little bit in terms of even games.
0:34:24 You said 50% goes toward content creation.
0:34:26 So how quickly is that dropping?
0:34:27 And then same thing for the devices.
0:34:31 Yeah, it’s interesting, particularly for these non-gaming use cases,
0:34:34 some of which, photorealism is everything.
0:34:39 And that’s why as Unreal and other 3D engines have progressed towards photorealistics,
0:34:41 these use cases have been unlocked.
0:34:45 But for other use cases, actually, you don’t really care what the BIM model looks like
0:34:48 so long as it has utility for you.
0:34:56 And so as some of these asset classes are up to par with what they would expect to use for these,
0:34:58 the cost dropped dramatically.
0:35:03 But more importantly, I think, particularly if you think about virtual simulation,
0:35:08 virtual training use cases, where let’s say we wanted to train our workforce
0:35:14 on how maintenance and repairs for a robot or some other piece of equipment.
0:35:20 Well, you would build this experience and you would fund the development of this virtual simulation.
0:35:25 But then after the fact, if the team wanted to update it or add content to it,
0:35:31 they’d have to go back to the outsourced agency who built them the original digital twin.
0:35:34 And now they’ll be empowered to do that themselves internally.
0:35:40 And so this content and curriculum doesn’t go stale, but they can constantly improve it
0:35:41 and update it over time.
0:35:43 So what you’re pointing at is it’s not just a one-to-one,
0:35:46 how is the economics of creating one thing?
0:35:47 How is that changing?
0:35:50 But also how it’s integrated into the entire system.
0:35:51 That’s really interesting.
0:35:52 Let’s talk about applications.
0:35:55 You’ve already touched on a bunch, but you’ve mentioned several companies,
0:35:57 which are very different, right?
0:35:59 Andrel, Tesla, BMW.
0:36:01 And then you’ve also talked about workforce training.
0:36:05 Tell me a little bit more about those applications and where does it end?
0:36:07 Or is it really, we’re seeing it everywhere?
0:36:11 Autonomy is deeply rooted with these virtual simulations.
0:36:12 Andrel as a great example.
0:36:17 Funny enough, Andrel’s first acquisition was a game studio.
0:36:17 Really?
0:36:19 Which would be surprising for a defense tech company.
0:36:21 I guess if you take Palmer’s past.
0:36:27 True, but they were interested in acquiring it for the game engine that this studio had developed.
0:36:33 And they use that technology for strategy simulation and other autonomy workflows.
0:36:38 And then with other companies, so Applied Intuition as an example,
0:36:41 it’s just impractical with the scale of training data that you need
0:36:43 to capture this in the real world.
0:36:46 And so when you have these virtual simulations,
0:36:48 you can not only scale the amount of data,
0:36:55 but also the fringe and edge cases that you would never be able to experience
0:36:56 or capture in the real world.
0:37:02 Whether it’s extreme weather or human intervention that is one in a thousand situations.
0:37:04 But of course, for these things to be deployed,
0:37:06 they need to take into account all these edge cases.
0:37:08 I remember when we talked to Waymo a year or so ago,
0:37:12 they were talking about that, how they ingested all of the crash documentation,
0:37:16 which exists somewhere on pieces of paper or not in the real world
0:37:19 that Waymo can necessarily interface with at that moment.
0:37:20 Right.
0:37:23 But again, like you’re saying, these virtual environments allow you to simulate it.
0:37:28 And so speaking to that, one way to put what you just said around Applied Intuition
0:37:32 is that you can actually do something new that you couldn’t do before
0:37:34 with the ability to simulate at scale.
0:37:36 Are there other downstream opportunities or like second,
0:37:40 third order effects that you can think of that we get from these virtual environments?
0:37:41 Totally.
0:37:47 While in the past, we had the ability to use these virtual simulations for physics,
0:37:52 training environments, or the learning and workforce development that we talked about.
0:37:55 But these were mostly other physics simulations or hard skills.
0:38:00 But now with, we call them AI NPCs in the gaming context,
0:38:02 whereas before, NPCs were scripted.
0:38:10 But now with autonomous agents and LLMs, these agents can take on a life of their own.
0:38:15 They can observe the environment, they can reason and plan, and then they can act.
0:38:22 Well, when you have a multi-agent simulation, now when we think about the next pandemic response
0:38:26 or immigration policies and how those impact a civilization,
0:38:30 we’re going to be testing these in a virtual environment with these agents who can interact
0:38:34 with each other and decision tree out all these different developments.
0:38:34 Yeah.
0:38:37 And instead of just decision tree on paper, what you’re getting at is that we actually
0:38:41 get to simulate these ideas that existed in the ether.
0:38:46 So far, a lot of the applications you’ve mentioned have been more enterprise-focused,
0:38:48 right, a company like Android or Tesla.
0:38:52 Gaming obviously existed to begin with in the consumer sphere.
0:38:57 And so do you see more consumer applications already also coming up?
0:39:03 So one of the ones that I’ve just been so excited for is I just moved into a new apartment.
0:39:08 And as I wanted to plan out the space, I was still using grid paper and pen.
0:39:09 Same.
0:39:14 Despite the fact that we’ve had the Sims for 25 years, where we can in a 3D environment,
0:39:17 drag and drop furniture and see how it fits.
0:39:23 And all the technology exists today to have that experience in an amazing,
0:39:24 intuitive way.
0:39:25 And yet it doesn’t exist.
0:39:31 But we should be able to, and we can, scan our space and develop a digital twin of the 3D
0:39:32 environment.
0:39:37 We should be able to show a design inspiration that I find from Pinterest,
0:39:42 have it find the pieces of furniture, the artwork that closest matches my inspiration,
0:39:46 fill the scene, and then either be able to walk through it in a virtual world
0:39:52 or use augmented reality and see how it fits into your space with your dimensions.
0:39:56 Like a 3D Wayfair, if you will, where there’s the end consumer
0:40:00 has a lifelike digital twin visualization of their space.
0:40:05 So looking to 2025, so far, we’ve talked mostly about technologies that have been
0:40:06 invented over the last few decades.
0:40:09 But there’s obviously this wave of new technologies that are really exciting,
0:40:13 haven’t really found their footing necessarily in terms of applications.
0:40:18 Is there anything you’re paying attention to there and maybe how that intersects with gaming?
0:40:18 Yeah.
0:40:24 There’s some really interesting research and work being done in the HMI human machine
0:40:29 interaction space where you can imagine all kinds of different use cases.
0:40:33 But as with most emerging tech, there’s probably going to be initial use cases
0:40:37 in gaming that are the wedge for these companies to use consumer spend
0:40:39 to fund their R&D similar to Nvidia.
0:40:44 So obviously, Apple Vision Pro made huge progress this year with eye tracking.
0:40:51 But we’re going to see soon BCI-type technology that reads energy signals from your brain
0:40:55 to actually control and interact with the computer and the virtual environment.
0:41:01 So we can think about VR use cases where I can use strictly my brainwaves to interact
0:41:03 with the scene, which is amazing.
0:41:04 And then the inverse is true too.
0:41:10 And we’ve seen technologies that allow sort of sensory or digital touch based on solely
0:41:16 wearing a ring on your finger for increased immersion in the virtual world,
0:41:21 which is sort of like the dream of every gamer to be able to be fully immersed
0:41:25 with that haptic feedback, not just in the game controller, but actually throughout your body.
0:41:31 All right, I hope these big ideas got you geared up and ready for 2025.
0:41:35 Stay tuned for parts two, three, and four where we discuss.
0:41:39 The search monopoly ends in 2025.
0:41:41 On-device and smaller generative AI models.
0:41:43 Romanticizing inorganic growth.
0:41:51 Again, if you’d like to see the full list of 50 big ideas, head on over to a16z.com/bigideas.
0:41:58 It’s time to build.
translate-vi content
translate-zh content

As 2025 begins, industries are evolving at unprecedented speed: robots are revolutionizing manufacturing, terabytes of earth observation data are driving new possibilities, and gaming technology is transforming how we design, train, and innovate across sectors.

In this episode, a16z General Partner Erin Price-Wright, Engineering Fellow Millen Anand, and Partner Troy Kirwin discuss the trends reshaping the future of hardware, software, and beyond.

We explore:

  • How robots and full-stack engineers are driving the next industrial renaissance.
  • The explosion of Earth observation data and its potential to revolutionize industries.
  • How gaming technology is moving beyond entertainment to reshape training, design, and more.

This is just the beginning of our four-part series on 50 Big Ideas for 2025—don’t miss the full list at a16z.com/bigideas.

Resources: 

Find Erin on X: https://x.com/espricewright

Find Millen on LinkedIn: https://www.linkedin.com/in/millen-anand/

Find Troy on X: https://x.com/tkexpress11

Stay Updated: 

Let us know what you think: https://ratethispodcast.com/a16z

Find a16z on Twitter: https://twitter.com/a16z

Find a16z on LinkedIn: https://www.linkedin.com/company/a16z

Subscribe on your favorite podcast app: https://a16z.simplecast.com/

Follow our host: https://twitter.com/stephsmithio

Please note that the content here is for informational purposes only; should NOT be taken as legal, business, tax, or investment advice or be used to evaluate any investment or security; and is not directed at any investors or potential investors in any a16z fund. a16z and its affiliates may maintain investments in the companies discussed. For more details please see a16z.com/disclosures.

Leave a Comment