AI transcript
0:00:10 [MUSIC]
0:00:13 Hello, and welcome to the NVIDIA AI podcast.
0:00:16 I’m your host, Noah Kravitz.
0:00:21 Since it launched in 2006, Roblox has grown into one of the biggest gaming and
0:00:26 digital experiences platforms in the world, by basically any metric you want to look at.
0:00:29 According to the company’s fourth quarter 2023 financial reporting,
0:00:33 Roblox boasts more than 71 million average daily users,
0:00:38 accounting for 15.5 billion hours of engagement last year.
0:00:41 Those numbers include both players and creators,
0:00:45 as user-created content has always been central to the Roblox experience.
0:00:48 Providing both cutting edge tools for creators and
0:00:52 quality experiences for users at scale is no easy feat.
0:00:56 And with so many of Roblox users being under the age of 16, including my own son,
0:01:01 who can often be found drifting virtual supercars through various of the Roblox games.
0:01:05 Keeping things civil and safe for everyone has to be a high priority.
0:01:08 How do you run a platform like this at such a massive scale?
0:01:11 And how does AI play a part in the process?
0:01:14 Here to take us under the hood of Roblox is Anupam Singh,
0:01:17 Vice President of AI and Growth Engineering.
0:01:22 Anupam, welcome and thank you so much for joining the NVIDIA AI podcast.
0:01:23 >> Hey, Noah, thank you very much.
0:01:28 My son, I mentioned in the intro, made sure I did my homework on this one.
0:01:31 He’s very excited we’re having this conversation.
0:01:34 Maybe very briefly, because there’s a lot to dig into
0:01:38 in terms of the infrastructure and the things that are under your purview.
0:01:41 Again, from both the creator and end user side of things.
0:01:44 But for folks who might not be familiar with Roblox,
0:01:46 and I think there are at least a few out there,
0:01:49 maybe give us an overview of what Roblox is all about.
0:01:55 So at a vision level, as a founder talks about it for the last 10 years,
0:01:59 it’s about reimagining the way people come together.
0:02:01 You and I want to hang out somewhere.
0:02:04 Obviously, we have many, many different ways to hang out.
0:02:09 But our vision is to bring a billion people together
0:02:12 with optimism and civility.
0:02:16 Now, especially the civility part is very important
0:02:21 because that gets us to deep technical innovation
0:02:24 to keep everything safe, everything civil.
0:02:27 And from day one, we’ve invested a lot in that area.
0:02:31 And optimism is about, if you go into one of our experiences,
0:02:37 you’ll be amazed on how encouraging and interesting they could be.
0:02:40 There’s the latest one, something called Dusty Trip.
0:02:45 There’s another one called Pet Simulator, where you hang with your pet.
0:02:48 But there’s a lot of other things going on like Valentine’s Day,
0:02:49 St. Patrick’s Day.
0:02:53 So it’s all about connecting a billion people with optimism and civility.
0:02:55 And it’s a group experience, right?
0:03:02 There’s, as you put it, it’s as much, it seems as about hanging out with your friends
0:03:07 as it is about this incredibly diverse array of games and experiences.
0:03:09 Yes, absolutely.
0:03:10 And so how do people hang out?
0:03:15 Is text chat, voice chat, how does the interaction happen?
0:03:20 Yeah, so it starts with you open the Roblox app or the Roblox web page.
0:03:25 And there’s hundreds of experience that are there for you to select.
0:03:29 You know, think of a movie that you have to select to watch.
0:03:32 But after that, you’re inside the movie, that’s the difference.
0:03:39 And so you press play like you would do on any other app where you consume content.
0:03:42 But then you get into the universe.
0:03:48 And my favorite ones are where you can actually immediately create an avatar.
0:03:51 You know, you get feathers if you’re if you’re willing to.
0:03:55 And if you’re interested, you get like a lovely feather dress.
0:03:58 And, you know, there’s a lot of audio going on.
0:04:05 And so another favorite ones of mine are where you can dance with people.
0:04:10 So I managed to say ballroom dance is one of my favorites right now.
0:04:10 Excellent.
0:04:13 And I just keep learning dancing.
0:04:18 Something that honestly, I wouldn’t be able to do in my normal weekday.
0:04:20 But I can do a ballroom dance in the evening.
0:04:26 So let’s talk about your role, what’s under your purview and how that, you know,
0:04:30 sort of informs the experience for the millions and millions of Roblox users.
0:04:35 You one of the things, as I understand it, that you’re responsible for is managing
0:04:38 and optimizing infrastructure across the platform.
0:04:43 And there’s a lot happening now with AI and generative AI tools in particular.
0:04:46 So maybe you can you can take us a little bit into that.
0:04:48 Yeah. So two part answer.
0:04:52 When your son plays it, he doesn’t realize that we have to connect
0:04:56 in to a data center, which is hopefully close by.
0:04:58 So that is the experience is amazing.
0:05:02 Remember, your son is up a generation who believes that press play does not have buffers.
0:05:06 And I’m sure looking at you, you remember the time when, you know,
0:05:09 you would press play and some buffering would happen.
0:05:11 So that’s the first magical experience.
0:05:14 Oh, I remember that the AOL dial-up sound.
0:05:14 That’s what I’m thinking about.
0:05:16 There you go.
0:05:22 But this generation of users on the Internet, just expect to press play.
0:05:25 Then you have to place inside the experience behind the things
0:05:29 what’s happening is he’s connecting with one of our edge data centers.
0:05:34 And then you have to decide who are the best people your son could play with.
0:05:37 You know, it has to be age appropriate.
0:05:38 It has to be interesting.
0:05:40 Maybe he already has friends on the platform.
0:05:43 So I have to quickly figure out where are his friends?
0:05:46 Are they in the same data center or they’re in a different data center,
0:05:50 placing them in the right instance of the experience?
0:05:55 Our biggest experience sometimes has 40 to 50,000 copies running worldwide
0:05:57 on 20 plus data centers.
0:06:00 So we have to place them in the right instance.
0:06:03 After that, let’s say he wants to chat with people.
0:06:04 So we have to enable that chat.
0:06:08 Let’s say he wants to do a voice call with one of them.
0:06:09 We have to enable that.
0:06:14 Let’s say he actually wants to talk to somebody in India,
0:06:16 which means he has to talk in Hindi.
0:06:19 But assuming, let’s say, your son doesn’t know Hindi.
0:06:25 We have real-time translation to facilitate chatting with somebody in India.
0:06:26 So in Hindi.
0:06:31 So that’s the kind of stuff that we in the infrastructure team build.
0:06:33 Now, we like to be invisible.
0:06:38 You should never think about the data center that you’re connecting to.
0:06:40 How does machine learning play a role?
0:06:41 Broad question.
0:06:42 Very broad question.
0:06:47 So we think about machine learning, typically, to start with,
0:06:50 either for the creator or for the user.
0:06:52 So you have to create these magical experiences.
0:06:55 We talked about ballroom dance.
0:06:57 We talked about dress interest.
0:06:59 There’s a lot of storytelling in there.
0:07:03 But most of our creators have the right code to build that world.
0:07:06 Anything that facilitates their building of the world.
0:07:08 It’s their idea.
0:07:10 We don’t build our own experiences.
0:07:13 It’s millions of developers who build experiences.
0:07:17 We need to facilitate that really, really quickly.
0:07:19 And I’m sure we’ll go into those examples.
0:07:22 On the other side are the users.
0:07:24 The users just join the experience.
0:07:29 And if we want a safe environment, if we want a civil environment,
0:07:33 a very simple example, you and I are chatting on Roblox.
0:07:37 Every letter that you type, every word that you type,
0:07:40 goes through a text filter for a civility check.
0:07:45 And just that portion of our world is–
0:07:46 I have to get this right.
0:07:56 It’s 90.7 billion messages are translated, and 2.5 billion chat messages are sent every day.
0:08:01 And every one of these have to be checked whether you’re being civil to me,
0:08:02 whether I’m being civil to you.
0:08:07 And this is in real time across all the different languages,
0:08:09 all the different data centers and geographic locations,
0:08:13 and the private chats and the public chats and just the scale.
0:08:14 Every time, yeah.
0:08:19 Now, of course, people choose to sample this in other settings.
0:08:22 But from day one, we’ve not sampled.
0:08:25 Every one of these goes through a text filter,
0:08:31 which means you need a machine learning solution to look at 2.5 billion chat messages.
0:08:35 And sometimes, as you said, in a private setting,
0:08:38 we might be more colorful with each other.
0:08:42 But in a public setting, we’re not going to be colorful.
0:08:44 We should not be colorful.
0:08:51 So making all those decisions in real time would have only been possible with machine learning.
0:08:57 How do you approach a problem sort of at that scale?
0:08:59 How do you get– has that been from day one?
0:09:04 Has the importance of real time civility tools to put it that way?
0:09:07 Has that always been baked into Roblox’s mission,
0:09:10 or is it something that kind of evolved necessity?
0:09:14 Yeah. So one thing for us is it’s always been baked into it.
0:09:19 So our engineers never start building something, saying maybe we should sample,
0:09:25 maybe we should just do it for NOAA, but not for Anupam, which is arbitrary.
0:09:26 It’s for every user.
0:09:32 So first, your design principle should be clear that I want to do it for every user, every chat message.
0:09:38 Once you’ve established that, every few years, we have had to change our machine learning model.
0:09:45 So a few years ago, there was a model that was– AI people have to have acronyms, by the way, NOAA.
0:09:48 So one of them is SOTA, state of the art.
0:09:52 The problem is, the SOTA changes every year.
0:09:57 So we are the state of the art model, which would do a billion messages.
0:10:02 So we took the model, we trained it with our own data,
0:10:07 and then we had to make it smaller to run faster.
0:10:10 Right, right. It could be billions of parameters,
0:10:15 and then you sort of put it on a diet so it can run faster.
0:10:20 And so we go from, let’s say, 70 plus billion to 7 billion parameters.
0:10:26 But what’s happened in the last, I would say, 24 months, which is exciting,
0:10:28 is the entire model architecture has changed.
0:10:34 So it’s not just about, hey, let’s take one more model and that does natural language processing.
0:10:39 You now have all these generative AI models that can do text summarization,
0:10:41 that can do text moderation, et cetera.
0:10:47 So we take those bigger models, and to run it from scale, we take every technique possible.
0:10:49 We have to distill it to make it smaller.
0:10:53 We have to fine tune it to take our data and fix it.
0:10:55 And then we run it in production.
0:11:00 And honestly, once you start running things in production, you have many phase palm moments.
0:11:02 You say, wow, we could have done this.
0:11:04 We could have done memory.
0:11:05 We could back the thing.
0:11:09 So yeah, it’s our design thinking and then running it in production.
0:11:15 Now, I know that, broadly speaking, and also in Roblox, and as I understand it,
0:11:18 even within the purview of scaling, safety and civility,
0:11:24 multimodal LLMs models are, I don’t want to say the new thing,
0:11:30 but they’re becoming more and more important and talked about in all phases of technology.
0:11:32 How do multimodal LLMs play a part?
0:11:35 Multimodal models play a part in your work.
0:11:40 And this may or may not be relevant, but it’s something that popped into my mind talking about civility.
0:11:43 When you were talking about running the chats through text filters,
0:11:52 it made me think about slang and lingo and how you sort of keep up with words that I might not understand,
0:11:56 but might be extremely colorful to use that word to people in the know.
0:11:59 So how do you just keep up with all of that?
0:12:03 And then second question is about non-text things.
0:12:13 So if an avatar has something questionable, or I don’t know actually if you’re allowed to share images and memes and that sort of thing.
0:12:14 But yeah, you can talk about that.
0:12:25 Yeah, so let’s talk about multimodality and then we’ll talk about, you know, what I would call internet with things that you and I might not know are offensive, but they are offensive.
0:12:35 But multimodality, you’re 100% right that in the last two years, we just assume text models are there.
0:12:42 Any of us can access PPD, any of us can access, you know, any model that you want to pick up, right?
0:12:47 What’s exciting about the last one year is the use papers are also tending.
0:12:52 So more and more on our platform, people would love to use voice.
0:13:07 So what we did around two years ago, we decided that we will think twice the same way as your ticket tech, which means, you know, you want to check for profanity and other offensive words in speech.
0:13:18 And so we use a very large model, thankfully, large models are available both open source and closed source to convert firstly voice to tech.
0:13:25 And then we use all our tech knowledge from 10 plus years to moderate voice.
0:13:29 The next question that you have is even more interesting, which is images.
0:13:46 We always had image moderation in our, in our platform, since 10 plus years, our founder likes to tell the story of, he used to do the moderation you maybe 15 years ago, it does not anymore, but he used to.
0:13:50 We donate billions of money in 70 days.
0:13:56 And the exciting part is each one of these large models has the wisdom of the internet packed into them.
0:13:58 Earlier, we might have to train it from scratch.
0:14:01 Maybe five years ago, Roblox would have to train it from scratch.
0:14:06 So now let’s say there is a new plan or a new offensive image.
0:14:13 I don’t get the benefit of somebody else in the large state of the art model and open source in there.
0:14:24 But now we start many of our initiatives with a large open source model that has the wisdom of the internet and is able to update to newer things.
0:14:29 Then we find the unit when we distill it to Roblox as we would say.
0:14:36 So image, voice and text are all in production for art.
0:14:46 Then if you’re going to take multi-modality further out, and I know you talked about this in some of your other podcasts is really that’s not just a picture.
0:14:51 That is, you know, I could make something really interesting.
0:14:54 And I don’t want to just focus on civility here.
0:15:01 It’s just the beauty of what you can create on the platform and how quickly can you create about it.
0:15:07 So we are very focused on 3D and 4D as the next modality.
0:15:14 And then, honestly, we don’t see a lot of models that have already been built in open source.
0:15:19 There is no easy wisdom of the internet as far as 3D and 4D.
0:15:26 And so you’re using kind of a cross all these things I’m generalizing, but you’re using a mix of available open source,
0:15:32 you know, available models that you find, train and otherwise, but then you’re also building models in-house.
0:15:42 Yeah, OK, so for example, for recommendations, our model is internally built for certain safety use cases, our model is internally built.
0:15:45 We have a coding system, but we have our own language.
0:15:52 So we take an open source model and then we combine with our language and build a large model.
0:15:59 I’m speaking with Anupam Singh. Anupam is vice president of AI and growth engineering at Roblox.
0:16:04 Roblox is one of the leading online platforms in the world, bar none.
0:16:13 But certainly when it comes to creating and using all kinds of digital experiences from games to role-play simulators,
0:16:20 ballroom dancing, as you said, Anupam, it’s just amazing, all the things that are out there and being built literally every day.
0:16:29 You touched on this briefly and I want to sort of flip over to the creation experience and how, you know, you mentioned Roblox has its own code,
0:16:32 the Roblox Studio, I believe, is the platform for creating.
0:16:41 But actually first, I wanted to start with talking about avatars, because my experience has been, you know, as a user, as a parent of a user,
0:16:49 but then as a user myself, I’ll go on and play games. I love the driving games. There’s some fun and big paintball is one of my favorites.
0:16:56 But the whole idea of an avatar is just incredibly essential and important.
0:17:05 And, you know, it’s vital to so many people’s online identities broadly, but particularly on your platform.
0:17:10 You know, every time my son will show me like, hey, check out my new avatar’s outfit.
0:17:18 And it’ll be, you know, his favorite footballer’s uniform or it’ll be, you know, some some just wild costume or this or that.
0:17:26 So can you talk a little bit about the technology sort of behind being able to create and customize avatars?
0:17:32 And, you know, how that relates to, I mean, basically anything that that is important to you, but talking about civility.
0:17:39 But then, you know, more talking about just like giving users the tools to express themselves.
0:17:48 Yeah, I’ll tell us of such a rich team. We could spend hours talking about it, but let’s start with a very simple application.
0:17:53 There’s a likelihood that you want the author to reflect some of your personality, right?
0:18:02 Including you have this lovely backdrop behind you, which people can’t see on the audio podcast of these lovely electronic devices.
0:18:07 And so let’s start with taking your photo and creating an avatar out of it.
0:18:13 To be simple, if it was only 2D, 2D filters are on the phone, you can do them today.
0:18:17 Great thing, right? By all the great phone manufacturers.
0:18:20 But you want it to moron, you want it to mo.
0:18:29 That’s when, you know, creation of these photos of the generation of 2D and 3D are major innovations.
0:18:35 And it is ongoing. There, our technology has to, you know,
0:18:43 both be built from scratch, but also use some of the existing 2D to 3D, 2D to 3D innovation.
0:18:47 Then, okay, we took your photo, we will take an avatar, but we want to set it up.
0:18:52 You know, we want to give it a phone, which is beyond just your maybe face.
0:18:59 That’s how to set it up. Next, we want to track your upper body, because your upper body movements.
0:19:04 I love to gesture a lot. Maybe you gesture less. How do we capture that?
0:19:09 And after all of that, you need to put it in a word, in a cohesive way.
0:19:16 So each one of these, think of these as almost separate modalities.
0:19:19 Movement is a different modality from texture.
0:19:23 It is a different modality from what you’re wearing, between material.
0:19:27 And none of that, to you or your son, is interesting.
0:19:34 It is our job as an AI platform, that the right models get called, the right models get orchestrated.
0:19:39 Of course, in an ideal world, and I’m looking very, very into the future,
0:19:42 all of this should be answered by one model.
0:19:50 It can do photo talk, it can set up your upper body, it can set up your face and body coordination,
0:19:56 it can set up your gestures, and then put you into a world where you’re dancing to impacts or dressing to impacts.
0:20:01 But in reality, I tell you, each one of these are different models being called.
0:20:04 So generally, specific, special things to do.
0:20:07 – Let’s talk about creators. – Yeah.
0:20:11 You know, you mentioned you’ve got your own language that creators can code in.
0:20:15 There’s obviously, as we’ve alluded to during the conversation,
0:20:21 all kinds of visual, 3D, physics engines, all kinds of things happening in these experiences.
0:20:27 How are you incorporating generative AI into the creator tools?
0:20:33 And what are some of the, not just concerns, but some of the exciting things that are happening,
0:20:39 whether they’re at the level of an individual creator, or if we’re talking about orchestrating all of this at this massive scale?
0:20:47 Yeah, so the creator journey is very fascinating, because many of our creators are unleaving storytelling.
0:20:52 Right, and forgive me for interrupting, but just to sort of emphasize,
0:20:56 it’s been like a wake-up call to sort of how, you know, this generation,
0:21:01 and for me, it’s the generation of my son, but obviously your user span ages.
0:21:09 But just how important storytelling and just sort of the like personal, narrative, emotional aspects of these experiences really are, right?
0:21:14 I’ll watch my son, you know, role play, buying a house and decorating it.
0:21:20 And just doing, to me, seem like mundane things, but he’s hanging out and living this experience.
0:21:22 And it’s amazing.
0:21:24 Oh, yes, building a house on Roblox, it’s so much fun.
0:21:27 We could go on, but let’s go to the creator.
0:21:29 So there are creators.
0:21:35 One of my favorite experiences right now is being able to land on any airport in the world,
0:21:39 which is, you know, airport simulators has been around for a long while,
0:21:41 but combining it with Roblox is storytelling.
0:21:46 Now, but think about the creator, what they have to do is they have to start building the airport.
0:21:48 And I always speak by break.
0:21:50 We want to facilitate that really, really quickly.
0:21:56 It all starts with the most popular use case today in the industry is coding assistant.
0:21:59 Just let me code faster, right?
0:22:04 But after I’ve coded the world, now I want to give it texture.
0:22:07 Now I want to give it material, right?
0:22:11 You know, you’re giving your, you’re a creator.
0:22:15 You’re giving your users lovely aviator glasses, they could get pilots, right?
0:22:16 Talk on your friends.
0:22:21 And these aviators should have textures, they should have sound.
0:22:23 The material should be maybe metal.
0:22:26 All of this takes some time for our creators.
0:22:30 And they’re in a hurry to tell a beautiful story, but this takes time.
0:22:36 So for every step of their way, generative AI starts helping them.
0:22:40 The coding assistant is a pure text model.
0:22:47 But the material and texture models are much more richer and more interesting.
0:22:52 And now every one of our creators would love to have their players worldwide.
0:22:53 Right, of course.
0:22:55 Now, should they spend time translating?
0:22:59 And that’s where Roblox comes in, our translation is automated.
0:23:06 You, if Noah is creating a brilliant experience, but now you want to translate it
0:23:08 everywhere, we just make it happen.
0:23:13 And now once people are into your experience, we do all the chat translation too.
0:23:18 So from the time of coding to the time of release, we’re helping you everywhere,
0:23:19 originally to where.
0:23:22 >> That reminds me of something I wanted to ask you earlier.
0:23:28 When we talk about real time in the context of, say, translation or
0:23:31 even civility filters to put it that way.
0:23:35 Do you have a benchmark for what real time means?
0:23:41 >> So a real time for us is literally as you’re typing, the translation happens.
0:23:45 So as long as the user doesn’t see the thing we talked about,
0:23:50 when you press play, you shouldn’t see buffering, that’s what we aspire to.
0:23:51 So we shouldn’t even exist.
0:23:56 A great example of that is, and I’ll see your founder love to throw this example is,
0:24:00 Noah and other from get on a one-on-one on Roblox.
0:24:04 We have Roblox office, you and I get on a one-on-one.
0:24:06 >> Noah says something colorful.
0:24:06 >> Yeah.
0:24:07 >> In real time.
0:24:09 >> As I want to do.
0:24:10 >> Yeah.
0:24:14 >> In real time, you will get a nudge from our voice moderation system.
0:24:14 >> Right.
0:24:16 >> Then you say something more colorful.
0:24:20 You will now be suspended maybe for a few minutes.
0:24:20 >> Right.
0:24:22 >> So that is what real time means to us.
0:24:26 It is not a warning that will come to your inbox a day later.
0:24:29 >> As we start to wrap up here and ask you the question,
0:24:32 we always ask it in these conversations.
0:24:33 What’s next?
0:24:37 What are you either working on now or looking ahead to?
0:24:40 You mentioned, of course, way out in the future,
0:24:44 the one model that can handle all these different modalities and things.
0:24:47 Are there either problems that you’re trying to tackle right now or
0:24:53 something in the near horizon that you’re really excited about that you might give us a glimpse into?
0:24:55 >> Huge excitement is 4D.
0:24:59 I know you’ve talked about CD and 2D in many of your podcasts.
0:25:03 The fourth dimension, and I sound science-kitchen-y,
0:25:07 but the fourth dimension is you want a car in your experience.
0:25:09 The car doors have hinges.
0:25:11 It has to open the right way.
0:25:15 My favorite example is, I live in San Francisco.
0:25:19 I want to recreate all of San Francisco in its glory.
0:25:24 Alcatran siren, parade building, the painted ladies, Victorian houses, on Roblox.
0:25:27 I can create that, but it will take me some time.
0:25:30 But once I create the Victorian house, I want to enter it.
0:25:32 I want to open the door.
0:25:38 I want to hear the echo because the sound is different when I enter a Victorian house where there’s a glass house.
0:25:42 All of that takes effort on our current platform.
0:25:43 >> Of course.
0:25:48 >> What if you could just talk to it and then you start building the story?
0:25:50 You’ve seen all these movies like in San Francisco, right?
0:25:53 From romantic comedies to action thriller.
0:25:56 What if you could do that storytelling much faster?
0:26:00 Because the base of San Francisco was created so quickly for you.
0:26:03 That’s what I’m excited about, where they don’t think about models.
0:26:06 They don’t think about coding assistants, work templates, and etc.
0:26:11 They just think about storytelling, and the model is in the background just assisting them continuously.
0:26:15 It’s not even called an assistant because it is so much in the background.
0:26:21 >> We could talk for hours at least about any of these topics, as you alluded to throughout.
0:26:24 Perhaps we’ll get the opportunity to do this again in the near future.
0:26:31 I don’t think Roblox is going anywhere, so it would be great to check back in as technology advances
0:26:32 and the experiences advances.
0:26:37 But we do have quite a few technical-minded listeners in the audience.
0:26:44 So for folks who want more, want to dig into how all of these things, the models and the filters
0:26:49 and the real-time translation, are happening or are happening at such scale, are there places online?
0:26:53 Obviously Roblox has a website and a blog, but are there specific places
0:26:55 that you would direct folks to learn more?
0:26:58 >> Oh, yes. We have a Tech Talks podcast.
0:26:59 >> Oh, fantastic.
0:27:04 >> That is hosted by our CEO and founder, Dave Bazzucchi.
0:27:06 Every one of the topics that we talked about,
0:27:09 whether it’s just outcomes, growth engineering, safety, civility,
0:27:14 we have 40 to 45 minutes of deep dive by Dave himself.
0:27:17 >> Great. And that’s Roblox Tech Talks?
0:27:17 >> Yes.
0:27:20 >> Excellent. There’s a developer blog as well?
0:27:22 >> Yes, there’s a blog.roblox.com.
0:27:23 >> Easy enough.
0:27:26 >> You can go and look at what we are talking about.
0:27:28 >> Great. Well, Anupam, thank you again.
0:27:34 This podcast is not about me, but you’ve made me a star in my own household at least for a day,
0:27:37 getting to talk to you, so I appreciate that.
0:27:40 But more importantly, appreciate your coming on the podcast.
0:27:46 Just to give people a little bit of an insight into everything that has to go on behind the scenes,
0:27:51 so that whether you’re chatting with a friend, being kept safe and civil,
0:27:56 or experiencing these amazing 3D experiences,
0:27:59 you don’t have to wait for things to buffer. They just happen.
0:28:00 >> Yes. Thank you very much.
0:28:04 This was, I’m an avid listener of your podcast, so it should be great.
0:28:05 >> I appreciate that.
0:28:08 Look forward to chatting again and all the best to you and your teams.
0:28:08 >> Thank you.
0:28:18 [MUSIC]
0:28:28 [MUSIC]
0:28:38 [MUSIC]
0:28:48 [MUSIC]
0:28:58 [MUSIC]
0:29:08 [BLANK_AUDIO]
0:00:13 Hello, and welcome to the NVIDIA AI podcast.
0:00:16 I’m your host, Noah Kravitz.
0:00:21 Since it launched in 2006, Roblox has grown into one of the biggest gaming and
0:00:26 digital experiences platforms in the world, by basically any metric you want to look at.
0:00:29 According to the company’s fourth quarter 2023 financial reporting,
0:00:33 Roblox boasts more than 71 million average daily users,
0:00:38 accounting for 15.5 billion hours of engagement last year.
0:00:41 Those numbers include both players and creators,
0:00:45 as user-created content has always been central to the Roblox experience.
0:00:48 Providing both cutting edge tools for creators and
0:00:52 quality experiences for users at scale is no easy feat.
0:00:56 And with so many of Roblox users being under the age of 16, including my own son,
0:01:01 who can often be found drifting virtual supercars through various of the Roblox games.
0:01:05 Keeping things civil and safe for everyone has to be a high priority.
0:01:08 How do you run a platform like this at such a massive scale?
0:01:11 And how does AI play a part in the process?
0:01:14 Here to take us under the hood of Roblox is Anupam Singh,
0:01:17 Vice President of AI and Growth Engineering.
0:01:22 Anupam, welcome and thank you so much for joining the NVIDIA AI podcast.
0:01:23 >> Hey, Noah, thank you very much.
0:01:28 My son, I mentioned in the intro, made sure I did my homework on this one.
0:01:31 He’s very excited we’re having this conversation.
0:01:34 Maybe very briefly, because there’s a lot to dig into
0:01:38 in terms of the infrastructure and the things that are under your purview.
0:01:41 Again, from both the creator and end user side of things.
0:01:44 But for folks who might not be familiar with Roblox,
0:01:46 and I think there are at least a few out there,
0:01:49 maybe give us an overview of what Roblox is all about.
0:01:55 So at a vision level, as a founder talks about it for the last 10 years,
0:01:59 it’s about reimagining the way people come together.
0:02:01 You and I want to hang out somewhere.
0:02:04 Obviously, we have many, many different ways to hang out.
0:02:09 But our vision is to bring a billion people together
0:02:12 with optimism and civility.
0:02:16 Now, especially the civility part is very important
0:02:21 because that gets us to deep technical innovation
0:02:24 to keep everything safe, everything civil.
0:02:27 And from day one, we’ve invested a lot in that area.
0:02:31 And optimism is about, if you go into one of our experiences,
0:02:37 you’ll be amazed on how encouraging and interesting they could be.
0:02:40 There’s the latest one, something called Dusty Trip.
0:02:45 There’s another one called Pet Simulator, where you hang with your pet.
0:02:48 But there’s a lot of other things going on like Valentine’s Day,
0:02:49 St. Patrick’s Day.
0:02:53 So it’s all about connecting a billion people with optimism and civility.
0:02:55 And it’s a group experience, right?
0:03:02 There’s, as you put it, it’s as much, it seems as about hanging out with your friends
0:03:07 as it is about this incredibly diverse array of games and experiences.
0:03:09 Yes, absolutely.
0:03:10 And so how do people hang out?
0:03:15 Is text chat, voice chat, how does the interaction happen?
0:03:20 Yeah, so it starts with you open the Roblox app or the Roblox web page.
0:03:25 And there’s hundreds of experience that are there for you to select.
0:03:29 You know, think of a movie that you have to select to watch.
0:03:32 But after that, you’re inside the movie, that’s the difference.
0:03:39 And so you press play like you would do on any other app where you consume content.
0:03:42 But then you get into the universe.
0:03:48 And my favorite ones are where you can actually immediately create an avatar.
0:03:51 You know, you get feathers if you’re if you’re willing to.
0:03:55 And if you’re interested, you get like a lovely feather dress.
0:03:58 And, you know, there’s a lot of audio going on.
0:04:05 And so another favorite ones of mine are where you can dance with people.
0:04:10 So I managed to say ballroom dance is one of my favorites right now.
0:04:10 Excellent.
0:04:13 And I just keep learning dancing.
0:04:18 Something that honestly, I wouldn’t be able to do in my normal weekday.
0:04:20 But I can do a ballroom dance in the evening.
0:04:26 So let’s talk about your role, what’s under your purview and how that, you know,
0:04:30 sort of informs the experience for the millions and millions of Roblox users.
0:04:35 You one of the things, as I understand it, that you’re responsible for is managing
0:04:38 and optimizing infrastructure across the platform.
0:04:43 And there’s a lot happening now with AI and generative AI tools in particular.
0:04:46 So maybe you can you can take us a little bit into that.
0:04:48 Yeah. So two part answer.
0:04:52 When your son plays it, he doesn’t realize that we have to connect
0:04:56 in to a data center, which is hopefully close by.
0:04:58 So that is the experience is amazing.
0:05:02 Remember, your son is up a generation who believes that press play does not have buffers.
0:05:06 And I’m sure looking at you, you remember the time when, you know,
0:05:09 you would press play and some buffering would happen.
0:05:11 So that’s the first magical experience.
0:05:14 Oh, I remember that the AOL dial-up sound.
0:05:14 That’s what I’m thinking about.
0:05:16 There you go.
0:05:22 But this generation of users on the Internet, just expect to press play.
0:05:25 Then you have to place inside the experience behind the things
0:05:29 what’s happening is he’s connecting with one of our edge data centers.
0:05:34 And then you have to decide who are the best people your son could play with.
0:05:37 You know, it has to be age appropriate.
0:05:38 It has to be interesting.
0:05:40 Maybe he already has friends on the platform.
0:05:43 So I have to quickly figure out where are his friends?
0:05:46 Are they in the same data center or they’re in a different data center,
0:05:50 placing them in the right instance of the experience?
0:05:55 Our biggest experience sometimes has 40 to 50,000 copies running worldwide
0:05:57 on 20 plus data centers.
0:06:00 So we have to place them in the right instance.
0:06:03 After that, let’s say he wants to chat with people.
0:06:04 So we have to enable that chat.
0:06:08 Let’s say he wants to do a voice call with one of them.
0:06:09 We have to enable that.
0:06:14 Let’s say he actually wants to talk to somebody in India,
0:06:16 which means he has to talk in Hindi.
0:06:19 But assuming, let’s say, your son doesn’t know Hindi.
0:06:25 We have real-time translation to facilitate chatting with somebody in India.
0:06:26 So in Hindi.
0:06:31 So that’s the kind of stuff that we in the infrastructure team build.
0:06:33 Now, we like to be invisible.
0:06:38 You should never think about the data center that you’re connecting to.
0:06:40 How does machine learning play a role?
0:06:41 Broad question.
0:06:42 Very broad question.
0:06:47 So we think about machine learning, typically, to start with,
0:06:50 either for the creator or for the user.
0:06:52 So you have to create these magical experiences.
0:06:55 We talked about ballroom dance.
0:06:57 We talked about dress interest.
0:06:59 There’s a lot of storytelling in there.
0:07:03 But most of our creators have the right code to build that world.
0:07:06 Anything that facilitates their building of the world.
0:07:08 It’s their idea.
0:07:10 We don’t build our own experiences.
0:07:13 It’s millions of developers who build experiences.
0:07:17 We need to facilitate that really, really quickly.
0:07:19 And I’m sure we’ll go into those examples.
0:07:22 On the other side are the users.
0:07:24 The users just join the experience.
0:07:29 And if we want a safe environment, if we want a civil environment,
0:07:33 a very simple example, you and I are chatting on Roblox.
0:07:37 Every letter that you type, every word that you type,
0:07:40 goes through a text filter for a civility check.
0:07:45 And just that portion of our world is–
0:07:46 I have to get this right.
0:07:56 It’s 90.7 billion messages are translated, and 2.5 billion chat messages are sent every day.
0:08:01 And every one of these have to be checked whether you’re being civil to me,
0:08:02 whether I’m being civil to you.
0:08:07 And this is in real time across all the different languages,
0:08:09 all the different data centers and geographic locations,
0:08:13 and the private chats and the public chats and just the scale.
0:08:14 Every time, yeah.
0:08:19 Now, of course, people choose to sample this in other settings.
0:08:22 But from day one, we’ve not sampled.
0:08:25 Every one of these goes through a text filter,
0:08:31 which means you need a machine learning solution to look at 2.5 billion chat messages.
0:08:35 And sometimes, as you said, in a private setting,
0:08:38 we might be more colorful with each other.
0:08:42 But in a public setting, we’re not going to be colorful.
0:08:44 We should not be colorful.
0:08:51 So making all those decisions in real time would have only been possible with machine learning.
0:08:57 How do you approach a problem sort of at that scale?
0:08:59 How do you get– has that been from day one?
0:09:04 Has the importance of real time civility tools to put it that way?
0:09:07 Has that always been baked into Roblox’s mission,
0:09:10 or is it something that kind of evolved necessity?
0:09:14 Yeah. So one thing for us is it’s always been baked into it.
0:09:19 So our engineers never start building something, saying maybe we should sample,
0:09:25 maybe we should just do it for NOAA, but not for Anupam, which is arbitrary.
0:09:26 It’s for every user.
0:09:32 So first, your design principle should be clear that I want to do it for every user, every chat message.
0:09:38 Once you’ve established that, every few years, we have had to change our machine learning model.
0:09:45 So a few years ago, there was a model that was– AI people have to have acronyms, by the way, NOAA.
0:09:48 So one of them is SOTA, state of the art.
0:09:52 The problem is, the SOTA changes every year.
0:09:57 So we are the state of the art model, which would do a billion messages.
0:10:02 So we took the model, we trained it with our own data,
0:10:07 and then we had to make it smaller to run faster.
0:10:10 Right, right. It could be billions of parameters,
0:10:15 and then you sort of put it on a diet so it can run faster.
0:10:20 And so we go from, let’s say, 70 plus billion to 7 billion parameters.
0:10:26 But what’s happened in the last, I would say, 24 months, which is exciting,
0:10:28 is the entire model architecture has changed.
0:10:34 So it’s not just about, hey, let’s take one more model and that does natural language processing.
0:10:39 You now have all these generative AI models that can do text summarization,
0:10:41 that can do text moderation, et cetera.
0:10:47 So we take those bigger models, and to run it from scale, we take every technique possible.
0:10:49 We have to distill it to make it smaller.
0:10:53 We have to fine tune it to take our data and fix it.
0:10:55 And then we run it in production.
0:11:00 And honestly, once you start running things in production, you have many phase palm moments.
0:11:02 You say, wow, we could have done this.
0:11:04 We could have done memory.
0:11:05 We could back the thing.
0:11:09 So yeah, it’s our design thinking and then running it in production.
0:11:15 Now, I know that, broadly speaking, and also in Roblox, and as I understand it,
0:11:18 even within the purview of scaling, safety and civility,
0:11:24 multimodal LLMs models are, I don’t want to say the new thing,
0:11:30 but they’re becoming more and more important and talked about in all phases of technology.
0:11:32 How do multimodal LLMs play a part?
0:11:35 Multimodal models play a part in your work.
0:11:40 And this may or may not be relevant, but it’s something that popped into my mind talking about civility.
0:11:43 When you were talking about running the chats through text filters,
0:11:52 it made me think about slang and lingo and how you sort of keep up with words that I might not understand,
0:11:56 but might be extremely colorful to use that word to people in the know.
0:11:59 So how do you just keep up with all of that?
0:12:03 And then second question is about non-text things.
0:12:13 So if an avatar has something questionable, or I don’t know actually if you’re allowed to share images and memes and that sort of thing.
0:12:14 But yeah, you can talk about that.
0:12:25 Yeah, so let’s talk about multimodality and then we’ll talk about, you know, what I would call internet with things that you and I might not know are offensive, but they are offensive.
0:12:35 But multimodality, you’re 100% right that in the last two years, we just assume text models are there.
0:12:42 Any of us can access PPD, any of us can access, you know, any model that you want to pick up, right?
0:12:47 What’s exciting about the last one year is the use papers are also tending.
0:12:52 So more and more on our platform, people would love to use voice.
0:13:07 So what we did around two years ago, we decided that we will think twice the same way as your ticket tech, which means, you know, you want to check for profanity and other offensive words in speech.
0:13:18 And so we use a very large model, thankfully, large models are available both open source and closed source to convert firstly voice to tech.
0:13:25 And then we use all our tech knowledge from 10 plus years to moderate voice.
0:13:29 The next question that you have is even more interesting, which is images.
0:13:46 We always had image moderation in our, in our platform, since 10 plus years, our founder likes to tell the story of, he used to do the moderation you maybe 15 years ago, it does not anymore, but he used to.
0:13:50 We donate billions of money in 70 days.
0:13:56 And the exciting part is each one of these large models has the wisdom of the internet packed into them.
0:13:58 Earlier, we might have to train it from scratch.
0:14:01 Maybe five years ago, Roblox would have to train it from scratch.
0:14:06 So now let’s say there is a new plan or a new offensive image.
0:14:13 I don’t get the benefit of somebody else in the large state of the art model and open source in there.
0:14:24 But now we start many of our initiatives with a large open source model that has the wisdom of the internet and is able to update to newer things.
0:14:29 Then we find the unit when we distill it to Roblox as we would say.
0:14:36 So image, voice and text are all in production for art.
0:14:46 Then if you’re going to take multi-modality further out, and I know you talked about this in some of your other podcasts is really that’s not just a picture.
0:14:51 That is, you know, I could make something really interesting.
0:14:54 And I don’t want to just focus on civility here.
0:15:01 It’s just the beauty of what you can create on the platform and how quickly can you create about it.
0:15:07 So we are very focused on 3D and 4D as the next modality.
0:15:14 And then, honestly, we don’t see a lot of models that have already been built in open source.
0:15:19 There is no easy wisdom of the internet as far as 3D and 4D.
0:15:26 And so you’re using kind of a cross all these things I’m generalizing, but you’re using a mix of available open source,
0:15:32 you know, available models that you find, train and otherwise, but then you’re also building models in-house.
0:15:42 Yeah, OK, so for example, for recommendations, our model is internally built for certain safety use cases, our model is internally built.
0:15:45 We have a coding system, but we have our own language.
0:15:52 So we take an open source model and then we combine with our language and build a large model.
0:15:59 I’m speaking with Anupam Singh. Anupam is vice president of AI and growth engineering at Roblox.
0:16:04 Roblox is one of the leading online platforms in the world, bar none.
0:16:13 But certainly when it comes to creating and using all kinds of digital experiences from games to role-play simulators,
0:16:20 ballroom dancing, as you said, Anupam, it’s just amazing, all the things that are out there and being built literally every day.
0:16:29 You touched on this briefly and I want to sort of flip over to the creation experience and how, you know, you mentioned Roblox has its own code,
0:16:32 the Roblox Studio, I believe, is the platform for creating.
0:16:41 But actually first, I wanted to start with talking about avatars, because my experience has been, you know, as a user, as a parent of a user,
0:16:49 but then as a user myself, I’ll go on and play games. I love the driving games. There’s some fun and big paintball is one of my favorites.
0:16:56 But the whole idea of an avatar is just incredibly essential and important.
0:17:05 And, you know, it’s vital to so many people’s online identities broadly, but particularly on your platform.
0:17:10 You know, every time my son will show me like, hey, check out my new avatar’s outfit.
0:17:18 And it’ll be, you know, his favorite footballer’s uniform or it’ll be, you know, some some just wild costume or this or that.
0:17:26 So can you talk a little bit about the technology sort of behind being able to create and customize avatars?
0:17:32 And, you know, how that relates to, I mean, basically anything that that is important to you, but talking about civility.
0:17:39 But then, you know, more talking about just like giving users the tools to express themselves.
0:17:48 Yeah, I’ll tell us of such a rich team. We could spend hours talking about it, but let’s start with a very simple application.
0:17:53 There’s a likelihood that you want the author to reflect some of your personality, right?
0:18:02 Including you have this lovely backdrop behind you, which people can’t see on the audio podcast of these lovely electronic devices.
0:18:07 And so let’s start with taking your photo and creating an avatar out of it.
0:18:13 To be simple, if it was only 2D, 2D filters are on the phone, you can do them today.
0:18:17 Great thing, right? By all the great phone manufacturers.
0:18:20 But you want it to moron, you want it to mo.
0:18:29 That’s when, you know, creation of these photos of the generation of 2D and 3D are major innovations.
0:18:35 And it is ongoing. There, our technology has to, you know,
0:18:43 both be built from scratch, but also use some of the existing 2D to 3D, 2D to 3D innovation.
0:18:47 Then, okay, we took your photo, we will take an avatar, but we want to set it up.
0:18:52 You know, we want to give it a phone, which is beyond just your maybe face.
0:18:59 That’s how to set it up. Next, we want to track your upper body, because your upper body movements.
0:19:04 I love to gesture a lot. Maybe you gesture less. How do we capture that?
0:19:09 And after all of that, you need to put it in a word, in a cohesive way.
0:19:16 So each one of these, think of these as almost separate modalities.
0:19:19 Movement is a different modality from texture.
0:19:23 It is a different modality from what you’re wearing, between material.
0:19:27 And none of that, to you or your son, is interesting.
0:19:34 It is our job as an AI platform, that the right models get called, the right models get orchestrated.
0:19:39 Of course, in an ideal world, and I’m looking very, very into the future,
0:19:42 all of this should be answered by one model.
0:19:50 It can do photo talk, it can set up your upper body, it can set up your face and body coordination,
0:19:56 it can set up your gestures, and then put you into a world where you’re dancing to impacts or dressing to impacts.
0:20:01 But in reality, I tell you, each one of these are different models being called.
0:20:04 So generally, specific, special things to do.
0:20:07 – Let’s talk about creators. – Yeah.
0:20:11 You know, you mentioned you’ve got your own language that creators can code in.
0:20:15 There’s obviously, as we’ve alluded to during the conversation,
0:20:21 all kinds of visual, 3D, physics engines, all kinds of things happening in these experiences.
0:20:27 How are you incorporating generative AI into the creator tools?
0:20:33 And what are some of the, not just concerns, but some of the exciting things that are happening,
0:20:39 whether they’re at the level of an individual creator, or if we’re talking about orchestrating all of this at this massive scale?
0:20:47 Yeah, so the creator journey is very fascinating, because many of our creators are unleaving storytelling.
0:20:52 Right, and forgive me for interrupting, but just to sort of emphasize,
0:20:56 it’s been like a wake-up call to sort of how, you know, this generation,
0:21:01 and for me, it’s the generation of my son, but obviously your user span ages.
0:21:09 But just how important storytelling and just sort of the like personal, narrative, emotional aspects of these experiences really are, right?
0:21:14 I’ll watch my son, you know, role play, buying a house and decorating it.
0:21:20 And just doing, to me, seem like mundane things, but he’s hanging out and living this experience.
0:21:22 And it’s amazing.
0:21:24 Oh, yes, building a house on Roblox, it’s so much fun.
0:21:27 We could go on, but let’s go to the creator.
0:21:29 So there are creators.
0:21:35 One of my favorite experiences right now is being able to land on any airport in the world,
0:21:39 which is, you know, airport simulators has been around for a long while,
0:21:41 but combining it with Roblox is storytelling.
0:21:46 Now, but think about the creator, what they have to do is they have to start building the airport.
0:21:48 And I always speak by break.
0:21:50 We want to facilitate that really, really quickly.
0:21:56 It all starts with the most popular use case today in the industry is coding assistant.
0:21:59 Just let me code faster, right?
0:22:04 But after I’ve coded the world, now I want to give it texture.
0:22:07 Now I want to give it material, right?
0:22:11 You know, you’re giving your, you’re a creator.
0:22:15 You’re giving your users lovely aviator glasses, they could get pilots, right?
0:22:16 Talk on your friends.
0:22:21 And these aviators should have textures, they should have sound.
0:22:23 The material should be maybe metal.
0:22:26 All of this takes some time for our creators.
0:22:30 And they’re in a hurry to tell a beautiful story, but this takes time.
0:22:36 So for every step of their way, generative AI starts helping them.
0:22:40 The coding assistant is a pure text model.
0:22:47 But the material and texture models are much more richer and more interesting.
0:22:52 And now every one of our creators would love to have their players worldwide.
0:22:53 Right, of course.
0:22:55 Now, should they spend time translating?
0:22:59 And that’s where Roblox comes in, our translation is automated.
0:23:06 You, if Noah is creating a brilliant experience, but now you want to translate it
0:23:08 everywhere, we just make it happen.
0:23:13 And now once people are into your experience, we do all the chat translation too.
0:23:18 So from the time of coding to the time of release, we’re helping you everywhere,
0:23:19 originally to where.
0:23:22 >> That reminds me of something I wanted to ask you earlier.
0:23:28 When we talk about real time in the context of, say, translation or
0:23:31 even civility filters to put it that way.
0:23:35 Do you have a benchmark for what real time means?
0:23:41 >> So a real time for us is literally as you’re typing, the translation happens.
0:23:45 So as long as the user doesn’t see the thing we talked about,
0:23:50 when you press play, you shouldn’t see buffering, that’s what we aspire to.
0:23:51 So we shouldn’t even exist.
0:23:56 A great example of that is, and I’ll see your founder love to throw this example is,
0:24:00 Noah and other from get on a one-on-one on Roblox.
0:24:04 We have Roblox office, you and I get on a one-on-one.
0:24:06 >> Noah says something colorful.
0:24:06 >> Yeah.
0:24:07 >> In real time.
0:24:09 >> As I want to do.
0:24:10 >> Yeah.
0:24:14 >> In real time, you will get a nudge from our voice moderation system.
0:24:14 >> Right.
0:24:16 >> Then you say something more colorful.
0:24:20 You will now be suspended maybe for a few minutes.
0:24:20 >> Right.
0:24:22 >> So that is what real time means to us.
0:24:26 It is not a warning that will come to your inbox a day later.
0:24:29 >> As we start to wrap up here and ask you the question,
0:24:32 we always ask it in these conversations.
0:24:33 What’s next?
0:24:37 What are you either working on now or looking ahead to?
0:24:40 You mentioned, of course, way out in the future,
0:24:44 the one model that can handle all these different modalities and things.
0:24:47 Are there either problems that you’re trying to tackle right now or
0:24:53 something in the near horizon that you’re really excited about that you might give us a glimpse into?
0:24:55 >> Huge excitement is 4D.
0:24:59 I know you’ve talked about CD and 2D in many of your podcasts.
0:25:03 The fourth dimension, and I sound science-kitchen-y,
0:25:07 but the fourth dimension is you want a car in your experience.
0:25:09 The car doors have hinges.
0:25:11 It has to open the right way.
0:25:15 My favorite example is, I live in San Francisco.
0:25:19 I want to recreate all of San Francisco in its glory.
0:25:24 Alcatran siren, parade building, the painted ladies, Victorian houses, on Roblox.
0:25:27 I can create that, but it will take me some time.
0:25:30 But once I create the Victorian house, I want to enter it.
0:25:32 I want to open the door.
0:25:38 I want to hear the echo because the sound is different when I enter a Victorian house where there’s a glass house.
0:25:42 All of that takes effort on our current platform.
0:25:43 >> Of course.
0:25:48 >> What if you could just talk to it and then you start building the story?
0:25:50 You’ve seen all these movies like in San Francisco, right?
0:25:53 From romantic comedies to action thriller.
0:25:56 What if you could do that storytelling much faster?
0:26:00 Because the base of San Francisco was created so quickly for you.
0:26:03 That’s what I’m excited about, where they don’t think about models.
0:26:06 They don’t think about coding assistants, work templates, and etc.
0:26:11 They just think about storytelling, and the model is in the background just assisting them continuously.
0:26:15 It’s not even called an assistant because it is so much in the background.
0:26:21 >> We could talk for hours at least about any of these topics, as you alluded to throughout.
0:26:24 Perhaps we’ll get the opportunity to do this again in the near future.
0:26:31 I don’t think Roblox is going anywhere, so it would be great to check back in as technology advances
0:26:32 and the experiences advances.
0:26:37 But we do have quite a few technical-minded listeners in the audience.
0:26:44 So for folks who want more, want to dig into how all of these things, the models and the filters
0:26:49 and the real-time translation, are happening or are happening at such scale, are there places online?
0:26:53 Obviously Roblox has a website and a blog, but are there specific places
0:26:55 that you would direct folks to learn more?
0:26:58 >> Oh, yes. We have a Tech Talks podcast.
0:26:59 >> Oh, fantastic.
0:27:04 >> That is hosted by our CEO and founder, Dave Bazzucchi.
0:27:06 Every one of the topics that we talked about,
0:27:09 whether it’s just outcomes, growth engineering, safety, civility,
0:27:14 we have 40 to 45 minutes of deep dive by Dave himself.
0:27:17 >> Great. And that’s Roblox Tech Talks?
0:27:17 >> Yes.
0:27:20 >> Excellent. There’s a developer blog as well?
0:27:22 >> Yes, there’s a blog.roblox.com.
0:27:23 >> Easy enough.
0:27:26 >> You can go and look at what we are talking about.
0:27:28 >> Great. Well, Anupam, thank you again.
0:27:34 This podcast is not about me, but you’ve made me a star in my own household at least for a day,
0:27:37 getting to talk to you, so I appreciate that.
0:27:40 But more importantly, appreciate your coming on the podcast.
0:27:46 Just to give people a little bit of an insight into everything that has to go on behind the scenes,
0:27:51 so that whether you’re chatting with a friend, being kept safe and civil,
0:27:56 or experiencing these amazing 3D experiences,
0:27:59 you don’t have to wait for things to buffer. They just happen.
0:28:00 >> Yes. Thank you very much.
0:28:04 This was, I’m an avid listener of your podcast, so it should be great.
0:28:05 >> I appreciate that.
0:28:08 Look forward to chatting again and all the best to you and your teams.
0:28:08 >> Thank you.
0:28:18 [MUSIC]
0:28:28 [MUSIC]
0:28:38 [MUSIC]
0:28:48 [MUSIC]
0:28:58 [MUSIC]
0:29:08 [BLANK_AUDIO]
Roblox is a colorful online platform that aims to reimagine the way that people come together — now that vision is being augmented by generative AI. In this episode of NVIDIA’s AI Podcast, host Noah Kravitz speaks with Anupam Singh, vice president of AI and growth engineering at Roblox, on how the company is using the technology to enhance virtual experiences with features such as automated chat filters and real-time text translation, which help build inclusivity and user safety. Singh also discusses how generative AI can be used to power coding assistants that help creators focus more on creative expression, rather than spending time manually scripting world-building features.