Claude 3.5 Sonnet: Is OpenAI Falling Behind?

0:00:02 I need this from my email as soon as possible.
0:00:08 Yeah, I’m like imagining this workflow where like you’re listening to your emails with some extra commentary.
0:00:11 There’s something new being born there that never existed before.
0:00:18 When all your marketing team does is put out fires, they burn out.
0:00:23 But with HubSpot, they can achieve their best results without the stress.
0:00:32 Tap into HubSpot’s collection of AI tools, Breeze, to pinpoint leads, capture attention, and access all your data in one place.
0:00:35 Keep your marketers cool and your campaign results hotter than ever.
0:00:38 Visit hubspot.com/marketers to learn more.
0:00:47 Hey, welcome to the Next Wave Podcast.
0:00:47 I’m Matt Wolf.
0:00:49 I’m here with Nathan Lanz.
0:00:54 And today we’re going to discuss a lot of the latest stuff to come out of the AI world.
0:01:03 Things from Anthropic and OpenAI and HubSpot and all of these big players that are building stuff in the AI space right now.
0:01:05 But we’re not just going to talk about the news.
0:01:08 We’re going to talk about what the heck do we actually do with this stuff?
0:01:14 You know, there’s a lot of discussion going on in the AI world around that’s a really, really cool thing.
0:01:16 But how would I actually use that in my life?
0:01:22 Well, we’re going to talk about that and some really cool stuff has come out from Anthropic and OpenAI lately.
0:01:29 And we’re going to give you our thoughts on where this might be going and how you can actually integrate this and implement it in your business.
0:01:36 So this week, I think the most exciting thing that I saw that’s actually useful is the new Claude 3.5 Sonnet.
0:01:42 You know, I’ve been a big believer in OpenAI and even though people were saying, “Hey, Claude’s better at writing.”
0:01:49 I’m like, “Ah, but still, you know, with OpenAI and ChatGPT, I have my custom instructions and it knows more about me and has more context about me.”
0:01:55 Well, now with the new Claude, not only is it better than ChatGPT, but also they’ve added this new thing called Projects.
0:01:58 And so Projects is basically like custom instructions, but better.
0:02:04 For example, like with my newsletter, I created a project called The Lore Newsletter and then I gave it all these notes.
0:02:07 So I said, “Here’s kind of my writing style.
0:02:11 Here are like two of my favorite newsletters and the kind of writing style that I’ve learned from.
0:02:18 Here are my previous issues of newsletter and also the kind of general template I use to lay out my newsletter every week.”
0:02:21 And that has made the Claude such a better editor than before.
0:02:26 Like before, it had no context like, “Who’s Nathan?” or like, “What is he like?” or “What’s the newsletter?”
0:02:29 And now you don’t have to do any of that. Like, it just knows all of it.
0:02:37 And so it seems like, you know, yeah, for a newsletter, it’s a great use case, but it feels like this is going to be where companies can really start to find value with AI.
0:02:40 Because my understanding too is you can actually share the projects, right?
0:02:45 So you can make this for any kind of project and feed it all the context that’s relevant for that project.
0:02:50 And now everybody who’s involved in that project, when they go into the AI, it’s already got everything set up.
0:02:52 So it knows like what you’re trying to accomplish.
0:02:55 So honestly, I haven’t played with the projects feature yet.
0:03:01 You know, at the time of this recording, I’ve actually been traveling and I just got home and I haven’t played with that yet.
0:03:07 But they also rolled out a feature called Artifacts, where it puts this like sidebar inside of Claude.
0:03:13 So on the left of your screen, you type your prompts and it looks just like Claude’s always looked.
0:03:18 But then on the right, whatever the sort of output you’re looking for will show up on the right.
0:03:28 So one of the very first things that I tested with that was I wanted to see if I can have it write a game for me and actually test the game straight in Claude without ever leaving the website.
0:03:31 And it worked. I asked it. I made a very, very simple game.
0:03:36 I said, hey, make me a tic-tac-toe game that I can play against the computer.
0:03:41 And with a single prompt, it generated that game and then it worked first try.
0:03:47 I mean, the computer actually sucked at tic-tac-toe like the logic of where it should place the thing wasn’t there yet.
0:03:53 But I would put my X’s down and it would put an O down and I put an X down and it put O down and I beat it every single time.
0:04:00 Because the AI that it generated wasn’t very smart for the game, but it was all playable right inside of Claude.
0:04:05 I didn’t even need to copy the code, paste it into a text document, open it as like a HTML file.
0:04:06 Didn’t need to do any of that.
0:04:10 It just loaded up in this new artifact sidebar and I was able to test it out.
0:04:12 And I just thought that was like so cool.
0:04:16 You can test the code without ever leaving the website.
0:04:21 And then if something doesn’t work with it, you just go to the left side of your screen and say, hey, this didn’t work.
0:04:26 Fix it and it will rework the code and show it to you again in the right sidebar.
0:04:27 And that was really, really cool.
0:04:30 But I haven’t actually played with the projects yet.
0:04:39 I just know that, you know, I have some custom GPTs that I made over in over in chat GPT where I mostly use them for like
0:04:44 Duplicatable processes that I find myself doing over and over again, kind of like you mentioned for your newsletter.
0:04:52 And one of the ways that I was using the custom GPT was I was taking all of the links from one of my YouTube videos, right?
0:04:57 I usually have like 20 tabs open and I’m like, here’s this thing and then here’s this thing and then here’s this thing.
0:05:03 And then I take all of the URLs from those tabs, I would plug them over into chat GPT and a custom GPT that I made.
0:05:09 And I said, you know, create a resource list for me and it would give every single URL a sort of title, a URL, title URL.
0:05:17 And it used to work really, really good. When GPT 4.0 came out, it actually broke that custom GPT and stopped working for me.
0:05:26 So I’m like, when you mentioned this just now, that Claude has this projects and it’s kind of similar to like a system prompt or almost like a custom GPT.
0:05:31 I’m like, well, that sort of eliminated one of the use cases I used to go to chat GPT for.
0:05:36 Yeah, for sure. I mean, this is like the first time I feel like I can actually switch over.
0:05:41 But you’re talking about the artifacts thing. So another thing with projects is apparently you can share the artifacts.
0:05:46 I’m imagining like two, you know, two teenagers who are like coding on a project together, like how cool that’s going to be now,
0:05:52 where they literally can go into the AI and say, hey, we want to make this little game together or this little website or whatever.
0:05:58 And you can talk to the AI and you can actually see the output. You can see the output of the code and go back and forth on that together.
0:06:02 There’s something new being born there that never existed before, like in terms of collaboration on projects.
0:06:09 I wonder if you can make like a multiplayer game, right? Like I make a game like just for the most basic possible example.
0:06:16 The tic-tac-toe game I made, I log in and and playing the game against you, you know, over in Japan, right?
0:06:22 Like that would be crazy. I don’t know if it’s there yet, right? You’re probably just seeing like the front facing code.
0:06:27 You’re probably not seeing my input, but that would be cool if we could figure out how to like make multiplayer games in there,
0:06:34 where you log in, you see like the move that I made and then you make your move and I see the move you made.
0:06:43 And we can go back and forth and almost like create a multiplayer game inside of artifacts, but with the sort of team group feature that’s there.
0:06:49 Yeah. I mean, I think right now it’s mainly JavaScript. They’re outputting. I could be wrong, but I think a lot of the stuff I’ve seen at least is JavaScript.
0:06:51 So you’d probably want to have some kind of back in.
0:06:59 But like, you know, you know, whether it’s Microsoft or one of these guys, you know, you know, Anthropic, I think they’re funded partially by Amazon.
0:07:02 So in theory, they could just partner with AWS, right?
0:07:11 And you could have something in the back end where it rolls up a server, usually with games, you know, net code is one of the kind of challenging things, engineering wise.
0:07:14 But my understanding is there’s a few best practices for that now.
0:07:20 So I don’t see why AI couldn’t learn how net code works and then just roll up a server for a game.
0:07:21 And then, yeah, now you do have a multiplayer game.
0:07:27 So I don’t think that’s currently possible, but that feels like something that’s probably six months away, maybe 12 months.
0:07:29 Yeah. Yeah. And they’re up expect by Google, too.
0:07:33 So they have AWS and Google Cloud, you know, potentially at their disposal.
0:07:36 Right. So yeah, I mean, I think that’ll be really interesting.
0:07:42 I need to play with that projects feature a little more as far as the project features go.
0:07:50 I mean, what are what are some of the like super exciting use cases that that we can think of for using that projects feature?
0:07:55 Because, you know, again, like we mentioned at the beginning of the show, like, this is really, really cool.
0:07:57 All right. Now, how do I use this in my business?
0:07:59 How do I use this in my daily life for productivity?
0:08:03 How do I actually, like, integrate this new technology?
0:08:05 I’m curious your thoughts there.
0:08:13 One on the on a personal side, you know, I recently saw a tweet from Greg Eisenberg talking about micro weddings and telling me how that’s like a new thing,
0:08:16 where people don’t want to spend hundreds of thousands of dollars on a wedding.
0:08:18 They want to have like 10 to 20 friends.
0:08:24 And and but he talks about how that’s a huge trend and it’s so hard to like manage putting together a wedding.
0:08:26 And obviously, I just recently got married.
0:08:29 We had a relatively small wedding, very expensive, though.
0:08:33 And in the meetings with the staff were so long.
0:08:37 I was sitting there thinking, God, you know, now that there’s this cloud, you know, the projects.
0:08:39 I’m like, I can make a project for the wedding.
0:08:43 I could have told it like, here’s the kind of wedding we’re wanting to have help us organize everything.
0:08:45 And here’s like some reference images and stuff.
0:08:51 And yes, sure, it could have done everything, but I think it could have helped basically been like the wedding organizer for sure.
0:08:58 I wonder how close it is to like, you know, Anthropics got like visual capabilities as well, right?
0:09:01 You can upload a photo and then it can see what’s in the photo.
0:09:03 And you can ask questions about that photo.
0:09:09 I wonder, can Claude and this is something I don’t know, maybe you do, but if you don’t, that’s OK.
0:09:16 Can Claude actually like see what it built over in that right side, the artifact sidebar, right?
0:09:23 Because if it can, how close is Claude to being like what we saw from Devin, right?
0:09:26 Write me this game and then it writes the game.
0:09:28 The game pops up in the right sidebar.
0:09:34 It tests the game itself to see if the game is functioning the way that specific game should.
0:09:42 And if it’s not, send that image or the response or the error report or whatever back to the code on the left sidebar.
0:09:46 Fix it, iterate it and then present it again on the right sidebar.
0:09:53 Like it feels to me like this is one step closer to that sort of agentic thing that everybody was looking for, especially for code.
0:10:00 I mean, right now with Anthropic, the thing that everybody is sort of blown away by is how good it is at writing code.
0:10:06 It’s gotten like so much better than what GPT4 can do at writing code in a single prompt, usually.
0:10:12 So I’m just wondering that to me feels like where they’re going with all of this is like that sort of agentic.
0:10:17 It can see what the output was, determine if the output was the output we were looking for.
0:10:22 If it is cool, if not, throw it back into the chat and try again, you know?
0:10:26 Yeah, I mean they definitely should go there. My understanding is currently it doesn’t do that.
0:10:32 I could be wrong, but you know, I think right now, you know, Artifacts is basically like a UX experiment or UI experiment for them.
0:10:38 Basically, you know, it’s actually one of the first things they’ve invented as far as I know that chat GPT didn’t have first.
0:10:44 Yeah, because every other feature they’ve created was basically a copy of chat GPT’s features so far.
0:10:48 Right. And Artifacts is the first thing that’s like, oh, that’s new. That’s a really cool thing.
0:10:50 You just see the output. Yeah, why not?
0:10:57 Yeah, especially with JavaScript, HTML, CSS, there should be no barrier to being able to just present that on the same screen.
0:11:00 Yeah, but I think that is where it’s going, like whether it’s Claude doing it or someone else.
0:11:03 And I think, you know, chat GPT is coming. They’re not going to just going to lose this fight.
0:11:05 They’re going to roll out some amazing stuff too.
0:11:12 But yeah, that’s something I noticed a lot of engineers are talking about online is like people are saying like in terms of like refactoring was a big thing.
0:11:15 I heard they’re like, oh my God, like you can go in and like all your code is messy.
0:11:23 You just copy and paste in all of it and it just like makes it all like tidy and removes all the unnecessary stuff or anything that’s redundant or inefficient.
0:11:29 It just and it gives you code that’s like way better, runs better, cleaner, easier to read and nothing breaks.
0:11:35 And it’s like before apparently like when you would do that, yeah, we’d like make it cleaner, but sometimes that would break things.
0:11:38 And I’m hearing a lot less people saying, oh, it breaks things now.
0:11:43 It seems like it’s way better. Like it understands what it’s doing and yeah, it can clean up your code and it doesn’t break anything.
0:11:45 That’s that’s that’s that’s huge.
0:11:57 Like when you’re coding, like you can, you know, that’s one of the hardest things about engineering is, you know, the project I’ve worked on is like when you go when you go into something and especially if there’s other people involved to go and look at somebody else’s code and understand what’s going on.
0:12:06 Right, it’s so it’s so hard because like they’ve been sitting there for like, you know, you know, sometimes even like 24 hours coding on something and and it just, you know, it makes sense in their head.
0:12:11 And then when somebody else looks at it, it’s like, how is all this stuff interconnected and what the hell is this and what’s that?
0:12:17 And and so yeah, I think that’s a big thing that is going to actually be really useful for companies now.
0:12:19 Is it like, yeah, your code will be cleaner, run better.
0:12:28 I think one of the things that I’m I’m sort of feeling lately is that OpenAI is starting to fall behind a little bit.
0:12:31 And again, we’ve talked about this plenty of times on the podcast.
0:12:34 We have no idea what OpenAI is doing behind the scenes, right?
0:12:41 They’re fairly secretive. Most of the stuff that they’ve announced and shown off, people didn’t see that coming.
0:12:45 Because they don’t like to show it off until it’s ready to show off.
0:12:56 But lately it’s starting to feel like companies like Anthropic are passing them in a lot of areas, you know, and other examples outside of the large language model is the video stuff.
0:13:06 We actually kind of talked about this on a different episode, but you’ve got Sora, which they announced seemingly to overshadow, overshadow Google, right?
0:13:11 Like when Sora was announced, I think it was the same week that Google announced Gemini 1.5 or whatever.
0:13:15 It was a really big leap for Google with like a million token context window.
0:13:23 Well, that week OpenAI went and showed off Sora and nobody was talking about Gemini 1.5 once they saw Sora.
0:13:29 Sora was all anybody in the AI world was talking about or looking at or caring about, right?
0:13:31 Well, here we are several months later.
0:13:36 We still don’t have Sora access, but now we’ve got Luma AI video available.
0:13:41 We’ve got Runway Gen 3, which is about to be available most likely before Sora.
0:13:43 We don’t have it yet, but most likely before Sora.
0:13:53 And then you’ve got the demo that they did for the sort of advanced audio assistant, I think, is what they call it, right?
0:13:55 They did that demo once again.
0:13:59 I feel like they timed that demo to sort of slap Google, right?
0:14:06 Like Google had their Google AI IO event the same week like Google IO started on Tuesday.
0:14:07 Well, what did OpenAI do?
0:14:11 Monday, we’re announcing an event where we’re going to make a big announcement, right?
0:14:19 They made this big amount announcement on Monday, which kind of took some of the flair away from the Google IO event.
0:14:20 Here we are a month later.
0:14:23 We still don’t have it.
0:14:26 And the they just made an announcement that, oh, it’s getting delayed.
0:14:27 We’re pushing it out.
0:14:29 It’s not going to be rolled out.
0:14:30 I mean, some people seem to be getting it.
0:14:34 But for the most part, they’re telling us we’re not going to get it till fall now.
0:14:41 And it’s like they’re making all of these big announcements with the intention of sort of overshadowing Google.
0:14:42 But then they’re not actually shipping anymore.
0:14:45 And I don’t think it’s a good look for OpenAI, in my opinion.
0:14:51 And it also kind of feels like it’s giving a lot of these other companies an opportunity to catch up and pass them.
0:14:57 Like Claude 3.5 is beating OpenAI and all of the LLM benchmarks right now.
0:15:00 Like the companies are starting to pass them up.
0:15:02 I agree that it’s not a good look.
0:15:06 But I’m still convinced that behind the scenes, they’re pretty far ahead.
0:15:09 And they’re starting to be some evidence of that.
0:15:14 It’s like the stuff with Sora, even though, yeah, they did a demo and it’s not out yet.
0:15:18 But the video that came out, I think it was yesterday, the Toys R Us commercial.
0:15:18 Have you seen that yet?
0:15:21 I haven’t watched it yet, but I saw the news.
0:15:22 That’s generated with Sora.
0:15:23 Yeah, I heard that.
0:15:29 So Sora, there are deals going on behind the scenes where the technology is being used.
0:15:31 I think with Sora, it’s probably just so expensive.
0:15:33 They’re like, yeah, we can’t just roll this out.
0:15:37 Everyone is like, like people got to pay like hundreds of dollars to use it.
0:15:39 Like people are, you know, they’re not going to do that.
0:15:42 The funny thing is, I didn’t even know that Toys R Us was like back.
0:15:45 It’s like, and they’re back with Sora.
0:15:49 Yeah, like this was their introduction to go like, hey, look, we’re here again.
0:15:54 Yeah, yeah. And so, you know, I thought that commercial was pretty cool.
0:15:55 Like, you know, is it perfect?
0:15:58 No, but like, that’s the worst it’s ever going to get.
0:16:01 And you can see that they’re able to accomplish things in that commercial
0:16:04 that probably would have traditionally cost a lot, a lot more.
0:16:06 Probably to the point where they never would have made that kind of commercial.
0:16:09 It’s just like you’re almost making like a short film at that point.
0:16:12 I think that behind the scenes that they’re still doing quite well, I agree.
0:16:15 They’ve kind of slipped up in terms of how they presented things.
0:16:19 I don’t think it’s good that like, I highly prefer how Claude’s doing it,
0:16:22 where like they talk about something and then it’s just out and hey, try it.
0:16:24 Like, you know, like the old Steve Jobs style.
0:16:26 Like, I think that’s way better personally.
0:16:30 We’ll be right back.
0:16:34 But first, I want to tell you about another great podcast you’re going to want to listen to.
0:16:37 It’s called Science of Scaling, hosted by Mark Roberge.
0:16:40 And it’s brought to you by the HubSpot Podcast Network,
0:16:44 the audio destination for business professionals.
0:16:48 Each week, host Mark Roberge, Founding Chief Revenue Officer at HubSpot,
0:16:53 Senior Lecturer at Harvard Business School, and Co-Founder of Stage 2 Capital,
0:16:57 sits down with the most successful sales leaders in tech to learn the secrets,
0:17:00 strategies, and tactics to scaling your company’s growth.
0:17:06 He recently did a great episode called How Do You Sol For A Siloed Marketing in Sales,
0:17:08 and I personally learned a lot from it.
0:17:09 You’re going to want to check out the podcast.
0:17:13 Listen to Science of Scaling wherever you get your podcasts.
0:17:21 But I still think, you know, GPT-5 is coming, and it’s probably way better than Claude.
0:17:23 So right now, Claude’s better for the moment.
0:17:25 But yeah, I guess we’ll see.
0:17:26 Yeah, we’ll see.
0:17:26 We’ll see.
0:17:32 The Toys R Us video is interesting to me because I’m wondering what sort of reception
0:17:32 it’s going to get.
0:17:36 Like, if it starts, I don’t know if that’s airing on TV already right now,
0:17:40 or if it’s just kind of circulating on the internet.
0:17:44 But almost every scenario where AI was used and this kind of thing,
0:17:46 there was massive negative backlash, right?
0:17:48 Oh, there is online right now.
0:17:49 Oh, there is.
0:17:50 Yeah, for this.
0:17:53 It’s like, really, yeah, it’s really, yeah, people are quite hateful.
0:17:56 Like, you know, screw, you know, Toys R Us.
0:17:56 Screw Macy’s.
0:17:58 They just stayed dead and all this kind of stuff.
0:18:00 It’s like horrible stuff.
0:18:01 I don’t get it.
0:18:03 I don’t quite understand it.
0:18:06 You know, I guess the argument is like, well, why didn’t you just hire real people,
0:18:08 real visual effects artists to go make that?
0:18:10 You know, you would have employed more people if you did.
0:18:14 But I mean, they’re a company that went bankrupt, you know.
0:18:18 So like, they’re probably looking to cut some costs in some places.
0:18:19 Yeah, yeah.
0:18:23 But yeah, I just remember like when the, there was that Disney plus show,
0:18:25 the secret, what was it called?
0:18:27 Secret agent, secret invasion.
0:18:31 And parts of the intro were done with AI and like people were boycotting,
0:18:34 watching that show because the intro was made with AI, right?
0:18:39 And like, there was like a magazine post where there was like a clock.
0:18:41 I don’t remember exactly what the ad was for.
0:18:43 But there was like an ad where like the clock in the background,
0:18:46 people are like, wait a second, the numbers on the clock look weird.
0:18:47 That image is AI.
0:18:49 You know, boycott this company.
0:18:51 They use AI for their images.
0:18:52 I don’t understand that.
0:18:55 Like, like you’re throwing the baby out with the bathwater.
0:18:58 You’re like, okay, because they use this one ad.
0:19:02 The product that they’re offering is like, I don’t know.
0:19:06 It’s a weird take to me that people are like that passionate about like,
0:19:09 this company is saving costs by using AI.
0:19:10 Therefore, screw that company.
0:19:15 But that seems to be the sentiment whenever this kind of stuff comes out.
0:19:19 I don’t know if that’s like the vocal minority or if that’s how most people feel.
0:19:22 I kind of get the impression there’s like this vocal minority of AI haters.
0:19:27 Most of the world is either like AI is cool or I really don’t care one way or the other.
0:19:29 But then there’s this vocal minority of people that
0:19:31 tend to speak the loudest on the internet.
0:19:34 Yeah, I think it’s the vocal minority.
0:19:37 But it will be interesting to see long-term.
0:19:42 It’s definitely going to be like one of the biggest transitions in human history,
0:19:46 at least in our lives, where things are going to radically change.
0:19:47 And a lot of it’s going to be good.
0:19:51 And there’s going to be a lot of, there’s going to be some bad and complicated stuff too,
0:19:52 like we talked about before.
0:19:55 It’s, you know, I think we should accelerate, but also at the same time,
0:19:58 it’s like, yeah, but also like care about people because it’s like,
0:19:59 some people are going to lose their jobs.
0:20:02 You know, so we’ll see how that works long-term.
0:20:04 I think there will be some backlash.
0:20:09 But at some point, you know, like you get these, like the new show from Disney,
0:20:11 I already forgot the name of it, the new Star Wars show.
0:20:12 It’s, but it’s, it’s horrible.
0:20:15 Like it’s all the commercial and they’re like chanting the power of one and all.
0:20:19 It’s like, it looks like a, it looks like a, a comedy skit.
0:20:20 My wife and I have actually watched them all.
0:20:23 And I know where to start off on a tangent here.
0:20:26 Oh no, I think the show’s horrible, but it’s almost like I’m watching it now
0:20:28 to watch this train wreck in slow motion.
0:20:33 There was an interview with the musician Will I Am, the guy who used to be in the
0:20:34 Black Eyed Peas.
0:20:37 And he said that, you know, the AI video stuff he’s seen, you know,
0:20:39 he feels like it is going to take power away from Hollywood.
0:20:43 And it’s going to give it back to individual creators for them to create new things.
0:20:46 And he thinks that’s going to be like a more beautiful world where like people can
0:20:49 bring it on, create the kind of stuff they want to see, you know.
0:20:51 And so I am hoping like technology gets way better.
0:20:56 And then Hollywood’s like, has to like produce better films with humans in it
0:20:57 and stuff that humans actually want to see.
0:21:00 And then there’ll be a whole other category.
0:21:03 Like you said, probably a niche of where people can use AI to make stuff that’s
0:21:06 personalized for them, what they want to interact with.
0:21:08 So yeah, it’s interesting.
0:21:10 I definitely see the arguments, right?
0:21:14 Like I see the arguments of like, okay, this is taking away the need to hire
0:21:17 visual effects artists and things like that.
0:21:22 But I also think that the visual effects artists that learn to like leverage a lot
0:21:26 of these AI tools are going to be much better at their craft, you know,
0:21:29 using all the tools that are at their disposal, right?
0:21:35 Why let yourself get left behind because you’re going to boycott a certain technology?
0:21:39 Well, your competitors probably aren’t going to boycott that same technology.
0:21:43 Like it’s ridiculous, but I do understand it’s changed.
0:21:45 People are scared of change.
0:21:48 But I think those that leverage it as another tool in their toolbox
0:21:50 will only get better at their craft.
0:21:54 Yeah, one of the other interesting things that came out this week was
0:21:59 Eleven Labs, the AI voice company, they wrote out this reader app.
0:22:03 So basically you can feed it any document and then you can use an AI voice to read it to you.
0:22:07 So like if there was a book that didn’t have an audio version of the book,
0:22:09 you could have it read it to you.
0:22:14 Or if there’s a presentation or any kind of PDF or anything like that,
0:22:17 you could feed it to it and have it read it to you.
0:22:21 So like it feels like that’s going to be really powerful for people.
0:22:24 Like it feels like it moves us closer and closer to like not having to be on your computer all the
0:22:28 time, where you’ll be able to go off and live your life and do work at the same time.
0:22:32 Like you can be going for a walk and staying healthy while hearing the presentation that
0:22:35 your boss just sent to you or whatever.
0:22:37 Like, yeah, I don’t have time to like look at that this moment,
0:22:41 but like, hey, let’s just send that to Eleven Labs and have it read it to me while I’m like
0:22:43 going off and enjoying my life for a little bit.
0:22:47 No, that to me will be really interesting because it kind of makes it so like
0:22:48 everything can be an audio book.
0:22:52 Like articles you read online, they can be an audio book.
0:22:58 Like you mentioned, like the memos from a meeting that you don’t really feel like reading.
0:22:59 Turn it into an audio book.
0:23:03 Go for a walk and listen and listen to the summary of the meeting.
0:23:08 Like anything can be an audio book or a podcast that you can listen to and multitask.
0:23:11 I need to run to the store real quick.
0:23:16 I’ll listen to the audio of this meeting that was generated while I’m there.
0:23:20 Or I’ll listen to this blog post that I came across on the way to the store real quick.
0:23:24 I told Amar who’s working over there is like, I need this for my email as soon as possible.
0:23:28 And then when it gets to the point where then you’re able to actually like talk back to it
0:23:30 and tell it how to like craft response back.
0:23:34 I mean, we’re probably like six months away from all this, which is awesome.
0:23:35 Do they have an API for that feature?
0:23:38 I think Eleven Labs has a pretty robust API.
0:23:40 So if they don’t, I bet they will soon.
0:23:47 Yeah. And that sort of gives me ideas of like, you know, using something like Zapier or make.com
0:23:52 that you can start tying these tools together and every time an email comes in,
0:23:56 automatically send it over to the Eleven Labs API, make an audio version of it,
0:23:59 and then queue it up in my podcast player, right?
0:24:03 And then when you go anywhere, you just open up your podcast player
0:24:06 and listen to all the emails that have come in in the last couple hours, you know?
0:24:08 Well, and what you could do too.
0:24:10 And I’m just like, I’m sort of totally nerding out right now.
0:24:14 But like, I like to make workflows with Zapier and make.com.
0:24:18 And I’m like imagining this workflow where like an email comes in,
0:24:25 it automatically sends it to the anthropic API, has anthropic at its own commentary
0:24:31 to the email for you and then sends that over to Eleven Labs, makes a podcast for you.
0:24:36 And now it’s like, you’re listening to your emails with some extra commentary.
0:24:40 Like you can tell anthropic, make me some jokes about this email.
0:24:42 Make me some jokes about this contract.
0:24:46 So as you’re listening to the contract, it adds in a little bit of like entertainment factors.
0:24:49 You’re more like interested in and reading it, you know?
0:24:53 Like every once in a while laugh at something that’s said in this contract.
0:24:55 So you can be listening to it and they’re like laughing at the contract
0:24:57 as they’re reading it to you.
0:25:00 Like that kind of stuff I could actually see myself doing
0:25:04 just to like help me get through more of the content I’m trying to get through.
0:25:07 Yeah. I mean, so a lot of the stuff we’re talking about with the email though,
0:25:10 you know, a lot of that’s, you know, maybe some of it could be doable with Zapier
0:25:10 and other things right now.
0:25:15 I’m not sure what to go play with it and see, but if not, it’s going to be available soon.
0:25:19 But one thing you can actually use like right now, which I’ve been finding really useful
0:25:23 is, you know, and this is, you know, I’m not saying it because Darmesh is, you know,
0:25:24 the co-founder of HubSpot.
0:25:31 But Darmesh, the co-founder of HubSpot, the CTO launched this thing called agent.ai.
0:25:35 And my understanding is he’s building different agents for different business use cases.
0:25:38 I’m not sure that’s going to get rolled up into HubSpot products or what.
0:25:41 But what he has right now that you can use without even signing up is this thing
0:25:44 where you can forward an email to agent@agent.ai.
0:25:49 And then it basically connects it to an LLM and you can ask it things.
0:25:52 Like you can say, you can ask it a question about the email or you can ask it.
0:25:55 The thing I’ve been finding very useful is summarize this email.
0:25:55 Yeah.
0:25:58 Right. And I don’t have to go anywhere else or anything.
0:26:01 I literally just, you know, forward it to agent@agent.ai and say,
0:26:06 “Hey, this email that’s like six paragraphs, summarize it into like three bullet points.”
0:26:08 And you’re just writing that in the message that you send.
0:26:12 So you’re like forwarding it and then in the message that above the forwarded message,
0:26:13 you’re asking a question or whatever.
0:26:15 That’s all you do.
0:26:17 And you get a response back in about 30 seconds.
0:26:19 Mine was like 20 to 30 seconds every time I tried it.
0:26:20 And it’s great.
0:26:24 It’s like, you know, it’s, I’m not sure what, you know, they’re using behind the scenes.
0:26:27 Maybe they’re using Claude or, you know, whatever.
0:26:28 But the responses are good.
0:26:31 Like the summaries are pretty similar to what you’d get from putting it in the Claude.
0:26:33 Of course you could go copy and paste and do all that.
0:26:37 But, you know, for a lot of people who don’t know how to do all that or, you know,
0:26:41 who are not as fast at doing that as I might be, like it’s super useful.
0:26:42 And you can use it like right now.
0:26:43 You just like forward the email.
0:26:47 So anyone listening, I said, if you haven’t tried it and you’ve got emails that are like
0:26:50 super long, you know, I suggest like just try it out.
0:26:54 Like forward an email to agent@agent.ai and just say,
0:26:55 “Hey, summarize this email.”
0:26:56 It’s pretty magical.
0:27:00 Yeah. Yeah. And so, yeah, there’s a lot there to think about.
0:27:04 You know, we talked about a lot of the new tools that are coming out.
0:27:08 We talked a lot about the use cases that you might be able to use them for.
0:27:11 Even talked a little bit about the future implications of where some of these tools
0:27:12 might go.
0:27:16 I think this has been a really fun, fascinating discussion.
0:27:20 And if you enjoyed this discussion, make sure you like this.
0:27:25 If you’re watching it on YouTube and subscribe wherever you’re listening/watching this.
0:27:27 If you’re watching it on YouTube, subscribe to us there.
0:27:30 If you’re listening on our podcast platform, subscribe to us there as well.
0:27:31 We really appreciate it.
0:27:35 It helps get this show more reach in front of more people.
0:27:39 We can’t thank you enough for tuning in and nerding out around AI with us.
0:27:40 We really appreciate you.
0:27:41 We’ll see you in the next one.
0:27:59 [Music]
0:28:09 [BLANK_AUDIO]