There Are No Girls on the Internet - April 14, 2026


The Racist AI TikTok Scam That's Flooding Your Feed

Topics
The Drama with Zendaya; BAFTAs Slur Fallout; Sheryl Sandberg Leans AI; Sex Pest Take-It-Down Conviction; Sex Toys Meta Ban; ANTIFA Terrorism Trial – NEWS ROUNDUP! Reese Witherspoon AI Gender Gap; Lauren Sanchez Cosplays Relevance; Online Assault Academy; Flock Spying; Nigerian WhatsApp Smut – NEWS ROUNDUP

Episode Stats


Length

1 hour and 3 minutes

Words per minute

179.29

Word count

11,392

Sentence count

510

Harmful content

Misogyny

8

sentences flagged

Toxicity

22

sentences flagged

Hate speech

31

sentences flagged


Transcript

Transcript generated with Whisper (turbo).
Misogyny classifications generated with MilaNLProc/bert-base-uncased-ear-misogyny .
Toxicity classifications generated with s-nlp/roberta_toxicity_classifier .
Hate speech classifications generated with facebook/roberta-hate-speech-dynabench-r4-target .
Topics generated with Qwen2.5-3B-Instruct.
00:00:00.000 This is an iHeart Podcast.
00:00:02.540 Guaranteed human.
00:00:04.520 My SUV's worth more than ever.
00:00:07.100 Time to upgrade?
00:00:08.160 There's never been a better time.
00:00:10.060 At Plaza Auto Group, locations get top value for your trade
00:00:13.320 and shop hundreds of new and pre-owned vehicles across 11 locations.
00:00:17.640 And if you can't come to us, we'll come to you.
00:00:19.880 With best-in-class pricing, unbeatable trade values, and 70 years of trust,
00:00:25.100 it's easy to see why families choose the Plaza Auto Group.
00:00:27.980 Plaza Auto Group, celebrating 70 years family-owned and operated.
00:00:32.360 Visit plazaautogroup.com.
00:00:34.600 Run a business and not thinking about podcasting?
00:00:36.860 Think again.
00:00:37.500 More Americans listen to podcasts than ad-supported streaming music from Spotify and Pandora.
00:00:41.660 And as the number one podcaster, iHeart's twice as large as the next two combined.
00:00:45.780 Learn how podcasting can help your business.
00:00:47.620 Call 844-844-iHeart.
00:00:49.960 I survived nine months in captivity,
00:00:52.860 And I've spent my life exploring how other people survive what should have destroyed them.
00:00:58.680 I'm Elizabeth Smart, and these are The Survivor Files.
00:01:02.260 Every week, I'm with survivors who live through the unthinkable, abducted, stalked, controlled, and nearly silenced.
00:01:09.820 These are stories about what it takes to make it out alive.
00:01:13.640 Listen to The Survivor Files with Elizabeth Smart on the iHeartRadio app, Apple Podcasts, or wherever you get your podcasts.
00:01:21.260 If your bookshelf and your For You page are equally important to your personality, welcome home.
00:01:27.400 Pro Society is a weekly podcast that's part book club, part group chat for anyone who thinks Pride and Prejudice and Love Island deserve the same level of discourse.
00:01:35.640 Each week, we're connecting the dots between books, the internet, and pop culture with your favorite writers, book talk creators, and plenty of overthought opinions.
00:01:43.900 Yeah, I'm obsessed. I'm obsessed.
00:01:45.360 Listen to Pro Society on the iHeartRadio app, Apple Podcasts, or wherever you get your podcasts.
00:01:51.260 There Are No Girls on the Internet is a production of iHeartRadio and Unbossed Creative.
00:02:03.540 I'm Bridget Todd, and this is There Are No Girls on the Internet. 0.98
00:02:09.240 Someone, probably a guy in a basement somewhere, has figured out that if you generate a black woman 1.00
00:02:15.280 and make her say degrading, racist things about herself, you can make money on the internet. 0.94
00:02:21.260 Probably not a lot of money, maybe just a few hundred dollars a month, but enough to keep on doing it.
00:02:27.840 TikTok, Instagram, and every other social media platform, they're serving it up on your social media feed right now.
00:02:34.960 It's AI-generated digital blackface, and it is absolutely everywhere on social media.
00:02:41.280 There are accounts built entirely around it. 0.99
00:02:43.640 Fake Black women with impossibly dark skin, performing self-hatred, and funneling viewers to things like porn sites and dropshipping scams. 0.96
00:02:52.980 So this is not one of those future AI problems we might have to grapple with down the line. 0.96
00:02:58.880 This is happening right now.
00:03:01.420 And Jeremy Carrasco is one of the people actually trying to do something about it.
00:03:06.080 He's kind of become the AI debunking guy on social media.
00:03:10.400 He started out as a video production guy working in live streaming and technical producing,
00:03:14.860 and that background has given him a sharp eye for spotting AI fakes.
00:03:19.300 When Jeremy partnered with the BBC to expose over 100 of these AI-generated accounts,
00:03:25.200 TikTok actually listened, pulling 20 of them down within three days.
00:03:29.120 It's a start, but as Jeremy will tell you, it is a very small dent.
00:03:33.380 my name's uh jeremy carrasco creator at jeremy finds ai and director of riddance so i love that
00:03:44.540 you kind of come at this from a technical place as somebody who got you know was working in live
00:03:50.660 streaming making content i feel that so much of the conversation around ai has really been set by
00:03:55.440 tech companies and their sycophants frankly and so it's just nice to have a different kind of voice
00:04:01.120 Do you feel like that producer, live streamer, VideoEye has helped you develop a framework around AI deepfakes?
00:04:08.760 It's the voice that I wanted to have and the background that I felt like was needed in this space.
00:04:13.920 I think exactly what you said.
00:04:15.440 When I created my pages in June of last year, the main reason was that a lot of the ways people were talking about AI video,
00:04:24.100 they were pretending that these were tools for my industry, like the one that I knew people in,
00:04:28.820 the one that i didn't see many good uses for in general so i just wanted to speak up and be like
00:04:34.480 hey no one really wants this like we're not asking for this stop using the industry as a reason to
00:04:40.940 push out ai slot making tools just be honest that you're making ai slop or you're trying to maybe
00:04:46.360 replace hollywood uh down the line but i i felt like a lot of it was just either inauthentic or
00:04:53.420 like very, very rose colored glasses that people were going to start making independent films with
00:04:59.140 AI videos. And in fact, a lot of the opposite has happened. A lot of people who are true creatives
00:05:04.760 have rejected this, but it has definitely encroached on transactional spaces. And I spent a
00:05:10.920 lot of my time in places of, you know, video commerce where a lot of that is kind of under
00:05:16.500 threat by AI. So that's one of the reasons I started was I just felt like a lot of that was
00:05:20.640 disingenuous or or too rosy but the the technical background i have i had no idea that this is what
00:05:27.060 it would be used for um when i was a live streaming technical producer i was also what they call an
00:05:31.800 engineer in charge which means sometimes i would have to like visually check check lip sync like
00:05:38.260 very very specific thing down to like a frame of of accuracy i didn't know that would come in handy
00:05:43.860 for looking at AI lip sync later or looking at errors in encoding and video would come
00:05:50.900 into play when I was looking at AI videos. So yeah, it's a very weird niche skill set, but
00:05:56.560 that plus my obsession with internet culture and politics kind of brought it to a more
00:06:03.300 media literacy place rather than just spotting AI video. Because I think that AI video spotting is
00:06:10.260 a part of a media literacy toolkit that some people don't have. So in that case, they should
00:06:17.120 have other parts of a media literacy toolkit because it's going to get harder and harder.
00:06:21.200 I'm not under any illusion that people are going to be able to do this for that much longer.
00:06:26.700 This is a little bit of a non sequitur, but to your point about how when AI video tools like
00:06:32.860 Sora were being talked about, I don't know if you see this on your social media feeds,
00:06:38.000 but i cannot escape it and it drives me fucking crazy where ai sycophant i guess like uh dito
00:06:46.340 taze will say did xyz ai platform just end the need for hollywood or cgi and then they will post 0.89
00:06:56.720 the wackest looking most out of context ridiculous video and i'm like are you all are you seeing what
00:07:04.140 you posted you're saying that this is going to like like like this is what people are going to 0.77
00:07:09.280 pay to watch are you are you are you really saying this so there there are two things here first like
00:07:14.640 the whole hollywood is cooked thing is so funny because hollywood's not exactly like a burgeoning
00:07:19.200 profitable industry right now just like stick to tech like why are you trying to to enter this
00:07:24.940 like industry that is being threatened in so many different ways so just the obsession with hollywood
00:07:29.800 as like a cultural phenomenon is just so funny to me especially like the anti-hollywood people
00:07:33.520 I'm not a big Hollywood person, by the way. I'm a social media person. I've never worked in
00:07:36.820 Hollywood. I just think the fascination is funny because I specifically wasn't working in Hollywood
00:07:42.280 because I didn't think it was the place to be. Anyway, and that's nothing against the people
00:07:47.100 who love movies. It's just not how I grew up. The other thing that is missing here is
00:07:52.800 we have to ask ourselves why we watch things and why we would watch that in the context that
00:08:00.640 they're presenting it so like why would you go to a movie theater to watch something if ai could
00:08:06.560 make anything then theoretically nothing really matters on like aesthetic grounds and it's all
00:08:12.700 about the meaning that it would have and if if you can't get that meaning out of the artistic work
00:08:19.660 that was put in or even like the celebrity that you like going to see like then what is the point
00:08:24.700 and i don't think that they've thought that far ahead i think there are a lot of useful tech demos
00:08:28.960 But they haven't gotten a good way around that point, which is if you can make that at home on your desktop, then why would anyone go watch it in the first place? It doesn't mean anything. So it's a little bit of like a problem. It's like a zero sum game. We have too much content out there. How do we decide what we want to watch? It's not just because it looks like Hollywood. It's because it means something or we have some sort of connection to it.
00:08:55.940 Yeah, it doesn't mean anything is a great way to put that, where I'll watch these clips that people are telling me are so phenomenal, and I feel nothing. They just feel so flat. And I, my listeners all know I am a movie person. And it's like, the thing that I feel when I go to the movies, it's like a very specific thing. It's not just, I guess the attitude that boils that down into, hey, I made this very quickly and cheaply. That's not the thing that gives anything meaning.
00:09:24.300 yeah and just just to be clear i like to say that i'm not a movie person because i've seen
00:09:29.220 an embarrassing few number of movies okay i still love like seeing movies sometimes i just like
00:09:33.640 whenever you know there's like i'm embarrassed by it um the whenever i go though is because i
00:09:39.280 really want to see something i really want to watch it and um you know that doesn't just come
00:09:44.220 because of like some impressive technical feat that happened um you know i i just i i don't think
00:09:50.980 that we do a good job of separating like why we watch certain things because i think the the
00:09:56.200 natural tendency is like well people just doom scroll they watch slop so like yeah but like we're
00:10:00.900 not watching we haven't been watching social media videos in movie theaters this whole time like
00:10:04.880 the the the bar to to create things has never been lower it was never lower before ai media like we
00:10:11.720 were still figuring out reasons to watch something on our phone versus something in the theater
00:10:15.480 there weren't a lot of movies coming out that like specifically used iphone cameras even though they
00:10:20.320 are way cheaper because you have to rejigger your entire workflow around an iphone camera you have
00:10:26.160 to remake your entire workflow around ai video production if you're going to do that because
00:10:31.340 you can't cut between a 4k cinema camera and a 720p ai video that's what all of them still are
00:10:37.720 by the way then you can pay extra for 1080p or 4k but they still look like ai videos when you're
00:10:42.860 especially if you're looking at them on a big screen so there are technical limitations to
00:10:46.620 is happening. There are also like meaning relationships that just like aren't being
00:10:50.800 made with AI videos. But I think a lot of people who are super into it are just like they're into
00:10:54.740 the AI hype, they're into the technology. So they just don't see that because for them,
00:10:59.260 the purpose here is the technology. That's like, that's the entire point. I just don't think
00:11:03.380 normal people do that. I don't know if this is true or not, Jeremy, but I read that you actually
00:11:09.040 started from a place of being quite optimistic about AI and that initially you wanted to do
00:11:14.460 a youtube channel about kind of how people can use ai video tools is that right i read it in verge
00:11:20.360 i think yeah it just that was before google vo3 even came out i mean it was basically like i chose
00:11:27.520 the my my pages used to be called show tools ai because i was i was gonna make shows with tools
00:11:33.140 and some of those are gonna be ai very witty except for the fact that like google came out
00:11:37.320 with vo this the week that i was gonna launch my page i had to like stop everything i was doing
00:11:43.620 and being like what is happening here um and yeah i it's i wasn't really ever thinking that i was
00:11:51.460 going to use like ai video to make movies i was more interested in how it could be used for
00:11:58.940 storyboards maybe or how it could use be used for green screen backgrounds or stuff and you can
00:12:03.860 actually see me experiment with some of that and like try it out in my like my early days and i was
00:12:09.200 very, very upfront with it. I disclosed all of it. I was trying to be the demonstrator of how to
00:12:15.140 label and do this responsibly. And then I just realized it just didn't really mean anything to
00:12:20.480 me at the end of the day. I didn't find it was that helpful. And I just hated the process. I
00:12:24.780 just hated prompting AI videos. And I still do. I just think it's boring. I think it is
00:12:30.740 not an efficient way to make media. I think that there's a lot of reasons why you can't
00:12:35.100 um you can't convey an entire scene over text and you do have to have some like visual medium to
00:12:42.060 tell that's like just more efficient for me i don't know i can point the camera at something
00:12:46.580 in some ways quicker than i can write it given you know the right context so um you know the the
00:12:53.480 the reason that hollywood works the way it does and the reason they haven't moved over to a phone
00:12:59.020 is because this is harder to use in the context that they are making movies they need more control
00:13:05.040 Their producers expect more control.
00:13:07.020 That's the same way I felt about AI videos.
00:13:09.340 It did not give me the control that I needed
00:13:11.280 in order to make the thing I wanted.
00:13:12.820 So then what was the point?
00:13:14.140 And the whole thing that I think
00:13:15.120 is kind of ontologically evil
00:13:16.320 and it stole a bunch of data.
00:13:17.440 And it's not like there are a bunch of other reasons
00:13:18.840 that it wasn't about it, you know.
00:13:20.440 Is that really what changed for you
00:13:22.280 from going from like a kind of an AI optimist
00:13:24.940 to being like, actually, I don't know about this.
00:13:26.840 This maybe isn't the thing I thought it might be.
00:13:29.420 Yeah.
00:13:29.900 I mean, I don't think I was ever an AI optimist.
00:13:31.620 I think I was always an AI pragmatist.
00:13:33.420 and like, how are we going to use this?
00:13:34.780 Like it's here, how is it possible?
00:13:37.200 And then I just saw a surprising amount
00:13:40.380 of reaction against AI.
00:13:42.440 I don't think it was a given at the time
00:13:44.000 when I started my pages
00:13:44.980 and I was starting to do
00:13:46.020 like these AI video spotting videos.
00:13:47.740 People are like, they don't care.
00:13:49.000 They just want to watch whatever.
00:13:50.260 They'll just do and scroll, they'll watch Slop.
00:13:52.360 No one cares, but it turns out
00:13:54.200 people do not want to be tricked.
00:13:56.440 Even if they want to watch Slop,
00:13:58.780 like they want to watch Slop and know it's Slop.
00:14:00.700 They don't want to watch something real
00:14:02.740 and find out that it was AI later.
00:14:04.640 That's just like a really bad feeling.
00:14:06.700 We want to have real connections with people.
00:14:08.300 We want to assume that we're interacting with real people.
00:14:10.800 And oftentimes, even the slop interactions are like,
00:14:14.820 you're meta aware that you're watching slop
00:14:16.880 and you're engaging with the comments
00:14:18.420 and like you're all memeing each other.
00:14:20.180 It's like, it still can be a social thing.
00:14:22.740 But I think that it was just pretty early when I started
00:14:26.220 and I knew it was early.
00:14:27.160 And the learning process was really quick
00:14:29.460 because all of a sudden,
00:14:30.640 a lot of people cared about AI video.
00:14:32.260 and I just didn't think that would ever happen
00:14:34.220 because I was also under the impression
00:14:36.080 that people didn't care
00:14:37.160 and I'm glad that I was wrong.
00:14:41.340 I spend a lot of time talking about people
00:14:44.300 lying on the internet
00:14:45.600 specifically for nefarious means,
00:14:48.220 for social or political control
00:14:50.660 or to influence people.
00:14:52.960 But a lot of people are just
00:14:55.100 good old-fashioned financial grifters
00:14:57.260 trying to make some quick cash,
00:14:59.280 especially when it comes to AI-generated content on social media.
00:15:04.700 And I think that understanding that dynamic,
00:15:07.160 the power of algorithms and platform monetization
00:15:10.040 to push everyone toward extremist, clickbaity content
00:15:13.600 is central to understanding the internet in general.
00:15:17.300 Jeremy says that accounts chasing that monetization or other scams
00:15:21.220 are very different than someone who was using AI
00:15:24.320 to just make slop entertainment content,
00:15:26.840 like those Fruit Love Island AI micro-dramas that recently went viral.
00:15:33.020 On our podcast, we talk a lot about things like mis- and disinformation.
00:15:38.300 AI has been a huge part of that conversation.
00:15:40.800 And a lot of times when we're talking about it,
00:15:43.080 we frame it as just inherently kind of nefarious, right?
00:15:47.240 That it is that AI and other forms of mis- and disinformation
00:15:50.440 are manipulating people for some sort of political or social ends.
00:15:55.340 But from watching a lot of your content, I've come to realize that, yes, that is true.
00:16:00.540 But also a lot of times it's a lot simpler than that.
00:16:03.120 People are just trying to make money.
00:16:05.140 This is a little bit of a financial grift.
00:16:07.280 Do you see it that way?
00:16:08.460 And if so, is one of those is one of those motivating factors like worse than the other?
00:16:15.400 There are too many reasons people would use AI video.
00:16:18.840 The first is just to make slop.
00:16:21.060 And this is something interesting.
00:16:22.180 so people understand that i'm like the ai debunking ai spotting guy and so like um you know the ai
00:16:30.780 fruit love island videos for example i was not tagged once no one brought it to my attention
00:16:35.000 at all i had to find out like everyone else did just through through culture publication you know
00:16:41.260 like whatever like it's just the normal way learned about it on the streets yeah yeah out on the
00:16:46.340 streets exactly most of the times i find out about videos because people tag me in them people send
00:16:50.380 me them. And if an AI video gets over 100 to 500,000 views and I'm not tagged in it, sometimes
00:16:58.360 I'm a little bit surprised or I'm worried because no one's caught it. But not one person tagged me
00:17:03.840 in that because people knew, people were aware. Now, a lot of the things I get tagged in are
00:17:08.700 scams, exactly what you said, which is just like a drop shipping scam that pretends that their
00:17:14.940 goods are handmade. That is the thing that I'm seeing everywhere right now. I'm tagged in at
00:17:18.720 least five or 10 of those every day of like this new chinese good that pretends to be handmade
00:17:25.220 and a lot of the times those are also reusing media from people who are actually making those
00:17:31.440 goods and reskinning them with ai and it's a very frustrating thing for those real people to go
00:17:36.720 through and then i also see yeah coordinated campaigns or just mis or disinformation but i
00:17:43.160 mean, I think a lot of the people who, you know, there is a reasonable, there is a reasonable
00:17:51.340 viewpoint that an AI person, so like a person who shows up and tells you something like you should
00:17:58.500 not trust them because they don't have any accountability. You don't know who they are.
00:18:02.620 They don't have a history. They don't have a past. It's completely reasonable to see this and
00:18:06.900 go, I don't trust you. And therefore I'm just going to disagree with you because you have to
00:18:12.060 check what they are saying anyway, because they don't have any stakes. They don't have any
00:18:16.020 accountability. So at that point, I don't think that they're a very reliable piece of information.
00:18:20.880 You're not going to get good information from them. This is actually different than using a
00:18:24.580 large language model. You can ask a large language model questions. You can ask it for sources. You
00:18:28.920 can debate with a large language model. So it's not even just that AI itself can't tell the truth
00:18:34.480 about things. But if I see an AI avatar saying something on social media, I'm going to not trust
00:18:39.280 it because i'm going to ask where this is coming from i think that that's a good instinct that
00:18:43.200 people have and we're seeing it used a bunch of different ways but like you can largely throw a
00:18:48.880 lot of that information away and i'm glad that that is the direction we're headed um i'm glad
00:18:53.980 that that's the instinct people have rather than the opposite right now i want to get into this
00:18:58.740 you mentioned the sort of ai generated fake fake handmade good stuff i see so much of that and
00:19:08.120 I will say like a lot of what I see is also I guess I would almost call it like racialized 0.80
00:19:14.720 guilt marketing where it'll it'll it'll use some sort of it'll be an AI generated black person
00:19:21.260 selling something using a kind of racialized sob story to to sell it so it'll either be
00:19:27.820 I got I am the victim of a racist hate crime so buy my handmade item or I am a black person who
00:19:36.360 makes a handmade item. And the only people that I trust to support my business are white women. 0.97
00:19:41.320 So white women buy my handmade item. What is going on here? So there are unfortunately examples that 0.50
00:19:48.440 I've seen where you, you know, basically have a A and B experimentation on like one of them is a 0.54
00:19:56.880 white woman, one of them is a black woman, and the black woman usually performs better. So there is 0.96
00:20:01.140 something there. And it's usually because they're both using exploitative language, like you just
00:20:07.320 said, and that performs better for the black character. I've also seen pages that have 0.99
00:20:14.040 inconsistent characters. So they might go from a white guy selling dog supplements to a wise Asian 0.97
00:20:23.540 man selling dog supplements. And then it's just like, boom, it just takes off. And part of the 0.93
00:20:29.260 reason if i want to be very charitable about it is there's something just like shocking about this
00:20:33.160 it's like real people don't manipulate people like that or if they do they're shamed and they
00:20:39.080 it's embarrassing and so there's just something about ai like that's an arbitrage opportunity for
00:20:45.440 ai because no one has to be held accountable and they can they can literally just like make a racist 0.74
00:20:51.660 comment in front of a black character and like that's okay for them because it's just a white
00:20:58.060 guy making them usually it's like some dude in kosovo like i see that a lot and and so i i you
00:21:04.040 know it's an exploit that ai is uniquely able to to manage as far as like what it says about us i
00:21:11.120 mean i will i will leave that to people smarter than me i can see the patterns i can i i hate it
00:21:17.840 i've i've seen it like manipulated in very big and harmful ways and i've actually um you know the 0.95
00:21:25.040 articles I've done about it, I oftentimes like will like ask a black woman how it makes them 0.65
00:21:31.000 feel because I can't feel that the same way. I like I feel uncomfortable about it, but like 0.98
00:21:36.520 it's harmful to have these depictions out there just like in general, like it is inherently
00:21:41.800 harmful. It makes people feel bad when they see it. And like that harm is being done. And like
00:21:48.000 that's not harm being done to me, but it is something that I can spot and make people aware
00:21:51.820 So that's the role I've taken.
00:21:57.560 Let's take a quick break.
00:22:21.820 unbeatable trade values, and 70 years of trust.
00:22:25.060 It's easy to see why families choose the Plaza Auto Group.
00:22:28.120 Plaza Auto Group, celebrating 70 years family-owned and operated.
00:22:32.260 Visit plazaautogroup.com.
00:22:34.200 Run a business and not thinking about podcasting?
00:22:37.300 Think again.
00:22:38.260 More Americans listen to podcasts than ad-supported streaming music
00:22:41.280 from Spotify and Pandora.
00:22:42.860 And as the number one podcaster,
00:22:44.620 iHeart's twice as large as the next two combined.
00:22:47.060 So whatever your customers listen to, they'll hear your message.
00:22:49.780 Plus, only iHeart can extend your message to audiences across broadcast radio.
00:22:54.280 Think podcasting can help your business?
00:22:56.160 Think iHeart.
00:22:57.180 Streaming, radio, and podcasting.
00:22:59.260 Call 844-844-IHEART to get started.
00:23:02.400 That's 844-844-IHEART.
00:23:04.880 When I was 14 years old, I was kidnapped and held captive for nine months.
00:23:10.740 I survived, and I've spent my life exploring how other people survive what should have destroyed them.
00:23:16.900 I'm Elizabeth Smart, and these are the Survivor Files.
00:23:20.860 I just remember this low, taunting voice next to my ear saying, 0.96
00:23:26.300 shut up, don't say anything.
00:23:28.960 Every week, I'm with survivors who live through the unthinkable. 0.98
00:23:33.480 I knew if he woke up, without a doubt, he was going to hurt me.
00:23:38.040 I started feeling that there was someone at the end of my bed,
00:23:42.680 and I just started screaming.
00:23:45.000 They are abducted, stalked, controlled, and nearly silenced.
00:23:49.460 But these aren't stories about what's taken from them.
00:23:52.920 They're stories about what it takes to make it out alive.
00:23:56.540 Listen to The Survivor Files with Elizabeth Smart on the iHeartRadio app, Apple Podcasts, or wherever you get your podcasts.
00:24:04.980 If your bookshelf and your For You page are equally important to your personality, welcome home.
00:24:10.920 This is Prose Society, the weekly podcast that's part book club, part group chat for thought daughters, pop culture obsessives, and anyone who thinks Pride and Prejudice and Love Island deserve the same level of discourse.
00:24:23.400 I'm Eli Rallo, and every week we're connecting the dots between books, the internet, and the conversations everyone can't stop having.
00:24:30.500 I'm going to have to look up this story.
00:24:32.400 I'm obsessed.
00:24:33.140 So obsessed.
00:24:33.640 From best-selling authors and your favorite BookTok creators to the latest pop culture moments, nothing is off the table.
00:24:40.040 It's like if you can hide some real messages inside compelling characters, then that is a Trojan horse.
00:24:47.940 Whether you're looking for literary deep dives, smart pop culture conversations, or a community of readers who love to think a little too much, you're in the right place.
00:24:57.120 Listen to Pro Society on the iHeartRadio app, Apple Podcasts, or wherever you get your podcasts.
00:25:02.600 See you between the pages.
00:25:10.420 And we're back.
00:25:14.980 I've been talking about digital blackface, both AI-generated and otherwise, for a while.
00:25:21.380 Like when Google's VO3 first came out and racist skits depicting AI-generated black women as gorillas,
00:25:28.180 or depicting AI-generated enslaved people on plantations blooded TikTok.
00:25:34.160 I really thought that tech platforms should have had to answer for it.
00:25:38.780 But I was pretty much screaming into the void.
00:25:41.640 And stuff like that just became more and more ubiquitous.
00:25:45.020 Earlier this year, a Black student researcher named Angel Nulani reached out to Jeremy.
00:25:50.000 Angel had been seeing those very same overtly racist AI-generated videos depicting Black women. 0.62
00:25:57.560 She had found 40 social media accounts with AI-generated Black women 0.84
00:26:01.880 that perpetuated racist and anti-Black behavior.
00:26:05.880 An angel told Jeremy how it feels to use social media platforms as a Black woman 1.00
00:26:10.620 when those same platforms are awash in this kind of racist, misogynistic garbage. 1.00
00:26:16.960 She said, 0.99
00:26:17.660 What upsets me is not that these characters are self-hating,
00:26:21.380 but that there is no self.
00:26:23.700 For the majority of the people who are behind these accounts,
00:26:26.280 The only Black people they know are the women they generated. 0.95
00:26:30.520 They were not born Black. 1.00
00:26:32.040 They chose to be Black. 0.90
00:26:33.740 And yet, they spend so much time distancing themselves from it. 0.94
00:26:37.980 An All Lives Matter shirt can be paired with booty shorts.
00:26:41.640 Crime statistics can be overlaid on thirst traps.
00:26:45.120 Videos crying over their features are spliced between suggestive yoga poses.
00:26:50.040 It's not enough to pander to people that say Ebony more than African. 0.92
00:26:53.980 because The Appeal is not simply a Black woman desiring white men. 0.80
00:26:59.040 The Appeal is a Black woman desiring a complete absorption into whiteness. 0.91
00:27:05.180 The men they attract are not suitors, they're saviors. 1.00
00:27:09.080 I've tried so hard to disassociate.
00:27:11.840 As a Black woman that's been online since I was young,
00:27:14.680 I assumed I saw it all.
00:27:16.840 Nothing really hurt me.
00:27:18.500 At first, all I wanted was to be objective and rational and done with it.
00:27:22.560 But this cuts me down to my core.
00:27:25.460 So that's what Angel told Jeremy, and I really understand how she feels.
00:27:30.100 In a collaborative investigation with the BBC, Jeremy worked to uncover 100 social media accounts that depict the likenesses of Black women through AI-generated characters.
00:27:40.660 TikTok took action and removed some of these accounts from their platform, and I'm really glad they did.
00:27:46.240 But Jeremy says that doing work like this sometimes just feels weird because the content is so deeply racist and exploitative and gross.
00:27:54.940 But he's also very aware that it isn't really his pain to bear, like it is for Black women like me and Angel.
00:28:02.040 Yeah, I wanted to ask you about this, and I wasn't even sure how to ask this.
00:28:06.960 We have been talking about digital blackface for a very long time, both AI-generated and other kinds of what I would consider to be digital blackface.
00:28:14.740 We did an episode about it way back when in 2022 where this like AI generated rapper named FN Mecca was released. We had a whole conversation about it when Sora and VO3 were being used to create the skits that I think you and I would probably agree are like essentially digital minstrel shows. We did an episode about it.
00:28:32.740 I, I don't know. I, I, in my opinion, that especially when VO3 and Sora were becoming things, that was like an urgent moment to me. I was like, this is we need to like, have this conversation. And I was kind of surprised that that did that moment did not get the traction as like an urgent change that I would have thought it would.
00:28:56.920 And when I came across your videos, I was like quite thrilled to see them getting such traction, especially the videos that are about, you know, race and the way that black women are depicted in these things.
00:29:07.620 And I guess my question, and I'm not even sure if this is something you could speak to, but do you think there is an element of like, who is the messenger here?
00:29:16.620 Because I wonder if like me as a Black woman saying these these videos make me feel X, Y, Z, these videos are trafficking and X, Y, Z, misogynistic, racist trope.
00:29:28.560 I think that there's something where a lot of people can just be like, oh, it's just Black women complaining about something again.
00:29:34.540 And then when you speak about it, not just from the perspective of a white man, but also somebody who, you know, has this technical background, like in your Substack piece,
00:29:44.820 You really break down like the color gradients of why the kinds of skin that is depicted in some of these videos is actually impossible and what that means.
00:29:53.780 I am really grateful and happy that you are talking about this and amplifying it.
00:30:00.380 But I wonder if like if there's a good thing with the messenger there where it's more people are more like, oh, well, this kind of technical guy is saying it.
00:30:08.840 So we better pay attention.
00:30:10.360 I agree.
00:30:10.960 I think that that's pretty likely.
00:30:13.440 I also am very uncomfortable with that because like, I know that's why I'd, so I'll say I
00:30:19.460 actually have not talked about this. This is a great time to do it. So the way that I found out
00:30:23.740 about, um, the, well, not found out. So I, I had seen other, uh, the, the AI generated sexualized
00:30:32.660 black women before, and I feel uncomfortable talking about it because I think that the
00:30:37.260 depiction is quite harmful. Um, and what actually made me write that article was I had a young
00:30:44.940 woman who she's black and she had found a lot of these accounts and she sent them and she's
00:30:49.160 credited in the piece. Her name's Angel Nalani. And, um, I was really thankful that she was there
00:30:55.780 because she was able to be like the emotional core. And like, I wasn't, I didn't feel like I
00:31:02.120 was like taking advantage of something. Cause I felt really bad. Like, I don't want to get views
00:31:06.120 on something exploitative i don't like i i do feel like a discomfort here and and i think that
00:31:13.060 it's a discomfort on so many levels it's all new it's like this is this is all like quite new like
00:31:18.340 the technology layer obviously uh you know racist depictions and digital blackface aren't anything
00:31:23.240 new but like this is a new kind of intersection of like technology and and race and and so i think
00:31:30.240 it's like a really difficult thing to navigate so the reason i'm answering this way is like i agree
00:31:34.600 that there's something there i i struggle to navigate it because i really don't want to be
00:31:40.140 taking advantage of these stories any more than i should be i would love other people to talk about
00:31:45.880 it and i you know my opportunity to platform angel is someone who like i want you to be in this piece
00:31:51.480 because like you came to me like this is personally affecting you you told me that this is a difficult
00:31:56.300 thing for you to go through like i want to like pay you to do this so that like you can be a part
00:32:01.520 this and like i don't think that's like i'm not doing that to like pat myself on the back or
00:32:05.560 something i'm just like i'm aware of the discomfort there and it doesn't like it i'm very very meta
00:32:12.460 aware of this i think that just kind of a nature like i i'm very careful about like um you know
00:32:19.580 the language and it's actually it keeps me from making a lot of videos sometimes it like definitely
00:32:24.640 puts a pause because i don't want to uh make the problem worse by showing more depictions when we
00:32:29.960 did the story that you're referencing, we went through a ton of different variations on if we
00:32:36.700 were even going to show the depictions, how we were going to show them. When we worked at the
00:32:42.980 BBC, the BBC decided not to name any of these accounts. We decided to name the accounts.
00:32:50.980 That's a difference in how we decided harm could be done, right? The BBC decided that
00:32:55.500 by directing people to these, it could be harmful. Whereas I wanted to call them out. And, um, and
00:33:01.560 so I think that there just isn't one answer and I'm seeing, I'm seeing those, uh, things all play
00:33:07.220 out in real time and navigating them and just kind of doing my best. But I, I agree. And I do hope
00:33:12.780 that, um, you know, I can provide any sort of platform I can to people who aren't white men to,
00:33:18.400 to help because it's it's not it really is like uh ai is very good at making a lot of identities
00:33:25.540 really quickly it's going to impact a lot of different types of people yeah it was really
00:33:30.740 clear from the piece the intention and care and thought that you would put into kind of framing
00:33:35.820 it and it is like just a tough growth thing to have to talk about yeah the quotes from angel i
00:33:43.340 thought really were so resonant she says like i'm terrified to think there's a little black girl
00:33:47.480 somewhere feeling as terrible as I do right now because some guy in Malta wanted to make three
00:33:51.380 euro a month or you know they make us seem so ugly but we're so beautiful like all of these
00:33:56.740 I just was really moved by a lot of what she had to say and so I'm grateful that her voice was
00:34:03.640 included in the like throughout the piece and it's just is very clear that you all are taking
00:34:07.700 very intentional steps to talk about something that is like sensitive and tough and thorny to
00:34:15.220 talk about because i don't feel like everybody would be a lot of people would be like what a
00:34:19.660 scoop can't wait to get a million views on this tiktok about horrible racist ugly depictions of
00:34:26.860 black women i i also there are similar things happening um with um the way that children are
00:34:34.460 depicted online that have been very troubling for me um a lot of stuff related to like frankly
00:34:40.280 um uh there was one like example i could give and this is not this is not to say that someone is
00:34:46.580 doing this the wrong way or right way i'm just i'm just like stating the difference that i would
00:34:49.760 cover and how i would cover it like um there were a lot of ai depictions of girls with jeffrey
00:34:56.560 epstein that got a lot of views by people on instagram who were like pointing out at me like
00:35:02.680 this is wrong and like i don't feel comfortable doing that i just i don't i don't feel like
00:35:07.980 there's a responsible way for me to cover that. And so like when I was doing, when I did videos
00:35:13.620 about the piece we're talking about, like I decided to blur them all out because I don't
00:35:17.860 want to be trafficking them the same like shock value that a lot of these have. Like there is a
00:35:21.660 lot of shock value here. And I think that's unfair. But again, I don't think that there's
00:35:26.900 one right or wrong way to do it. I think that it depends who your audience is and what your angle
00:35:32.200 is. Thanks to Jeremy's investigation alongside the BBC, within three days, TikTok banned 20 of
00:35:39.900 the 37 accounts that his team found pumping out this racist AI-generated content. TikTok also
00:35:46.440 applied AI-generated labels to the videos that Jeremy and his colleagues pointed out.
00:35:51.880 So we're talking about this investigation you did with the BBC. From that investigation,
00:35:56.280 tick tock banned 20 accounts for using these ai generated black women influencers to drive to 1.00
00:36:03.320 sites some of them were driving to like porn sites where you could then pay like pay for porn
00:36:08.640 um the accounts are they're upsetting i guess i'll say but they they're overtly racist yeah
00:36:15.540 they're overtly bad yeah and a lot of the comments a lot of the the posts will kind of
00:36:22.240 use these like race play terms like the the the post will be like I love white men and things
00:36:28.660 like that um I it just it's clear to me what's going on but I think to your point it's one of
00:36:38.820 those things that like it's difficult to talk about like oh someone has figured out that using
00:36:44.160 super racist depictions of black women might generate clicks back to this pay porn site and
00:36:49.760 to the point that you made earlier there's certainly you know adult content that is super 0.97
00:36:55.040 racist and horrible and violent but the idea that you can create that kind of content without a
00:37:00.640 human right so like all of the harm that you that would be resulting of that you could do that
00:37:06.220 without any person signing up and consenting and being like okay i'll do this like you can just
00:37:10.660 make it quickly and cheaply you can i there does still have to be a human in the loop right now
00:37:16.140 just to be clear so like i think we still have to remember that but there are very few and so it
00:37:22.120 just takes one person rather than a team of people and someone to be like this probably isn't the
00:37:27.360 right thing to do um and then there are people who are just intentionally making racist depictions
00:37:32.920 and know it and they don't care and this is a very cynical way to just to view how to use these tools
00:37:38.760 and so i you know i think that there there are different types of accounts that's something else
00:37:43.220 I wanted to say like there are accounts that are run internationally that are not as overtly racist and they really are just using like a black woman's likeness, which is problematic, but they aren't doing anything different than a similar white character that they might be running.
00:37:58.920 So they're just like running different identities. But, you know, so there were there were a gamut, you know, we found like 136 different accounts and they weren't all the same, but there were a lot of trends for sure.
00:38:09.840 And I would say that probably over a third were overtly racist and over a half were suggestive or at least like dabbled in race play terminology in some sort of direct way.
00:38:24.760 And then there were some that were just like way too far, even even for Instagram and Instagram didn't take his money down, but Instagram took a few down that were extremely problematic, too.
00:38:34.620 So, yeah, there were there were a lot of them, but they had a lot of the same patterns.
00:38:38.440 Do you have a sense of where videos like this originate from in the world?
00:38:43.860 Everywhere. It is an international problem. We did track across, I think it was five different continents. I think Australia wasn't included and Antarctica wasn't included. So those are the only two not included.
00:38:56.880 um it was pretty what it was pretty wide ranging i would say i think i'll um a lot of people will
00:39:04.420 make assumptions but this is something that anyone can do from really anywhere in the world
00:39:10.300 and um there were operations runs so there were accounts that were run by content farms and there
00:39:17.980 were um you know solo accounts it's a pretty wide range so i try not to to pin it down anywhere but
00:39:24.740 you can get location data from Instagram, especially if they let you see it. And those
00:39:30.680 can be spoofed too. So it's not always the most accurate, but it at least tells you that there's
00:39:34.720 a range. Let me ask you this. So I know that TikTok did take down a lot of these accounts.
00:39:40.280 Instagram was like, we're looking into it. What explains the difference there?
00:39:47.440 so tiktok will uh so tiktok actually cited exactly the policy that they broke and they
00:39:56.060 were very direct about it and part of the difference is that instagram doesn't have as
00:40:01.300 directive language about this in their policies and their terms of service um their inauthentic
00:40:07.380 media is more protecting real people from being deep faked or copied whereas tiktok takes a
00:40:14.180 broader view of inauthentic behavior. Uh, so that's, that's the first difference. The second
00:40:19.900 difference is that Instagram is just generally where a lot of this content is. And that's because
00:40:26.340 it is more permissible of it. So like there were, I think 96 accounts that we tracked on Instagram
00:40:34.040 and it might've been 36 on Tik TOK or something along those lines. And like the fact that we
00:40:41.200 reported more of them and few of them got taken down on Instagram is also why there are more on
00:40:45.940 Instagram. So it's a little bit of like a, uh, a self replicating cycle there that Instagram has
00:40:52.000 built. Um, that also means ironically that videos I do about it do better on Instagram too. So it's
00:40:58.980 like, it's affecting everyone. If I, if I make a video that includes so much as like an AI woman 0.99
00:41:05.420 wearing a bikini, I have to blur that on Tik TOK. Otherwise it'll, it'll get shadow, you know, 0.64
00:41:10.160 deprioritized, right? These are just things we're aware of as creators. So it is consistent with
00:41:16.620 how they each run their platform. I think that's what I'm trying to say. Yeah, that makes sense to
00:41:21.000 me. Just as someone who has covered a lot of meta and their policies and how they abide by or don't
00:41:26.320 abide by those policies, what you're saying really checks out to me, I guess. Checks out. Yeah, I
00:41:31.640 didn't have to think that hard about it. It was consistent. Consistent, that's a good way to put
00:41:35.640 it. One of the videos that you talked about in the piece took a real model from Malaysia and then
00:41:42.120 gives her that impossibly dark skin using AI. And just as a Black woman, to me, it almost feels 0.98
00:41:49.540 like it is using technology to create this impossible standard of beauty where it's a 0.97
00:41:56.260 woman who is not Black, who has, of course, has non-Black features, but then has not just dark 0.81
00:42:04.420 skin but like impossibly dark skin and i guess i just feel that it's really is using technology 0.96
00:42:10.920 to create these people that cannot exist but but of course like also then sets an existing beauty
00:42:17.680 standard despite that standard being impossible yeah i got so frustrated and that's why i actually
00:42:23.340 did the whole thing about actually detecting the undertones to prove that these skin tones were
00:42:28.700 impossibly black because people would be like oh no there really are people that with that dark
00:42:33.520 of pigmentation i'm like no there aren't like the they have no undertones and i actually like
00:42:38.160 i actually found the people they were talking about and i put them on vectorscopes i'm like
00:42:42.320 i can tell there's a scientific difference here there is there is a difference and um you know
00:42:48.100 it's like the the models that would create these are open source models um so they don't have the
00:42:54.060 guardrails to prevent you from doing this anyway i don't know if there are guardrails i haven't i
00:42:59.060 haven't tried to make many impossibly black characters i'm not very interested in doing it
00:43:03.460 um i don't know if you're allowed to do it on like google's ais for example i could probably test it
00:43:10.000 but the ones that they were using are open source anyway that can create sexual content like
00:43:15.920 sora um which is closing down soon uh vo um even like uh mid journey like these these like big
00:43:24.660 names have guardrails. So they're using open source models that are a little bit less high
00:43:29.960 quality, but can make sexual content. So it's, they're much harder to stop.
00:43:38.320 More after a quick break.
00:43:45.140 My SUV is worth more than ever. Time to upgrade. There's never been a better time.
00:43:50.440 At Plaza Auto Group, locations get top value for your trade
00:43:53.900 and shop hundreds of new and pre-owned vehicles across 11 locations.
00:43:58.300 And if you can't come to us, we'll come to you.
00:44:00.720 With best-in-class pricing, unbeatable trade values, and 70 years of trust,
00:44:05.660 it's easy to see why families choose the Plaza Auto Group.
00:44:08.780 Plaza Auto Group, celebrating 70 years family-owned and operated.
00:44:12.920 Visit plazaautogroup.com.
00:44:15.240 Run a business and not thinking about podcasting?
00:44:17.920 Think again.
00:44:18.380 More Americans listen to podcasts than ad-supported streaming music from Spotify and Pandora.
00:44:23.540 And as the number one podcaster, iHeart's twice as large as the next two combined.
00:44:27.720 So whatever your customers listen to, they'll hear your message.
00:44:30.720 Plus, only iHeart can extend your message to audiences across broadcast radio.
00:44:34.940 Think podcasting can help your business?
00:44:36.800 Think iHeart.
00:44:37.840 Streaming, radio, and podcasting.
00:44:39.920 Call 844-844-iHeart to get started.
00:44:43.060 That's 844-844-iHeart.
00:44:45.300 when I was 14 years old I was kidnapped and held captive for nine months I survived and I've spent
00:44:52.980 my life exploring how other people survive what should have destroyed them I'm Elizabeth Smart
00:44:59.020 and these are the survivor files I just remember this low taunting voice next to my ear saying
00:45:06.660 shut up don't say anything every week I'm with survivors who live through the unthinkable
00:45:14.140 I knew if he woke up, without a doubt, he was going to hurt me. 0.75
00:45:18.600 I started feeling that there was someone at the end of my bed, and I just started screaming.
00:45:26.220 They are abducted, stalked, controlled, and nearly silenced.
00:45:30.120 But these aren't stories about what's taken from them.
00:45:33.560 They're stories about what it takes to make it out alive.
00:45:36.680 Listen to The Survivor Files with Elizabeth Smart on the iHeartRadio app, Apple Podcasts, or wherever you get your podcasts.
00:45:45.640 If your bookshelf and your For You page are equally important to your personality, welcome home.
00:45:51.580 This is Prose Society, the weekly podcast that's part book club, part group chat for thought daughters, pop culture obsessives, and anyone who thinks Pride and Prejudice and Love Island deserve the same level of discourse.
00:46:04.040 I'm Eli Rallo, and every week we're connecting the dots between books, the internet, and the conversations everyone can't stop having.
00:46:11.160 I'm going to have to look up this story. I'm obsessed. I'm obsessed.
00:46:14.740 From best-selling authors and your favorite book talk creators to the latest pop culture moments, nothing is off the table.
00:46:20.680 It's like if you can hide some real messages inside compelling characters, then that is a Trojan horse.
00:46:28.160 Whether you're looking for literary deep dives, smart pop culture conversations, or a community of readers who love to think a little too much, you're in the right place.
00:46:37.780 Listen to Pro Society on the iHeartRadio app, Apple Podcasts, or wherever you get your podcasts.
00:46:43.800 See you between the pages.
00:46:52.180 Let's get right back into it.
00:46:53.580 the last time i did a deep dive into ai generated content on social media i noticed just how often
00:47:03.000 people who make this kind of content insist that you too can make passive income just by setting
00:47:09.680 up an ai influencer now i had no proof but the whole thing just had the whiff of a scam to me
00:47:17.360 like when a girl you went to high school with dms you about a business opportunity where you can
00:47:22.500 make lots of money and be your own boss from home. You know, when we first did our episode,
00:47:28.040 when VO3 and Sora were first like becoming things, one of the things that I, I was, it was the, it
00:47:36.000 was early days that I haven't really revisited it since. But one of the things I saw a lot about
00:47:39.860 this kind of content was it had a lot of almost like an MLM quality to it, where people would be
00:47:47.500 making kind of, not all racist, but some really racist depictions of Black people using AI. And
00:47:55.140 then there'd be sort of a like, oh, and you could, I make so much money from this. I can teach you
00:47:59.360 how to do it too. I can teach you how to create an AI influencer and start making cash. And at the
00:48:05.640 time I had no idea, but my thought was, I was like, I think that this is one of those things where
00:48:11.040 I don't know that a lot of AI influencers are making a lot of money because if they were,
00:48:17.320 they probably wouldn't also be selling the like the like course on how to make money because that
00:48:22.180 seems like the grift here i don't know what what are your thoughts on that it is both so some of
00:48:29.280 the uh most racist ones were what you were talking about where they were primarily selling courses to
00:48:35.040 people and the reason that those are the most racist is because they're mostly trying to grab
00:48:38.800 people usually men who are creating these and so it's like the shock value that gives you to look
00:48:43.800 and then say like oh maybe i could do this which is saying a lot about like the
00:48:47.320 type of people that oftentimes create this. And I mean, yeah. Anyway, so the ones that are making
00:48:54.720 money are oftentimes like your bigger accounts. And a lot of those aren't selling like AI making
00:49:02.320 courses. So like they are actually making money primarily on the offsite porn sites that they
00:49:09.340 direct people to. Their media, and I have not bought any of this just to be clear, but like
00:49:15.260 the prices for the ai content they're selling are like really ridiculously high so you can tell what
00:49:21.720 that means they're trying to get like what betters would just call whales like they're trying to just
00:49:25.060 get some people who just have a bunch of money to spend and like that's how they make it so
00:49:28.240 you know they get their big audience on instagram and they just hope that i don't know maybe a
00:49:33.280 hundred people spend a bunch of money on their off on their off sites and that's how they're
00:49:38.000 doing it but there there's a bit of both what role do you see ai having on the influencer economy
00:49:43.200 Um, I'm, I'm pretty worried about it lowering rates for everyone. Um, I don't know too much
00:49:50.980 about the influencer economy, ironically, because I don't take sponsorships. So I haven't seen it
00:49:54.940 like firsthand. Um, but I think that the concern is that a lot of those like direct to consumer
00:50:04.300 style, uh, advertisements can just be made using AI now, whether or not they will is a different
00:50:11.360 question. It is still something that is pretty easily caught and pretty embarrassing, but a lot
00:50:18.240 of brands aren't doing their own marketing. They're going to agencies and they might be pretty hands
00:50:21.780 off. Like for some reason, I've seen a lot of AI advertisements for like Cetaphil, the skincare
00:50:27.420 company. I use that every day. Yeah, but I don't think that they're doing it. I think that someone
00:50:34.360 is making the ads and then doing an affiliate link on Amazon. So it's like, that's the other
00:50:41.180 tricky thing is you don't always know if they're actually associated with it, or it's just like an
00:50:45.800 Amazon affiliate thing. So it's tricky to tell. But I mean, obviously, a lot of the AI companies
00:50:54.040 are selling this as yeah, you can just have AI influencers and not communicate with regular
00:50:59.620 influencers. But I also think that the reason people like regular influencers, because they
00:51:04.160 have a relationship with them. So I think they're also missing the point. Yeah, we talk about that
00:51:08.460 a lot. You know, we, the reason why, like, like, as a podcaster, people are often like, oh, you
00:51:16.000 know, are you worried about AI podcasters coming for your job and your whole podcast could be AI
00:51:21.840 one day? Not really. I'm not really that worried about it. I don't like the idea of it. But I know
00:51:26.040 that the reason why people come to podcasts and my podcast, but podcasts in general, is for things
00:51:32.660 that AI is not so good at fostering trust, authenticity, a connection with a real human.
00:51:38.360 I just don't. I mean, if people wanted to listen to AI podcasts, there are plenty of AI podcasts
00:51:42.160 that exist already. You could go listen to them right now. People aren't listening to them right
00:51:45.660 now. And I think there's a reason for that. It's just a general misunderstanding. And I think a
00:51:50.800 little bit like people don't think much of social media or they think they don't think about like
00:51:57.340 why people are actually on social media or why people are listening to podcasts instead of the
00:52:01.740 other types of media that they know people are watching less of and it's generally because it's
00:52:06.380 more personal or it feels more authentic to them so i don't think that's changing anytime soon
00:52:11.580 there will be people who don't value that as much who might switch more to the ai versions
00:52:16.440 i am worried about that again like maybe being a negotiating tactic if you're an advertiser like
00:52:22.300 well i can just get an ai to do it and you know it's like well can you i don't know but that could
00:52:27.380 at least be a tactic. So I think that it still comes with risk, but I don't worry about it
00:52:32.080 as much as I would if I were like a purely transactional TikTok shop creator, maybe.
00:52:39.380 Then I might be a little bit worried. Yes. And I have found that so much,
00:52:43.500 at least in the podcast space, so much of the conversation of like, oh, AI can replace humans
00:52:47.440 is hype that is being promoted by people who are selling AI tools. And so they are invested
00:52:53.140 in people believing, especially like decision makers and people who are writing the checks,
00:52:57.380 They have an investment in those people believing that that is what people want, even if it
00:53:01.600 maybe isn't.
00:53:03.400 Yeah, absolutely.
00:53:04.680 And so many people are selling it.
00:53:06.160 It does feel a little bit NFT, a little bit Web3 era, where it's just like, you feel
00:53:13.080 like you have to get people in on it.
00:53:14.960 Ironically, you really don't need, with crypto, you really did need other people to buy in
00:53:20.560 for it to go well.
00:53:21.560 You don't need to do that here.
00:53:22.500 But like a lot of those people are coming over to the AI product space and vibe coding apps and stuff like that.
00:53:29.440 So, yeah, I absolutely agree. That's that's the kind of vibe it has to me.
00:53:32.700 And of course, it always comes down to the thing that you flagged as the piece that worries you is how can we underpay and undercut human labor?
00:53:41.140 How can we disrespect human labor? I hate that that's always what it comes back to.
00:53:46.220 But that does seem to be what it always comes back to.
00:53:48.560 yeah and and again i would just remind people that like people do like working with other people
00:53:55.340 and like i think small businesses are you know going to keep working with other people a lot
00:53:59.860 of the bigger corporations i'd be probably a little bit more worried about if if i were them
00:54:04.600 but um i mean it's going to happen like natural like technology will keep happening and i think
00:54:10.120 it is unclear if this is actually just to be clear moving faster than any other like normal
00:54:15.160 technology would do in so far as like how it's impacting labor. A lot of like layoffs that are
00:54:20.680 being done are done in the name of AI, but are really efficiency cuts maybe from over hiring of
00:54:26.540 COVID. Like, I don't know these things. They're not transparent about it. I think it's very
00:54:31.880 likely that AI will have a massive impact on labor. I think that that is, I mean, almost
00:54:38.520 guaranteed at this point, if I'm being honest. And yet, like, I think that it will also go by
00:54:43.800 many names. They might be more excited to call things AI because that does have usually positive
00:54:51.300 benefits to their stock value. So we just have to be careful not to overhype it even when it is a
00:54:56.720 real risk. Very well put. And I've heard you mention that you think that AI detection will
00:55:02.740 eventually be outpaced by AI quality improvements. I don't know if this is a question that you can
00:55:07.760 answer, but how urgent is that window? What needs to happen before that window closes?
00:55:13.800 um so i don't think that software detection is going to save us here at least not in the next
00:55:19.340 few years and i think that people assume it will i don't know why except for the fact that they're
00:55:25.760 used to software solving their problems but there's no indication that we're really that
00:55:31.180 close here if i'm being honest like ai photo detection is not that good ai video detection
00:55:36.200 is very bad right now uh you still have media literacy tells right now that are very helpful
00:55:41.820 And if you're a platform, like you have access to that data and you should probably take it more seriously, in my opinion, but their moderation is so under resourced that they're not doing that. So there's like a lot of problems kind of all converging at once. But I think that we have an opportunity right now to figure out what is real or not, like a little bit more on a day to day basis. And as AI video and photo keeps improving, it's just going to keep getting harder. I'm just like trying to be realist about that.
00:56:11.120 So I would like platforms to take it more seriously now because it is technically still a little bit possible and we don't know where it's going to be in the future.
00:56:18.460 I don't think that it's going to be completely undetectable anytime soon, but that's not really what I'm worried about.
00:56:24.380 I'm more worried about it making people believe that real things aren't real en masse than anything else.
00:56:32.580 Yeah. I mean, I guess to sort of wrap it up here, I think that you often are kind of seen as like the AI deepfake spotter debunker guy on the internet. But as you mentioned, it's really more of a broader set of media literacy tools. Do you have tips for what folks should be looking out for?
00:56:54.440 full disclosure i've admitted it on the podcast i turns out i have a real uh blind spot for ai
00:57:01.900 generated animal videos and i've kind of been put in group chat time out because my friends are like
00:57:09.020 it's ai girl are you not seeing this those bunnies are not jumping on this guy's tummy it's fake
00:57:13.780 so yeah give us some tips for what we can do to be a little bit sharper when it comes to media
00:57:18.840 literacy given all of this so the first is i think reposts accounts are pretty much dead to me i just
00:57:27.940 don't think that they're useful anymore i think they're really likely to repost ai content right
00:57:33.760 now um and part of the reason is that if you're not getting like algorithms make it possible to
00:57:40.240 just get things from original sources like you don't need another reposter to curate your algorithm
00:57:44.640 them for you um that's that's one thing uh the second is that uh and this goes to a little bit
00:57:51.660 of like why right now is important is even if uh ai videos get much better in the coming months
00:57:59.560 that means that accounts are going to have to keep like updating their content deleting their
00:58:04.280 old stuff that's more obviously ai so as of now a lot of deceptive ai accounts are less than four
00:58:11.820 months old or you can scroll back to their old content and be like okay that's more clearly ai
00:58:16.820 generated if you were ever good at spotting it before if you weren't good at spotting it before
00:58:20.800 then that might not be that helpful for you um and the other thing is just really spend more time
00:58:27.440 watching like people and creators you trust rather than having the algorithm decide for you because
00:58:32.240 the algorithm can't figure out what's real any better than you can right now so um i think like
00:58:38.320 I spend probably less time watching AI videos than other people because I watch more long-form
00:58:42.720 content and less long-form content is AI-generated. Unless it's faceless YouTube, there are
00:58:48.460 exceptions. Unless it's your AI-generated podcast that we were talking about. But I'm really looking
00:58:54.760 for people I trust and following people I trust and trying to tailor my recommendation algorithms
00:58:59.040 to that as well. If you think about it as more of a people problem, it becomes more manageable.
00:59:05.380 It's like, do I trust this source?
00:59:06.780 Do I trust this person?
00:59:08.540 You're not going to be able to just spot your way out of this.
00:59:11.540 It's just not possible.
00:59:12.820 It's going to be exhausting at the very least.
00:59:14.900 I find that more and more people are tuning out before they are trying to actually figure
00:59:19.840 it out.
00:59:20.440 So take that burden off yourself.
00:59:22.780 Spend more time watching people you trust and less time doing scrolling and trying to
00:59:26.120 figure out what's real.
00:59:26.820 It's just not going to be a thing we can do for that much longer.
00:59:30.120 Jeremy, you are a person I trust.
00:59:32.140 Where can folks follow you and all of your content?
00:59:35.020 I'm at JeremyFindsAI, my handles on all social media.
00:59:39.660 And then riddance.ai is our sub stack
00:59:42.700 and where we do investigations.
00:59:44.600 So check us out there.
00:59:46.060 Thank you so much for being here.
00:59:47.840 You are such, I mean, I really,
00:59:49.260 I get tagged in your content a lot
00:59:51.140 and I'm always like, yep, that's AI.
00:59:52.480 We're like, oh, interesting, I haven't seen this.
00:59:53.800 So thank you so much for what you're doing.
00:59:55.440 I feel like it makes me smarter
00:59:57.500 and like a better digital citizen, I guess.
01:00:04.540 Got a story about an interesting thing in tech or just want to say hi?
01:00:09.620 You can reach us at hello at tangody.com.
01:00:11.900 You can also find transcripts for today's episode at tangody.com.
01:00:15.320 There Are No Girls on the Internet was created by me, Bridget Todd.
01:00:18.060 It's a production of iHeartRadio and Unbossed Creative.
01:00:20.780 Jonathan Strickland is our executive producer.
01:00:22.840 Tari Harrison is our producer and sound engineer.
01:00:25.460 Michael Amato is our contributing producer.
01:00:27.560 Edited by Joey Patt.
01:00:29.060 I'm your host, Bridget Todd.
01:00:31.040 If you want to help us grow, write and review us on Apple Podcasts.
01:00:34.540 For more podcasts from iHeartRadio, check out the iHeartRadio app, Apple Podcasts, or wherever you get your podcasts.
01:00:50.660 If your bookshelf and your For You page are equally important to your personality, welcome home.
01:00:56.780 Pro Society is a weekly podcast that's part book club, part group chat for anyone who thinks Pride and Prejudice and Love Island deserve the same level of discord.
01:01:05.060 Each week, we're connecting the dots between books, the internet, and pop culture
01:01:08.560 with your favorite writers, book talk creators, and plenty of overthought opinions.
01:01:13.320 Yeah, I'm obsessed. I'm obsessed.
01:01:15.080 Listen to Pro Society on the iHeartRadio app, Apple Podcasts, or wherever you get your podcasts.
01:01:21.180 I survived nine months in captivity,
01:01:24.060 and I've spent my life exploring how other people survive what should have destroyed them.
01:01:29.860 I'm Elizabeth Smart, and these are the Survivor Files.
01:01:33.060 Every week, I'm with survivors who live through the unthinkable, abducted, stalked, controlled, and nearly silenced.
01:01:41.020 These are stories about what it takes to make it out alive.
01:01:44.840 Listen to The Survivor Files with Elizabeth Smart on the iHeartRadio app, Apple Podcasts, or wherever you get your podcasts.
01:01:52.900 I'm Hoda Kotb, host of the podcast Joy 101 with Hoda Kotb.
01:01:57.300 You know, I'm always searching for inspiration and useful tools to maximize joy.
01:02:02.480 Like when my friend Henry Winkler offered advice to aspiring actors and really anybody hoping to stand out.
01:02:09.680 You're not hired just to fill time and space.
01:02:12.500 You're hired to fill the space with you.
01:02:15.660 Listen to Joy 101 with Hoda Kotb on the iHeartRadio app, Apple Podcasts, or wherever you get your podcasts.
01:02:23.740 Our hometown is not a test tube.
01:02:26.400 90 miles northeast of Nashville, a battle for the future of America plays out in one small town.
01:02:32.500 Developers with right-wing ties have purchased hundreds of acres of land.
01:02:36.140 We need cities on a shining hill.
01:02:38.340 This is Our Town, a podcast about what happens when a small town
01:02:42.400 becomes the site of a social experiment and fights back. 0.99
01:02:46.380 Guess you didn't move in on a bunch of dumb hillbillies now, did you? 0.98
01:02:49.080 Listen to Our Town on the iHeartRadio app, Apple Podcasts, 0.99
01:02:53.160 or wherever you get your podcasts.
01:02:57.680 This is an iHeart Podcast.
01:03:00.560 Guaranteed human.
01:03:02.300 Thank you.