00:01:24.640Eligible orders only. Other fees and terms apply.
00:01:32.020There Are No Girls on the Internet is a production of iHeartRadio and Unbossed Creative.
00:01:40.120I'm Bridget Todd, and this is There Are No Girls on the Internet.
00:01:45.660So this is going to be a little bit different of an episode than the one that we initially had planned for today.
00:01:50.860And that is because I have found myself personally in a situation that I think really speaks to this specific moment in technology, media, the internet, and where we're going in the future.
00:02:02.860And as we're exploring this present future of ours, we are probably going to find ourselves having more and more moments like this one.
00:02:10.540So I wanted to bring all of you along on this ride with me.
00:11:29.120I have no insight into Essence Magazine's editorial room.
00:11:32.620I put out a poll on Instagram to say, like, do people think this is AI or not?
00:11:37.400Overwhelmingly, most people think it's AI.
00:11:39.220Not that it's a scientific poll, but one person said that they believed that it was written by a human who was trying to do this, like, youthful, voicey, TikTok voice and just falling short.
00:11:52.840I spend a lot of time analyzing AI-generated content, both visual content and written content.
00:11:59.500And one thing that when it comes to written text is AI can sometimes be a bit repetitive. And so the fact that this Essence post reiterated this eight bit a few times, that seemed a little AI-like to me.
00:12:18.100like, this ate, this is an ate, this is an eat. I don't, it's not something, I get that they are
00:12:26.160going for like a very specific Black women, you know, slang. I say that, you know, she ate, that1.00
00:12:33.200ate, left no crumbs all the time. That would be, those are phrases that I've heard before in the
00:12:39.620vernacular. The way that they put it in that repetitive way have never heard that before.
00:12:44.720And the fact that it's repeating similar words, I'm sorry, that is something that AI kind of does when you're looking at AI-generated text is repetition.
00:12:54.120So that was the first thing that kind of made me think, oh, this is AI.
00:12:56.480The second thing is a little bit harder to describe, but you know it when you see it.
00:13:03.660It's just that AI-generated text just doesn't sound right.
00:13:07.580The same way that when you see an AI-generated image, sometimes it just has a quality to it that's hard to define, but you know it when you see it.
00:13:14.720that tells you this isn't quite right.
00:13:17.880Like, Mike, do you remember a couple of years ago
00:13:20.100when people would be playing with AI and be like,
00:13:23.320oh, we trained an AI on watching 50 Hallmark Christmas movies
00:14:30.260Those two metaphors seem very distinct to me.
00:14:34.260It's curious to me that someone would put them in the same post.
00:14:39.520It just seems so disparate that I have to question it.
00:14:42.100It just sounds like somebody was trying to pack way too many AAVE metaphors and slang terms into one sentence, even metaphors that don't really relate to each other.
00:14:54.620And that is something that we know that AI does.
00:14:58.000When you ask AI to write something, that's one of the kind of giveaways that it might not be a human, and in fact it is AI, is that it's giving you way too much.
00:15:07.400It's a little bit over the top in a way that makes it that much more obvious that it's not a human.
00:15:13.020And I want to get into a little bit more why I feel like this post reads like AI to me after a quick break.
00:16:34.920Every week, I'm with survivors who live through the unthinkable.0.98
00:16:39.460I knew if he woke up, without a doubt, he was going to hurt me.
00:16:44.040I started feeling that there was someone at the end of my bed, and I just started screaming.
00:16:51.460They are abducted, stalked, controlled, and nearly silenced.
00:16:55.420But these aren't stories about what's taken from them.
00:16:58.860They're stories about what it takes to make it out alive.
00:17:02.000Listen to The Survivor Files with Elizabeth Smart on the iHeartRadio app, Apple Podcasts, or wherever you get your podcasts.
00:17:10.960If your bookshelf and your For You page are equally important to your personality, welcome home.
00:17:16.900This is Prose Society, the weekly podcast that's part book club, part group chat for thought daughters, pop culture obsessives, and anyone who thinks Pride and Prejudice and Love Island deserve the same level of discourse.
00:17:29.380I'm Eli Rallo, and every week we're connecting the dots between books, the internet, and the conversations everyone can't stop having.
00:17:36.500I'm going to have to look up this story. I'm obsessed. I'm obsessed.
00:17:40.080From best-selling authors and your favorite book talk creators to the latest pop culture moments, nothing is off the table.
00:17:46.020It's like if you can hide some real messages inside compelling characters, then that is a Trojan horse.
00:17:53.480Whether you're looking for literary deep dives, smart pop culture conversations, or a community of readers who love to think a little too much, you're in the right place.
00:18:03.100Listen to Pro Society on the iHeartRadio app, Apple Podcasts, or wherever you get your podcasts.
00:18:17.560So another thing that just strikes me as potentially one of the reasons why this feels like AI to me, in my opinion, is that it was part of a series of posts just breaking down different celebrities' outfits.
00:18:36.380And so it's, you know, it's going to be like, it's not like one post, it's going to be multiple posts as people walk the carpet at the festival.
00:18:44.660And so I, just having worked in social media before, I've run social media for big news companies that you've definitely heard of, I know that when you are in a situation where you're live tweeting or you're going to be posting 10 pictures and coming up with posts and captions for 10 or 20 pictures in an hour, that's a lot.
00:19:06.420I was doing this work before AI was so commonplace in media. It would not be surprising to me if
00:19:12.960a brand like Essence were to be like, listen, we're going to have 100 images of celebrities
00:19:18.300who get the caption from this festival. Let's just run it into ChatGPT and pull from there
00:19:23.240to make this quick. That would not surprise me at all. And again, no shade. That would not be
00:19:28.220any different than I'm sure any other media company is doing right now. That is not anything
00:19:33.180to be ashamed of. That's something bad. I'm not even calling them out. It just is a reality of
00:19:38.340how brands and media companies are likely right now already using AI, if not experimenting with
00:19:46.240it, and certainly how they're going to be using it going forward, I'm pretty sure.
00:19:50.220And because media companies and brands are already using this technology to communicate with us,
00:19:57.100the public, I wanted to play a little game, do a little experiment that I think
00:20:01.840will just be another bit of evidence as to why I feel so strongly that this post was
00:20:08.640generated by AI. So I went over to ChatGPT, and I asked ChatGPT to come up with a short social
00:20:16.140media post about Viola Davis, her outfit at Cannes. So first, when I put it in, I said,
00:20:23.300make a post about how good Viola Davis' outfit looked at Cannes as a Black woman.
00:20:27.540the first thing that they gave me was very kind of formal. It was like, let's take a moment to
00:20:33.100appreciate the incomparable Viola Davis, a true embodiment of elegance and beauty, who raced the
00:20:39.000red carpet at this year's Cannes Film Festival. As a fellow Black woman, I couldn't help but be in
00:20:43.520awe of her captivating presence and radiant charm. So this, what I just said, do it as a Black woman,0.94
00:20:49.400it was giving me, you know, still pretty polished, like standard English. It was just,
00:20:55.500The speaker is just referencing that they are a black woman, which obviously is not what this post sounds like.
00:21:01.640So then I was like, ah, same thing, but give it to me in AAVE, African-American vernacular English or like slang.
00:21:10.580Listen to the difference in this and what they gave me.
00:21:15.380So this you're going to read what ChatGPT gave you in response to that prompt.
00:23:12.380I don't know that someone would say in a,
00:23:16.300if they were making a social media post, I would be surprised if someone was using this many slang
00:23:23.460words. Like, if you're saying, yes, queen, adding something that is on fleek, that's like a hat on a
00:23:31.340hat. Like, it's just like, I don't know a person who would speak that way. And I think I see a lot
00:23:37.640of the similar repetition of things that we got in that Essence post to what I've just generated
00:23:43.420from ChatGBD. It just seems very similar to me. It seems similar in the ways of making little
00:23:52.140references to things that are not totally slang. They kind of sound like slang, and if you read it
00:24:00.500quickly, you might be like, oh, that sounds like what you would expect. But then when you actually
00:24:07.020parse it, you're like, well, do I actually know anybody who speaks like this? Is this what a human
00:24:11.400would actually say? Or is this what AI pulling from parts of the culture, parts of like everything
00:24:18.160that's out there about what is the perception of what it sounds like to be a Black woman speaking
00:24:22.620in AAVE about something that she likes? It just feels like someone doing a bad impression of Black
00:24:32.560women and the way that we talk online. It really reminds me a lot of what Shafika Hudson described
00:24:37.020in our episode about and Father's Day as she describes it as obviously racist word salad.
00:24:44.460Like there's something about this that chat GPT, the content that chat GPT spit out that
00:24:50.620just reads like a Black woman impersonation word salad.0.96
00:24:55.800Like it makes all of the things on their own make sense.1.00
00:24:59.640But when you zoom out and you're like, well, is that really what someone would string together
00:25:04.840if they were trying to create a social post?
00:25:07.020in my opinion probably not yeah that's really astute i think you nailed it it's like a
00:25:13.180a hat on a hat like it just goes on and on with multiple metaphors uh multiple things that sound
00:25:22.660like they could be slang but maybe aren't and yeah it's and when you zoom out it looks like
00:25:31.840what a large language model trained on a corpus of perceptions of what Black women might sound like.
00:25:42.660And again, as cringy as all of this sounds, and I know it sounds very cringy,
00:25:48.240I'm not even necessarily pointing all of this out to call out Essence or any media company. Because
00:25:54.160again, Essence is not doing anything that I don't think any other media company
00:25:58.520out there is doing. I think this is commonplace. I think there are times when it is more obvious
00:26:04.400than others. But I think this is something that we're going to have to train ourselves to
00:26:12.300be aware of and critical of and be thinking about as we consume media, as we go forward
00:26:20.980in this particular moment in our shared tech world. Yeah. I keep thinking about
00:26:28.520What does it mean that it packed all of those different metaphors and illusions and idioms in there?
00:26:36.460And like, maybe that's what it looks like when part of the prompt to chat GPT or one of these large language models is to try to sound like a particular group is that it just really hyper focuses on that part of the assignment.
00:26:52.460And so it just keeps like hammering on it over and over again in a really unnaturalistic way.
00:27:01.860And I also think that, you know, it's particularly salient when you're talking about the way that marginalized groups communicate with each other.
00:27:13.040You know, if you ask ChatGPT to say something in a stereotypical, you know, like, give it to me in AAVE or give it to me as a gay person, or I just think that it's easy to recognize when someone is being a caricature of a marginalized person when we're seeing it on television or in a movie.
00:27:34.660I don't know that it's easy to recognize it in text that is generated by AI, but I think that the same way that we are thinking about it when we consume movies and television, we should be thinking about it, I guess, or now we're going to have to be thinking about it as we just consume content out in the world in this era going forward.
00:28:00.120Yeah, I think we've all been seeing headlines for the past, I don't know, five or six months now, ever since AI really just like exploded into the public discourse with these publicly available tools.
00:28:13.200you know we've all heard the messaging that we need to start using ai and figure out how to work
00:28:19.760ai into our professional workflows so that we can be using it more and be that much more efficient
00:28:25.940and effective and productive than people who aren't using it who are going to fall away like
00:28:32.640dinosaurs and relics and you know i think a lot of people are kind of questioning how true is that
00:28:40.780and what does that even mean but yeah you can't blame essence for uh experimenting with it and
00:28:48.940you know trying to put ai to work for them if that's what they were doing which you know like
00:28:54.980you said it seems like they probably were uh so yeah it's not so shameful it's probably a little
00:29:00.560embarrassing that they published something that they then had to go back and edit but like you
00:29:05.280know people do embarrassing stuff all the time so i should also say that the idea like this post
00:29:11.280this is not even really coming from me as i said i'm a former social media editor and so i'm still
00:29:17.660in a lot of these big like online professional groups dedicated to social media management and
00:29:22.780like best practices and all of that that is where i first saw this post that is where it first came
00:29:28.160on my radar somebody not me posted a screenshot of the original essence magazine facebook post
00:29:34.920put it in the group and they were like yo is essence in here like this is a really weird post
00:29:41.920and so everybody was roasting it so certainly wasn't just me and the consensus of social media
00:29:49.780industry professionals was that it was written by ai so i can't even take credit for for that as an
00:29:55.540idea i wish i could i definitely would have seen that and thought something's up but the reality
00:30:01.500is, is that a large group of social media professionals were roasting it and said it
00:30:06.740was AI. I happen to be one of them, but this is not just coming from me. This was like an online
00:30:12.800consensus of the space. So I'm sorry. I'm sure that if you, like for Essence Magazine, I'm sure
00:30:18.800that it's like difficult to hear. Nobody wants to hear that their post was being roasted by a bunch
00:30:23.720of their peers, but I hate to break it to you. That is what was going on. I'm suddenly concerned
00:30:28.700that it might have actually been written by a human
00:30:30.640who is now devastated that everyone thinks they're a robot