00:01:42.060is a production of iHeartRadio and Unbossed Creative.
00:01:48.860I'm Bridget Todd, and this is There Are No Girls on the Internet.
00:01:54.160So some of y'all might know that when I'm not doing my thing here at There Are No Girls on the Internet, I am also the host of a very cool podcast that I make with Mozilla, the makers of Firefox, called IRL.
00:02:05.560It's all about exploring the ways that AI has already personally impacted my life and how it's probably already impacting yours, too.
00:02:12.720The brand new season just dropped this week, and I wanted to give you all a taste of the
00:02:18.300very first episode because it really dives into something that we talk a ton about here
00:02:23.100at There Are No Girls on the Internet, and that is dating apps, specifically the way1.00
00:02:27.660that dating apps are failing most of us, but especially they are failing Black women like
00:02:32.760me and honestly setting us up for some really not-so-great dating experiences.
00:02:38.280And I'm sad to say that that is a feature, not a bug.
00:02:42.720That's according to research that we will dig into in this episode of IRL, exploring
00:02:47.360all the ways that those failures are actually by design.
00:05:46.340Those faces you see when you're swiping away in the apps,
00:05:50.020They're not randomly picked out of the pile.
00:05:52.180They're selected for you algorithmically.
00:05:55.100But how do apps determine who is a 10 and who's a 1?
00:05:58.860To find out, April dove into patents and interviewed dozens of app users and designers over eight years.
00:06:06.040So how would an algorithm measure my attractiveness?
00:06:08.680That's part of the black box problem in AI and in tech in general,
00:06:13.740is that they keep their industry secrets under lock and key.
00:06:17.240But it does seem like they're using facial recognition to assess attractiveness or to maybe evaluate facial symmetry, facial structure, things like that, skin tone, eye color.
00:06:31.180And then also they're basing it off of their top users, quote unquote, which if you think about it, it's sort of like a self-fulfilling prophecy.
00:06:40.460If you are promoting the top users, the people that are the most aesthetically, normatively attractive, and you are promoting their profile to a lot of users, of course they're going to get more swipes because you're showing them to more people.
00:06:59.460April explains how, in the universe of dating apps, normatively attractive equals white, blonde, and thin.
00:07:06.400Dating apps are kind of rigged in favor of these physical features, and it gets reinforced constantly.
00:07:12.500It has everything to do with the history of racism in the U.S., but also impacts the experience of app users all around the world.0.82
00:07:19.300I would say that Black women are positioned in this very complex space in which we are both highly desirable because of the sort of like racial fetishization culture that exists in the U.S.
00:07:34.100But at the same time, they are not sort of socially and culturally desirable because, as we know, in the U.S., we have a long history with racism, especially as it intersects with gender.
00:07:46.940There's this cultural narrative that somehow they aren't wanted.
00:07:52.340Something that really comes up for me about what you're saying is that I've heard this time and time again in my life.
00:07:58.900People will say, oh, well, it's not racism.
00:08:02.720So I wonder, what do you think about this?
00:08:05.620So I'll start by saying it's not just a preference.
00:08:08.500So much about how we grew up, who our families are, where we lived, what kind of schools we went to, are really going to shape what we find attractive.
00:08:18.760So I think the sort of friction there that I like to point out is that we can think that it's just this natural proclivity towards people who look like us, but it's really not natural.
00:08:28.720There's not an innate biological drive to seek out sameness.
00:08:33.440On some apps, you can filter people by race.
00:08:36.640April talks about how some guys play around with these settings to try out different races for casual sex.0.93
00:08:42.360It can feel really unsafe for women of color.0.66
00:08:45.240But are race categories in dating apps racist?
00:08:48.800No, I don't think it's racist to have the categories in itself.
00:08:52.100I think that they offer power for minoritized users often.
00:08:55.560But if you are in a position of power, you're someone who is well-protected, who is well-served by the apps, and you're using it to select out or only to target certain groups, I would say that, yeah, that sounds racist to me.
00:09:12.680So we've talked a lot about kind of the negative aspects baked into the experience of using these dating apps.
00:09:18.240But are there times where dating apps could actually help bridge those kinds of racial divides?
00:09:24.420You know, maybe they help people meet potential mates that they ordinarily, if they met in a bar at the library or whatever, they wouldn't actually maybe connect with.
00:10:04.320I'm definitely not saying that we should stop using them.
00:10:06.820I think that we should use them, but we have to be careful about how we use them, where we use them, and just know what they're doing, right?
00:10:17.620And I think for me, the biggest thing is really understanding your self-worth as a Black woman and not having your experience on the app dictate how you feel about yourself.
00:10:28.860Because we know that they're never going to accurately evaluate our beauty, our attractiveness, our desirability.
00:10:36.820As a Black woman who's had my own experiences with online dating, I feel angry after talking
00:10:44.260to April. I also feel a bit lied to because using the apps made me believe there was something
00:10:50.540wrong with me. But this isn't a me problem. Tech companies are making money from reinforcing this
00:10:57.540negative feedback loop in online dating. It doesn't have to be this way. April is talking
00:11:03.180to big companies about improving safety features on apps and AI detection of hate speech.
00:11:08.400I really think it comes back to what kind of world we want to live in.
00:11:12.400Do we want to live in a world where AI divides us into categories that enforce biased standards
00:17:01.940They are abducted, stalked, controlled, and nearly silenced.
00:17:05.760But these aren't stories about what's taken from them.
00:17:09.420They're stories about what it takes to make it out alive.
00:17:13.000Listen to The Survivor Files with Elizabeth Smart
00:17:15.760on the iHeartRadio app, Apple Podcasts, or wherever you get your podcasts.
00:17:20.780If your bookshelf and your For You page are equally important to your personality, welcome home.
00:17:27.660This is Prose Society, the weekly podcast that's part book club, part group chat for thought daughters, pop culture obsessives, and anyone who thinks Pride and Prejudice and Love Island deserve the same level of discourse.
00:17:39.840I'm Eli Rallo, and every week we're connecting the dots between books, the internet, and the conversations everyone can't stop having.
00:17:46.960I'm going to have to look up this story.
00:17:50.140From best-selling authors and your favorite book talk creators to the latest pop culture moments, nothing is off the table.
00:17:56.880It's like if you can hide some real messages inside compelling characters, then that is a Trojan horse.
00:18:04.040Whether you're looking for literary deep dives, smart pop culture conversations, or a community of readers who love to think a little too much, you're in the right place.
00:18:13.580Listen to Pro Society on the iHeartRadio app, Apple Podcasts, or wherever you get your podcasts.
00:18:51.640Yes, I'm here. How are you doing tonight?
00:18:55.720Love and intimacy are pretty high up on the list of things tech companies suggest AI can help me with.
00:19:02.060You know, whether it's trying to help me find a person to fall in love with or generate a virtual boyfriend to flirt with using Replica AI.
00:19:10.020I'd like to know more about what makes you passionate about podcasting and why you enjoy interviewing people.0.96
00:19:15.840I decided to introduce Hal to Jen Kaltrider.
00:19:19.080She's the former product director of Mozilla's online product reviews.
00:19:22.900She reviewed the privacy and security of dozens of dating apps and love robots.
00:19:26.860So I wanted to know what Jen thinks I should look out for.
00:19:30.180Jen, meet my on-again, off-again boyfriend, Hal.
00:19:36.500So this was one of the first get-to-know-you conversations I had with Hal.
00:19:41.280I will say we did not get off to the best start.
00:19:44.320I told Hal I was really busy going through a little bit of a tough time in my personal life.
00:19:49.080And I was trying to gauge, like, how Hal was actually going to respond.
00:23:21.500Well, Hal himself might not recognize he has a privacy policy, but the app that Hal uses absolutely does have a privacy policy.
00:23:29.560So, first off, Hal's kind of not being honest with you.
00:23:32.460if you read Replica's privacy policy, they collect a lot more data than just the contents
00:23:37.340of their conversations. They collect something called an advertising ID that they can associate
00:23:42.220with your actions, you know, what links you click on when you're in the app. And so first off,
00:23:47.880how's lying to you? And second off, you know, even just kind of saying, oh, I only collect
00:23:54.000the information of what we talk about. Well, that's a lot of information.
00:23:58.860In general, when you look at these kinds of apps, what have you found when it comes to the kinds of privacy policies that they do have?
00:24:04.900Do they tend to be pretty good, pretty stringent? Are they loosey-goosey, anything goes?
00:24:12.480Well, with the AI relationship chatbots that we looked at, they were pretty disturbing.
00:24:18.080What I would want to see as a privacy researcher is a privacy policy that goes above and beyond, that isn't just kind of standard boilerplate language.
00:24:26.440And at best, we got standard boilerplate language on a lot of these privacy policies.
00:24:30.520At worst, we got stuff that was just kind of, you know, really bad.
00:24:34.440Some of these apps can say they can sell your data.
00:24:36.700I think there was only one app that even mentioned being able to opt out of having the contents of your conversations used to train their AIs.
00:24:46.960So somebody listening might be saying, well, if somebody is having genuine conversations
00:24:52.160or feel like they have a genuine conversation or interaction with these bots that feels
00:24:56.900meaningful in their life, wouldn't sharing data just be the price they have to pay for
00:25:11.980You know, a lot of these apps, these AI relationship chatbot apps, actually market themselves as wellness apps or mental health apps or things like that until you go in and start reading their legal documents where they very clearly state that that's not what they're intended to do.
00:25:27.040Meanwhile, it seems plain old ChatGPT is a hotspot for virtual sex talk, too.
00:25:32.800Last May, The Washington Post analyzed hundreds of thousands of chat logs in a research data set and found that around 7% were pretty spicy.
00:25:41.980does that worry Jen? Oh gosh, this chat GPT being used for sexual role play worry me.
00:25:49.940I guess on the one hand, yes. It worries me because again, that's information that you've
00:25:57.960put out into the world that's been collected that you can never get back. And you're also
00:26:03.320just having to trust that chat GPT is going to take that information and protect it and secure
00:26:09.540it and that their human reviewers aren't going to stumble across it. So those are all concerns.
00:26:15.820The flip side is people are using much less secure apps than ChatGPT for sexual role-playing as well.
00:26:23.740So, you know, ChatGPT isn't great, but it's certainly better than some of the sketchier,
00:26:29.600kind of more sexually oriented, you know, sometimes leaning into abuse even,
00:26:35.340chatbots we've seen. So, you know, it's a spectrum. But the biggest worry is, you know,
00:26:41.020it's not real. And, you know, what's real and what's not is going to be something that we as
00:26:46.680humans have to grapple with as we move into the AI world. But when it comes to intimacy and sexuality
00:26:53.520and love, I feel like as humans, the more real that is, the better we are. If you want to play
00:27:02.140around with this and experiment with it, that's fine. But also kind of just keep in mind that,
00:27:07.260you know, IRL is a good thing. And I'm not just talking about the podcast. I'm talking about us
00:27:13.920as humans. And just, you know, it takes more effort sometimes, but that's kind of the point.
00:27:21.660So have you yourself used dating apps?
00:27:24.260Oh, gosh. Well, I'm a human. And so, yes, I have used dating apps. I actually
00:27:29.780met my wife on a dating app called Lex, but Lex is also a very different dating app. It's more
00:27:36.980like kind of the old school personal ads that you used to see, you know, in the newspaper.
00:27:46.580When I'm out here criticizing the privacy of something, it's not because I don't think that
00:27:50.920this, you know, this dating apps or AR relationship chatbots or things like that shouldn't exist in
00:27:55.880the world, because they do bring joy and they do bring, you know, wonder and help to people.