00:09:09.760Because by the time you're picking up your third Gladwell book, what do you think is going to happen?
00:09:15.640The rest of the study is these very short descriptions of six studies that she's carried out to basically explore, like, is this a real thing?
00:09:24.000So she has a sample of just kind of a bunch of adults.
00:09:27.080There's like a web portal that she's set up where people can log on and be like, how gritty are you?
00:09:32.260She finds that like people who are college graduates are higher in grit than like high school graduates, etc.
00:16:00.420You have all these kind of like values and character things that you're also being judged
00:16:04.300on and being like accountable to, right?
00:16:06.400So it's like these two things are sort of both brewing at the same time.
00:16:10.160And so in 2012, we get a book called How Children Succeed, colon, Grit, Curiosity,
00:16:16.360and the Hidden Power of Character by a New York Times writer named Paul Tuff.
00:16:22.100And I'm going to send you the sort of nut graph of the book.
00:16:25.340In the past decade, and especially in the past few years, a disparate congregation of economists, educators, psychologists, and neuroscientists have begun to produce evidence that calls into question many of the assumptions behind the cognitive hypothesis.
00:16:39.220What matters most in a child's development, they say, is not how much information we can stuff into her brain in the first few years.
00:16:44.920What matters instead is whether we are able to help her develop a very different set of qualities, a list that includes persistence, self-control, curiosity, conscientiousness, grit, and self-confidence.
00:16:55.600Economists refer to these as non-cognitive skills.
00:16:58.620Psychologists call them personality traits, and the rest of us sometimes think of them as character.
00:17:03.480The book spends a lot of time profiling Angela Duckworth and other researchers who are sort of exploring, like, what are actually the characteristics, right?
00:17:12.080We know that there's, like, moral character.
00:17:41.200Yeah. So this book spends 49 weeks on the New York Times bestseller list. It results in an episode of This American Life dedicated to this. It is based on a very popular, very influential New York Times Magazine cover story about this idea, this kind of character education idea. And after all of this hype, in 2013, we finally get Angela Duckworth's TED Talk.
00:20:17.360If you knew nothing else about this, you'd be like,
00:20:18.720Dan, there's like study after study showing the same thing predicts success, right?
00:20:22.320What if we did a sort of affirmative action where we give poor kids more grit and rich kids less grit until they're equal?
00:20:29.860The idea here that there is like something that cuts across all other variables is very appealing to people, especially because you can see the gears working in people's brains where it's like, oh, my God, racial and class disparities will disappear if we simply prioritize our focus on grit.
00:20:50.640And this works for poor kids, right? This could be a really exciting idea to like help
00:20:54.360poor non-white kids in public education. I'm reading the YouTube comments on the
00:21:00.220Grit TED Talk. Oh, yeah. They're all about assignment.
00:21:03.400Yeah. Thumbs up if you're here because of a school assignment, LOL. 13,000 thumbs up.
00:21:08.700Damn. I didn't know everyone had the same assignment I did. 4,000 thumbs up. And then0.98
00:21:14.500there's one person with fewer thumbs up that says, I'm glad that I'm here, not because of0.99
00:21:18.860an assignment but because i want to be the best version of myself whatever you fucking loser dude0.97
00:21:23.520you're here because you had an assignment i'm here because i want to be a better version of0.99
00:21:28.400myself we're not the same she gives this talk in 2013 this explodes immediately she's all of a
00:21:34.200sudden like a massive academic celebrity this also gets very quickly taken up by education reformers
00:21:40.860and like policy so in 2013 the department of education produces a report that emphasizes
00:21:47.480non-cognitive skills. It's called Promoting Grit, Tenacity, and Perseverance, Critical
00:21:52.540Factors for Success in the 21st Century. And the number one recommendation, if you read the
00:21:57.340executive summary, is educators, administrators, policymakers, parents, and researchers should
00:22:02.440consider how to give priority to grit, tenacity, and perseverance in curriculum, teaching practices,
00:22:08.040professional development, and out-of-school support. Gotta prioritize grit. I'm relatively
00:22:12.320far into this episode. I don't have the slightest idea of what that would mean.
00:22:17.540The Economic Policy Institute published one in 2014 called The Need to Address Non-Cognitive Skills in the Education Policy Agenda.
00:22:25.060Dude, I love that you can – it's so funny how many policy ideas that like all research shows would be effective if you put more money into them.
00:28:31.780Like it's – because this is included as like one of six studies in this like 15-page larger study that is attempting to confirm the concept of grit, she doesn't go into like any detail about like basic descriptive statistics.
00:28:45.240I'm actually fairly skeptical that like there's actually all that much of a spread among West Point cadets, right?
00:28:50.900You're looking at people who are like at best high in grit versus very high in grit.
00:28:55.220Yeah. And I mean, if you've ever met someone who wants to go to West Point, it requires a certain type of like, it's hard to explain, but like they're, they're super type A. They're not cool.
00:29:07.960I don't want to say that. I think they're very disciplined. I think these are people who already are very disciplined.
00:29:13.520No, no. It's not about being disciplined. It's about wanting to lead a life of discipline.
00:32:40.160This military performance score thing, this sort of holistic assessment of your leadership performance, grit is the worst predictor of everything they measured.
00:32:48.080And when you look at the dropout rate over the course of the entire four years, this
00:32:52.000whole candidate score thing is a significantly better predictor than grit.
00:32:56.620And grit is also tied with physical fitness for predicting the overall dropout rate.
00:33:02.560So you might as well just be like, how many pushups can you do?
00:33:05.780And also, it's not even clear that they wanted this whole candidate score thing to predict
00:33:09.800who gets through beast barracks, right?
00:33:11.360It's probably like, who's going to get a good GPA?
00:33:13.780Who's going to complete all four years of school?
00:33:15.880And, like, it's still better than grit for that.
00:33:18.720Obviously, if they have, like, a holistic rating, a holistic score that's meant to measure you across, like, 10 different categories, like, you can come up with a metric that outperforms it for any given category.
00:33:36.300It makes sense that if you were going to come up with a metric to figure out who's going to survive this very physically grueling ordeal, that maybe like a physical fitness, a physical fitness adjacent metric might make sense there.
00:33:52.900Or like extroversion, potential for homesickness, right?
00:33:55.540It's the first summer that you're away from home for a lot of these like 18-year-old kids.
00:42:14.420So she goes into the teacher's resumes and she gives them a grit score from one to six based on how many extracurriculars they did in high school and college.
00:42:55.040She gives examples in the paper of like low grit, medium grit and high grit.
00:42:59.640Right. So how are we looking at these people's resumes?
00:43:01.380So she says like a low grit person is a member of the swim team for three years, but did not advance or win an award and has no other multi-year activities.0.98
00:58:34.980Famously cowardly and prone to surrender the Russians.0.86
00:58:39.000The ending anecdote of the book is about her kid's ballet teacher who is both supportive and demanding.0.61
00:58:46.360And we must borrow from ballet culture, the healthiest competition culture.
00:58:51.380Who do you think was grittier, Natalie Portman or Mila Kunis?
00:58:54.520But this argument in the final third of the book, basically that grit is malleable, this is the reason for the downfall of grit.
00:59:02.500So even before the book comes out, we start to get critiques of not really the concept of grit or the idea that kids have grit, but specifically the idea that you can do anything about grit, right?
00:59:13.400The idea that schools can meaningfully teach grit.
00:59:16.240So I'm going to send you an excerpt from the New Republic review by Jeffrey Snyder.
00:59:22.240There may be an increasingly cogent science of character, but there is no science of teaching
00:59:27.100character. We already know that grit is strongly correlated with conscientiousness, one of the
00:59:31.940big five personality traits that psychologists view as stable and hereditary. A recent report
00:59:37.080emphasizes that simply knowing that non-cognitive factors matter is not the same as knowing how to
00:59:43.240develop them in students. The report concludes that clear, actionable strategies for classroom
00:59:48.740practice are few and far between. Consider the fact that the world's grittiest students,
00:59:54.020including Chinese students who log some of the longest hours on their homework,1.00
00:59:57.620have never been exposed to a formal curriculum that teaches perseverance.1.00
01:00:01.340Which I think is a pretty good point.0.99
01:00:02.880This is really more about Chinese genetics than anything else.0.83
01:00:06.620Right. So I get this. And this is something nagging at me subconsciously. Just because
01:00:12.120you can identify a thing does not actually mean anything in a vacuum, right? You've identified
01:00:18.720identified what you are saying is a personality trait that might be correlated with good outcomes.
01:00:26.880But what does that matter if you can't manage it in some way?
01:00:31.060I also read a really interesting article about the self-esteem fad in psychology in the 1980s,
01:00:36.220where it was basically the same thing, right? That kids who report having higher self-esteem
01:00:39.840are more likely to graduate from high school, they get better grades, etc. And there were all
01:00:43.320these efforts to like instill self-esteem in kids but they all kind of fell down because like what
01:00:49.400are we doing here because a lot of kids are just losers i feel like what ends up happening in all
01:00:54.560of these situations is that you just end up measuring the thing you measure grit and then
01:01:00.780you reward the kids that are high in it right which feels like the rich get richer or you do
01:01:05.340the thing where you just give kids a bunch of like pro grit propaganda and then at the end of the
01:01:09.420semester all they're going to do is they're going to report that they have grit right are you gritty
01:01:12.780do you follow through on things? Yep, I sure do. But nothing has actually changed, right? All you've
01:01:17.160done is you've trained them on how to answer a test question. There's also, when I was talking
01:01:21.280to Marcus Crudet, who wrote these meta-analyses of like all the grit studies, he also noted that
01:01:26.720while it's really hard to manipulate personality traits in general, it's just kind of like a doomed
01:01:31.940endeavor, there are things like study skills that you can teach students and actually do respond to
01:01:37.960interventions. So he points out in higher education, simply going to class is twice as
01:01:43.300good a predictor of grades as grit. Yeah. But is that more important than making up new personality
01:01:49.340traits and writing about them? There's this really interesting article by a researcher
01:01:53.380named Mike Rose who points out that like, yeah, there isn't really a clear difference between
01:01:58.240cognitive and non-cognitive skills. And also it's not clear what like teaching non-cognitive skills
01:02:04.160means like yeah we have kids for six hours a day are we just going to tell them that it's good to
01:02:08.620be optimistic now i'm going to teach you brainless skills here's this in order for students to
01:02:14.400believe that they are capable of improving they must have the concrete experience of getting
01:02:18.260better at challenging tasks otherwise exhortations to change their mindset ring hollow kids generally
01:02:24.480know when they are improving for real when they can do things that once seem too difficult versus
01:02:29.320when adults are merely trying to make them feel good it's really striking reading those old white
01:02:34.480papers just kind of how half-baked this all was like as you heard of those excerpts they talked
01:02:39.800about how urgent it was how important it was we know that character has this huge effect on kids
01:02:45.620yeah but then if you keep reading they would mention like 10 pages in that like well we don't
01:02:51.780really know which character traits are important we don't know how to measure them and we don't
01:02:57.100know how to change them. There was like this weird rush to do something, but nobody had a clear idea
01:03:02.860of what they were rushing to do. But then the real nail in the coffin comes in 2015 with a paper
01:03:11.460called Measurement Matters Assessing Personal Qualities Other Than Cognitive Ability for
01:03:16.360Educational Purposes. This is an assessment of the efforts to implement these like non-cognitive
01:03:22.840skills in schools so i'm gonna send you this students in a set of oversubscribed charter
01:03:28.700schools where students make unusually large test score gains report lower average levels of
01:03:34.180conscientiousness self-control and grit than students in open enrollment district schools0.98
01:03:40.500that makes sense because being surrounded by a bunch of fucking nerds i know is gonna that's0.97
01:03:46.160gonna erode your grit over time but what's wild is these are kids that went from public schools0.98
01:03:52.040to charter schools. Their test scores got better. Their attendance got better. And they reported
01:03:57.680lower scores on self-control, grit, and conscientiousness. So basically, there's a
01:04:04.560mismatch between what they say and what they are doing. So all that stuff about how if you teach
01:04:10.360kids grit, they'll report themselves to be higher in grit, right? They'll just deliver the propaganda.
01:04:15.220That turns out not to be true. They're actually lower on these things. You're telling them,
01:04:20.280Basically, the theory that the researchers come up with is that because you're constantly being told, oh, you must have self-control, you must have grit, over the course of your normal life, you're going to sort of fail at things.
01:04:31.120You're going to skive off homework to go watch anime, right?
01:04:34.060You're going to sort of be a normal teenager, but you're basically going to feel worse about yourself for doing it if you're constantly surrounded by this propaganda of like you must have grit, you must follow through on everything.
01:04:43.820I think my theory also works, but sure.
01:04:46.780I think that being around this, the soft cerebral types will make you in turn soft and cerebral
01:05:15.140So basically, grit at this point is sort of like, okay, schools can't change it.
01:05:20.800We don't know if it's all that predictive of performance.
01:05:23.640And if we try to measure schools on it or teachers on it, it might be making the kids worse off or at least reporting that they're worse off, right?
01:05:31.700So it essentially has like no utility.
01:05:34.600So are you ready for the twist of this episode, Peter?
01:12:25.360It's not useful for assessing teachers.
01:12:27.840The research behind it doesn't really hold up.
01:12:30.040It was never going to predict grades anyway.
01:12:31.680then it's like what is the point of your book then what is even the premise of the book at this point0.99
01:12:37.080continuing to pitch your stupid idea a decade after it was functionally debunked that's grit0.98
01:12:42.820that's what grit is the other thing that i wanted to say which is like kind of mean is like1.00
01:12:47.480you can take the person out of mckinsey but you can't take the mckinsey out of the person
01:12:52.660so true other people have been thinking about this for years decades other people are within
01:12:56.780this organization but i'm gonna parachute in right and then like solve it for you she might
01:13:01.320not even realize that she's doing that when she begins exactly she's like hey i went to normal
01:13:06.020schools for a year yeah now i have this idea and these losers who are like looking for silver0.99
01:13:13.380bullets for everything right are like oh my god let's put you on a fucking stage so little epilogue0.93
01:13:19.260most of the people involved with hyping up this trend have kind of moved away from it so the author0.96
01:13:25.180of the original airport bestseller that popularized grit paul tuff has also kind of moved away from
01:13:30.860grit, he gives an interview to the New York Times where he says, there's no evidence that any
01:13:35.500particular curriculum or textbook or app can effectively teach kids grit or self-control or
01:13:40.080curiosity. This entire kind of issue of non-cognitive skills has also kind of transformed
01:13:46.760into like a more holistic understanding of like what contributes to kids' success and like how to
01:13:53.060foster it in kids. So that guy, Mike Rose, who wrote an article in 2014 being like, hey, let's
01:13:58.980be careful with this grit stuff. He basically pointed out like exactly what would happen. He
01:14:03.320predicted like, yeah, this isn't going to turn to be all that useful. He writes a follow-up in 2015
01:14:08.060just being like, yeah, I was right about this and here's why. Nice. Get them. So I'm going to send
01:14:13.340you an excerpt from this. Over the last few years, I have been working with a group of community
01:14:18.520college students who have overcome difficult, even traumatic backgrounds to succeed. They possess
01:14:23.680grit by the truckload, yet every one of them has been significantly delayed by financial,
01:14:28.100housing and transportation problems by bureaucratic snafus, by violence in their communities,
01:14:33.460by disruptions in their families, by health care. One fellow's younger brother was murdered.
01:14:37.840One woman had to quit school for a year to pay down a $10,000 emergency room bill.
01:14:42.880The poor routinely face barriers that they have few material resources to address,
01:14:47.240and sometimes no matter how hard they try, the barriers are too frequent and too high
01:14:51.080to overcome. A good education has always had as one of its goals the development of character,
01:14:56.280But as a matter of public policy, it would be counterproductive and ultimately cruel to focus on individual characteristics without also considering the economic and social terrain on which those characteristics play out.
01:15:07.760It's sort of obvious looking back, but if you want to help poor kids graduate from high school or get better grades, the most effective thing that you can do is solve the poverty, right?
01:15:17.580There's studies that show that increasing the earned income tax credit improves graduation rates.
01:15:24.120Increasing food stamps improves grades and graduation rates.
01:15:27.640Like when kids are less poor, they do better in schools, right?0.86
01:15:31.500And it's a little unfair to just make schools kind of solve this problem without even giving the fucking schools more money, much less giving the kids and their families more money, right?0.97
01:16:46.100It feels to you like the thing that your kid is lacking.1.00
01:16:49.540There's also a unintentionally funny epilogue in the book where in the final chapter, Angela Duckworth talks about what's going on at West Point now.
01:16:58.120So she continued to track West Point cadets for 10 more years to find out what was going on with their grit scores, etc.
01:17:03.680And she finds that the dropout rate during Beast Barracks has fallen from 6% when she was doing her first study to 2%.
01:17:11.900So almost nobody drops out of Beast Barracks anymore.
01:17:14.720And the issue isn't that they have more grit.
01:17:17.600The issue is that there's less hazing.
01:17:19.440So apparently West Point is like really cracked down on hazing of first years.
01:17:22.840And basically it's like a much less abusive environment now.
01:17:26.940She chalks this up to like what happened was like the school really has like a culture of grit now.
01:17:32.580Well, it sounded like it was grittier before with the hazing.