Can Charter Schools Improve Over Time?

Fight disinformation: Sign up for the free Mother Jones Daily newsletter and follow the news that matters.


A new study from Stanford’s Center for Research on Education Outcomes concludes that charter schools “post superior results with historically disadvantaged student subgroups.” Via Twitter, Neerav Kingsland asks, “can you run this study through your skepticism wringer?”

The full study is a couple hundred pages long, so the answer is no. What’s more, the main conclusion of the study is actually about the consistency of charter school results over time, not charter performance among minorities. Their primary takeaway is simple: charters that start out strong stay strong, and charters that start out weak stay weak. They don’t get better over time as they “work out the kinks.”

I actually find that reasonably plausible. Nonetheless, although I don’t have time to read the full report right now, I can read the executive summary and point out a few issues:

Short time frame: “Using the broad range of data that CREDO has developed in partnership with 25 state education agencies, we follow student-level performance in schools from their opening through their fifth year.”

Small sample size: “While the available data does not extend into the past, far enough to observe the birth of all [charter management organizations], a limited number of CMO ‘births’ are evident in the data window at our disposal and it is possible to observe their flagship school’s performance before and after replication.”

Confirms own biases: “Interviews with school staff along with our own observations of school activities and operations have formed the impression that the ‘rules’ of a school get set early on in the life of the school….If our admittedly limited, qualitatively-based conjecture is true and more generally supported, we conjectured that it should be possible to observe the phenomenon quantitatively and test the hypothesis statistically.”

These are reasons to treat CREDO’s conclusions with caution. Nonetheless, it’s worth pointing out that some of CREDO’s results aren’t super friendly toward the charter movement. Lousy charters stay lousy over time, for example, and that’s especially true for middle and high schools. Charter performance, on average, is pretty average. There are very few observable attributes that serve as signals of charter quality. So while their study confirms the bias they took into it—something that seems to be an absolute scourge in the ed reform field—it wasn’t all just confirmation bias. A few of their results were challenging for the charter school movement.

Overall, I don’t have a big issue with this study. It seems to be fairly modest in its claims, and its main policy recommendation is that since charters display a wide range of performance, they should be monitored closely and shut down early if they perform poorly. I’m generally in favor of lots of ruthless experimentation, so I guess this appeals to my biases.

As for whether charters really are especially strong among minority and low-income populations, that’s been the subject of dozens of studies, not just this one. The CREDO study seems to confirm that it’s possible for a charter to do especially well among these groups, but we still don’t how easy it is, how scalable it is, how replicable it is, or how expensive it is. The jury is still out.

AN IMPORTANT UPDATE

We’re falling behind our online fundraising goals and we can’t sustain coming up short on donations month after month. Perhaps you’ve heard? It is impossibly hard in the news business right now, with layoffs intensifying and fancy new startups and funding going kaput.

The crisis facing journalism and democracy isn’t going away anytime soon. And neither is Mother Jones, our readers, or our unique way of doing in-depth reporting that exists to bring about change.

Which is exactly why, despite the challenges we face, we just took a big gulp and joined forces with the Center for Investigative Reporting, a team of ace journalists who create the amazing podcast and public radio show Reveal.

If you can part with even just a few bucks, please help us pick up the pace of donations. We simply can’t afford to keep falling behind on our fundraising targets month after month.

Editor-in-Chief Clara Jeffery said it well to our team recently, and that team 100 percent includes readers like you who make it all possible: “This is a year to prove that we can pull off this merger, grow our audiences and impact, attract more funding and keep growing. More broadly, it’s a year when the very future of both journalism and democracy is on the line. We have to go for every important story, every reader/listener/viewer, and leave it all on the field. I’m very proud of all the hard work that’s gotten us to this moment, and confident that we can meet it.”

Let’s do this. If you can right now, please support Mother Jones and investigative journalism with an urgently needed donation today.

payment methods

AN IMPORTANT UPDATE

We’re falling behind our online fundraising goals and we can’t sustain coming up short on donations month after month. Perhaps you’ve heard? It is impossibly hard in the news business right now, with layoffs intensifying and fancy new startups and funding going kaput.

The crisis facing journalism and democracy isn’t going away anytime soon. And neither is Mother Jones, our readers, or our unique way of doing in-depth reporting that exists to bring about change.

Which is exactly why, despite the challenges we face, we just took a big gulp and joined forces with the Center for Investigative Reporting, a team of ace journalists who create the amazing podcast and public radio show Reveal.

If you can part with even just a few bucks, please help us pick up the pace of donations. We simply can’t afford to keep falling behind on our fundraising targets month after month.

Editor-in-Chief Clara Jeffery said it well to our team recently, and that team 100 percent includes readers like you who make it all possible: “This is a year to prove that we can pull off this merger, grow our audiences and impact, attract more funding and keep growing. More broadly, it’s a year when the very future of both journalism and democracy is on the line. We have to go for every important story, every reader/listener/viewer, and leave it all on the field. I’m very proud of all the hard work that’s gotten us to this moment, and confident that we can meet it.”

Let’s do this. If you can right now, please support Mother Jones and investigative journalism with an urgently needed donation today.

payment methods

We Recommend

Latest

Sign up for our free newsletter

Subscribe to the Mother Jones Daily to have our top stories delivered directly to your inbox.

Get our award-winning magazine

Save big on a full year of investigations, ideas, and insights.

Subscribe

Support our journalism

Help Mother Jones' reporters dig deep with a tax-deductible donation.

Donate