The Perils and Pitfalls of Statistical Analysis

Get your news from a source that’s not owned and controlled by oligarchs. Sign up for the free Mother Jones Daily.

This is mostly in the pointless frivolity category, but the chart below from Matt Glassman shows total annual volume of email received by Congress since 1996. Matt has a few observations about what this all means, which you should read, but what I’m curious about is the huge drop in 2008-09. What happened? Matt says it’s a technical artifact: “The large peak in 2007 and the drop-off following it are almost certainly due to the explosion of more intelligent spam and the corresponding adoption of powerful new and improved spam filters in both chambers that year.”

If that’s true — and corroboration would be welcome from anyone with working knowledge of this stuff — it’s an object lesson in statistical analysis. Land mines are everywhere! If you saw this chart and concluded, say, that the financial crisis had somehow wiped out people’s desire to email their congresscritters, and then built an elaborate theory around that guess, you’d be totally wrong. It would be a perfectly reasonable theory, but it would be wrong. In reality, nothing interesting happened at all. Caveat emptor.

BEFORE YOU CLICK AWAY!

December is make or break for us. A full one-third of our annual fundraising comes in this month alone. A strong December means our newsroom is on the beat and reporting at full strength. A weak one means budget cuts and hard choices ahead.

The December 31 deadline is closing in fast. To reach our $400,000 goal, we need readers who’ve never given before to join the ranks of MoJo donors. And we need our steadfast supporters to give again today—any amount.

Managing an independent, nonprofit newsroom is staggeringly hard. There’s no cushion in our budget—no backup revenue, no corporate safety net. We can’t afford to fall short, and we can’t rely on corporations or deep-pocketed interests to fund the fierce, investigative journalism Mother Jones exists to do.

That’s why we need you right now. Please chip in to help close the gap.

BEFORE YOU CLICK AWAY!

December is make or break for us. A full one-third of our annual fundraising comes in this month alone. A strong December means our newsroom is on the beat and reporting at full strength. A weak one means budget cuts and hard choices ahead.

The December 31 deadline is closing in fast. To reach our $400,000 goal, we need readers who’ve never given before to join the ranks of MoJo donors. And we need our steadfast supporters to give again today—any amount.

Managing an independent, nonprofit newsroom is staggeringly hard. There’s no cushion in our budget—no backup revenue, no corporate safety net. We can’t afford to fall short, and we can’t rely on corporations or deep-pocketed interests to fund the fierce, investigative journalism Mother Jones exists to do.

That’s why we need you right now. Please chip in to help close the gap.

We Recommend

Latest

Sign up for our free newsletter

Subscribe to the Mother Jones Daily to have our top stories delivered directly to your inbox.

Get our award-winning magazine

Save big on a full year of investigations, ideas, and insights.

Subscribe

Support our journalism

Help Mother Jones' reporters dig deep with a tax-deductible donation.

Donate