Poll Averagers Are Having the Wonk Version of a Knife Fight. Choose Your Side!

Fight disinformation: Sign up for the free Mother Jones Daily newsletter and follow the news that matters.


With 2 days left until our long national nightmare ends, we are now arguing about the statistical models underlying poll averaging. Seriously. Last night, Nate Silver got into a massive war with Huffington Post writer Ryan Grim after Grim published an article headlined “Nate Silver Is Unskewing Polls — All Of Them — In Trump’s Direction.” Grim basically accused Silver of applying an ad hoc correction to his polling model so that it would show a tighter race. Silver responded pithily: “This article is so fucking idiotic and irresponsible….The article made clear you have **no fucking idea** what you’re talking about.”

Well. I guess it’s not surprising that a historically nasty presidential race has also produced a historically nasty wonk war. This morning, however, Silver was on This Week, where he defended himself in more family-friendly terms:

STEPHANOPOULOS:  Another variability that we’ve seen here right now. There have been a lot of other forecasts out there, Princeton Election Consortium, Huffington Post, several others — and The New York Times.  Yours is much more bullish for Donald Trump and more cautious on Hillary Clinton than theirs are. Why?

SILVER:  Because we think we have a good process [and, presumably, the other guys have lousy processes. –ed]….Look, you have some forecasts that show Clinton with a 98 or 99 percent chance of winning. That doesn’t pass a commonsense test, which is we’ve seen lots of elections where there’s about a three-point polling error. In 2012, in fact, Obama beat his polls in many states by about three points. If Clinton were to beat her polls by three points and you see something we call a borderline landslide, but if it goes the other way, and all of a sudden Trump could very easily win the electoral college.

I have a couple of comments. First, I don’t get the point of making a prediction about the percentage chance that a candidate will win. It’s useless. If Hillary Clinton wins, every pollster will be able to say they called it, because every pollster has her with more than a 50 percent chance. What’s the point of this? Better to just tell us the national and state averages, and leave it at that. I think everyone is smart enough to tell a tight race from a blowout.

Second, Silver is being a little disingenuous here. Have we really seen a “lot” of elections where there’s a three-point polling error in the poll averages? Sure, in some state contests, where there aren’t very many polls. But in a presidential election, where there are dozens? In the case of Obama 2012, Silver had Obama ahead of Romney by 2.1 points a couple of days before the election. Obama won by 3.9 points. Pollster was farther off, showing Obama ahead by 1.5 points. But even that’s still an error of only 2.4 points.

Silver’s point about a 99 percent chance of winning defying common sense is well taken. Stuff happens. Maybe all the polls are missing something. Even if Clinton were five points ahead, I’d probably still operate under the assumption that Trump had a one in twenty chance of winning. That said, a three-point lead with two days left really is pretty overwhelming. You can make a case that maybe Clinton will only win the popular vote by one point, but will then lose all the swing states and lose the Electoral College. But even that strikes me as a one-in-twenty kind of deal. If Al Gore had won the popular vote by 1 percent in 2000, he would have won the Electoral College handily.

Anyway, Hillary Clinton has been ahead of Trump by a steady 3-4 points for the past year, and I’ve come to believe that most of the variability in the polling averages is fictitious. On Tuesday, I’ll bet she wins by a solid 3-4 points, maybe a bit more because Trump’s ground game is so amateurish. That’s my prediction.

POSTSCRIPT: By the way, the latest ABC and NBC polls have Clinton up by 5 points.

AN IMPORTANT UPDATE

We’re falling behind our online fundraising goals and we can’t sustain coming up short on donations month after month. Perhaps you’ve heard? It is impossibly hard in the news business right now, with layoffs intensifying and fancy new startups and funding going kaput.

The crisis facing journalism and democracy isn’t going away anytime soon. And neither is Mother Jones, our readers, or our unique way of doing in-depth reporting that exists to bring about change.

Which is exactly why, despite the challenges we face, we just took a big gulp and joined forces with the Center for Investigative Reporting, a team of ace journalists who create the amazing podcast and public radio show Reveal.

If you can part with even just a few bucks, please help us pick up the pace of donations. We simply can’t afford to keep falling behind on our fundraising targets month after month.

Editor-in-Chief Clara Jeffery said it well to our team recently, and that team 100 percent includes readers like you who make it all possible: “This is a year to prove that we can pull off this merger, grow our audiences and impact, attract more funding and keep growing. More broadly, it’s a year when the very future of both journalism and democracy is on the line. We have to go for every important story, every reader/listener/viewer, and leave it all on the field. I’m very proud of all the hard work that’s gotten us to this moment, and confident that we can meet it.”

Let’s do this. If you can right now, please support Mother Jones and investigative journalism with an urgently needed donation today.

payment methods

AN IMPORTANT UPDATE

We’re falling behind our online fundraising goals and we can’t sustain coming up short on donations month after month. Perhaps you’ve heard? It is impossibly hard in the news business right now, with layoffs intensifying and fancy new startups and funding going kaput.

The crisis facing journalism and democracy isn’t going away anytime soon. And neither is Mother Jones, our readers, or our unique way of doing in-depth reporting that exists to bring about change.

Which is exactly why, despite the challenges we face, we just took a big gulp and joined forces with the Center for Investigative Reporting, a team of ace journalists who create the amazing podcast and public radio show Reveal.

If you can part with even just a few bucks, please help us pick up the pace of donations. We simply can’t afford to keep falling behind on our fundraising targets month after month.

Editor-in-Chief Clara Jeffery said it well to our team recently, and that team 100 percent includes readers like you who make it all possible: “This is a year to prove that we can pull off this merger, grow our audiences and impact, attract more funding and keep growing. More broadly, it’s a year when the very future of both journalism and democracy is on the line. We have to go for every important story, every reader/listener/viewer, and leave it all on the field. I’m very proud of all the hard work that’s gotten us to this moment, and confident that we can meet it.”

Let’s do this. If you can right now, please support Mother Jones and investigative journalism with an urgently needed donation today.

payment methods

We Recommend

Latest

Sign up for our free newsletter

Subscribe to the Mother Jones Daily to have our top stories delivered directly to your inbox.

Get our award-winning magazine

Save big on a full year of investigations, ideas, and insights.

Subscribe

Support our journalism

Help Mother Jones' reporters dig deep with a tax-deductible donation.

Donate