There’s Value in Weird Questions From Pollsters

Public Policy Polling is well known for its periodic inclusion of off-the-wall survey questions. In its March national poll, for example, they asked whether Joe Biden could whup Donald Trump in a fistfight. (Answer: Democrats chose Biden and Republicans chose Trump.) But they also ask some questions that seem kind of batty at first glance but actually reveal something interesting. For example, here’s a question about the level of support for various candidates in a 2020 campaign against Trump:

There are two interesting things here. First, a lot of Democrats obviously have no idea who Stephanie Cliffords is (it’s Stormy Daniels’ real name) but would vote for her anyway. Second, Gillibrand and Harris are supported at the same rate. What this demonstrates is something that we all know: polling candidates this far ahead of the election is dumb. It’s based on nothing but name recognition and is essentially meaningless, something that this poll question demonstrates viscerally. Then there’s this:

This seems weird: Why would Trump supporters be less likely to think the sky is blue? Especially since they’re more likely to live in rural and suburban areas, where the sky really is blue? I can think of a few possibilities, but the real answer is probably that there’s no difference at all. Despite the official 3 percent margin of error, polls really have much higher margins of error. That 3 percent is just the statistical error, but there’s also error from bad sample design, question wording, question order, and a bunch of other stuff. A question like this brings the real margin of error to life.

 

REAL QUICK, REAL URGENT

Minority rule, corruption, disinformation, attacks on those who dare tell the truth: There is a direct line from what's happening in Russia and Ukraine to what's happening here at home. And that's what MoJo's Monika Bauerlein writes about in "Their Fight Is Our Fight" to unpack the information war we find ourselves in and share a few examples to show why the power of independent, reader-supported journalism is such a threat to authoritarians.

Corrupt leaders the world over can (and will) try to shut down the truth, but when the truth has millions of people on its side, you can't keep it down for good. And there's no more powerful or urgent argument for your support of Mother Jones' journalism right now than that. We need to raise about $450,000 to hit our online fundraising budget in these next few months, so please read more from Monika and pitch in if you can.

payment methods

REAL QUICK, REAL URGENT

Minority rule, corruption, disinformation, attacks on those who dare tell the truth: There is a direct line from what's happening in Russia and Ukraine to what's happening here at home. And that's what MoJo's Monika Bauerlein writes about in "Their Fight Is Our Fight" to unpack the information war we find ourselves in and share a few examples to show why the power of independent, reader-supported journalism is such a threat to authoritarians.

Corrupt leaders the world over can (and will) try to shut down the truth, but when the truth has millions of people on its side, you can't keep it down for good. And there's no more powerful or urgent argument for your support of Mother Jones' journalism right now than that. We need to raise about $450,000 to hit our online fundraising budget in these next few months, so please read more from Monika and pitch in if you can.

payment methods

We Recommend

Latest

Sign up for our free newsletter

Subscribe to the Mother Jones Daily to have our top stories delivered directly to your inbox.

Get our award-winning magazine

Save big on a full year of investigations, ideas, and insights.

Subscribe

Support our journalism

Help Mother Jones' reporters dig deep with a tax-deductible donation.

Donate