Polls

What's the Matter with Michigan? Polls Miss Badly in Dem Primary

Hillary Clinton was supposed to have the state locked up.

|

It's been a pretty good run for pollsters this year. With the notable exception of Iowa, most of the projections about who would win 2016's caucuses and primaries have been approximately right—until Democratic voters went to the polls in Michigan yesterday, that is.

All the polling averages and forecasters expected Hillary Clinton to take the Great Lakes State in a romp. RealClearPolitics had her 21 percentage points ahead, while HuffPost Pollster had her 18 percentage points up. FiveThirtyEight put her odds of victory at 99 percent.

Instead, Bernie Sanders clinched the shocking win:

There are a lot of potential explanations for what happened. One possibility is that the polls failed to get a clean read on where the true electorate was at the time the surveys were conducted. I've written a lot (including a long feature in the February issue, "Why Polls Don't Work") on what's caused the art and science of accurately measuring public opinion to get so much harder in recent years.

It's also possible that people changed their minds late in the game, either deciding at the last second whether to turn out to vote at all, or deciding at the last second to support Sanders over Clinton. Because Michigan has an open primary, it's even conceivable that a significant number of Hillary supporters, thinking their candidate was a lock (hey, that's what the polls were telling them!), opted to cross over and vote for or against Trump in the Republican primary rather than cast a ballot on the Democratic side.

It's not necessarily a polling failure when people choose to behave differently than they were genuinely planning to at the time they were interviewed, even though we tend to treat it like it is.

As other commentators have noted, Sanders managed to capture a higher proportion of black voters in Michigan (31 percent, according to the exit polls) than pre-election polls were finding. It also appears that young people—with whom Sanders is extraordinarily popular—turned out in higher numbers (voters under 30 made up 21 percent of the electorate, according to the exit polls) than pre-election polls predicted.

Are those discrepancies because the pre-election polls were wrong? It's certainly possible. Of the seven surveys completed in March and included in the RCP average, the three that found Clinton leading by the largest margins were all conducted by the same outfit, Mitchell Research & Communications, which uses "IVR," or robo-polling, instead of live interviewers. A fourth came from CBS, which partners with YouGov, a company that surveys people via the Web and therefore isn't able to use the random sampling methodology that is the basis of most modern survey research. A fifth was a product of Monmouth University, which does traditional live telephone polling but spoke to just 302 likely Democratic voters in the state.

Unlike in Iowa, where the exit polls found people breaking late and hard away from Donald Trump, Michigan voters who made up in their minds in the last week were only barely more likely to support Sanders than those who made up their minds earlier. This at least suggests the problem here has more to do with a failure by pollsters to get an accurate read of the electorate (again, no easy feat!) than it has to do with a late change of heart among voters.

The thing is, the amount and quality of the polling leading up to the Michigan primary is on par with or even better than the polling in a bunch of recent states that didn't see shocking upsets this year. Many of the Super Tuesday contests had barely any pre-election polls from which to make predictions, and yet the predictions people made weren't that far off.

Which brings us back to the conclusion we arrived at after the New Hampshire primary: Not all polls are bad, but it's nearly impossible to predict ahead of time whether the polls in a state will end up having been wrong or right.

***

An aside regarding Idaho: Some people have lumped the miss in the Gem State on the Republican side in with the much bigger and more significant miss in Michigan on the Democratic side. I wouldn't do that.

In Idaho it would be more accurate to say the pollster missed than the polls missed, and even that is an uncharitable interpretation of the facts. Only one guy was surveying voters there and the last poll he took happened pre–Super Tuesday. Again, a lot can change in the final days of a campaign, as Iowa should have taught us. This isn't necessarily an example of the polls failing. It might just be yet another example of the polling community walking away from a race before it's over.

NEXT: You Can't Say That on Chinese Television

Editor's Note: We invite comments and request that they be civil and on-topic. We do not moderate or assume any responsibility for comments, which are owned by the readers who post them. Comments do not represent the views of Reason.com or Reason Foundation. We reserve the right to delete any comment for any reason at any time. Report abuses.

  1. Because Michigan has an open primary, it’s even conceivable that a significant number of Hillary supporters, thinking their candidate was a lock (hey, that’s what the polls were telling them!), opted to cross over and vote for or against Trump in the Republican primary rather than cast a ballot on the Democratic side.

    So I’m not the only one scratching my chin over the 3d chess possibility.

    1. I am also scratching your chin over this one. That’s Obama-level 3d chess

      1. Well, I would call it Clinton-level, but sure.

      2. Obama’s playing 3d chess. Cruz is playing 2d chess. Clinton is cheating at 3d chess. Bernie is playing checkers. And Trump just tipped over the board and called them all losers.

    2. This logic only makes sense in a winner take all scenario. Weren’t the delegates assigned proportionally in Michigan? Even if your candidate is a lock it still benefits them to get more votes…

      1. They’re Democrat voters. Your appeals to logic have no impact. They feel they are making a difference.

  2. Oh, BTW, while this whole Sanders upset over Clinton makes for great horse-race coverage, the night was a big win for Clinton as she pulled even further ahead with her overall delegate count.

    1. Polls and voting booths are for Proles. Candidate selection if for Party Members.

      1. Maybe the Republicans will steal the superdelegate strategy from the Dems to stop the next Trump next time. If Trump lets them have another election.

        1. I’m guessing it’s exactly this kind of thing which caused the Democrats to adopt the super-delegate strategy. Well, that and the Democrats are intrinsically corrupt.

  3. As other commentators

    comentators

    tators

    This is all I got from this entire article.

    1. I got stuck at prejections.

      I can’t tell if it’s just a regular typo or if Stephanie is taking notes from John and it’s really a sarcastic portmontypo of projection and premature ejaculation.

  4. The haruspice read the entrails of a goat instead of the entrails of a chicken as proper protocol requires.

  5. Bernie Sanders and the soft bigotry of low expectations.

  6. I always love to see poll results not effectively predicting behavior. It teaches us to not be overconfident in polls.

    1. What’s fun about this one is it was like Sandinista-government off.

      1. Michigan==Nicaragua?

        I will allow it.

      2. And yet our Superiors in the punditry class will learn nothing and continue to rely on them as though they are the worl of God Barack H. Christ, our Lord and Savior science.

  7. Um, what happened is that working class white Democrats crossed party lines and voted for Trump.
    Which left only the hard-core progressives voting in the Democratic primary, hence the Sanders victory.

      1. Higher turnout in R primaries. Lower turnout in Dem primaries. The fact that Michigan has a lot of white working class Democrats in it. The fact that Bernie Sanders base of support is further to the left and more affluent than the typical white working class voter in Michigan.
        The fact that the numbers add up. You can just subtract votes from Hillary and add them to Trump and the results make perfect sense.

        1. I’m in agreeance with the right Hon. Hazel. Bernie Sanders appeals largely to upper middle class white kids.

  8. Nate Silver is little more than auto regressive surveys of surveys of surveys. If enough people think other people think Hillary will win then Nate says she will win. Voter input has little to do with it

  9. Garbage. Polling is a science and unless the methodology is correct can not reverse 30+ points in a single day unless there is a significant publicity event accompanying it to massively ‘educate’ the electorate with new information. The same is true with Minnesota, Kansas, Iowa and Oklahoma on the GOP side.

    A better rationale is vote fraud. For instance, how could the GOP have the EXACT Minnesota primary results on their server – THE DAY BEFORE THE PRIMARY TOOK PLACE? (h/t Lame Cherry Blog – http://bit.ly/1XdHXlK )

    Get your heads out of the sand. As in 2008 and 2012, the evidence strongly suggests the public’s wishes are NOT being properly reflected in the final voting results.

Please to post comments

Comments are closed.