Presidential Polls: How to Avoid Getting Fooled – The New York Times

The onslaught of presidential polls has already begun. You may be tempted to avoid the polling deluge, but the results of these surveys do influence the campaign, including who will get invited to the first G.O.P. debate. That’s why we want to show you how to read (or ignore) the polls like a pro.


  1. Photo

    President Obama at a campaign event shortly before the 2012 election. Changes in presidential approval ratings can be a result of random variation rather than in response to news.CreditDoug Mills/The New York Times
    Trust Polling Averages

    Polls with surprising or novel results can be irresistible to journalists and the public alike. It’s newsworthy if public attitudes seem to have changed in some unexpected way. As a result, these findings tend to attract the most public attention and media coverage. Unfortunately, they are the most likely to be spurious.

    What looks like a shift in public opinion is often just random statistical variation. First, all polls should come with an associated margin of error or some other estimate of uncertainty. Take it seriously. With the sample sizes conventionally used in polling, changes in support of one or two percentage points can’t be distinguished from random variation. Second, given the number of polls that are conducted, outliers are likely to be common. Approximately one in 20 polls of President Obama’s approval rating, for instance, will produce a statistically significant change from the last estimate even if nothing changed.


  2. Photo

    Hillary Rodham Clinton campaigning in South Carolina this month.CreditTravis Dove for The New York Times
    Be Skeptical of Outliers

    Instead of being seduced by potential outliers or statistical noise in individual polls, rely on polling averages like the ones provided by The Huffington Post Pollster or Real Clear Politics, which better distinguish between genuine changes in public opinion and random noise. When an average picks up shifts in opinion across multiple polls, we can be more certain that the views of the public are changing.

    When people ignore averages and focus on an individual poll with an extreme value, they’re often led astray. For example, a 2014 Gallup article highlighted Hillary Rodham Clinton as having by far the best net favorable ratings of the potential presidential candidates tested: +19 (55 percent favorable versus 36 percent unfavorable). However, the poll was an outlier compared with both Gallup’s previous poll, which had her at +11, and other polls of Mrs. Clinton’s favorability conducted at about the same time. Sure enough, the next Gallup poll had her at, you guessed it, +11, suggesting that her advantage over the Republican candidates tested (many of whom had net favorables of +6 to +12) was less clear than the original articles suggested.

  3. Photo

    Donald Trump at a campaign event in New Hampshire this month.CreditIan Thomas Jansen-Lonnquist for The New York Times
    Track Endorsements, Not Early Polls

    At this stage in the campaign, approximately six months before the first primaries, eventual nominees have traditionally been among the top three or four candidates in the polls, as Nate Cohn has noted

    But if it’s usually important for a candidate to be among the leaders, it’s virtually irrelevant who is the actual leader. Early polls often reflect name recognition more than anything else. Donald Trump, for instance, has come in first or second in a number of recent national polls of G.O.P. candidates, but he’s hardly a top-tier candidate

    What should you pay attention to instead of polls? Endorsements. Political science research suggeststhat endorsements from party elites are better predictors than polls of who will win the presidential nomination. First, these officials can help candidates win by rallying supporters to their side and providing financial and organizational assistance. In addition, party elites observe the contenders closely and can often anticipate which candidates are most likely to be successful.

    Historically, front-runners start to pull away in the endorsement race at this point. Mrs. Clinton is doing just that; she stands out as the most dominant Democratic candidate in the contemporary era. By contrast, almost all the action is yet to come for Republicans.


  4. Photo

    Rick Perry before a debate in New Hampshire in January 2012. A memorable gaffe hurt him, but that is not always the case.CreditCheryl Senter for The New York Times
    Keep Gaffes in Perspective

    Despite the media frenzies that often result, campaign “gaffes” like President Obama saying “The private sector is doing fine” in 2012 rarely matter much. 

    Much of the news coverage that suggests otherwise is the result of what psychologists call confirmation bias – the tendency to believe evidence that supports our pre-existing views. For example, a recent Washington Post column suggested that President Obama’s approval ratings had improved because of a series of policy victories, but the argument relied on a single poll and neglected the fact that other polls showed no change.

    Gaffes can matter, however, when they damage the prospects of a candidate among crucial party elites. Rick Perry’s “oops” moment in the 2012 race was the capstone on a series of poor debate performances and other mistakes that helped doom his candidacy with party insiders and activists.


  5. Photo

    Bernie Sanders campaigning in Iowa early this month. CreditRuth Fremson/The New York Times
    Heed the Rhythm of Polls 

    Presidential candidates’ images and support levels tend to change in predictable ways. For instance, Mrs. Clinton’s poll numbers were always going to declineas she returned to the partisan fray after serving as the nation’s chief diplomat, which removed her from day-to-day politics. It therefore shouldn’t besurprising that her public image became less favorable during the early stages of her campaign.

    Correspondingly, when candidates announce their campaigns, their support almost invariably rises. As front-runners like Jeb Bush, Marco Rubio and Scott Walker become better known, Republicans will be more likely to tell pollsters that they view these candidates favorably. But these candidates will in turn also be subject to more scrutiny and criticism. As a result, the number of people who view them unfavorably will also grow and their numbers will correspondingly decline, especially for those who can’t survive the “scrutiny” phase of the campaign.

    Few Democrats, for instance, know that Bernie Sanders has often opposed gun control measures supported by their party, but more will learn about his record as campaign coverage intensifies and Clinton surrogates and press coverage become more critical. And many Republicans haven’t yet heard of Mr. Trump’s numerous contributions to Democratic campaigns or the many positive statements he’s made about prominent Democratic officials like Mr. Obama and Mrs. Clinton. When primary voters learn more about the history of Mr. Sanders and Mr. Trump, their polling numbers are likely to decline.

  6. Photo

    Jeb Bush campaigning in New Hampshire early this month.CreditIan Thomas Jansen-Lonnquist for The New York Times
    The Bottom Line

    Polls play an important role in presidential primaries, influencing the strategies of the candidates, the coverage they receive from the media and the choices of voters who want to avoid wasting their vote. For political mavens they’re also often an amusing way to follow the horse race.

    So go ahead and pay attention to the polls if you want, but do it smartly. Don’t overreact to individual polls or fall for weak pundit analysis. Instead, remember that campaigns have predictable rhythms and that endorsements may be a better predictor of who will ultimately prevail than who’s up or who’s down right now.


    Brendan Nyhan is an assistant professor of government at Dartmouth College. Follow him on Twitter at @BrendanNyhan.

Leave a Reply

Your email address will not be published. Required fields are marked *

This site uses Akismet to reduce spam. Learn how your comment data is processed.