250 likes | 261 Views
This conference discusses the performance of polls, modelers, and journalists in the 2016 election. Topics include voter turnout, media errors, sample variations, likely voter models, and more. Recommendations for the future include transparency, improved journalist training, and refocusing polls on analysis rather than horse race coverage.
E N D
Polling Performance and Campaign Coverage in the 2016 Presidential Election in the United States Michael W. TraugottCenter for Political StudiesUniversity of Michigan INE – CIDE - WAPOR Conference December 5-6, 2016
Organization of the Talk Checking on the performance of the polls: Evaluating national and state polls Checking on the performance of modelers Checking on the performance of journalists Can we reasonably expect to do better? INE – CIDE - WAPOR Conference December 5-6, 2016
Current State of the Vote* 2012 2016 Difference Obama/Clinton 65.9 65.3 - .7 Romney/Trump 60.9 62.7 1.6 Other 1.9 7.9 6.0 * Millions of votes Voter Turnout 58.6% 58.8% INE – CIDE - WAPOR Conference December 5-6, 2016
Relative Party Vote in Recent Elections INE – CIDE - WAPOR Conference December 5-6, 2016
Another Way to Look at the Vote Out of 231,556,622 voting eligible Americans Hillary Clinton 28.2% Donald Trump 27.1% Others, unvoted 3.4% DID NOT VOTE 41.3% INE – CIDE - WAPOR Conference December 5-6, 2016
Media in the 2016 Campaign: News INE – CIDE - WAPOR Conference December 5-6, 2016
Errors in the National Polls INE – CIDE - WAPOR Conference December 5-6, 2016
Errors in the State Polls INE – CIDE - WAPOR Conference December 5-6, 2016
Sources of Errors in Samples Sample frames and designs Non-response bias Weighting algorithms INE – CIDE - WAPOR Conference December 5-6, 2016
Variations in Sample Composition Bloomberg Poll Decoder 11/16/16 INE – CIDE - WAPOR Conference December 5-6, 2016
Explanations for Sample Variation “Shy Trump voters” – no evidence Nonresponse bias Relative enthusiasm of supporters Non-college educated males Weighting issues (reference groups) First time voters for Trump Urban-rural turnout differentials INE – CIDE - WAPOR Conference December 5-6, 2016
Problems with Likely Voter Models What is the “reference” model or election? What does it mean to have a “change” election? What about shifting campaign strategies and techniques? INE – CIDE - WAPOR Conference December 5-6, 2016
2012 Presidential Resultin 9 Battleground States Economic Dinner Club November 21, 2016
Estimation Errors in the 2012 Battleground States INE – CIDE - WAPOR Conference December 5-6, 2016
2016 Presidential Resultsin 11 Battleground States Economic Dinner Club November 21, 2016
Estimation Errors in the 2016 Battleground States INE – CIDE - WAPOR Conference December 5-6, 2016
Turnout and Trump Support INE – CIDE - WAPOR Conference December 5-6, 2016
How the Media Got It Wrong INE – CIDE - WAPOR Conference December 5-6, 2016
How the Media Got It Wrong Failure to distinguish consistently between the popular vote and Electoral College totals Failure to explain assumptions used by pollsters and modelers Failure to distinguish between odds and chances of winning Severe “confirmation bias” INE – CIDE - WAPOR Conference December 5-6, 2016
Was It the Polls or the Modelers? INE – CIDE - WAPOR Conference December 5-6, 2016
What Do the Exit Polls Tell Us? pp pp pp pp pp pp INE – CIDE - WAPOR Conference December 5-6, 2016
Presidential Vote and Party Identification INE – CIDE - WAPOR Conference December 5-6, 2016
Time of Presidential Vote Decision INE – CIDE - WAPOR Conference December 5-6, 2016
Important Candidate Qualities INE – CIDE - WAPOR Conference December 5-6, 2016
What’s Needed Going Forward Continued emphasis on transparency from pollsters and modelers Production of multiple estimates based on differential turnout parameters More and better training of journalists Get polls back to serving the analysis function at which they excel, less horse race INE – CIDE - WAPOR Conference December 5-6, 2016