1 / 12

20 January 2010

Internet polling: a more hesitant approach. 20 January 2010. Andrew Cooper, Founder, Populus. Choosing not to be an online pollster (2003). 1. Low (and unrepresentative) internet penetration. Source: Ofcom , 2003. 2. Panel issues. PROFESSIONAL PANELLISTS

unity
Download Presentation

20 January 2010

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Internet polling: a more hesitant approach 20 January 2010 Andrew Cooper, Founder, Populus

  2. NCRM seminar Choosing not to be an online pollster (2003)

  3. NCRM seminar 1. Low (and unrepresentative) internet penetration Source: Ofcom, 2003

  4. NCRM seminar 2. Panel issues • PROFESSIONAL PANELLISTS Panels dominated by small minority of all internet-users, most of whom are members of several panels, raising further concerns about data quality and representativeness (research suggests that people who are members of several panels are relatively unrepresentative of all internet users – more likely to be female and lower socio-economic status). • ‘HAPPY CLICKING’ Absence of a human interviewer means there is no sanction for giving random responses to complete surveys as quickly as possible – and the primary motivation for respondents is to get the financial reward. • PANEL CONDITIONING Respondents are polled multiple times – becoming more and more atypical.

  5. NCRM seminar 3. Panel infiltration EDD Group in the EP & U.K. Independence Party Press Digest Wednesday 10th July 2002 UKIP & YouGov - Urgent action required by members/supporters Dear Member/Supporter, I would recommend that all members visit the www.yougov.com website, and register to participate in polls. YouGov suffer from a shortage of persons in the older age groups (55+) on low incomes, and consequently are forced to weight the polling data from those groups accordingly. I would urge all members/supporters to register as retired persons on low incomes, former Labour voters who are now undecided. Do not mention UKIP! The result will be a disproportionate response in favour of UKIP (or 'Other Party' if they continue to miss us out).

  6. NCRM seminar 4. Political sample bias Source: Populus & YouGov data tables, November 2004

  7. NCRM seminar 5. Under-representing the don’t knows & the disaffected (and over-representing the informed & interested) Source: Populus & YouGov data tables, December 2007 & January 2010

  8. NCRM seminar 6. The theological questions What exactly can internet poll data be said to be representative of? If you get the answer right, does it matter how you got to it? “Respondents for this survey were selected from among those who have agreed to participate in Harris Interactive surveys. The data have been weighted to reflect the composition of the adult population. Because the sample is based on those who agreed to participate in the Harris Interactive panel, no estimates of theoretical sampling error can be calculated.”

  9. NCRM seminar Looking again at online polling (2010)

  10. NCRM seminar • Internet penetration has improved. Nielsen estimates 80% of UK adults now have internet access (up from 64% in 2007 and 60% in 2005) • Best practice deals with ‘happy clickers’ & professional panellists. Consistency checks, time stamping, digital fingerprinting & data cleaning • Larger panels reduce over-sampling, panel-conditioning & onerous weighting factors. Many panels now have hundreds of thousands of members, rather than tens of thousands 4. ‘River sampling’ offers the prospect of moving away from panels altogether, enabling quasi-random online polls and reducing the infrastructural cost of panel maintenance.

  11. NCRM seminar • Fixed line telephony is in decline. 87% of households have a fixed-line telephone, down from 90% in 2007 & 93% in 2005. In the US, in-home internet penetration has just overtaken fixed-line penetration. • 13% now have only a mobile phone, not a landline. 26% of 15-24 year-olds, 21% of 25-34 year-olds and 22% of DEs • Market forces, technological change and cultural trends are making telephone polling more expensive. • YouGov has shown that the challenges of gauging voting intention by internet polling can be overcome!

  12. NCRM seminar But... challenges remain Source: Populus data tables, October 2009 ... as do the theological questions

More Related