Joanna Littlechild GenPopWeb Network Workshop University of Essex 7 June 2013

1. A probability-based web panel for UK policy research: some initial thoughts from a Government survey sponsor Joanna Littlechild GenPopWeb Network Workshop University of Essex 7 June 2013

2. DWP Business Plan Priorities Deliver welfare reform Get Britain Working Help tackle the causes of poverty and improve social justice Pensions reform Enable disabled people to fulfil their potential Improve our service to the public

3. Range of evidence used Administrative data Large-scale surveys (eg Family Resources Survey) Models Qualitative research Data from other sources eg Office for National Statistics, academics One-off surveys

4. DWP potential interest in web panel - model High level model outlined briefly to some colleagues in the social research community: Draw a random sample from the population and approach via telephone or face to face to recruit in the first instance. Contact this panel via the web sat every two months with different modules of questions that could be sponsored, some sort of core module presumably in the first wave. Possible size 5,000 households, 20 minute on-line questionnaire each time, going back to the same people each time. But other models may be possible.

5. DWP potential interest in web panel - feedback Omnibus – model looks like a traditional omnibus survey, but with different data collection mode and going back to the same respondents every time. Method – Use of a probability sampling approach would mean that we would have a much clearer idea of potential response bias then with existing panels. Supporting data collection for those without online access would be positive and presumably reduce bias. Speed – Ministers often make requests requiring a quick turnaround. Online surveys could help in this respect – but would need a model that was responsive and flexible to user demands.

6. DWP potential interest in web panel - feedback Topic – Need to think about the type of questions that can be used through this vehicle. For example might be useful in terms of understanding awareness of reform agenda, quality of communications material etc. Targeting specific population – for certain research we want to focus on specific groups eg parents in work, disabled people, pensioners. Larger sample size – given the initial investment in recruiting would it be feasible to recruit a larger panel to start with?

7. DWP potential interest in web panel - feedback Space – interest could be influenced by how much space there might be available to government users. Individuals or households – Practical implications re web survey and type of topics/questions that can be considered. Geography – Devolved Administrations are obviously keen on separate results. Would results be possible on this basis? Recruitment – asking people to commit to research when they don’t know what topic/themes etc would be asked in the future.

8. DWP potential interest in web panel - summary Need to draw on variety of evidence to meet our reform agenda, and deliver value for money research. Different approaches have different strengths and weaknesses – what gap could such a web based panel fill? Need for speed and flexibility Probability based approach should provide good quality and representativeness – but what about attrition? This seems to give the potential for greater rigour while retaining speed/responsiveness so likely that we would use it depending on the final model – but no guarantees. We look forward to see how this progresses.