cymru.uk

1. www.cymru.gov.uk Measuring the Wellbeing of Wales and the role of social surveys ESRA: Zagreb 19th July 2019 Dr Steven Marshall Chief Social Research Officer, Welsh Government

2. Context UK measuring wellbeing initiative A new integrated survey for Wales Wellbeing of Future Generations Act Preparing for WFGA: 2010-2016 Working with the WFGA: 2016- Conclusions Design Tips The session will cover Gwasanaethau Gwybodaeth a Dadansoddi Knowledge and Analytical Services

3. November 2010 – Prime Minister David Cameron asked the Office for National Statistics (ONS) to develop measures of subjective wellbeing to compliment GDP Large exercise involving experts and consultation and ‘Wellbeing Wheel’ Design Tips Britain’s wellbeing to be measured Gwasanaethau Gwybodaeth a Dadansoddi Knowledge and Analytical Services

4. Substantial pressures on budgets Survey costs are a high proportion of our spending on research and statistics Currently some duplication of content and survey activity ‘No change’ is not a realistic option But – there is a continued recognition of the importance of high-quality survey data Opportunity to develop an approach with more flexibility for the future Design Tips Why an integrated survey Gwasanaethau Gwybodaeth a Dadansoddi Knowledge and Analytical Services

5. An independent review was commissioned [Report] http://gov.wales/docs/caecd/research/2014/141127-options-carrying-out-large-scale-surveys-wales-en.pdf Broad options identified 1: Telephone, post or web: lower cost; less robust results 2: Reduced sample size or frequency of collection: lower cost; less timely or less detailed results 3: Bringing surveys together: lower cost; results still robust, timely, and detailed Design Tips Why an integrated survey Gwasanaethau Gwybodaeth a Dadansoddi Knowledge and Analytical Services

6. 5 surveys combined across 4 organisations Retained the name National Survey for Wales Annual sample size 12,000 Random selection of respondents 45 minute interview Face-to-face, in-home, interviews 1 random adult (aged 16+) per household 55 – 60% response rate https://www.europeansurveyresearch.org/conference/programme2015?sess=206#100 Design Tips The survey design chosen Gwasanaethau Gwybodaeth a Dadansoddi Knowledge and Analytical Services

7. The Well-being of Future Generations (Wales) Act is about improving the social, economic, environmental and cultural well-being of Wales. It will make the public bodies listed in the Act think more about the long-term, work better with people and communities and each other, look to prevent problems and take a more joined-up approach. This will help us to create a Wales that we all want to live in, now and in the future. To make sure we are all working towards the same vision, the Act puts in place seven well-being goals. Now and in the future; sustainability as a wider wellbeing definition; defined public bodies; take into account in decision making; National Indicators Design Tips Wellbeing of Future Generations Act Gwasanaeth au Gwybodaeth a Dadansoddi Knowledge and Analytical Services

8. Design Tips Gwasanaeth au Gwybodaeth a Dadansoddi Knowledge and Analytical Services

9. Design Tips Future Generations Act Gwasanaeth au Gwybodaeth a Dadansoddi Knowledge and Analytical Services

10. Design Tips Future Generations Act Gwasanaeth au Gwybodaeth a Dadansoddi Knowledge and Analytical Services

11. Preparing for WFGA: 2010-2016 Design Tips Gwasanaethau Gwybodaeth a Dadansoddi Knowledge and Analytical Services

12. Welsh Government involved in the ONS work Measuring wellbeing group set up in Welsh Government Many indicators were England only (e.g. Community Life survey) Too early to agree an approach (WFGA) But, the ONS 4 subjective wellbeing measures and other questions added to the National Survey for Wales Design Tips Collecting new data Gwasanaethau Gwybodaeth a Dadansoddi Knowledge and Analytical Services

13. What are the key predictors of low, medium and high scores for the four main indicators of personal wellbeing included on the National Survey? How do the different indicators of wellbeing relate to each other? What personal characteristics and aspects of life are important in explaining variations in wellbeing? Which population subgroups have particularly high or low wellbeing? What are the characteristics of subgroups with unexpectedly high wellbeing (for example, the people with poor health but high wellbeing)? How does wellbeing vary by geographic area? What relevance and application do these results have for Welsh Government policy objectives? Design Tips Analysis of Subjective Wellbeing 2012-13 (Natcen) Gwasanaeth au Gwybodaeth a Dadansoddi Knowledge and Analytical Services

14. Design Tips Analysis of Subjective Wellbeing Gwasanaeth au Gwybodaeth a Dadansoddi Knowledge and Analytical Services

15. Lower levels of local physical environment deprivation were associated with higher life satisfaction. Access to green or blue space was associated with wellbeing, but not when other factors were controlled for. A sense of belonging to the area where one lives predicts happiness and perceiving things as worthwhile, even after controlling for other factors. A positive perception of people in the neighbourhood is also associated with higher wellbeing when controlling for other factors. The perceived helpfulness of neighbours was linked to high wellbeing in terms of life satisfaction, things being worthwhile and happiness. Design Tips Analysis of Subjective Wellbeing 2012-13 [Selected results] Gwasanaeth au Gwybodaeth a Dadansoddi Knowledge and Analytical Services

16. Main report: http://gov.wales/docs/caecd/research/2014/140430-national-survey-wellbeing-wales-2012-13-en.pdf Supplementary tables: http://gov.wales/docs/caecd/research/2014/140430-national-survey-wellbeing-wales-2012-13-tables-en.pdf Design Tips Analysis of Subjective Wellbeing 2012-13 Gwasanaeth au Gwybodaeth a Dadansoddi Knowledge and Analytical Services

17. An initial set of proposed indicators was developed internally within Welsh Government A deliberate choice to include a mix of objective and subjective measures Analysis of the national survey data and the interactions between wellbeing measures informed the selection of indicators The final set was agreed following a public consultation – but being able to refer to analysis of survey data helped show why some indicators had been proposed Design Tips Developing the 46 National indicators Gwasanaethau Gwybodaeth a Dadansoddi Knowledge and Analytical Services

18. Working with the WFGA: 2016- Design Tips Gwasanaethau Gwybodaeth a Dadansoddi Knowledge and Analytical Services

19. Of the 46 national indicators covering the 7 Wellbeing Goals, 15 are measured by the National Survey for Wales (a third of the total) These are largely subjective measures that could not be collected in any other way A Wales of Cohesive Communities is measured exclusively using the National Survey An annual report describes progress against the indicators https://gov.wales/well-being-wales Design Tips Reporting on the 46 National indicators Gwasanaethau Gwybodaeth a Dadansoddi Knowledge and Analytical Services

20. Design Tips Summary report https://gov.wales/sites/default/files/statistics-and-research/2019-01/well-being-wales-2017-18.pdf Gwasanaethau Gwybodaeth a Dadansoddi Knowledge and Analytical Services

21. A list of indicators showing which Goal they measures and links to data Design Tips Individual indicators Gwasanaethau Gwybodaeth a Dadansoddi Knowledge and Analytical Services

22. PowerBI report for each indicators Design Tips Gwasanaethau Gwybodaeth a Dadansoddi Knowledge and Analytical Services

23. Design Tips Gwasanaethau Gwybodaeth a Dadansoddi Knowledge and Analytical Services

24. Design Tips Detailed statistical outputs are produced throughout the year Gwasanaethau Gwybodaeth a Dadansoddi Knowledge and Analytical Services

25. Just as one example of the fact that new types of data have been collected as part of developing data on wellbeing: data on loneliness has challenged the view that it is just an issue for older people “The key role of schools in building emotional and psychological resilience in children and young people and in developing an early understanding of loneliness and social isolation, in themselves and empathy towards others” Written Statement: Julie Morgan AM, Deputy Minister for Health and Social Services, 29 March 2019 Design Tips New data influences policy thinking Gwasanaethau Gwybodaeth a Dadansoddi Knowledge and Analytical Services

26. The National Survey has always adopted a flexible approach to content so that new measures can be included (remains policy relevant): Questions are asked every 2 or 3 years if a time series is needed but change is slow over time Some modules (from included surveys) are asked less frequently Sub sampling is used where only national results are needed Collecting a range of wellbeing measures alongside the early development of the approach to subjective wellbeing meant we were in a good position to inform the development of the WFGA National Indicators Design Tips Concluding comments Gwasanaethau Gwybodaeth a Dadansoddi Knowledge and Analytical Services

27. The creation of the integrated survey for Wales has brought more topics together in one place to allow more analysis of interaction (e.g. between health and sport participation) Collecting many things for the first time for Wales has allowed us to influence policy thinking More advanced analysis (regression and Latent Class Analysis) are now done in-house often with the support of PhD internships Design Tips Concluding comments Gwasanaethau Gwybodaeth a Dadansoddi Knowledge and Analytical Services

28. Questions? Steven.Marshall@gov.wales www.gov.wales/nationalsurvey Design Tips Concluding comments Gwasanaethau Gwybodaeth a Dadansoddi Knowledge and Analytical Services