1 / 31

Understanding Outcome Measures

Understanding Outcome Measures . David McPhee Communities Analytical Services. Outline. Background to outcomes approach Can you identify an outcome? Examples of different measures Linking outcomes and indicators Considering your data Menu of local indicators Support Questions.

hanh
Download Presentation

Understanding Outcome Measures

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Understanding Outcome Measures David McPhee Communities Analytical Services

  2. Outline • Background to outcomes approach • Can you identify an outcome? • Examples of different measures • Linking outcomes and indicators • Considering your data • Menu of local indicators • Support • Questions

  3. Background • The new administration came to power in 2007 and stated that it would focus on a set of high level outcomes • The National Performance Framework outlines the 15 National Outcomes which would sit below the Purpose of the Scottish Government

  4. Background

  5. Background

  6. Background • Concordat between the Scottish Government and Local Authorities • Removal of ring fencing and the creation of Single Outcome Agreement • First 2 rounds of SOA’s already carried out with many lessons learned between round 1 and round 2

  7. Background • The SOA’s will drive the local housing strategy with the key housing objectives forming a core set of outcomes • The LHS’s will therefore be a key driver in delivering SOA’s and also delivering the SG outcomes (particularly 7 and 10) • Template already created for recording outcomes, indicators, targets and actions. • Examples will follow in later sessions

  8. Outcomes and Indicators • Not synonymous! • Outcomes are the positive improvements to life we are all working to achieve • Indicators are numbers that should indicate whether an outcome is being achieved

  9. Can you identify an outcome? • “% of housing advice cases resulting in the prevention of homelessness” • Outcome? • Indicator? • Target? • Action?

  10. Can you identify an outcome? • “% of housing advice cases resulting in the prevention of homelessness” • Indicator

  11. Can you identify an outcome? • “Identify land and unsold private properties for the development of affordable housing” • Outcome? • Indicator? • Target? • Action?

  12. Can you identify an outcome? • “Identify land and unsold private properties for the development of affordable housing” • Action

  13. Can you identify an outcome? • “Improved housing choices in the size and types that people want in the areas they want to live and that they can afford” • Outcome? • Indicator? • Target? • Action?

  14. Can you identify an outcome? • “Improved housing choices in the size and types that people want in the areas they want to live and that they can afford” • Outcome

  15. Can you identify an outcome? • “Increase the number of social rented properties meeting the SHQS standard by 10% each year” • Outcome? • Indicator? • Target? • Action?

  16. Can you identify an outcome? • “Increase the number of social rented properties meeting the SHQS standard by 10% each year” • Target

  17. Can you identify an outcome? • “Potentially homeless households are able to sustain settled accommodation” • Outcome? • Indicator? • Target? • Action?

  18. Can you identify an outcome? • “Potentially homeless households are able to sustain settled accommodation” • Outcome

  19. Examples of Different Measures • Outcome: • The overall impact which is trying to be made • Not necessarily easily measured “People will have better access to appropriate and affordable housing”

  20. Examples of Different Measures • Indicator: • A measure which provides an indication of whether the outcome is being achieved • Measurable, but does not necessarily measure the impact of the full outcome “Number of affordable houses provided in a given year”

  21. Examples of Different Measures • Action: • The practical steps which will be taken to deliver the outcomes (and indicators) “Review lettings procedures and develop new protocols with RSL’s”

  22. Examples of Different Measures • Target: • More specific version of an indicator with a specific aim • Targets should where possible be Specific, Measurable, Achievable, Relevant and Time Specific (SMART) “Increase the % of housing advice cases resulting in the prevention of homelessness by 16% by 2011/12”

  23. Examples of Different Measures • Inputs and Outputs: • Measures of what are being put into and delivered by “a system” • Outputs and Inputs can look like outcomes but they do not tell you about the impact of actions only the actions themselves • One persons output could possibly be another persons outcome “The number of people being dealt with by homelessness teams in LAs”

  24. Linking Outcomes and Indicators • Outcomes not always possible to measure in an easy way • Indicators should provide true indication of whether outcome is being achieved (not just a small part) • Good indicators will show success of a variety of programmes/sectors/policies • Depending on outcome it may need a number of indicators to determine success

  25. Considering Your Data • Key Considerations for your data: • Is it survey or administrative data? • What is the coverage? • Is it consistent over time? • Is it quality assured? • Can you compare across different areas? • Is it precise enough?

  26. Menu of local indicators • Produced by the Improvement Service – current versions based on commonly used indicators in SOAs not all of which are high quality • BUT…. • SOLACE are leading an Improving Local Indicators Project • First output will be Version 4 of the menu – due to be published in October

  27. Improving Local Indicators Project • Main aim of project is to improve data available for measuring outcomes at a local level • The project will continue for a couple of years • Project involves SOLACE, Scottish Government, Improvement Service, LARIA, Audit Scotland, and many many more… • Everyone can get involved • Details available here: http://www.scotland.gov.uk/Topics/Statistics/scotstat/analystsnetwork

  28. Support • Scottish Government stats website: • www.scotland.gov.uk/stats • CHMA Website and Contacts: • www.scotland.gov.uk/chma • chma@scotland.gsi.gov.uk • SCOTSTAT Analysts Network • Analysts.Network@scotland.gsi.gov.uk • www.scotland.gov.uk/scotstat • Guidance on measuring change and monitoring targets • http://www.scotland.gov.uk/Topics/Statistics/scotstat/analystsnetwork/MCMTguidance

  29. Support • Outcome Template • Worked example: http://www.scotland.gov.uk/Resource/Doc/1035/0062216.pdf • Blank Template: http://www.scotland.gov.uk/Resource/Doc/1035/0062275.doc • Future Events – More information to follow

  30. Questions?

More Related