1 / 14

Evaluating Capabilities: Building consensus around capability measures and indicators

Evaluating Capabilities: Building consensus around capability measures and indicators Jason Pollard Think:Learn:Do. Background. Integrative Development Model (Kia-Keating, 2009) Young Foundation Report Adoption by commissioners Challenge for service deliverers

valin
Download Presentation

Evaluating Capabilities: Building consensus around capability measures and indicators

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Evaluating Capabilities: Building consensus around capability measures and indicators Jason Pollard Think:Learn:Do

  2. Background • Integrative Development Model (Kia-Keating, 2009) • Young Foundation Report • Adoption by commissioners • Challenge for service deliverers • Opportunity for the sector

  3. The challenges of evaluation • Bringing capabilities into a single tool • Developing a set of (valid) indictors • Scoring a capability measure • Getting the right data out of the service

  4. Meeting the Challenge • Local evaluation network • Feasibility study – • Asked can operationally useful information be collected to support operational decision making

  5. Evaluation Network • Recruited six youth providers through VAL • Jointly developed a set of indicators • Pilot evaluation and pre-test of data collection tool • Full evaluation to ‘road test’ tools

  6. Developing the Indicator Set

  7. Lewisham – Capability Measures • Being Creative • Communication • Relationships and Leadership • Resilience • Confidence and Agency • Managing Feelings • Planning and Problem Solving • Strengthening Citizenship • Making the most of London

  8. Delphi – Agreeing Definitions Example – Being Creative

  9. Delphi – Agreeing Measures How to measure Being Creative

  10. Delphi – Agreeing Indicators What would we expect to see?

  11. The Indicator Set • 27 indicators • Equally split over 9 outcomes • What we would expect to see • Conceptually linked to outcomes

  12. Developing the Data Collection Tool • A ‘composite’ tool – brings together several capability scales • Valid and reliable (in pre-test) • Soft Data – questions relating to the development of the young person and their engagement with their project • Hard Data – age-specific questions directly relating to the capabilities

  13. Next Steps • Pilot - Scale-up: 10+ organisations to collect common data • Explore Thematic indicators (talent; financial capability, etc) • Establish evaluation communities of interest (Co-ops; CiCs)

  14. End

More Related