1 / 23

Performance Indicators Within and Across Community Settings

Performance Indicators Within and Across Community Settings. Reed Early Canadian Evaluation Society Conference 2013 Toronto. Activity 1 - Obstacles to selecting indicators (3-4 min). Close eyes and write name on piece of paper

Download Presentation

Performance Indicators Within and Across Community Settings

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript


  1. Performance Indicators Within and Across Community Settings Reed Early Canadian Evaluation Society Conference 2013 Toronto

  2. Activity 1 - Obstacles to selecting indicators (3-4 min) • Close eyes and write name on piece of paper • Turn it over and write place of birth using non-dominant hand • Swap cards with person next & verbally instruct them to write your age in months without telling them what it actually is • Optional - Provide lengthy written instructions via a Policy and Procedure Manual on how to measure your success on the card

  3. Logic Model Inputs Activities Outputs Outcomes Ultimate Outcomes Performance Indicators

  4. Performance Indicator Proximity Distant Environment Beyond attribution Beyond the sphere of influence Organization Ultimate indicators Program/ServiceEnvironment Immediate performance indicators

  5. Strategic Choice of Indicators Strat-egies Indicators Targets Consultative Choice of Indicators Data Collection Indicators Analysis Best Practice Choice of Indicators Borrow & Adapt Shared and evaluated Indicators Styles of Indicator Selection Management Choice of Indicators Objectives Indicators Goals

  6. Management • Indicators reflect goals and objectives – i.e. related to logic model outcomes • Useful in service/prevention agencies • Often mandated via legislation • This style may be used by senior managers to independently choose the indicators

  7. Strategic • Indicators reflect strategies and targets – i.e. activities, outputs and near outcomes • Useful for quantifiable or tangible products • Often result of accountability initiative • This style may be used by performance team in a larger agency

  8. Consultative • Indicators based on focus group or survey of employees (or clients) • Useful for decentralized, flat organizations • Requires time, effort and original data collection • May be used by smaller agencies practicing more democratic management

  9. Best Practices • Selecting indicators from literature/Internet, from similar leading agencies, and adapted • Useful to any agency with resources to search and research • Requires time, effort, and openness to experimentation • May provide benchmark comparability

  10. Surgical wait time Immunization rate Infant mortality rate Hospital acquired infections Inpatient mortality rate Cost per bed/day Health Indicators

  11. Child Behavior Checklist Youth unemployment rate Teen pregnancy and childbearing School attendance or graduation rate Children in families below poverty line Cost per child in care Social Services Indicators

  12. Sales Sales of new products Value added to raw material consumed Cost savings to industry i.e. reduced training and down time Increased market share % Increased geographic penetration Industry Indicators

  13. Educational Financial Effectiveness ratio Reach Relevance Efficiency ratio Staffing Overhead Continuing Education

  14. Performance Measurement Systems community results based indicators, i.e. Tools For Action Series A resource guide for designing a community indicator project. a report by SPARC BC, April 2008 • Community Objective and Potential Indicators, United Way of Greater Milwaukee, Planning, Allocation & Monitoring Division

  15. How do you develop PI’s

  16. Conference Indicators… • Participant satisfaction • Citations to conference • Publications from conference • Networking and outside connections • Sleeper effects • Diffusion of benefits • …others

  17. Criteria for Indicators • Is it: • Authoritative - commonly agreed to be true • Economical – only what’s needed • Ethical • Feasible – possible to measure • Logical – outputs vs. outcomes

  18. Criteria Con’t • Is it: • Manageable - suggest 10 -40 • Measurable – qualitative or quantitative • Reliable - accurate • Specific – at the right level of precision • Visible/accessible like a car dashboard • Timely True and Valid

  19. Analog and Continuous Measures

  20. Digital and Logical Measures

  21. Qualitative and Spacial

  22. Ratio and Rate Measures

  23. Take away notes • Performance indicators relate to logic models • Indicator selection requires care, time and conscious thought • Different styles are: • Management, strategic, consultative, best practice • Indicators should be selected and evaluated against criteria

More Related