Planning for Effective Health Promotion Evaluation

1. Planning for Effective Health Promotion Evaluation Bernie Marshall School of Health and Social Development Deakin University bernie.marshall@deakin.edu.au

2. Evidence in health promotion • Acting on the evidence • evidence-based practice • Generating evidence • Accountability • Judgements - effectiveness, worth, value • Improving practice – ours and theirs • Making the case for health promotion – we are competing against illness treatment

3. Evaluation Resource • Works from DHS planning frameworks and the IHP guide • Evaluation planning grid • Case studies • Agency – mental health • Catchment – physical activity • Additional guides and resources for evaluation

4. Integrated health promotion planning and evaluation

5. Organisational HP planning template

6. Planning health promotion programs Health issue Determinants Actions on priority determinants of the issue Long term change Intermediate term change Short term change Goal Objectives Strategies

7. Evaluating health promotion programs Health issue Determinants Actions on priority determinants of the issue Outcome evaluation Impact evaluation Process evaluation Goal Objectives Strategies

8. When do I use each type? • Process evaluation – use during the life of the program. Includes participant satisfaction, quality of materials, quality of delivery etc • Impact evaluation – use at the completion of specific project stages (i.e. after sessions, at monthly intervals and/or at program completion) • Outcome evaluation – not often used by P&CH sector but include reductions in incidence/prevalence of health conditions, changes in mortality, improvements in quality of life, long-term changes in behaviour (eg smoking rates)

9. Evaluation planning grid

11. New evaluation planning grid

12. Case studies • Examine either of the mental health or the physical activity case study. • What information is there in the case study? • What did you find of use in it?

13. Evaluating your own programs • Think of a program that you currently need to evaluate • Identify one objective and its impacts – on the worksheet • We will now design the evaluation of this objective and its impacts.

14. Making objectives SMART Specific: clear and precise Measurable: amenable to evaluation Achievable: realistic Relevant: to the health issue, the population group and your organisation Time specific: time frame for achieving your objective

15. Evaluation planning worksheet • Objective – is it SMART? • What are the key questions that the evaluation should answer • Being strategic, rather than doing reach evaluation on every single intervention within a program • Bigger picture questions – eg sustainability, who is missing out • What information do we need in order to answer these questions? • How will we get this information – who, when, how? • Planning for analysis, reporting and dissemination • Budget – being realistic: what can we afford to do; what does DHS expect for its investment?

16. Evaluation Resource • Works from DHS planning frameworks and the IHP guide • Evaluation planning grid • Case studies • Agency – mental health • Catchment – physical activity • Additional guides and resources for evaluation