90 likes | 246 Views
Evaluating Complex Health Programmes. Fraser Battye. A word from our gurus(!). “Programmes chart out a perceived course whereby wrongs might be put to rights, deficiencies of behaviour corrected, inequalities of condition alleviated.
E N D
Evaluating Complex Health Programmes Fraser Battye
A word from our gurus(!) “Programmes chart out a perceived course whereby wrongs might be put to rights, deficiencies of behaviour corrected, inequalities of condition alleviated. Programmes are thus shaped by a vision of change and they succeed or fail according to the veracity of that vision. Evaluation…has the task of testing out the underlying programme theories… is that basic plan sound, plausible, durable, practical and, above all, valid?”
Points & structure • Main Points: • Of course it’s complex! • It’s our job to respond • Mix of approaches needed: but always underpinned by programme theory • Structure: • What is GHK? • Why are these evaluations difficult? • How have we addressed this? • Conclusions
What is GHK? • Multi-disciplinary • Independent and employee-owned • Various policy areas • Specialism in evaluation • (Working with ETHNOS)
Why might programmes like COFSS be hard to evaluate? • Complexity: neighbourhoods not labs • Interactions with context: • Other interventions • The real world (e.g. residential ‘churn’ / global catastrophe & war!) • Timescales, effects and attribution: • Intervention output outcome impact • Determinants of health • Lack of / debated evidence • Standards of evidence
How have we addressed this? • Approach based on programme theory • Define theory behind the programme: • What is COFSS? • What does it do? • Desired effects? • How does it expect to work? • Design research to test it: • Quantitatively (neighbourhood; individual) • Qualitatively (lit reviews; interviews; case studies; tracking beneficiaries) • Mixed methods
Defining the theory • Aims to reduce health inequalities • Significant resources at its disposal • Multi-agency and multi-disciplinary • Significant investment in management and ‘True’ partnership working • Community based and uses an assertive outreach approach • Aims to change mainstream service provision • Resident input is central
Concluding points • It’s always going to be complex (GOOD!) • Evaluation must respond • Theory-driven approaches promising • Best mixed with ‘traditional’ methods • Challenge to accepted public health understandings of ‘evidence’