270 likes | 421 Views
A Case Study of the use of Logic Models for Planning and Evaluation in Sligo Sport and Recreation Partnership . Máire Mc Callion Deirdre Lavin . SSRP- Strategy 2013-2016. To develop a more co-ordinated and systematic approach to monitoring and evaluation.
E N D
A Case Study of the use of Logic Models for Planning and Evaluation in Sligo Sport and Recreation Partnership MáireMcCallion Deirdre Lavin
SSRP- Strategy2013-2016 To develop a more co-ordinated and systematic approach to monitoring and evaluation. • Review and audit of monitoring and evaluation systems. • Actions include • Describe programmes – using logic model(retrospective)
Logic Models • Visual Map of how programme components are related to results • Developing a logic model is first step in many evaluation frameworks • Purposes include [1] • Assist in focusing evaluation on principal programme elements • Provide a common focus for staff, stakeholders • Identify performance indicators • Can incorporate programme theory • Developed – Planning, Implementation, Evaluation [1] Gugiu et al 2007. Semi – structured interview protocol for constructing logic models. Evaluation and Programme Planning 339-350.
Case Study SSRP Active Communities ProjectCranmore, Sligo Background • Cranmore Regeneration Project Team appointed in 2004 as a high priority project for Sligo Local Authorities • SSRP involved since 2004 • Evidence of high disadvantage e.g. Social Economic Profile Study April 2013 • Funding available from the Department of Environment How: • Partnership approach driven by the Cranmore Regeneration Office • Bottom up approach through tailored interventions/ programming (including personal contact/ capacity building/ local ownership)
Developing the Logic Model • 2 Workshops with staff • Consultation with community stakeholders • Drafts and Redrafts of model Involved … • Intro to Logic Models & Clarification of terms • Outcomes approach model[1] • Clarification of programme activities • Identification of Programme Inputs • Link to evidence of effectiveness of community programmes [1] W.K. Kellogg Foundation (2001). The Logic Model Development Guide. Battle Creek, MI: Author. Retrieved 6/6/2014, from file:///C:/Users/mmccallion/Downloads/LogicModel.pdf
Response from Staff & Stakeholders • Helps Systematic thinking • More than individual level changes • Stakeholders from Start • Communication and Consensus Programme • Stakeholders to hand over to (sustainability) • Framing (growing legs v evolving) • Monitoring and evaluation • Model for replication
Systems thinking Socio-ecological levels Resources
Programme Framing Programme Flexibility to let programme evolve – review model
Communication and Consensus • One page • Key programme activities
Replicate the programme Potential for other LSP’s Also use model for other SSRP programmes Inputs – Differ in other areas
Supporting Monitoring and Evaluation in SSRP • Programme Outputs • Staff previously collecting this data • Inform upcoming evaluation in Cranmore
Choosing Indicators for Outcomes • Challenge • Existing National Strategies • Ongoing
Logic model -no guarantee of Logic • A graphic display on paper may not always be true[1] • Model based on assumptions • Theory • Evidence of best practice [1] Watt Knowlton, L & Phiiips, C.C. (2013). The Logic Model Guidebook. California: Sage.
More Challenges Disadvantaged communities – Changes in inputs can effect model more There can be unintended outcomes & evaluation need to look for these Clarification of terms – Impacts / Outcomes It is a challenge to put outcomes in appropriate timeframe – changes in knowledge / attitudes v behaviour and Temporary v Long term changes
Challenges (Contin) • Time for planning • Basic Model doesn’t give detail ..long version • Interlinking programmes jointly contributing to outcomes • Linear model but iterative programme ..
Next Steps • Linking to planning documents • Developing models jointly with stakeholders for other key projects • Using Logic Model evaluation for Active Communities project in Cranmore • Developing indicators & systems for ongoing monitoring • Taking the next steps in evaluation cycle with prioritised Projects
Thank You Any Questions
Thank You ! Questions ?