350 likes | 365 Views
Understand the importance of evaluation in guiding community work, challenge assumptions, define goals, strategies, and outcomes, design theory of change, convene stakeholders for planning session, measure and improve strategies. Sources for evaluation guidance provided.
E N D
Evaluation 101 –Evaluation for the Small Community Based Organization Leticia Peguero Ayorkor Gaba The Robert Wood Johnson Foundation
To know how well you’re doing…you must have some place you’re trying to get to…. “If you don’t know where you’re going, you’ll end up somewhere else….
ASSUMPTIONS • VALUES • BELIEFS
We all hold beliefs and theories that guide our thinking about problems and the way we respond to them. • Clarity about the problems and about how to work with these problems is critical because these ideas and beliefs guide our work…
Define key problems/issues challenging our communities and clients • What are our UNDERLYING ASSUMPTIONS? • Describe WHAT we are hoping to change (our desired outcome) in this community through our intervention • Describe HOW (strategies, actions, interventions) we hope to accomplish these outcomes
Examine assumptions about what works…. • While assumptions can be based on experiences from the field, sometimes they are built on intuition. Challenging these assumptions allows us to look more closely at their theory and reflect on the choices we are making.
Think about the assumptions we are making concerning WHY an intervention might work... Discuss differences in assumptions among stakeholders in your organizations CHALLENGE THOSE ASSUMPTIONS!! What and whose experiences are they based on?
Think about the assumptions that we are making concerning WHY a particular intervention might work • We don’t want our theory to fall apart so…lets identify our assumptions…
Closely examine the links between our strategies, actions and outcomes and ensure they are logical and achievable • Identify and address gaps in our strategies – paths that might not get us where we want to go
Context: Identify the major conditions that serve as the backdrop to your work…what are the opportunities and challenges surrounding your work Assumptions Long Term Outcomes Positive changes that you hope to achieve in the long run Goals/Strategy of the Program The overall approach to conducting your work. If you cannot implement all of the goals…prioritize them Assumptions Actions/Program Activities Activities are the individual services your organizations uses to implement strategies. Identify the services you want to provide Assumptions Short Term Outcomes Identify the short term changes in your target population after they have participated in your program/activity
Theory of Change… • What is it ? • A theory of change explains your underlying understanding of the issue you are addressing • It helps to clarify WHY you are doing • WHAT your doing
Convene stakeholders for a planning session • Designate a facilitator • Address each element of the theory of change • Share with stakeholders and revise based on feedback
What is meant by improving strategies to improve health? • How will you know (measure) that it is the strategy that has improved health outcomes? • What are the health outcomes that you are looking at? • Baseline measures – Will you collect baseline information?
What are the goals of the intervention? • How is the program defining community awareness? • How is the program measuring community awareness?
Final Thoughts… • There are no correct number of outcomes • Outcomes can go beyond the project’s formal conclusion • PLEASE be realistic about when to expect outcomes • Short, Intermediate, Longer term
Context (Contextual Analysis) Assumptions Long Term Outcomes Goals/Strategy of the Program Assumptions Actions/Program Activities Assumptions Short Term Outcomes
Good Sources on Evaluation • Kellogg Foundation - www.wkkf.org • “Level Best – How Small and Grassroots Nonprofit can Tackle Evaluation and Talk Results” By Marcia Felsten and Marianne Philbin, 2007 • The Drucker Foundation Self-Assessment Tool Process Guide and Workbook, • www. pfdf.org
Leticia Peguero, lpeguero@rwjf.org • Ayorkor Gaba, agaba@rwjf.org