Logic Models and Theories of Change What are they and how should they be used

1. Logic Models and Theories of Change What are they and how should they be used? Presented by: Jara Dean-Coffey, Principal jdcPartnerships ORGANIZATIONAL LEARNING AND EVALUATION CONFERENCE May 11, 2006 Good Afternoon, Welcome to LM and Theories of Change. My name is Jara Dean-Coffey and I am in the principal of jdcPartnerships. I will tell you a little bit more about my practice in a few. In the next 75 minutes, we will cover a lot of ground. Before we begin, I thought it would be helpful not only for me but for all of you to get a sense of who was in the room and why. ASK QUESTIONS�So, now with a show of hands How many of you are familiar with logic models and theories of change? Of those of you that are familiar, can you think of a time when these tools have been helpful? Can you think of time when they have not been? How many of you are currently in the process of developing or thinking about using one of these tools in your work? Now take a few minutes at your table, introduce yourselves if you have not already and share with each other why you choose this workshop,Good Afternoon, Welcome to LM and Theories of Change. My name is Jara Dean-Coffey and I am in the principal of jdcPartnerships. I will tell you a little bit more about my practice in a few. In the next 75 minutes, we will cover a lot of ground. Before we begin, I thought it would be helpful not only for me but for all of you to get a sense of who was in the room and why. ASK QUESTIONS�So, now with a show of hands How many of you are familiar with logic models and theories of change? Of those of you that are familiar, can you think of a time when these tools have been helpful? Can you think of time when they have not been? How many of you are currently in the process of developing or thinking about using one of these tools in your work? Now take a few minutes at your table, introduce yourselves if you have not already and share with each other why you choose this workshop,

2. 2 Agenda Introductions Objectives Logic Models Theories of Change Practice: Developing Models Sharing Stories and Strategies To supplement our agenda as well as to provide you with some walk away tools and resources, please find in front of you a packet. Included in the packet is the following: Left � Key Terms and Concepts, resource list and various logic model and theory of change templates and worksheets. Right� Powerpoint . There is more in the PPT that we might cover, but I wanted you to have enough information to use it as a resource for yourself or to share with others. With regard to the agenda, we will spend almost half of our time together in the practice and sharing our related experiences, good and bad. Does anyone have any questions?To supplement our agenda as well as to provide you with some walk away tools and resources, please find in front of you a packet. Included in the packet is the following: Left � Key Terms and Concepts, resource list and various logic model and theory of change templates and worksheets. Right� Powerpoint . There is more in the PPT that we might cover, but I wanted you to have enough information to use it as a resource for yourself or to share with others. With regard to the agenda, we will spend almost half of our time together in the practice and sharing our related experiences, good and bad. Does anyone have any questions?

3. 3 Evaluation Philosophy Grounded in intent Goals and objectives linked to strategies/activities Reality based�context, capacity, and resources Informed decisions and enhanced learning Integrated into organizational culture and practice jdcPartnerhsips is a Bay Area based consulting firm whose primary mission is to support the work that you do. We work with agencies and organization of all types and sizes who have one common thread, they are working to improve the quality of life of others. And do so through a variety of strategies including direct or supportive services, philanthropic activities..etc. Our work spans all types of issues from early child mental health to professional development for grantmakers. What we enjoy most and what our clients tell is most valuable is working in the gray. That is when you are struggling around how to focus or where to focus your efforts, let alone how to document your impact, we like to be part of the conversation. In essence, we partner with you to think through the messy stuff so that you can clarify your intention given your resources and the context in which you work and help you design evaluative processes that allow you to document your work and answer the questions you want to answer, and can answer. It is with this evaluation philosophy in mind and understanding the broader goal of TCWF and OLE, this workshop was designed.jdcPartnerhsips is a Bay Area based consulting firm whose primary mission is to support the work that you do. We work with agencies and organization of all types and sizes who have one common thread, they are working to improve the quality of life of others. And do so through a variety of strategies including direct or supportive services, philanthropic activities..etc. Our work spans all types of issues from early child mental health to professional development for grantmakers. What we enjoy most and what our clients tell is most valuable is working in the gray. That is when you are struggling around how to focus or where to focus your efforts, let alone how to document your impact, we like to be part of the conversation. In essence, we partner with you to think through the messy stuff so that you can clarify your intention given your resources and the context in which you work and help you design evaluative processes that allow you to document your work and answer the questions you want to answer, and can answer. It is with this evaluation philosophy in mind and understanding the broader goal of TCWF and OLE, this workshop was designed.

4. 4 Our Objectives Understand the elements of Logic Models and Theories of Change Learn when to use what and why Practice developing a Logic Model or Theory of Change In the time we have together, my goal is to leave you with a few more tools or enhance the ones you have with regard to evaluation. If you have any questions as we move in to the meat of this presentation, please ask the group.. There is a wealth of knowledge in this room that I hope we can tap in to and build upon. Line one with transition Line two on click Line three on clickIn the time we have together, my goal is to leave you with a few more tools or enhance the ones you have with regard to evaluation. If you have any questions as we move in to the meat of this presentation, please ask the group.. There is a wealth of knowledge in this room that I hope we can tap in to and build upon. Line one with transition Line two on click Line three on click

5. 5 Logic Models and Theories of Change Similar but not the same They are tools Can be used at different stages Earlier is better than later These are frameworks for thought. They are applicable to all stages of a program in its life cycle. What happens on the ground, in practice, will validate the strength of the model and the validity of the theory.These are frameworks for thought. They are applicable to all stages of a program in its life cycle. What happens on the ground, in practice, will validate the strength of the model and the validity of the theory.

6. 6 What Are They? Logic Models are a framework for describing the relationships between investments, activities, and results. Theories of Change link outcomes and activities to explain HOW and WHY the desired change is expected and what contextual factors exist. It is a causal model. Logic Models - Different types can be used for different reasons. Theories of Change - Developed during planning but should be �tested� throughout the programmatic lifespan. They can be used together in a continuum from planning to implementation. Logic Models - Different types can be used for different reasons. Theories of Change - Developed during planning but should be �tested� throughout the programmatic lifespan. They can be used together in a continuum from planning to implementation.

7. 7 Why Use Them? Maximize limited resources Establish a common language and construct for change Support critical thinking Increase likelihood of success Assist in making tough decisions Resources: Time, Money, People and Political Will Can illustrate to potential partners how the pieces fit together and identify who might be responsible for what. Line one comes on with transition Each line after comes on with mouse clickResources: Time, Money, People and Political Will Can illustrate to potential partners how the pieces fit together and identify who might be responsible for what. Line one comes on with transition Each line after comes on with mouse click

8. 8

9. 9 How Are They Different? Logic Models require identifying program components Theories of Change require justifications at each step A well formed Logic Model can help you can see if outcomes are not aligned with inputs and activities. It will not tell you WHY activities are expected to produce outcomes. In a Theory of Change you have to articulate the hypothesis about what will lead to each outcome. It articulates WHY you think something leads to something else (outcome to outcome). Logic Models don�t always include measures (indicators) AND Theories of Change do. A well formed Logic Model can help you can see if outcomes are not aligned with inputs and activities. It will not tell you WHY activities are expected to produce outcomes. In a Theory of Change you have to articulate the hypothesis about what will lead to each outcome. It articulates WHY you think something leads to something else (outcome to outcome). Logic Models don�t always include measures (indicators) AND Theories of Change do.

10. 10 So, Why Care?

11. 11 Logic Models Come in All Shapes and Sizes I tend to use Excel or Word as they seem easiest for people to manipulate ( they look like table). There are many options. It�s the line of thought that these models help you think through that is most important.I tend to use Excel or Word as they seem easiest for people to manipulate ( they look like table). There are many options. It�s the line of thought that these models help you think through that is most important.

12. 12 When to Use?It depends on where you are Types of Logic Models Planning Implementation Evaluation In general, Logic Models help you Establish a starting place Think through the core elements of a program Clearly and concisely explain your intentions and efforts I have one client in which we use all different types: Planning � for the overall organization to show how the various pieces (initiatives) fit together and include the assumptions and principles which guide the work at the policy level Implementation � various initiatives have these (and include strategies) where as programs funded as part of the Initiatives include specific activities Evaluation � both at the initiative and the program level with varying degrees of overlap depending on the complexity of the intended change and the nature of the interventions Found any of these to be helpful in training or coordinating meetings with all different types of programs regardless of size and issue. Can identify similarities, differences and cross over points. Types of and three bullets come on with transition In general and first bullet on click Next bullet on click Last bullet on clickI have one client in which we use all different types: Planning � for the overall organization to show how the various pieces (initiatives) fit together and include the assumptions and principles which guide the work at the policy level Implementation � various initiatives have these (and include strategies) where as programs funded as part of the Initiatives include specific activities Evaluation � both at the initiative and the program level with varying degrees of overlap depending on the complexity of the intended change and the nature of the interventions Found any of these to be helpful in training or coordinating meetings with all different types of programs regardless of size and issue. Can identify similarities, differences and cross over points. Types of and three bullets come on with transition In general and first bullet on click Next bullet on click Last bullet on click

13. 13 A Logic Model: Planning This example was used at a broad level for an organization and tends to be how I have used it. Includes 6 core components: Issues Addressed Guiding Value Evidence Supporting Strategies Expected Change Contextual Factors Strategies All funded programs reflect the strategies and contribute in some way to one or more of the Expected Changes (outcomes). It is the Outcomes which serve as the launch pad for the evaluation as well as clearly serve as reference point for program design and implementation. This example was used at a broad level for an organization and tends to be how I have used it. Includes 6 core components: Issues Addressed Guiding Value Evidence Supporting Strategies Expected Change Contextual Factors Strategies All funded programs reflect the strategies and contribute in some way to one or more of the Expected Changes (outcomes). It is the Outcomes which serve as the launch pad for the evaluation as well as clearly serve as reference point for program design and implementation.

14. 14 A Logic Model: Implementation Similar to a scope of work. Includes: Activities Outputs Resources Needed Outcomes � short, interim and long term Often use in conjunction with the planning logic model. Sometimes includes timeline and responsible parties Similar to a scope of work. Includes: Activities Outputs Resources Needed Outcomes � short, interim and long term Often use in conjunction with the planning logic model. Sometimes includes timeline and responsible parties

15. 15 A Logic Model: Evaluation Includes: Outcomes Indicators Data SourcesIncludes: Outcomes Indicators Data Sources

16. 16 A Theory of Change Not unlike L/Ms Theories of Change common in different sizes, shapes and varying degrees of complexity.Not unlike L/Ms Theories of Change common in different sizes, shapes and varying degrees of complexity.

17. 17 A Theory of Change

18. 18 When to Use? Theories of Change are best when you want to: Design a complex initiative Articulate the preconditions for success Evaluate outcomes at the right time, in the right order Explain what worked, what didn�t, and why Extremely helpful during the conceptual phase in which you may be considering a new effort. Usually, by the time I show up, the horse has already left the barn and thus I tend to use the Planning Logic Model or so than the Theory of Change. Could also use when rethinking an effort to increase its effectiveness and target resources accordingly. Theories of and first bullet come on with transition Each bullet comes on with a mouse clickExtremely helpful during the conceptual phase in which you may be considering a new effort. Usually, by the time I show up, the horse has already left the barn and thus I tend to use the Planning Logic Model or so than the Theory of Change. Could also use when rethinking an effort to increase its effectiveness and target resources accordingly. Theories of and first bullet come on with transition Each bullet comes on with a mouse click

19. 19 Project Superwoman � Theory of Change Example of a theory of change. The letters correspond to strategies which either individually or in combination of others influence a change (or precondition) which is along the pathway to the long term outcome. For instance, 1. women hear about a program; A outreach 2. women enroll in the program; Screening 3. DV survivor attend P to P workshop and as a result; Lead groups sessions 4. Know how to get help and 5. Increase their coping skills. Long Term Outcome � Long Term Employment at a Liveable Wage for DV survivorsExample of a theory of change. The letters correspond to strategies which either individually or in combination of others influence a change (or precondition) which is along the pathway to the long term outcome. For instance, 1. women hear about a program; A outreach 2. women enroll in the program; Screening 3. DV survivor attend P to P workshop and as a result; Lead groups sessions 4. Know how to get help and 5. Increase their coping skills. Long Term Outcome � Long Term Employment at a Liveable Wage for DV survivors

20. 20 Practice Draft a model Use the worksheets and models provided to guide your thought process Refer to the Key Terms and Concepts if needed Discuss these questions: What stands out for you in doing this practice? Did you have an �ah ha� moment? What was it and why? How would you apply this process and your learning to your current work? Each table will work as group. ASSIGN TYPE OF MODEL/THEORY OF CHANGE TO DEVELOP Pull Practice Instructions Worksheet and Template from package Follow instructions Strongly suggest using an existing project so that you can leverage the wisdom of the group. Be prepared to share responses (either as individuals or as group) to questions on the slide. I will be walking around to provide assistance if needed. Each table will work as group. ASSIGN TYPE OF MODEL/THEORY OF CHANGE TO DEVELOP Pull Practice Instructions Worksheet and Template from package Follow instructions Strongly suggest using an existing project so that you can leverage the wisdom of the group. Be prepared to share responses (either as individuals or as group) to questions on the slide. I will be walking around to provide assistance if needed.

21. 21 Takeaways

22. 22 Cautions and Considerations They are what they are: models and theories Take time, focus, and honesty Require looking �under the hood� Too little focus on testing the theory Right path to the wrong place Context throughout the �intervention� Universal vs. context-specific mechanisms Highlights on mouse click Goes to black on advanceHighlights on mouse click Goes to black on advance

23. 23