Program Design

1. Program Design Global Health Fellowship St Luke’s/Roosevelt New York

3. Program DevelopmentLogic Model/Causal Hypothesis When developing a new program, it is especially important that an organization address a few key points when applying for funds to finance the program. The following guidelines cover these crucial steps, which include: • Assessment of community needs ↔Goal • Program design • Performance measurement • Program evaluation

4. Community Needs Assessment The Situation Before designing a program, an organization should conduct a community needs assessment to determine that the program is addressing a need that exists in the community. In order to get an accurate picture, assessment should involve people representing various aspects of the community. In gathering research, the following questions may serve as a guideline: • Who does the problem affect? How many people are affected? • How is this problem addressed in other locations affected by it? What has and has not worked? • Is this problem already being addressed in this community? How?

5. Community Needs Assessment A new program should not be replicating services already provided in the community. If the needs assessment determines that the problem is already being addressed adequately by other organizations in the community, it may be best to narrow or broaden the program’s approach to address the problem in a unique manner. Visit other organizations addressing the problem, in the community or not, to assess what approaches do and do not work, and how services can be improved upon.

6. Program Design Some basic qualities of a good program are that it: • Describes & gives evidence of a community need that can be addressed. • Identifies a gap in services available in the community which address the need. • Explains why this program is an appropriate strategy to meet the need. • Outlines the activities of program members in addressing the need. • Establishes community partnerships in the process of addressing the community need. • Anticipates the positive outcome of the program in the community. • Defines the method of measuring results (see the following section on Performance Measurement).

7. Program

8. A program is a sequence of intentional actions and events organized in a manner that they result in valued outcomes for a clearly defined audience.

9. How does a program work?

10. Good things happen. We do stuff.

11. If If A Then B Then C

12. Logic Model(logic modeling, program planning, program design, outcome engineering)

13. The Logic Model A recommended method of program design is to use a logic model to plan & evaluate the proposed program. A logic model is a depiction of the processes & targeted outcomes of the program. This should help the organization to specify goals, identify what resources are needed, identify indicators of progress and measurements of success, & communicate the program’s potential value.

14. Logic Model • A graphic representation of a program, • supported by a program theory, • depicted as a logical chain of “if-then” relationships, • & guides program implementation & evaluation.

15. The Logic Model – Components The components of a basic logic model include: • Needs: The community need as identified in the Community Needs Assessment. • Inputs: The resources needed to complete activities. • Activities: What staff, volunteers, etc. actually do. • Outputs: A measurement of the actual amount of service completed. • Intermediate Outcomes: Measurable change and improvements in the program’s constituents and/or community. • End Outcomes: The target changes that the organization hopes to achieve in the program’s constituents and/or community.

16. Causal Pathway • Causal: based on premise that activities should logically cause desirable results to occur • Pathway: based on the idea that the causal links form a technically & programmatically sound logical progression

17. Causal Pathway: 5 Main Components • Impact • Change in the health, socio-economic status of the population of interest thru sector specific contributions • Effects • Change in the knowledge, attitudes, skills, intentions &/or behaviors of the population of interest that contributes to desired IMPACT • Outputs • Products & services that must be in place for the EFFECTS to be achieved • Activities • The technical & support tasks required to → OUTPUTS • Inputs • Resources required to support your ACTIVITIES

18. Steps in Logic Modeling • Convene a planning group • Large room and lots of paper • Template or free form • Create a model beginning with outcomes • Get feedback from outside • Revise • Plan evaluation & select indicators

19. Three Major Components of Logic Models

20. Defining Outputs

21. Three Types of Outcomes

22. A Simple Linear Model

23. Generic Program Logic Model

24. Program Planning Worksheet

25. Let’s look at some logic models for specific programs.

26. Sample Logic Model Office of Faith-Based and Community Initiatives

29. LOGIC MODEL Logic Model Purdue University is an Equal Opportunity/Equal Access institution.

30. Why Use Logic Models? • Planning Tool • Blueprint for Implementation • Guides Evaluation • Strengthens Case for Investment • Simple Image of a Complex Phenomenon • Reflect Shared Understanding • Diagnose Program Flaws

31. Who Uses Logic Models? • W.K. Kellogg Foundation • Centers for Disease Control • United Way of America • Harvard Family Research Project • Cooperative Extension Service

32. Performance Measurement The purpose of performance measures is to capture the ongoing progress the program is making. It should provide a snapshot of the impact of the work that the organization is doing. This is an especially important step in establishing accountability to any funder. Identify all of the services the organization provides & the likely impact these services will have on the community.

33. Performance Measurement – Tracking Tools Determine tracking tools for use in measuring the results of services offered. These measures should focus on goal outputs & outcomes, as identified by the community needs assessment & defined by the program’s logic model. The measures should be in quantifiable terms & clearly defined. A good guide for determining performance measures is the acronym SMART. They should be: • Specific • Measurable • Attainable • Realistic • Timely

34. Program Evaluation Analytical study which measures the progress & impact the program has made. Evaluations should be scheduled & carried out throughout the course of the program. Should consist of thorough & objective research conducted by an experienced evaluator, starting at the beginning of the program year. Resources for finding a program evaluator include colleges & universities, research firms, & community organizations. Evaluator should collect data relevant to the program’s activities & programs & evaluate the organization’s impact. The organization should be consistently involved in the evaluation process & should adjust the programs offered according to performance measures & program evaluations in order to best serve the community.

35. Resources • CNCS Program Toolkit: http://nationalserviceresources.org/filemanager/download/online/sustainability_toolkit.pdf • Logic Models: http://www.uwex.edu/ces/pdande/evaluation/powerpt/nutritionconf05.ppt • Logic Model Development Guide: http://www.wkkf.org/Pubs/Tools/Evaluation/Pub3669.pdf • Logic Model - University of Idaho: http://www.uidaho.edu/extension/LogicModel.pdf

36. Logic Modeling Resources This Powerpoint Presentation http://www.ca.uky.edu/AgPSD/programdesign.ppt Program Design Publication http://www.ca.uky.edu/AgPSD/programdesign.pdf Logic Modeling Course on the Web www1.uwex.edu/ces/lmcourse/ W.K. Kellogg Foundation Logic Modeling Guide www.wkkf.org/Pubs/Tools/Evaluation/Pub3669.pdf