370 likes | 968 Views
Getting Started. Structure of this session 3 information sessions (20-25 minutes each) 2 Table Team Discussions (15 minutes each) 1 Question
E N D
1. Program Evaluation in Public Health Judith Garrard, PhD
Senior Associate Dean & Professor
School of Public Health
University of Minnesota
2. Getting Started Structure of this session
• 3 information sessions (20-25 minutes each)
• 2 Table Team Discussions (15 minutes each)
• 1 Question & Answer session (10 Minutes)
How to find your Table Team
• Number off (I’ll provide the numbers)
• Go to the Table with your Number
3. Who I Am • Psychologist
• Professor in the Division of Health Policy and Management in the SPH, University of Minnesota
• Taught Program Evaluation course in SPH for 25 years
• NIH funded research and evaluation studies for over 25 years
• Senior Associate Dean for Academic Affairs & Research in the SPH
4. Key Points of this Session First Information Session
• What is public health?
• What is program evaluation in public health?
• Ten Step Model for Designing a Program Evaluation Study
• Steps 1-3 in the Ten Step Model
5. What is Public Health? Public Health is concerned with
• the prevention of disease,
• prolonging of life and the quality of life, and
• promoting the health of a community, all through
• population health analysis
Public health is one of six major disciplines in the health sciences:
• Medicine • Pharmacy
• Nursing • Veterinary Medicine
• Dentistry • Public Health
6. Interventions Pubic Health concentrates on Programs that improve the health of the population. Often these Programs include specific interventions.
Program Evaluation in Public Health is largely focused on whether or not those Interventions made a difference.
7. Program Evaluation Defined Program Evaluation is the gathering of information for purposes of making decisions about a program. This is done through the use scientific and systematic methods.
Decision makers may need to involve the use of judgment or worth in making these decisions.
8. Ten Step Model(a Garrard original) Step 1. Purpose
• What is the purpose of the program or the intervention?
• Why do you need this evaluation study?
• When should a program NOT be evaluated?
• What have others done?
• How would you describe this program?
Take home point: Without a program or potential program, then you cannot have a Program Evaluation study.
9. Ten Step Model Step 2. Decisions and Decision Makers
• What Decisions need to be made as a result of this Evaluation Study?
• Who are the Decision Makers?
• Who are the Stakeholders?
10. Table Discussion #1 • Read the first abstract in your handout.
• Discuss the abstract and decide:
1. What is the Program to be evaluated?
2. What decisions need to be made based on the results of the Evaluation Study?
3. Who are the Decision Makers?
11. Key Points of this Session Second Information Session
Step 3. Types of Program Evaluation
• Program Planning
• Program Monitoring
• Program Impact
• Program Satisfaction
• Program Cost
12. Ten Step Model Step 3. Program Planning Evaluation
(Needs Assessment)
Program Planning Evaluation takes place
before the Program is initiated.
What is the definition and distribution of the problem?
What are the characteristics of the target population?
What is the need for this program?
What is the scope of this program?
What is the feasibility of success of this program?
13. Ten Step Model Step 3. Program Monitoring Evaluation
Program Planning Evaluation takes place
before the Program is initiated.
Are the services being delivered?
Is the target population being served?
14. Ten Step Model Step 3. Program Impact Evaluation
Did the intervention make a difference?
Were there unexpected results or impacts?
15. Ten Step Model Step 3. Program Satisfaction
(Happiness Quotient)
What did the recipients, staff, referral sources, users of the service, etc., think about the program?
16. Ten Step Model Step 3. Program Cost Evaluation
What is the cost per unit of service?
What is the cost benefit of the program?
What is the cost effectiveness of the program?
17. Table Discussion #2 Read Abstracts 2-4 in your handout.
Which abstract describes a program evaluation study?
If so, what type(s)?
Program Planning
Program Monitoring
Program Impact
Program Satisfaction
Program Cost
18. Key Points of this Session Third Information Session
• Steps 5-8. Scientific aspects of a Program Evaluation Study
• Step 9. Final Report
• Step 10. Managing an Evaluation Study
• Questions?
19. Ten Step Model These four steps involve the scientific aspects of an evaluation study.
Step 5. Subjects and Sampling
Step 6. Methodological Design
Step 7. Data Collection
Step 8. Data analysis
20. The Methods Map