1 / 25

FORMATIVE EVALUATION

FORMATIVE EVALUATION. Intermediate Injury Prevention Course August 23-26, 2011, Billings, MT. Session Goal. To provide participants with a basic knowledge of formative evaluation and its use when developing an injury prevention program. Session Objectives.

reed-dale
Download Presentation

FORMATIVE EVALUATION

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. FORMATIVE EVALUATION Intermediate Injury Prevention Course August 23-26, 2011, Billings, MT

  2. Session Goal To provide participants with a basic knowledge of formative evaluation and its use when developing an injury prevention program.

  3. Session Objectives • Describe the purpose of formative evaluation • Describe several formative evaluation methods • Provide resources for each formative evaluation method

  4. The 4 Stages of EvaluationReview • Formative • Will this work? • Process • Are we doing what we set out to do? • Impact • Can we see any changes? • Outcome • Have we reduce injuries?

  5. The 4 Stages of EvaluationReview Baseline Data Collection Project Implementation Looks at Changes in Target Audience Formative Evaluation Process Evaluation Impact Evaluation Short-term: Knowledge, Attitudes & Practice Timely Feedback Outcome Evaluation Long-term: Pre-Testing Monitoring Health Outcomes

  6. Formative EvaluationDefined The process of testing and /or obtaining expert review of program plans, messages, materials, strategies, or modifications, for weaknesses and strengths before they are put into effect.

  7. Formative EvaluationPurpose • Get target audience perception of the possible interventions • Gain community support • Ensure program materials & activities are acceptable or culturally appropriate • Identify problems with program concepts or design • Used in conjunction with process evaluation

  8. Formative EvaluationWhen to Conduct • New program • New materials • Existing program is: • modified, • having problems, or • adapted for a new setting, population, problem, or behavior • Ongoing at all stages of program

  9. Formative EvaluationWho to Involve - Stakeholders The people with a vested interest in a program and the future use of its evaluation

  10. Formative EvaluationCategories of Stakeholders • Implementers • Partners • Participants • Decision makers

  11. Formative EvaluationStakeholders Example: Car seat distribution program Who should we include? • Implementers • Partners • Participants • Decision makers

  12. Formative EvaluationData Collection Methods 1. Focus Groups 2. Key Informant Interviews 3. Town Hall Meetings 4. Expert Reviews 5. Surveys

  13. Formative EvaluationFocus Groups - Purpose To gather information on a particular topic by conducting an informal discussion between 6 to 10 individuals similar to target population

  14. Formative EvaluationFocus Groups • 8 Important Steps • Secret Ingredients: -Focus group similar in makeup to target population -Requires an experienced facilitator

  15. Formative Evaluation Key Informant Interviews - Purpose To obtain detailed information by asking broad open-ended questions and by probing interviewee

  16. Formative EvaluationKey Informant Interviews • 7 Important Steps • Secret Ingredients: -Take care to select informants with various points of view -Remember to first establish rapport

  17. KEY INFORMANT EXERCISE Scenario: Local IPS is seeking to determine attitudes and beliefs about ATV related injuries and possible interventions. They will interview two key community members.

  18. Formative EvaluationTown Hall Meetings - Purpose To gather a diverse group of community members together to think and talk about an issue

  19. Formative EvaluationTown Hall Meetings • 8 important steps • Special Ingredients • Plan early • Make sure there is plenty of time for interaction between audience and presenters

  20. Formative EvaluationExpert Reviews - Purpose To identify mistakes, concerns, and general areas for improvement.

  21. Formative EvaluationExpert Reviews • 7 important steps • Special Ingredients • The committee should be continuously involved in the process. • Include detailed instruction in the job description.

  22. Formative EvaluationSurveys - Purpose To obtain SPECIFIC information from a targeted group of people using a set of defined questions.

  23. Formative EvaluationSurveys • 7 important steps • Special Ingredients • Avoid overloading the survey • Design questionnaire such that its clear and simple.

  24. Formative EvaluationExamples in IHS • Sleep Safe and Ride Safe Curriculums – Focus Groups, Key Informant Interviews, Expert Review • Animal Control Project - Surveys • Child Passenger Safety Training - Expert Review • IHS Area Injury Prevention Program Evaluations - Expert Review

  25. Formative evaluation Tests program plans, messages, materials, strategies, or modifications for weaknesses and strengths before they are put into effect. Allows the evaluator to probe the feelings, beliefs, and impressions of participants. Generates community support for the proposed project or program. Formative EvaluationConclusion

More Related