270 likes | 528 Views
Implementation, Monitoring, and Evaluation. CHIP Learning Session # 2 • March 11 ,2014 Sarah Hartsig, M.S. Kansas Health Institute. PHAB Requirements. 5.2.2: CHIP Includes measureable and time-framed targets 5.2.3: Implementation Implement the CHIP in partnership with others
E N D
Implementation, Monitoring, and Evaluation CHIP Learning Session # 2 • March 11 ,2014 Sarah Hartsig, M.S. Kansas Health Institute
PHAB Requirements • 5.2.2: CHIP • Includes measureable and time-framed targets • 5.2.3: Implementation • Implement the CHIP in partnership with others • Tracking process to document progress in implementation (action plan) • 5.2.4: Monitoring • Monitor and revise as needed the strategies in the CHIP with participation from stakeholders and partners
Implementation: Where the ‘rubber hits the road’ • Strong CHIP and action steps are a prerequisite for successful implementation • But they DON’T guarantee success • Must maintain active engagement with partners • Keeping momentum can be aided by strong communication
Monitoring • Tracking progress of your outcome measures and process measures/activities • Need to determine: • Data Source • Responsible organization/individual • Monitoring frequency
Monitoring (continued) • Frequency is determined by • Sensitivity of measure (i.e. obesity rate vs. attendance at farmers’ market) • Time/resources • Availability of data (some statewide and national measures are only updated yearly) • Monitoring more frequently can allow responsiveness in strategies, if needed • Allows for adaptation to challenges • Remember to document!
What if we’re not on track? • PHAB anticipates that you may need to change course • That is OKAY! • Document what you did and why • Include in monitoring and evaluation plan
Practice • Use Worksheet #9 • Develop a Monitoring/Evaluation plan • Fill out the first 6 columns • Take a look at your Outcome Measure(s) • Where will you get the data? • How frequently will you monitor it? • Who will be responsible?
Monitoring and…Evaluation • Identify and understand the results of the program • Helps to form the decision about whether your activities produced the change you set out to make Remember this?
Evaluation: Types • Impact/outcome evaluation • Review outcomes measures • “Did the community’s health change in the way we set out to change it?” • Process evaluation • Review completion of process measures/action steps • “Did we do what we said we were going to do?”
Developing vs. Evaluating What will help us meet our…? Were we successful? Did it help mae progress toward our…? Impact/Outcome Process
Why Evaluate? Remember: Activities Outcomes Impact What do your stakeholders care about? And what really matters at the end of the day? How will you know when you have made a difference? Evaluation is about telling and learning from your story.
Evaluating for Success: Example Goal: Increase the consumption of healthy foods by County residents • Activities: Craft a healthy vending policy for schools • Outcomes: • 22% of youth ages 2-17 consume 5 or more servings of fruit and vegetables daily • Increase sales of healthy foods in vending machines from 10% to 30% • Impact: By 2020, obesity in County is under 28% (baseline: 32% in 2012)
More on Evaluation • For our purposes, evaluation is the end-result of your outcomes measures (and activities/process measures) • However, evaluations can include many parts: • Contextual narrative • Focus groups • Surveys • Advanced Statistical Analysis • External evaluation of program and related activities • Financial assessment • If you are receiving a grant, your funder may require a more extensive evaluation than a list of outcome measures
Tools and Resources • http://kansashealth.org/grantmaking/evaluation/resources
Discussion • Use Worksheet #9 • Review your Monitoring/Evaluation plan • Discuss: What will you do when you’re not on track to reach the goal?
Questions? Sarah Hartsig, M.S. Analyst, Kansas Health Institute shartsig@khi.org 785-233-5443
Resources • NACCHO CHA-CHIP resources • http://www.naccho.org/topics/infrastructure/CHAIP/upload/Final-Planning-for-CHIP-Monitoring-and-Evaluation-Participants-Slides.pdf • http://www.naccho.org/topics/infrastructure/CHAIP/upload/Unlocking-the-Secrets-of-CHIP-Implementation-Final-Slides.pdf • KU Community Toolbox: http://ctb.ku.edu/en/table-of-contents/evaluate/evaluation/framework-for-evaluation/main
Kansas Health Institute Information for policy makers. Health for Kansans.