190 likes | 404 Views
Indicators for ACSM. Objectives . Explain the role of indicators in monitoring and evaluation for ACSM. Describe the characteristics of well-defined indicators. Demonstrate how to develop indicator descriptions. Creating a Framework . What Is an Indicator? .
E N D
Objectives • Explain the role of indicators in monitoring and evaluation for ACSM. • Describe the characteristics of well-defined indicators. • Demonstrate how to develop indicator descriptions.
What Is an Indicator? • Clues, signs, or markers. • Used to: • Track inputs, activities, outputs, and outcomes. • Measure progress toward the goal and objectives. Crow and the Pitcher!
Outputs versus Output Indicators • Output is the immediate result of an activity: • # of people trained • # of people with TB symptoms going to health facility for evaluation • REPORT WHAT YOU ACTUALLY ACCOMPLISHED • Indicators for outputs measure your result against a target value: • # of people actually trained versus how many you wanted to train • # of people with TB symptoms going for evaluation versus how many you thought would go • ASSESS WHETHER YOU REACHED YOUR TARGET VALUE
NTP Goal: Reduce morbidity and mortality due to TB in Country X. Indicator: Number of TB deaths per 100,000 per year NTP Objective: Increase case detection rate from 42% to 60% by 2015. Indicator: Case detection rate ASCM Objective: Raise knowledge of TB symptoms and TB services to increase the number of people in City X seeking care for TB symptoms at DOTS centers by 30% by December 2013 . Indicator: # of people requesting screening at the City X DOTS center compared to baseline Inputs Funding List of subway routes Activity Develop and produce subway ads Outputs # ads produced # subway trains with ads Outcome Increased knowledge of TB and DOTS centers Impact Increased # of TB cases detected • Indicators: • % of people who know two TB symptoms and have heard of the DOTS center • # of people requesting screening at City X DOTS center Indicator: Difference in case detection rate between intervention and control cities Indicator: Lists developed (Yes/No) Indicator: Number of ads and subway trains versus target Indicator: Ads produced according to schedule (Yes/No)
Main Steps of Creating Indicators • Select an indicator • Test against criteria • Write a description
Is This Indicator Valid? • Does it tell us what we reallywant to know? • Could it actually measure something else? Example: % of Ministry of Health budget dedicated to TB as an indicator of government commitment to TB control. Improved indicator: % of NTP budget covered by government (compared to % covered by donors).
Is This Indicator Reliable? • Will everyone interpret or calculate it the same way? Example: Number of partners actively participating in advocacy coalition. Improved indicator: Number of partners who attend at least 75% of coalition meetings. Example: Smear conversion rate.
Is This Indicator Activity Specific? • Does it tell us about our activity only? Could any other factor (ACSM or not) influence this indicator? Example: % of TB screening clients receiving a smear test as an indicator that providers from our training are referring TB suspects properly. Improved indicator: % of TB screening clients with documented referral for smear microscopy.
Is This Indicator Feasible? • Do we have a realistic data source? Do we have enough money and staff? Example:% of population with correct knowledge about TB symptoms, annually (indicator of a successful communication activity). Alternative indicator: Number of people with possible TB symptoms presenting for diagnosis at specified DOTS clinics.
Comparable • Do the results mean the same thing in different geographic areas at different times? Example: Number of nongovernmental organizations in each region mobilized to participate in World TB Day. Alternative indicator: % of nongovernmental organizations in each region mobilized to participate in World TB Day.
Indicator Descriptions • What is the complete definition? • What is the data source for this indicator? • How do we calculate the value of the indicator? • Numerator, denominator • Qualitative criteria