220 likes | 401 Views
Why Indicators Matter Using Outcome Indicators to Plan and Evaluate Comprehensive Tobacco Control Programs Todd Rogers, PhD California Tobacco Control Program, CX Webinar July 9, 2009. Plan for this Presentation. Demonstrate the importance of indicators for:
E N D
Why Indicators Matter Using Outcome Indicators to Plan and Evaluate Comprehensive Tobacco Control Programs Todd Rogers, PhD California Tobacco Control Program, CX Webinar July 9, 2009
Plan for this Presentation • Demonstrate the importance of indicators for: • Planning and evaluating tobacco control programs • Monitoring the national tobacco control effort • Advocating for policy support and additional resources
What is an indicator? Specific, observable, and measurable characteristics that shows progress a program is making toward achieving a specified outcome Measuring Program Outcomes: A Practical Approach. Alexandria, VA: United Way of America; 1996
Characteristics of a “Good” Indicator • Relevant – important/useful information • Affordable – requires reasonable resources • Valid • Appropriate – meaningful for intended use • Understandable – makes sense • Reliable – minimal measurement error
Simplified Program Logic Model Outcomes Outputs Activities Inputs Context
Inputs State Health Department and Partners Outputs Activities Long-term 1 Completed efforts to reduce and counteract pro-tobacco messages Community mobilization 13 Reduced initiation among youth 2 Completed effortsto disseminate anti-tobacco/pro-health messages Counter marketing 14 Reduced youth smoking prevalence 3 Completed efforts to increase tobacco curricula and tobacco free policies School-based prevention Reduced tobacco- related morbidity and mortality 15 4 Completed efforts to increase restriction and enforcement of tobacco sales to minors 16 Decreased tobacco-related disparity Policy and Regulatory Action 5 Completed efforts to increase cigarette excise tax Targeted toDisparatePopulations Focus on Program Outcomes Outcomes Short-term Intermediate 6 Increased in anti-tobacco attitudes, support for policies to reduce youth initiation 10 Reducedsusceptibility to experimentation Increased anti-tobacco policies and programs in schools 7 8 Increased restriction, enforcement on restrictions on tobacco sales to minors 11 Increased price on cigarettes through tax 9 12 Decreased access Reduced tobacco industry influences
Outcome Component9 Reduced tobacco industry influences Indicator 1.9.3 Extent of tobacco advertising outside stores
Indicators Drive Program Planning • Develop program outcome objectives in the context of logical model “pathways” and associated outcome indicators • Integrate program and evaluation planning
Indicators Shape Program Objectives From: Local Program Evaluation Planning Guide (December 2004) California Department of Health Services, Tobacco Control Section
Local Evaluation of a “Pathway” • Does passage of SHS policies lead to: • Increased enforcement of policies? • Increased compliance with policies? • Reductions in reported exposure to SHS? Weber MD, Bagwell DAS, Fielding JE, Glantz SA. Long term compliance with California’s Smoke-Free Workplace Law among bars and restaurants in Los Angeles County. Tobacco Control 2003;12:269-273.
Although CX was an Early Innovation in State Tobacco Control Planning and Evaluation …
… There are Other National Efforts to Track Key Outcome Indicators for Tobacco Control …
… and Indicators are Being Developed for Many Other Public Health Issues
Indicators Are Widely Used to Track State and National Progress in Tobacco Control
TM CDC OSH Indicator Utilization by Funded State Tobacco Control Programs(2007-08)
TM CDC OSH Indicators Not Being Utilized by Funded State Programs (2007-08)
CTCP Evaluation Indicators Overlap Substantially with CDC OSH Indicators • Of 120 KOIs named by CDC, CTCP lacks data on only 22 indicators (18%): • Youth initiation – 6/54 missing (11%) • Secondhand smoke – 4/32 missing (13%) • Cessation – 12/34 missing (35%), especially on health care provider and insurance-related indicators
State Indicator Tracking Motivates Policy and Media Advocacy Actions
Indicator Data Presented by CTFK in State-Specific Press Releases
Summary • Indicators help your planning and evaluation efforts • Indicators are used to monitor state-specific and national progress • Indicator data are used to advocate for poicy change and program support • Indicators matter