250 likes | 356 Views
2003 National Conference on Tobacco or Health. Thursday, 11 December 2003: 1:30 pm – 3:00 pm Boston Marriott Copley Place Regis Suite EVAL-143: Local Evaluation and Surveillance Programs. Session Overview. Local Evaluation and Surveillance Programs. Thursday, 11 December 2003
E N D
2003 National Conference on Tobacco or Health Thursday, 11 December 2003: 1:30 pm – 3:00 pm Boston Marriott Copley Place Regis Suite EVAL-143: Local Evaluation and Surveillance Programs
Session Overview Local Evaluation and Surveillance Programs Thursday, 11 December 2003 1:30 pm – 3:00 pm Marriott Copley Place Regis Suite
Session Speakers Seth Emont, Ph.D.* & Jeff Soukup** *White Mountain Research Associates, L.L.C. **Tobacco Free Nebraska, Nebraska Health and Human Services Evaluating a Tobacco Control Program with Uncertain Funding Levels
Session Speakers Argelia Figueroa, MSc & Scott Pollack, MS Tobacco Use Prevention Program Georgia Division of Public Health Georgia Local Tobacco Ordinance Study
Session Speakers Thomas Melnik, DrPH Division of Chronic Disease Prevention & Adult Heath New York State Department of Health Local Level Tobacco Surveillance in New York State
Session Speakers Jim Chen, MD, PhD Department of Pediatrics Wayne State University School of Medicine State-Specific Smoking Prevalence Affecting National Trends in the U.S., 1990-2001
Evaluating a Tobacco Control Program with Uncertain Funding Levels Jim Chen Peter Finn Sherry Mills Tandi Njobe Abt Associates Inc. Cheryl Wiese Jeff Willett Ian Newman Seth Emont (consultant) University of Nebraska - Lincoln Jeff Soukup Judy Martin Tobacco Free Nebraska NE Health & Human Services System
Evaluating a Tobacco Control Program with Uncertain Funding LevelsLearner Objectives • At the end of the presentation, attendees will be able to plan and implement a scaled-down evaluation, which utilizes: • data-driven briefs • evaluation technical assistance, and • “built-in” monitoring strategies to track the impact of local tobacco control programming.
Tobacco Free NebraskaEvaluation Advisory Panel • Monica Eischen, Office on Smoking and Health, Centers for Disease Control and Prevention • Pebbles Fagan, Ph.D., National Cancer Institute, National Institutes of Health • Jean Forster, Ph.D., Director, Prevention and Policy Program, University of Minnesota • Karen Gerlach, Ph.D., Senior Program Officer, The Robert Wood Johnson Foundation • Eric Wiesen, Office on Smoking and Health, Centers for Disease Control and Prevention
Tobacco Free Nebraska:Program Goals • Prevent the initiation of tobacco use among young people • Eliminate exposure to second hand smoke • Identify and eliminate disparities related to tobacco use • To promote tobacco use cessation among adults and youths
$405,000 (3.0%) Tobacco Free Nebraska:Program Summary (continued) Source of Chart: A Broken Promise to Our Children, The 1998 State Tobacco Settlement Five Years Later. American Heart Association, Campaign for Tobacco Free Kids, American Cancer Society, American Lung Association, November 12, 2003 (page 67).
0.40 Tobacco Free Nebraska:Program Summary (continued) Source of Chart: A Broken Promise to Our Children, The 1998 State Tobacco Settlement Five Years Later. American Heart Association, Campaign for Tobacco Free Kids, American Cancer Society, American Lung Association, November 12, 2003 (page 67).
Expect the Unexpected? • Program Components • Community/School-based • interventions • Policy initiatives • Media-based • interventions • Statewide Quitline • Outreach to racial/ethnic minorities • Youth empowerment (“No Limits”) Outcomes • Implementation/ • Mediating Factors • Level of exposure to TFN programs • Compliance with CDC Best Practices • County-specific variations of model • Level of policy tracking and • enforcement • Data Sources (Existing) • Youth Risk Behavior Survey • Adult Behavior Risk Factor Survey • Youth Tobacco Survey • Adult Tobacco Survey • School Administrator Survey • Social Climate Survey • Pregnancy Risk Assessment Monitoring System • NCIAA/Youth Access Compliance Data • TRAIN • Media print monitoring - UNL • Data Sources (in Development) • Quitline database • Measures • Tobacco use • Quit attempts • ETS exposure • Policies/ordinances • (state, county, local, • workplace) • Attitude/risk perception • External Influences • Budget allocations to TFN and staffing • Tobacco control advocacy • Social climate • Effect of other agencies’ • programs and Federal policies • (e.g., RWJF, HCFA, ALA, CDC) • Documenting Achievement of TFN Goals • Short-Term Goals • TFN Program growth (e.g., implementation of • program components) • Youth empowerment • Public/stakeholder awareness of TFN programs • Establishing local infrastructure for tobacco control • Long-Term Goals • Policy change (e.g., tobacco-free schools, youth • access, smoke-free workplaces) • Changes in public attitudes • Changes in tobacco use behaviors • Comparison of program success with “model” states Program modifications based on interim findings
Tracking & Surveillance User Friendly Evaluation Logic Model: Documenting Strategies for Achieving Change Facilitators of Change Statewide/Community Implementation & Interventions Mediating Factors Achievement of TFN Goals Barriers to Change
Bird’s-Eye View of Evaluation Activities • Monitor trends in adult and youth tobacco use through existing statewide surveys • Compare trends in adult and youth tobacco use to surrounding states and the nation • Monitor trends in adult tobacco use cessation through State Quitline • Media monitoring • Evaluation technical assistance (to state and to local grantees) • TRAIN: Tobacco Reporting and Information Network • Coalition leaders and participants survey • Qualitative interviews of key stakeholders • Focus group of TFN staff • Variety of Evaluation-Based Publications: • State Snapshots: 2001-2003 • Local Briefs: “No Limits Snapshot”, “Building Public Health Infrastructure” • Process and outcome measures blueprint
Evaluation Activities...Revisited • Monitor trends in adult and youth tobacco use through existing statewide surveys • Compare trends in adult and youth tobacco use to surrounding states and the nation • Monitor trends in adult tobacco use cessation through State Quitline • Media monitoring • Evaluation technical assistance (to state and to local grantees) • TRAIN: Tobacco Reporting and Information Network • Coalition leaders and participants survey • Qualitative interviews of key stakeholders • Focus group of TFN staff • Variety of Evaluation-Based Publications: • State Snapshots: 2001-2003 • Local Briefs: “No Limits Snapshot”, “Building Public Health Infrastructure” • Process and outcome measures blueprint
“Built In” Evaluation Capacity and Sustainability Local evaluation technical assistance T.R.A.I.N.: Tobacco Reporting and Information Network Evaluation Activities...Revisited Monitor trends in adult and youth tobacco use through existing statewide surveys Tracking Outcome Measures Tracking Process Measures/ Program Implementation
“Data-Driven” Briefs • Very targeted topics • Brief and to the point! (3 pages) • Highlights complementary activities at state and local levels • Developed by an independent evaluation team • Balances qualitative and quantitative data • Written for policy makers as key audience • Easily communicates main messages • Key stakeholders’/partners’ perspectives are incorporated
State Funding Cuts to Tobacco Free Nebraska (TFN) Are Likely to Reverse Gains Summary: Based on the experience of other states, funding cuts to Nebraska’s tobacco prevention and cessation program are expected to slow down or reverse the positive trends made in reducing adult smoking prevalence, youth access to tobacco products, and exposure to secondhand smoke in the state. Examples of Data-Driven Briefs
Examples of Data-Driven Briefs Nebraskans Support Funding State Tobacco Prevention and Cessation Initiatives The 2003 Nebraska state legislature decided to no longer use money from the Tobacco Settlement Trust Fund, or use new money from a tax increase on cigarettes, to fund tobacco prevention and cessation initiatives. This decision will likely derail many of the state's tobacco control initiatives that were previously supported by settlement funds. However, a large majority of Nebraskans (including smokers) support using settlement or tobacco tax monies to fund these initiatives.
How Have the Data-Driven Briefs Been Used by Tobacco Free Nebraska? • Posted on website • Disseminated to: • Tobacco control coordinators • Partners • Advocates • Legislators • Media • Key tool for lobby team
For More Information... • Contact Jeff Willett, Cheryl Wiese, Ian Newman, Seth Emont–University of Nebraska - Lincoln • Contact Peter Finn–Abt Associates Inc. • Contact Jeff Soukup, Judy Martin – Tobacco Free Nebraska • For an electronic copy of these and other reports, please visit the Tobacco Free Nebraska website:http://www.hhs.state.ne.us/tfn/tfnpubrep.htm