1 / 57

Obesity Evaluation Toolkit: Resources for Evaluating Community-Level Obesity Prevention Efforts

This webinar focuses on the Institute of Medicine's Obesity Evaluation Toolkit and provides resources for evaluating community-level obesity prevention efforts. Experts discuss steps in evaluating efforts, web-based resources available, and the importance of evaluation in measuring progress.

rfranklin
Download Presentation

Obesity Evaluation Toolkit: Resources for Evaluating Community-Level Obesity Prevention Efforts

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Institute of Medicine Obesity Evaluation Toolkit: Resources for Evaluating Community-Level Obesity Prevention Efforts Webinar August 25, 2015

  2. 1. Introduction Leslie Sim, M.P.H. Institute of Medicine of The National Academies of Science, Engineering, and Medicine 2. Overview of report, Evaluating Obesity Prevention Efforts: A Plan for Measuring Progress Lawrence W. Green, Dr. P.H., M.P.H. University of California, San Francisco

  3. 3.Steps in evaluating community-level obesity prevention efforts Stephen Fawcett, Ph.D. Work Group for Community Health and Development, University of Kansas 4. Web-based resources to support your efforts Christina Holt, M.A. Community Tool Box, Work Group for Community Health and Development, University of Kansas 5. Questions

  4. Submit questions - toolbox@ku.edu Issues connecting? - 1-866-770-8162

  5. Evaluating Obesity Prevention Efforts:A Plan for Measuring Progress Lawrence W. Green, Chair; and 13 members of The Committee on Evaluating Progress of Obesity Prevention Efforts

  6. Committee on Evaluating Progress of Obesity Prevention Efforts Lawrence W. Green, Dr.P.H. (Chair) University of California, San Francisco Christina Bethell, Ph.D., M.P.H., M.B.A. Johns Hopkins University Ronette R. Briefel, Dr.P.H., R.D. Mathematica Policy Research Ross C. Brownson, Ph.D. Washington University in St. Louis Jamie F. Chriqui, Ph.D., M.H.S. University of Illinois at Chicago Stephen Fawcett, Ph.D. University of Kansas Brian R. Flay, D.Phil. Oregon State University Deanna M. Hoelscher, Ph.D., R.D., L.D., C.N.S. The University of Texas School of Public Health, Austin James W. Krieger, M.D., M.P.H. Action for Healthy Food Laura C. Leviton, Ph.D. The Robert Wood Johnson Foundation K.M. Venkat Narayan, M.D., M.Sc., M.B.A. Emory University Nico P. Pronk, Ph.D. HealthPartners, Inc. Lorrene Ritchie, Ph.D., R.D. University of California, Nutrition Policy Institute Elsie Taveras, M.D., M.P.H. Massachusetts General Hospital Harvard Medical School

  7. AN URGENT NEED FOR EVALUATION

  8. What we need to know from evaluation… • Where are we in making progress and with whom? (current status) • How are we doing in making progress? (trends over time in assessing needs and implementation of policies and strategies) • What works in which populations? • What are the unintended consequences?

  9. Committee on Evaluating Progress of Obesity Prevention Efforts Study Charge: “to develop a concise and actionable plan for measuring progress in obesity prevention efforts for the nation and adaptable guidelines for community assessments and evaluation.”

  10. The Concise and Actionable Plan • Enhanced Leadership • Enhanced Roadmap • Enhanced Capacity and Infrastructure Included resources: • Indicators for the evaluation plans • Tools and methods for assessing progress in populations at greater risk for obesity • Community health assessment, surveillance, and monitoring of interventions

  11. Interdependence of National and Community Obesity Evaluation Plans Core indicators, Data sources, Resources, Methodologies National Obesity Evaluation Plan Community Obesity Evaluation Plan Contextual data, Feasibility, Local innovation

  12. Recommendations • Improve Leadership and Coordination • Improve Data Collection • Provide Common Guidance • Improve Access to and Dissemination of Information • Improve Workforce Capacity • Address Disparities and Health Equity • Support a Systems Approach

  13. To access the full report and related dissemination materials(url: http://iom.nationalacademies.org/Reports/2013/Evaluating-Obesity-Prevention-Efforts-A-Plan-for-Measuring-Progress.aspx) Interactive indicator widget Pull-out summary of indicators 4-page report brief

  14. Indicators of Progress (Excerpt from Table 4-1)

  15. National and State Level Indicators (excerpt, Table 6-4)

  16. Community Level Indicators (excerpt, Table 7-2) Note: Larger – population >50,000; Smaller – population < 50,000

  17. Some Steps in Evaluating Community-Level Obesity Prevention EffortsStephen Fawcett, Work Group for Community Health and Development, University of Kansas

  18. Vision for IOM Report Assure collection and analysis oftimely and meaningful datato inform and improve obesityprevention efforts at national, state,and community levels

  19. CONTEXT for Evaluation • Multi-component, multi-sector, and multi-level interventions • Indicators/measures of varying quality & utility • Varying capacity, capabilities, leadership, and resources

  20. ACTIVITIES: Develop Resources for Training, Technical Assistance, and Dissemination • Products/protocols/templates • Web-based support & training • Curricula • Clearinghouses for measures • Communications

  21. Steps/Components of a Community Evaluation Plan (Box 8-1) • Design stakeholder involvement. • Identify resources for the monitoring and summative evaluation. • Describe the intervention’s framework, logic model, or theory of change. • Focus the monitoring and summative evaluation plan. • Plan for credible methods. • Synthesize and generalize.

  22. 1. Design stakeholder involvement • Identify stakeholders • Consider the extent of stakeholder involvement • Assess desired outcomes of monitoring and summative evaluation • Define stakeholder roles in the monitoring and summative evaluation

  23. Participatory Evaluation (CBPR)

  24. 2. Identify resources for monitoring and summative evaluation • Person-power resources • Data collection resources

  25. Some Web-Based Data Sources(Table 7-5) • Community Commons & CHNA.org • County Health Rankings • USDA Food Atlas • CDC Diabetes Interactive Atlas • Census ACS and County/Zip Business Patterns • HHS Community Health Status Indicators

  26. What indicators available at local level? Available for all/ many communities: • Adult obesity/overweight • Activity: Active transport by walking, bicycling, density of recreational facilities, leisure-time PA • Nutrition: Adult F/V, food outlet density, farmers’ market density, food deserts, SNAP/WIC store density Some larger communities also have: • Youth obesity/overweight • Activity: Youth PA, screen time, school PA participation • Nutrition: SSB consumption, youth F/V

  27. Data Availability (Table 7-2 – Example) Large Small

  28. 3. Describe the intervention’s framework or logic model, or theory of change. • Purpose or mission • Context or conditions • Inputs: resources and barriers • Activities or interventions • Outputs of activities • Intended effects or outcomes

  29. Generic logic model for community obesity prevention (Figure 8-1, adapted).

  30. 4. Focus the monitoring and summative evaluation plan. • Purpose or uses: What does the monitoring and summative evaluation aim to accomplish? • Set priorities by end-user questions, resources, context • What questions will the monitoring and summative evaluation answer? • Ethical implications (benefit outweighs risk)

  31. End-User Focused Evaluation Questions—Some examples: • How fully was intervention implemented? • Did the intervention have desired effects? • What was the impact on participants/ population? • With whom? • Under what conditions?

  32. 5. Plan for credible methods. • Stakeholder agreement on methods • Indicators of success • Credibility of evidence

  33. Some Emerging Methods forData Collection Environmental change data • Documentation of initiatives • Unobtrusive observations • Secondary data (e.g., GIS) Policy change data • Documentation of initiatives • Surveillance Systems change data • Mapping changing relationships

  34. Indicators of Success • Translate expected effects (logic model) into specific measurable units • Examples include: • Program Outputs—units of activities delivered • Intermediate Outcomes—changes in communities and systems (program, policy, environment) • Behavioral Outcomes—changes in diet and physical activity • Population-level Outcomes—reduced prevalence of obesity

  35. Evaluation Designs – Match to Goal/Context Qualitative methods: interviews, focus groups, photo-voice, etc.

  36. 6. Synthesize and generalize. • Disseminating and compiling studies • Learning more from implementation • Ways to assist generalization • Shared sense-making and cultural competence • Disentangling effects of interventions

  37. Logic Model Design and Shared Sensemaking Obesity

  38. Obesity Evaluation Toolkit:Web-based Resources for Community Evaluation CONTEXT: Distributed evaluation workforce • People we will never see • In places we will never be TOOLKIT: Just-in-time resources for: • Training • Technical Assistance

  39. Web-based resources to support your efforts Christina Holt, M.A. Community Tool Box, Work Group for Community Health and Development, University of Kansas

  40. Navigating to the Toolkit The Obesity Evaluation Toolkit is available online: http://iom.nationalacademies.org/activities/nutrition/obesityprevprogress/resources-evaluating-community-level-obesity-prevention-efforts

  41. What you will find

  42. Evaluation Toolkit

  43. Community Tool Box – Example Resource

  44. Troubleshooting Guide

More Related