Contextualizing the Evaluand : Contextual Influences and Constraints on Communicating Findings

1. Contextualizing the Evaluand: Contextual Influences and Constraints on Communicating Findings Kristi Pettibone, PhD The MayaTech Corporation, With CDC’s National Center for Injury Prevention and Control American Evaluation Association November 13, 2009 The findings of this presentation are the responsibility of the authors and do not necessarily represent the official views of the Centers for Disease Control and Prevention

2. Review of Key Stakeholders • CDC leadership • NCIPC program staff • ICRC program evaluation workgroup • ICRC directors • External peer review panel • Evaluation contractors • Board of Scientific Counselors

3. Purpose of Evaluation & Report • Intended for internal use only, though some parts may be shared • Identify research gaps and areas for program improvement • Required by CDC policy to conduct program and portfolio reviews for research and scientific programs every 5 years

4. Potential Uses of Findings • Demonstrate accountability • Program improvement • Future FOA requirements • Documentation of program history

5. Potential Uses of Findings (continued) • Talking points with Congress and state legislatures • Success stories • Sharing through general publications and/or Extramural Research Program Office website

6. Implications for Sharing Findings with Stakeholders • Only few stakeholders will receive the full report • Some stakeholders might receive only key findings • When possible, findings reported in format that prevents comparisons between centers

7. Contextual Influences/Constraints ICRC Directors • Wanted to promote their programs • Concerned about comparisons among centers • Half of the centers reapplied for funding under the 2009 Funding Opportunity Announcement • Asked for additional funding for program

8. Contextual Influences/Constraints ICRC Portfolio Evaluation Workgroup • Comprised of • ICRC Directors • CDC Evaluators • NCIPC Leadership and Researchers • Designed to ensure that members had • Experience with other programs/centers • History with ICRCs • Representation from ICRCs

9. Contextual Influences/Constraints NCIPC • Showcased benefits of program • Identified areas for program improvement Evaluation contractor • Guided by previous portfolio reviews • Financial constraints

10. Managing Competing Contexts • Discuss dissemination of findings early • Crosswalk data collection and analysis activities with dissemination plans • Ensure budget supports dissemination activities • Clarify and manage expectations with all stakeholders in advance • Revisit these expectations throughout evaluation to address possible changes

11. Contact Information Kristi Pettibone The MayaTech Corporation kpettibone@mayatech.com