January 26, 2012

2. Welcome! January 26, 2012 We Will Be Starting the “Strategies for Engaging and Utilizing Stakeholders and Gate Keepers” Webinar Shortly

3. Strategies for Engaging and Utilizing Stakeholders and “Gate Keepers” Donna Dent, MS, MISM Sally Honeycutt, MPH Associate Coordinator Evaluation Consultant Service to Science Lead Evaluation Team Lead, Emory Prevention Research Center SAMHSA’s Southeast Center for the Application of Prevention Technologies

4. Welcome to Connect Pro • We will be using the following windows: • PowerPoint Window • Attendee List • Chat • Note • We will also use the “Raise your Hand” feature Shannon Greer, Southeast IT Specialist

5. Raise your hand by clicking You will see your status change in attendees list Un-mute your phone (press * #) when called upon Remember to mute your phone again once you have finished speaking Lower your hand by again clicking Introduction to Connect Pro

6. Asking Questions in Connect Pro • By writing your question in chat window • Press enter • Only the moderator will see the question

7. Facilitator and Presenter • Donna Dent, MS, MISM Sally Honeycutt, MPH • CAPT Associate Coordinator STS Evaluation Consultant • Southeast Service to Science Lead Emory University Professor

8. Objectives The participant should be able to: • Define the term “stakeholder” • Differentiate between a stakeholder and a “gate keeper” • Explain at least three significant roles for stakeholders with regard to evaluation

9. Objectives (cont’d.) • Identify at least three potential stakeholders for their program and explain the benefit they add to the evaluation process • Discuss at least three strategies one might use for keeping stakeholders engaged over time • Explain at least two reasons stakeholders might become involved and then stay engaged in a program

10. I What is a Stakeholder?

11. Stakeholders • Have a vested interest in whatever is being evaluated • Are in a position to use findings • May use findings in different ways

12. Types of Stakeholders • Primary stakeholders • Are project beneficiaries • Secondary stakeholders • Are directly involved with/responsible for primary stakeholders • Are affected by the project (jobs, lives) • Key stakeholders • Are government officials/policy makers • Can influence others • Have an interest in the outcome of an effort (U. Kansas, 2008)

13. Gatekeepers vs. Stakeholders? Gatekeepers: • Control access to people, resources, or information needed for evaluation • May or may not overlap with stakeholders Can you give some examples?

14. II Why Engage Stakeholders?

15. Benefits of Stakeholder Engagement • Increase the relevance and usefulness of the evaluation • Improve evaluation process (U. Kansas, 2008) (RWJF, 2009)

16. Why Team Up? • Share (mission/goals) – increase capacity, create unison • Access – direct or indirect access to target audiences • Credibility – Double-edged sword • Nontraditional perspectives – creativity, invention, problem-solving, cultural inclusion • Saboteurs Cast a wide net vs. focusing efforts

17. Challenges in Teaming Up Poll #2 Which of these challenges have you experienced in working with stakeholders and partners?

18. III How Do We Engage Stakeholders?

19. Five-Step Process for Engaging Stakeholders (RWJF, 2009)

20. 1. Prepare for Stakeholder Engagement • Have a plan for recruitment, participation, and exit • Beginner Plan – Need to identify and recruit a board/partners • Intermediate Plan – You have a board or a few partners but they are not stable or large enough for the amount of work • Advanced Plan – Have a functioning board, partners, workgroups, etc., just would like to improve working relations, efficiency and/or retention.

21. Stakeholder Engagement Plan • Identify structures, roles and processes • Identify representation needed • Allocate resources, assign responsibilities • Write down

22. Stakeholder Engagement Plan (cont’d.) Define and explain • Recruitment strategies and activities • Retention strategies and activities • Exit/repurposing strategies and activities

23. 2. Identify Potential Stakeholders • Community partnerships for evaluation (data collection activities, locating, and accessing existing data) • Populations that directly benefit (participatory research) • Engaging comparison groups who may help with evaluations • Evaluators (Connecting with universities, graduate students, contractors)

24. Who are the Stakeholders and Gatekeepers? • How to identify? Consider motives? • Natural fits • Unexpected surprises • Creating alliances • Changing regimes - do you have all key team members? Is there an exit strategy?

25. Who are some potential partners that you can think of?Traditional and Nontraditional Potential Partners

26. Gate Keepers: Captive Audience • People at meetings • People in restroom stalls • People getting other services (beauty salons, nail salons) • Waiting rooms (auto repair shop, lawyer office, cable television office, doctor office)

27. Think Outside the Box • Captive Audiences • Waiting rooms, restroom stalls, train, planes, subways, post offices • Heightened Sensitivity • Neighborhood clinics, emergency rooms, (shared experience) • Churches, funeral parlors, auto repair shops

28. Think Outside the Box (cont’d.) • Targeted Audiences (demographic) • Age group specific (music store, nursing home, army retail store) • Gender specific

29. 3. Prioritize the List of Stakeholders (U. Kansas, 2008)

30. Considerations • What does this stakeholder bring to the evaluation? • How important is their perspective for the evaluation? • Vital • Important • Nice (RWJF, 2009)

31. 4. Consider Potential Stakeholders’ Motivations for Participating • Commitment to program’s goals • Personal stake in the program • Professional benefit • Professional development • Networking opportunities • Financial considerations • May be in-kind (RWJF, 2009)

32. Describe Potential Stakeholders

33. 5. Select an Engagement Strategy Considerations • Stakeholders perspectives and relationships • Program characteristics • Logistical

34. Stakeholder Engagement Considerations & Techniques

35. Stakeholder Engagement Considerations & Techniques

36. IV What Will the Stakeholders Do?

37. CDC Framework for Program Evaluation in Public Health (U. Kansas, 2008)

38. Challenges in Teaming Up Poll How have stakeholders contributed to your evaluation?

39. Engage Stakeholders • Assist in recruiting other stakeholders • Provide input on engagement plan • Develop common understanding of expectations

40. Describe the Program • Develop (or review) logic model • Ensure agreement on • Program activities • Intended outcomes Outputs Inputs Short-term outcomes Intermediate outcomes Long-term outcomes Activities

41. Focus the Evaluation Design • Clarify evaluation purpose • Why are we doing this evaluation? • Agree on intended users and uses? • Who will use evaluation findings? How? • Assist in developing evaluation questions • What do we want to know? • Provide input on appropriate methods • How will we find out what we want to know?

42. Gather Credible Evidence • Review/provide input on data collection instruments • Literacy • Cultural appropriateness • Length • Assist in data collection process • Access to data or populations needed • Additional data collectors • Data collection decision rules

43. Justify Conclusions • Help interpret findings • Provide context for data • Understand meaning behind statistics/facts • Determine practical significance • Generate recommendations • Data driven • Understanding of program and context

44. Ensure Use and Share Lessons Learned • Stakeholders are evaluation users • Develop useful products for different audiences • Disseminate findings • May assist with distribution, marketing of results • Provide materials to relevant audiences • Communicate evaluation findings

45. Thankyou! Donna Dent CAPT Associate Coordinator Southeast STS Lead ddent@edc.org 678-954-5822 Sally Honeycutt, MPH Evaluation Consultant Evaluation Team Lead, Emory Prevention Research Center sallyhoneycutt@gmail.com 404-997-2410 Additional resources are listed in the handouts