HOW TO ENGAGE COMMUNITY MEMBERS IN OUTCOME EVALUATION?

1. HOW TO ENGAGE COMMUNITY MEMBERS IN OUTCOME EVALUATION? HSCI 825-3 – Spring 2013 Binod Sharma April 4th, 2013

2. Overview • Introduction of Community Engagement • Concept of Outcome Evaluation • Community Engagement Process • Factors Contributing to the Success • Limitations & Challenges • Summary

3. What is Community Engagement? • “It is a powerful vehicle for bringing about environmental and behavioral changes that will improve the health of the community and its members. It often involves partnerships and coalitions that help mobilize resources, influence systems, change relationships among partners, and serve as catalysts for changing policies, programs, and practices” (Fawcett et al., 1995).

4. Approaches of Community Engagement

5. What is Outcome Evaluation? • Skills, attitude and knowledge • Behavioral changes: quit smoking • Changes in individual conditions: health condition • Changes in social conditions: educational status • Institutional changes: policies or practices

6. Types of Evaluation 1. Formative Evaluation 2. Process Evaluation 3. Summative Evaluation

7. Summative Evaluation Short-term Outcomes: • Immediate changes in individuals’ or participants’ awareness, knowledge, or behavior • Its prediction of long-term outcomes? Long-term Outcomes: • Assess the larger impacts of a program on a community • Implement in the community?

8. Inputs Activities Short-term outcomes • Increase percentage of healthy eating student • Increased in health information sharing trend • Ongoing monitoring trend in eating behaviour of Students • Increase in evidence based interventions planning and evaluation. • Collaborate with local agencies • Management of require fund • Recruitment of manpower • Trained health professional • Conduct work shop and awareness campaigns • Encourage people to participate in social work • Conduct health related program • Supervise and monitor program • Ensure the participation of community member in each program • Provide regular feedback • Link existing data sources • Insure data security and confidence • Disseminate the program information Staffs • Student • Residents Data Sources • National data • Provincial data • Communal data Equipment • IT hardware and software • Lab • Questionnaire • Long-term outcomes • Positive changes in eating behavior and improve quality of life Others • Funding • Community support Program Logic Model Eating Behavior of Student in SFU

9. Outcome Evaluation Process • Clarify intentions and expectations • Define the project activity • Develop outcome indicators • Data collection(mail or self administration) • Analysis and reporting(tables, figures, videos, stories) • Disseminate the results • Useof results to inform future planning

10. Major Issues of Community Engagement • Trying to solve complex issues • Multiple social sectors are included in the process (i.e. government agencies, community members) • Identify local priorities rather than exclusive problems

11. Major Issues of Community Engagement (cont’d) • Consider more collaboration and social inclusion • Create vision and change • Sharing responsibilities and leaderships • Focus on empowerment and motivation • Avoid discrimination and injustice

12. Factors Contributing to the Success Environmental • History of collaboration in the community • Collaborating group • Favorable political and social climate Membership  • Mutual respect,understanding, and trust • Appropriate cross-section of members • Ability to compromise Process/Structure • Members feel ownership • Flexibility of collaborating group • Clear rules and guidelines

13. Factors Contributing to the Success (cont’d) Communication • Open and frequent interaction • Informal and formal channels of communications Purpose • Goals clear and realistic to all partners Resources • Sufficient funds • Skilled manpower

14. Benefits of Community Engagement • Improve target and effectiveness of services • Performance evaluation of agencies, organizations, and partnerships • Build community ownership, development, and leadership • Cooperative working and empowering community members • Take more responsibility for what is happening

15. Benefits of Community Engagement (cont’d) • Higher quality solution • Develop the positive attitude and build trust • Focus on social justice by ensuring a political, social and economic priority (equity) • Connect people and resources

16. Disseminating the Results • After analysis and interpretation the findings • Comparison data with baseline information, control group or sample population • Report should disseminate the information to the public • Make sure that all community members are participating • Maintain high levels of confidentiality.

17. Summary Summary • Encourage and empower the public • Make them more responsible • Increase collaboration and cooperation • Trends in information sharing habits • Improve quality of life

18. References: • http://www.theinnovationcenter.org/files/Reflect-and-Improve_Toolkit.pdf • http://www.qld.gov.au/web/community-engagement/guides-factsheets/people-disabilities/ • http://tamarackcommunity.ca/g3s11.html#top6CommunityEngagement • http://www.partnershipsforolderadults.org/resources/resource.aspx?resourceGUID=4bb867a0-888d-4997-b59d-03b1cbf2132b&sectionGUID=17e73f4e-b245-4e74-88dd-4664d83f42a • http://www.health.state.mn.us/communityeng/ • Fawcett, S. B., Paine-Andrews, A., Francisco, V. T., Schultz, J. A., Richter, K. P., Lewis, R. K., ... & Lopez, C. M. (1995). Using empowerment theory in collaborative partnerships for community health and development. American journal of community psychology, 23(5), 677-697. • http://www.cdc.gov/phppo/pce/part1.htm