Data Evaluation and Tools for Measuring Collective Impact

1. Data Evaluation and Tools for Measuring Collective Impact Christine Murray, UNC Greensboro Cindy Fraga Rizo, UNC Chapel Hill Tonya VanDeinse, UNC Chapel Hill

2. Presentation Overview • Data & Evaluation Strategies of the Guilford County Family Justice Center – Christine • Developing a Shared Vision and Agenda for FJC Research and Evaluation in NC – Cindy and Tonya • Questions & Discussion of FJC Data & Evaluation Trends Across NC – Group Discussion

3. Data & Evaluation Strategies of the Guilford County Family Justice Center

4. Data & Evaluation Strategies of the Guilford County Family Justice Center • Data collection began before the Greensboro FJC opened in 2015 • Ongoing data collection strategies include the following: • Tracking client data (FJC Data Dashboard) and other FJC statistics (e.g., volunteer hours and community outreach) • Annual community-level data provided by partner organizations • Annual survey of frontline professionals • Annual/bi-annual week-long census • Unique opportunities with the 2nd FJC location opening in High Point in 2018 • Compile data in annual reports

5. Sharing our Resources

6. Toolkit Overview • Available online at http://www.christinemurray.info/violence--abuse-resources.html • Professional Survey: • Demographic & professional questionnaire • Rating statements about perceptions of the community’s responses to violence & abuse, the effectiveness of the FJC, and professional burnout • Open-ended questions • Can be done electronically or via paper • Should be anonymous • Partner Annual Organizational Data: • Data request email template • Sample types of data to request from different types of partners (e.g., law enforcement, SANE program, FJC, DV agency, CPS) • Annual Week-Long Census: • Templates for different types of agencies to track data during the census week • More specific information, such as time spent assisting clients and outcomes of court data

7. Developing a shared vision and agenda for FJC research and evaluation in North Carolina

8. Summit Background Pre-Summit Summit • Listening sessions with FJCs and co-location agencies during the summer of 2018 • Discussion with the Alliance for Hope • Participating counties included: Alamance, Avery/Watauga, Buncombe, Durham, Forsyth, Guilford, Mecklenburg, Rockingham, Wake • Brainstorm evaluation needs, assets, and priorities

9. Summit Priorities Pre-development/Development and Planning of FJC • Understand and learn from data collection and monitoring methods used by other agencies • Identify what local communities want to accomplish (i.e., identify outcomes) • Identify what data points are needed to document the need for FJCs

10. Summit Priorities Implementation (early and later stages) • Enhance state-level support and understanding of the FJC framework and model • Focus on sustainability and funding over time • Identify outcomes to be tracked across various levels (clients, systems, communities, existing data) – e.g., Guiding Principals Logic Model • Collective impact

11. Summary of Summit Findings and Conclusions • Challenges related to current evaluation practices make it difficult to translate findings into programmatic decisions • Reporting to many funders • No standards or benchmarks for comparison • Variation in definitions and terms • Integrating data from partners • Etc.

12. Summary of Summit Findings and Conclusions • Some FJCs in NC (e.g., Buncombe and Guilford) have robust program monitoring/evaluation capacity • Consider building on these efforts to generalize to other counties • Collaboration is key and sustainable solutions are needed: • Current approach to technical assistance and the need for a more sustainable model

13. Discussion • Initial reactions? • Is there anything missing? • How do you see your role in research and evaluation?

14. Moving Forward • Subcommittee of the Research and Evaluation Summit tasked with moving forward on these priorities • How should this group engage others? • How, when, and where should this group report out?

15. Overall Questions & Discussion of FJC Data & Evaluation Trends Across NC