Falling in Love with Data

1. Falling in Love with Data Creating Organizational Systems and Buy-In for Effective Program Evaluation Presented by Gayle Villani & Olivia Núñez, the GO Project

2. Today’s Agenda • Welcome and Introductions   • Program Evaluation Diagnostic Exercise • Organizational Showcase: GO Project •  Shifting the Culture: Small Group Exercise   • Q & A

3. Program Evaluation Diagnostic List the data systems & tools that exist in your organization for analysis:

4. Questions to Consider • How are metrics assessed throughout the program? (i.e., what are the tools used to measure progress towards program/organizational goals?) • How frequently is your team having conversations about program data?  • How is your team expected to prepare for these program data conversations?  • What happens after the data conversations? • How does the team or individual staff use the data to make decisions, identify program refinement areas, or innovate?  • Are there signs of resistance?

5. THEORY OF CHANGE GO PROJECT VISIONThe GO Project aims to close the achievement gap for all under-resourced families who have children that are struggling in their New York City public school. • COMMUNITY • BUILDING • By building long-term public and private partnerships within a defined geographic area we are able to secure necessary resources critical to program implementation. Our model relies heavily on volunteerism, community collaboration and strong family engagement. We foster healthy and responsive relationships with all stakeholders to integrate community support, educational resources, and cultural exchange. • Stakeholders Include: • Independent Schools • Public Schools • Community Partners • Volunteers • Higher Ed Institutions • Families • Children • EARLY & CONTINUOUS • INTERVENTION • Early intervention • Sustained participation • Year round, intensive services • IMPACT • 1. Academic Outcomes • Increased proficiency on standardized test scores • Summer learning gains • On time/ advantageous school matriculation • Proficient Report Card Grades • Enrollment in “good” Middle School/High School • Increased academic time on task • 2. Social-Emotional Outcomes • Strong engagement with learning • Increased confidence • Positive personal/social development • Productive classroom behavior • Strong peer relationships • 3. Family Support Outcomes • Strengthened advocacy skills • Increase access/ utilization of opportunities and resources • Strong parent collaboration with GO Project OUR UNIQUE APPROACH Strategically designed to serve UNDER-RESOURCED families with children who are UNDER-PERFORMING in schools that are UNDER-SERVED; our approach addresses the comprehensive needs of students who are struggling at the earliest stage of their academic career through year-round innovative, holistic and individualized educational programming. • RESPONSIVE & • INDIVIDUALIZED • INSTRUCTION • Academic skill-building • Individualized Instruction • Differentiated group instruction • Low student to adult ratios • Experienced, committed and Certified teachers • HOLISTIC & INTEGRATED • PROGRAMMING • Social emotional skill-building tied to academic learning • Comprehensive student and family needs assessment • Whole system involvement • Accessible family support services

6. Impact Sheet

7. Monthly Snapshot

8. From Snapshot to Strategy Implementation All Program Staff Should… Have “Data Analysis” as a weekly item on their supervision agendas Have weekly conversations about one critical area of analysis to address from monthly snapshots

9. Data GO Collects

10. Challenges Getting the Team On-board and the Process Moving • Resistance to new systems • Not understanding the purpose of analysis • Confusing data for analysis and evaluation • Different levels of understanding or expertise • Missing deadlines • Collecting the wrong data • Errors in calculation

11. Best Practices Setting a Gold Standard • Backward planning with team • Codified processes-from implementation to analysis • Streamlined agendas • Directives • “Data buddy” system • Involving all team members in the process • Establishing different levels of conversation • Making decisions based on analysis and evaluation

12. Strategies for Buy-In • Establish an “onboarding” process • Provide training • Create ongoing dialogue • Make sure everyone understands their role • Demonstrate the value of the process • Stick to the plan • Celebrate innovation

13. Different Kinds of Evaluations Free Management Library, Program Evaluations Guide

14. Questions? Stay in touch! Gayle Villani Associate Executive Director gvillani@goprojectnyc.org Olivia Núñez Director of Community Engagement onunez@goprojectnyc.org

15. Resources • Boulmetis, J. & Dutwin, P. (2011). The ABCs of Evaluation: Timeless Techniques for Program and Project Managers, 3rd Edition. • Colby, S and N. Stone, P. Carter, “Zeroing in on impact in an era of declining resources, non-profits need to clarify their intended impact” Stanford Social Innovation Review (Fall 2004):24 – 33. • Fund for the City of New York: Demystifying Outcomes Brief • Harvard Family Research Project • PASE, Afterschool Youth Outcomes Inventory • The GO Project: www.goprojectnyc.org