Measuring Our Impact: Lessons from the Field

1. North Carolina DHHS Division of Social Services Measuring Our Impact: Lessons from the Field Verna P. Best, MSA Freeman Denton, MPA, NCRT NASCSP Annual Training Conference September 12, 2013 Phoenix, AZ

2. NC is SLIGHTLY Different “So let's be honest with ourselves and not take ourselves too serious, and never condemn the other fellow for doing what we are doing every day, only in a different way.” – Will Rogers • Primarily used to fund 8 Service Delivery Models (Self-Sufficiency, Employment, Housing, Education, Nutrition, Emergency Assistance, Information and Referral & Income Maintenance) • Limited use for Administrative Support of Other Programs • Discretionary restricted to Limited Purpose Agencies • Reserves 5% for CSBG Administration

3. Current Service Delivery System Basics • 35 Community Action Agencies • 4 Limited Purpose Agencies (Outcomes vary significantly) • 9 State Level Staff (1 ROMA NPtP Certified Trainer/3 In-Progress) • Active State Association(2 ROMA NPtP Certified Trainers/1 In-Progress)

4. Why the Self-Sufficiency Focus? Self-Sufficiency (comprehensive case management) • mobilizes CSBG funding for direct service provision to low-income families while also leveraging dollars with other agency and community resources. • Affords us a methodology to demonstrate • CSBG’s effectiveness of changing people’s • Scaled participant progress • Framework for creating meaningful collaborations/optimal partnerships • Usage for direct service provision not solely for administrative purposes

5. Eligibility & Standard Measures Eligibility based on 100% of the Federal Poverty Guidelines Standard Measures Performance: #of low-income families participating in comprehensive activities designed to remove them from poverty Efficiency: $per family participating in comprehensive activities designed to remove them from poverty Key Outcomes: • The number of low-income families rising above the poverty level • The average change in annual income per participant family • The number of participants obtaining employment • The number of jobs with medical benefits obtained • The participant average wage rate • The number of participants completing education/training programs • The number of participants securing standard housing • The number of participants provided emergency assistance

6. FY 2012-13 Self-Sufficiency Outcomes

7. The Not So Good Thing … No standard methodology to capture ROI to really make the numbers tell a more comprehensive and convincing story…

8. Federal and State Reporting(Methods for Data Collection and Measuring Outcomes) • Monthly Financials (includes performance objective) • Specific to CSBG funding • Quarterly Performance Reports • Specific to CSBG funding • Year-End Report of State Contracted Outcome • Specific to CSBG funding • CSBG-IS • Agency wide/ inclusive of all funding streams

9. Examining Impact • Context Matters • Monitoring and Verification • Timely and Consistent Guidance • ROMA Cycle vs. Numbers Only • Establishing Expected Achievement Rates (80%-120%) • Local, Regional and Statewide Considerations • Ask Questions • Tell the Story Simply

10. Past ROMA Efforts • ROMA Training for NC’s CSBG Sub-Grantees • 5 Certified NPtP ROMA Trainers • Development of AR4CA (Accountable Results for Community Action) • Regional Self-Sufficiency Seminars • Strengthened review and guidance for monitoring and reporting (CSBG-IS and state specific)

11. Current ROMA Efforts • 5 network staff became NPtP Certified in 2012 • Additional State and Association Staff Seeking NPtP Certification • OEO/NCCAA sponsored NPtP ROMA Certification • Performance Management vs. Performance Measurement • Engaged in Center of Excellence Efforts • Exploring Data Dashboards • Sound Management Practices vs. Reporting

12. Measuring Our Impact: Lessons from the Field North Carolina DHHS Division of Social Services Contact us…we would love to further explore our approach with you! Verna P. Best Verna.Best@dhhs.nc.gov 919-527-6251 Freeman Denton Freeman.Denton@dhhs.nc.gov 919-527-6254