ADCANP/CTF HHS/OFA Partner Program Performance Measurement Training November 16, 2012

1. ADCANP/CTF HHS/OFA Partner Program Performance Measurement TrainingNovember 16, 2012 Debra Nelson-Gardell, Ph.D., LCSW M. Felicia Woerner, MA The University of Alabama School of Social Work

2. Overview of the Contract Structure • HHS/OFA • ICF International • DCAP/CTF • Partner Programs • University of Alabama School of Social Work Program Evaluation Team

3. UA Evaluation Project Mission • To support DCAP/CTF in the successful delivery of child abuse and neglect prevention services through an effective, efficient, and feasible data collection, management, analysis, and reporting system.

4. All data points listed are taken directly from the documents provided by ICF International for performance measurements purposes.

5. HHS/OFA Performance Measure Implementation • Two stages of implementation: • Stage 1 (complete) • Stage 2 (effective December 1)

6. HHS/OFA Performance Measure Implementation – Stage 1 • Additional client-level data: • Partner programs began collecting enrolled and completed dates if they had not already. • Additional agency-level data: • Several new data points were added and listed for all programs and for each authorized activity . This stage is complete.

7. HHS/OFA Performance Measure Implementation – Stage 2 • Additional client-level data: • New client demographic form (required) • New outcome instruments (required) • Drafts • Reduction in client-level data: • Contact hours, contact sessions, parental status • Reduction in agency-level data: • Number of children with special needs/disabilities served • Number of fathers temporarily or permanently unemployed This stage is effective December 1, 2012.

8. HHS/OFA Partner Program Performance Measurement Workbook • This workbook will be updated two weeks after today’s meeting. • Instruments attached are drafts. • User Guide will be available once website updates are complete. • The entire updated workbook will be emailed upon completion. • What’s in the workbook?

9. New Client & Agency Forms • Available the first week of January for the December 2012 monthly report • What will they look like? • HHS/OFA User Guide forthcoming

10. Important Definitions • Pre-test • Administered at intake or during first session/meeting • Post-test • Any instrument administered beyond the two week pre-test time-limit • Administered to clients at end of service delivery (as determined by your program) • Enrolled • Clients have completed intake process • Completed • Clients have completed core requirement as determined by program

11. Important Reminders • Due dates have changed! • Read the website User Guide. • It will save you time. • Supporting your ability to serve clients • It will save evaluation staff time. • Supporting timely report generation • Supporting potential website enhancements

12. Important Reminders • How do I know my program’s monthly report has been successfully submitted and received by the UA evaluation team? • The online forms tell you. • How do I make corrections? • Send email detailing needed corrections to dcapdata@ua.edu. • Include either your program’s contract number and/or agency ID.

13. Outcome Data Analysis • Your diligence in obtaining and entering data is crucial. • If enough data are not entered, we cannot do a meaningful analysis. • This affects the credibility of what ADCANP can claim regarding the effectiveness of its programs. • Your actions affect everyone!

14. We need your feedback! Please provide feedback on the 3 post-test drafts via email by November 26, 2012. (Don’t forget your program’s contract number or agency number)

15. Thank you! • Debra Nelson-Gardell, Principle Investigator • dnelsong@ua.edu • 205-348-2990 • M. Felicia Woerner, Project Manager • dcapdata@ua.edu • 205-348-8011 • This presentation will be available on the evaluation website in January 2013.