ADCANP/CTF Program Evaluation: RFP Training April 4, 2011

1. ADCANP/CTF Program Evaluation:RFP TrainingApril 4, 2011 M. Felicia Woerner, MA Debra Nelson-Gardell, Ph.D., LCSW The University of Alabama School of Social Work

2. ADCANP Overall Goal • Programs will work to decrease risk factors and increase protective factors related to child maltreatment. • Congruent with current, empirically supported, best practices • Same goal recommended for all programs • Implementation differs across program types

3. Protective Factors • Nurturing and attachment • Knowledge of parenting and of child and youth development • Parental resilience • Social connections • Concrete supports for parents

4. Risk Factors • Parent or caregiver factors • Personality characteristics/mental health • History of abuse • Substance abuse • Child rearing approaches • Teen parents • Family factors • Family structure • Domestic violence • Stressful life events • Child factors • Birth to age 3 • Disabilities • Environmental factors • Poverty and unemployment • Social isolation and social support • Violence in communities

5. Parent Education/Support and/or Home Visitation Program – Objectives • Programs will: • develop parents’ knowledge and skills in responding to the various types of maltreatment (physical abuse, emotional abuse, sexual abuse, neglect). • develop parents’ abilities to manage their own emotional responses and identify their own risk for maltreatment of their own children. • develop parents’ knowledge of community resources. • develop parents’ knowledge and skills around developmentally appropriate practices for nurturing their children and managing child misbehavior.

6. Public Awareness and Training Programs – Objectives • Public Awareness and Training Programs will: • Increase knowledge about the respective issue. • Increase knowledge about how to respond to the respective issue.

7. Abusive Head Injury Prevention – Objectives • Each public awareness training program will: • Increase knowledge about consequences of Abusive Head Injury (Shaken Baby Syndrome). • Increase knowledge about infant crying (#1 Trigger for Shaking). • Increase knowledge of ways to sooth babies. • Increase knowledge of ways to handle frustration.

8. Mandatory Reporter Training – Objectives • Each public awareness training program will: • Increase participants’ awareness of mandatory reporters’ legal responsibilities in reporting suspected child abuse and neglect. • Increase participants’ knowledge about physical and behavioral indicators commonly associated with child abuse and neglect. • Increase participants’ knowledge of how to report abuse and neglect.

9. Internet/On-line Safety Training - Objectives • Each public awareness training program will: • Increase knowledge about internet/on-line risks for children and teens. • Increase knowledge of how adults’ can help protect children and teens from internet-related personal safety hazards.

10. Respite Care Program – Objectives • Each public awareness training program will: • Reduce caregiver(s) stress

11. Child Focused Program – Objectives (includes School-Based, After-School/Non-School Based, and Mentoring Programs) • Programs will: • Increase participants’ knowledge about identification of feelings in self and others • Increase participants’ abilities to choose prosocial behaviors rather than risky behaviors • Increase participants’ knowledge about physical and emotional safety • Increase participants’ knowledge of how to report risk of harm (i.e., bullying, child abuse and neglect, cyberbullying and internet exploitation)

12. Our Mission as Program Evaluators • Our mission is to support DCAP/CTF in the successful delivery of child abuse and neglect prevention services through an effective, efficient, and feasible data collection, management, analysis, and reporting system.

13. UA Evaluation • Process and Outcome Evaluation • Process Evaluation: Describe clients and clients • Outcome Evaluation: Measure change • Monthly Online Reporting • 2011-2012 Target Data Form in RFP gives a broad overview of data collected. Specific data points will be emailed after grants are awarded. • client-level data (demographics, pre- and post-tests, etc.) • agency-level data • Pre- and Post-Testing of Objective Attainment (described in the following slides) • Instruments selected to maximize data quality while minimizing instrumentation burden. • Training on the data entry system will be provided after grants are awarded (through User Guide as well as phone and e-mail contacts).

14. Outcome Instruments • Parent Focused & Home Visiting Program • Protective Factors Survey (PFS) • Respite Care Programs • Perceived Stress Scale (PSS) • Child-Focused Programs • Assessments for Prosocial and Self-Protective Behaviors (APSB) – customized for CTF programs • Kindergarten to 2nd Grade • 3rd Grade to 5th Grade • 6th Grade to 12th Grade

15. A Quick Tour of UA Evaluation Website • Website: http://dcapdata.ua.edu • Two forms for monthly data entry: • Client Form (3 components) • Agency Form

16. CTF Program Evaluation Website – Login Page

17. Client Form Excerpt (main window)

18. Client Form Excerpt (Add Client window)

19. Client Form Excerpt (PFS pre-/post-test window)

20. Agency Form Excerpt

21. UA Reports • monthly reports to DCAP/CTF • six-month executive summary reports to DCAP/CTF and grantees for their use • annual report to DCAP/CTF

22. Reminder – Finalizing Monthly Reports There are confirmation messages at the bottom of both online forms that allow you to immediately determine if your program's data was or was not received. NOTE – For the client form: Check the active and inactive section headings to make sure you are working on the correct month. For the agency form: Select the correct month from the drop-down menu. • Enter data into the online form. • When finished, click on the "FINALIZE MONTH" button. • Do you see a message in green stating that the form has been successfully finalize? • YES. Your program's data has been successfully submitted without any problems and is considered on time if done before your program’s due date. • NO. Check the “Save/Error” box. If errors are indicated there, follow the instructions to locate and correct those errors. Return to Number 2, and continue repeating the process until the green confirmation message appears at the bottom. If you see a message in red that states that the form is not finalized and the due date has passed, then your report will be considered late.

23. Thank you! Questions? • M. Felicia Woerner, Project Manager • dcapdata@ua.edu • mfwoerner@ua.edu • 205-348-8011 • Debra Nelson-Gardell, Principle Investigator • dnelsong@ua.edu • 205-348-2990 This presentation is available at http://dcapdata.ua.edu under the Additional Resources tab.