1 / 16

ADCANP/CTF Program Evaluation: Grantee Training September 21 – 24, 2010 & September 29, 2010

ADCANP/CTF Program Evaluation: Grantee Training September 21 – 24, 2010 & September 29, 2010. Debra Nelson-Gardell, Ph.D., LCSW M. Felicia Woerner, MA The University of Alabama School of Social Work. Gone Through Any Changes Lately?. Changes to the Evaluation Project.

fern
Download Presentation

ADCANP/CTF Program Evaluation: Grantee Training September 21 – 24, 2010 & September 29, 2010

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript


  1. ADCANP/CTF Program Evaluation:Grantee TrainingSeptember 21 – 24, 2010&September 29, 2010 Debra Nelson-Gardell, Ph.D., LCSW M. Felicia Woerner, MA The University of Alabama School of Social Work

  2. Gone Through Any Changes Lately?

  3. Changes to the Evaluation Project • 2009-2010 Evaluation: Process Evaluation • 2010-2011 Enhancement: Outcome Evaluation • For client-level data • Parent-Focused & Home Visiting Programs • Protective Factors Survey • Respite Care Programs • Perceived Stress Scale • Child-Focused Programs • Custom Created Child-Focused Measures • Thank you to Child Abuse Prevention Services of Tuscaloosa for piloting!

  4. DCAP/CTF Overall Goal • Programs will work to decrease risk factors and increase protective factors related to child maltreatment. • Congruent with current, empirically supported, best practices • Same goal recommended for all programs • Implementation differs across program types • Goals by type of program are listed in the RFP

  5. Protective Factors • Nurturing and attachment • Knowledge of parenting and of child and youth development • Parental resilience • Social connections • Concrete supports for parents

  6. Risk Factors • Parent or caregiver factors • Personality characteristics/mental health • History of abuse • Substance abuse • Child rearing approaches • Teen parents • Family factors • Family structure • Domestic violence • Stressful life events • Child factors • Birth to age 3 • Disabilities • Environmental factors • Poverty and unemployment • Social isolation and social support • Violence in communities

  7. 2010-2011 Enhancements • Updates to client form • To decrease repetitiveness of data entry • Give more control over data • Provide clearer “saved” notifications • Increase efficiency through “Quick Facts” • Less data on agency form • Addition of outcome measures • scoring vs. entering responses • reduce burden • maintain data quality

  8. Pre- and Post-Test Instruments • Instruments were selected to maximize data quality when measuring objective attainment while minimizing instrumentation burden on clients and program staff. • Parent Focused & Home Visiting Program • Protective Factors Survey • Respite Care Programs • Perceived Stress Scale • Child-Focused Programs • Assessments of Prosocial and Self-Protective Behaviors • Kindergarten to 2nd grade • 3rd grade – 5th grade • 6th grade – 12th grade

  9. Orientation • Refer to email sent on Sept. 15th (available on website) • Location: “Outcome Instruments” tab on left side of webpage • Page contains instruments, User Manuals, and scoring guides (optional) • User Manuals provide general instructions • customize to your program’s specific needs • Optional scoring guides

  10. Special Instructions • Instruments are available at http://dcapdata.ua.edu • Do NOT download them from another source! • Instruments have been customized for CTF programs.

  11. Important Reminders • Use online forms template to make demographic sheet for clients to complete or for program staff to ask. • Race and ethnicity must be asked separately. • All clients must complete a post-test even if they do not complete a pre-test. • With time, this situation will “even out.”

  12. User Manual Overview • User Guide versus User Manuals • website versus instrument-related instructions • Administration Timing • Material preparation • instrument with client ID • consent if required • Templates need to be customized to your program. • demographic form if needed • Instrument Administration • Report of responses on website • Record for the reporting month the pre- or post-test was completed by client.

  13. Instrument Administration Highlights • PSS:Perceived Stress Scale • self-report, alone or in group setting • PFS:Protective Factors Survey • self-report, alone or in group setting • APSB:Assessment of Prosocial and Self-Protective Behaviors • Kindergarten • one-on-one or guided self-report with at least two adults (one to read items and one to guide) • 1st – 5th grade • self-report (adult reads items) • 6th – 12th grade • self-report, alone or in group setting

  14. Evaluation Website: FAQs & Reminders • How do I know my program’s data has been saved and received by the UA evaluation team? • How do I make corrections? • email needed corrections • include either your program’s contract number and/or agency ID • FAQs section forthcoming • This presentation is available for download under the “Additional Resources” link.

  15. Evaluation Data Reminders • Client form must be entered and finalized every month even if your program did not serve clients that month • exception: programs that are ONLY Public outreach & trainings • Agency form still must be completed every month • All reports submissions are now time stamped as well as date stamped.

  16. Thank you! • Debra Nelson-Gardell, Principle Investigator • dnelsong@ua.edu • 205-348-2990 • M. Felicia Woerner, Project Manager • dcapdata@ua.edu • 205-348-8011

More Related