Evaluating SPP/APR Improvement Activities

1. Evaluating SPP/APR Improvement Activities Presented by Jeanna Mullins, Mid-South Regional Resource Center, RRCP Document developed by members of the Systems and Improvement Planning Priority Team (NECTAC and RRCP)

2. Resource Document Highlights Content • Types of SPP/APR Improvement Activities • Selection and Review of Activities • Steps for Evaluation of Activities • Evaluation Scenarios

3. Poll Question • Have you reviewed the Evaluating SPP/APR Improvement Activities document?

4. Types of Improvement Activities • Improve data collection and reporting • Improve systems administration and monitoring • Build systems and infrastructures of technical assistance and support • Provide technical assistance/ training/professional development

5. Types of Improvement Activities • Clarify/examine/develop policies and procedures • Program Development • Collaboration/coordination • Evaluation • Increase/adjust FTE

6. Selection and Review of Improvement Activities • Root cause analysis? • Links between root cause, data, and proposed outcomes? • Evidence-based practices? • Address more than one indicator? • Identification of collaborative partners?

7. Selection and Review of Improvement Activities • Detailed action plan (tasks, person(s) responsible, resources needed, timelines) for each activity? • Short-term and long-term outcomes? • Data sources, collection, analyses, and reporting?

8. Poll Question • Do you have an evaluation plan for one or more of your SPP/APR improvement activities?

9. Steps for Evaluating Improvement Activities • Goal/Purpose • Questions • Process/Impact • Data Collection Methods

10. Steps for Evaluating Improvement Activities • Timelines • Data Analysis Methods • Use and Reporting of Results • Person(s) Responsible

11. Sample Improvement Activity Collaborate across State Part C and Section 619 agencies to clarify roles and responsibilities of local programs at the data collection point when the child exits Part C and enters Part B.

12. Collaboration Scenario Context • Missing data on C3/B7 • Local programs are unclear about when data should be collected and reported • Written policies and procedures are unclear, (e.g. roles and responsibilities of Part C v. 619) • All local staff have not been trained

13. Goal/Purpose Goal • To clarify roles and responsibilities of Part C and Section 619 Question • To what extent did the collaboration result in clear descriptions of roles and responsibilities of Part C and 619 staff?

14. Impact and Methods Impact: Outcome Evaluation Data Collection Method: Focused discussion with small group

15. Timelines and Data Analysis Timelines: Prior to the dissemination of revised policies and procedures and provision of training (Identify the specific timelines) Data Analysis: Baseline: Local programs report that roles and responsibilities are not clear.

16. Data Analysis Method • Notes/transcript from the reviewer discussion will be analyzed to determine whether or not roles and responsibilities for Part C and 619 are clear, and, if not, how they could be improved.

17. Data Use and Reporting • Feedback will help ensure written roles and responsibilities are clear. Will be incorporated into overall policies and procedures related to collecting and reporting outcomes data and into training.

18. Persons Responsible • Responsibilities: Part C and 619 staff will identify a set of local providers/program staff to participate in the review and discuss the reviewer feedback and implications for additional clarification needed regarding roles and responsibilities

19. Improvement Planning Resources RRCP SPP/APR Planning Calendar http://spp-apr-calendar.rrfcnetwork.org/explorer/view/id/650?2#category2 • Evaluating SPP/APR Improvement Activities • NCRRC SPP/APR Improvement Activity Review Form • State Systems Self-Assessment and Planning Guide • Using the SPP/APR as a Management Tool

20. Questions, Comments, Ideas • What are your thoughts?