Using Implementation Data Effectively

1. Using Implementation Data Effectively Improving Systems, Practices, and Outcomes

2. Key Considerations Admire the solution, not the problem Solution Oriented Value team members time Capitalize on team member’s skills Maximize collective knowledge Ensure everyone leaves the meeting knowing their task Develop and monitor fidelity of implementation action plan Goal Focused

3. Using Data Effectively Requires • Clearly defined and used: • Data Team Roles & Responsibilities • Effective Team Meeting Process • Member with Strong facilitation skills • Knowledge and skills to use: • Rapid Cycle Problem Solving • Practice Policy Improvement Cycles • Easy access to data to set short and long term goals for change • Proximal and summative data • Decision Rules – Data your District will Use and Support • Implementation data • Capacity, training, coaching

4. Your Turn: Academic Data our District Will Use and Support • Decision Rules • Identify academic data your district will use and support • Summative • Distal

5. Academic Problem Statement & End of Year Goals • Clearly define academic problem statements • Clearly define academic end of year goals • Summative • Interim • 3. Display goals at every Implementation Team meeting MAP Our Coordinates

6. Summative Data – One time per year All and Some: Academic Problem Statement Percentage of Students who Met Proficiency in Math Percentage of Students who Met Proficiency in Math

7. Interim Data – Three times per year All and Some: Example: Academic Problem Statement Only 30% of third to fifth grade students are meeting benchmark reading fluency. . 30%Proficient

8. Interim Data – Three times per year All and Some: Example: Academic Problem Statement 50% of third to fifth grade students will meet benchmark reading fluency. 50% end of year goal

9. Example: Academic Problem Statement and Goal

10. Your Turn I. Academic Problem Statement and Goal • Clearly define academic problem statements • Clearly define academic end of year goals • Summative • Interim • 3. Display goals at every Implementation Team meeting Plan

11. Your Turn I. Academic Problem Statement and Goal

12. Plan for Implementation Close Implementation Gap Define Implementation Goals

13. II. Implementation Problem Statement & End of Year Goals • Clearly define implementation problem statements • Clearly define implementation end of year goals • 3. Display goals at every Implementation Team meeting Plan

14. II. Implementation Problem Statement and End of Year Goals • Examine Data and Ask Why • Investigate systems of support for school staff • Ask why is the problem is occurring? • Analyze fidelity data • Analyze capacity data • Analyze implementation data • Training, coaching, data use Plan

15. OTISS Example: We think it is becasue... Low fidelity in using effective instructional practices. 1.6 OTISS Goal

16. DBPA EXAMPLE: We think it is because… FA & SI Goal Leadership Training & Coaching Fidelity

17. Leadership Organization DCA EXAMPLE: We think it is because…. Competency

19. Example: Merge Academic and Implementation Problem Statement & Goal

20. Your Turn II. Implementation Problem Statement & End of Year Goals • Clearly define implementation problem statements • Clearly define implementation end of year goals • 3. Display goals at every Implementation Team meeting Plan

21. Your Turn II. Implementation Problem Statement & End of Year Goals • Examine Data and Ask Why • Investigate systems of support for school staff • Ask why is the problem is occurring? • Analyze fidelity data • Analyze capacity data • Analyze implementation data • Training, coaching, data use Plan

22. Your Turn Merge Academic and Implementation Problem Statement & Goal

23. Next Steps: How to Dig Deeper into Your Data We can’t do it all at once • How will teachers be supported? • How will BITs be supported? • Identify the next right steps • Develop Short Term Goals

24. District Supported Training Data • Training Effectiveness Data • Did we do what we said we would do? • Training Pre-Post Data • Did they learn it? • What follow-up training is needed? • Training Evaluation Data • What did the participants say? • Did we respond to their feedback?

25. EXAMPLE: Training Data Practice Profile Components Trained Screenshot compliments of KDE from their Data Dashboard

26. EXAMPLE: Training Data Pre – Post: Training Impact Data Screenshot compliments of KDE from their Data Dashboard

27. EXAMPLE: Training Data Training Efficacy or Evaluation Data Screenshot compliments of KDE from their Data Dashboard

28. EXAMPLE: Training Data Adult Learning Strategies Used in Training Screenshot compliments of KDE from their Data Dashboard

29. District Supported Coaching Data • Coaching Survey Data • Did we do what we said we would do? • Are teachers benefiting? • What follow-up training or coaching is needed? • Did we respond to teacher feedback? • Coaches Log • Are coaches coaching? • Coaches Needs Assessment • Are coaches supported?

30. EXAMPLE: Coaching Data • How are Coaches Spending their Time? • What percentage is spent in observation and modeling? Screenshot compliments of KDE from their Data Dashboard

31. EXAMPLE: Coaching Data What are teachers saying about the coaching they receive Based on the Coaching Practice Profile Components? Screenshot compliments of KDE from their Data Dashboard

32. Handout: Guiding Questions

33. Example: Identify Solutions

34. Act – Use PDSA Template

35. CELEBRATE PDSA Cycle again and again