Understanding Your Top from Your Bottom: A Guide to Michigan’s Accountability System

1. Understanding Your Top from Your Bottom: A Guide to Michigan’s Accountability System September 2013 Mitch Fowler fowlerm@calhounisd.org

2. Agenda Scorecard Overview Scorecard Components Top to Bottom Overview Understanding Z-Scores Z-Score Components

3. Outcomes Participants will: Identify Scorecard Components and Scoring Guidelines Complete an Audit to Identify Areas of Concern Understand Top to Bottom Components and Scoring Guidelines Complete a Top to Bottom Audit to Identify Areas of Concern Identify Resources from BAA (TTB Lookup Tool, BTO Look Up Tool, Focus Achievement Gap Tool)

4. Accountability Pre Assessment

5. Two Sides to Accountability

6. Scorecard Availability Available on BAA Secure Site Available on MI School Data (Public or Secure)

7. Scorecard

8. Scorecard Components Proficiency • Based on Annual Measurable Objectives • Must be at 85% Proficient by 2022 in ALL Areas and Subgroups Participation • Must Test 95% of Students Completion Rate • Graduation / Attendance Rate Other Factors • SIP / DIP • Educator Evaluations

9. Scorecard Components - Proficiency Annual Measurable Objectives (AMO)

10. Activity: Identifying AMOs

11. Scorecard Components - Proficiency AMO Example

12. Scorecard Components - Proficiency All Students made the 20.94% proficiency mark… 2 points. The Bottom 30% of students did not meet the 20.94% proficiency mark… 0 points.

13. Scorecard Components - Proficiency This is awesome!

14. Scorecard Components - Proficiency 1 = Top 30% 2 = Middle 40% 3 = Bottom 30%

15. Activity: Who are the Bottom 30%?

16. Scorecard Components - Proficiency Of the 33 proficient students, 18 were provisional… they received a 3.

17. Activity: Revealing Proficiency

18. Activity: Proficiency Audit

19. Scorecard Components - Participation 95% Tested!

20. Scorecard Components - Participation

21. Activity: Participation Audit

22. Scorecard Components – Completion Rate Completion Rate OR Attendance Rate

23. Activity: Completion Rate Audit

24. Scorecard Components – Other Factors

25. Activity: Other Factors Audit

26. Scorecard Decision Tree http://www.michigan.gov/documents/mde/ScorecardOverallColorDecisionTree_433459_7.pdf

27. Activity: Overall Color

28. Top to Bottom Availability Available via the BAA Look Up Tool • (On the BAA Website Here) Available on MI School Data (Public or Secure)

29. Top to Bottom Ranking Schools are compared to other schools in the state by utilizing z-scores (a statistical measure that describes how far you are from the middle of the pack). Z-scores that are positive, show that you are above the 50th percentile when compared to the state. Z-scores that are negative, show that you are below the 50th percentile when compared to the state.

30. Z-scores (Standard Deviations) State Average Z-score = Zero -1 -3 -2 1 2 3 0.5 -0.5 98% 84% 68% 32% 50% 16% 2% Percentile State Average Slide courtesy of Doug Greer, Ottawa ISD Z-scores are centered around zero or the “state average” Positive is ABOVE the state avg. Negative is BELOW the state avg.

31. Z-Score Structure • Overall Ranking • Subject Area • Z- scores • Subject Area • Sub Z-Scores • Weight • Achievement • 50% • Science • Improvement • 25% • Math • Achievement Gap • 25% • Reading • 33rd • Writing • Social Studies • Graduation

32. Top to Bottom Report (MI School Data) Subject Area Sub Z-Scores Overall Rank Subject Area Z-Scores

33. Accountability Labels (Priority, Focus, Reward) Achievement Gap z-score (Focus) Overall Rank (Priority or Reward) Top or Bottom 5%

34. Activity: Z Score Review

35. How Close to Focus Are We? Achievement Gap Z-Scores Focus Cut Off School’s Location http://www.michigan.gov/documents/mde/2013_Individual_School_Gap_Lookup_Tool_431296_7.xls

36. TTB Resources and Look Up Tools http://www.michigan.gov/mde/0,4615,7-140-22709_59490---,00.html

37. Accountability Post Assessment

38. Thank YouQuestions? Mitch Fowler School Data Consultant fowlerm@calhounisd.org