330 likes | 460 Views
2011 Top to Bottom Ranking. Understanding How the Ranking is Calculated. Top to Bottom (TTB) Ranking.
E N D
2011 Top to Bottom Ranking Understanding How the Ranking is Calculated
Top to Bottom (TTB) Ranking • The statewide top-to-bottom ranking takes into account both student achievement on state tests and graduation rates. Student achievement on state tests is included in the statewide top to bottom ranking in the following three ways: • Achievement at the elementary, middle, and high school levels • Improvement in achievement over time • The largest achievement gap between two subgroups calculated based on the top scoring 30% of students versus the bottom scoring 30% of students
TTB Ranking • In addition to the achievement components, student graduation is included in the statewide top-to-bottom ranking for schools with a graduation rate in the two following ways: • Graduation Rate • Improvement in graduation rate over time
Who receives a ranking? Schools with 30 or more full academic year (FAY) students tested over the last two years in at least two state-tested content areas: • Mathematics • Reading • Science • Social Studies • Writing
Geographic Distribution of Top to Bottom Rankings
What is a Z-Score? Quick Reference for Z-Scores
Why do We Use Z Scores? • Z-scores are a standardized measure that helps you compare individual student (or school) data to the state average data (average scores across populations). • Z-scores allow us to “level the playing field” across grade levels and subjects • Each Z-score corresponds to a value in a normal distribution. A Z-Score will describe how much a value deviates from the mean.
Z-Score “Cheat Sheet” Student z-score = (Student Scale Score) – (Statewide average of scale scores) Standard Deviation of Scale Score School z-score= (School Value) – (Statewide average of that value) Standard deviation of that value Z Score Summary PowerPoint and Business Rules- http://www.michigan.gov/mde/0,4615,7-140-37818_56562---,00.html
Z-Score “Cheat Sheet” • Z-scores are centered around zero • Positive numbers mean the student or school is above the state average • Negative numbers mean the student or school is below the state average State Average …Worse than state average Better than state average…. 1 -3 -2 0 2 3 -1
Z-Score Examples • Your school has a z-score of 1.5. You are better than the state average. Z-score of 1.5 State Average …Worse than state average Better than state average…. 1 -3 -2 0 2 3 -1
Z-Score Examples • Your school has a z-score of .2. You are better than the state average, but not by a lot. Z-score of 0.2 Z-score of 1.5 State Average …Worse than state average Better than state average…. 1 -3 -2 0 2 3 -1
Z-Score Examples • Your school has a z-score of -2.0. You are very far below state average. Z-score of -2.0 Z-score of 0.2 Z-score of 1.5 State Average …Worse than state average Better than state average…. 1 -3 -2 0 2 3 -1
How Is the Top to Bottom Ranking Calculated • For grade 3-8 reading and mathematics Two-Year Average Standardized Student Scale (Z) Score School Achievement Z-Score 1/2 Two-Year Average Performance Level Change Index School Performance Level Change Z-Score Content Index Z-score School Content Area Index 1/4 Two-Year Average Bottom 30% - Top 30% Z-Score Gap School Achievement Gap Z-Score 1/4
Weighted Performance Level Change • A weighted composite of individual student performance level change is used to calculate improvement in grades 3-8 reading and mathematics • Rewards large improvements more heavily, rewards maintenance of proficiency if a student was already proficient
How Is the Top to Bottom Ranking Calculated • For science, social studies, writing, and grade 11 all tested subjects Two-Year Average Standardized Student Scale (Z) Score School Achievement Z-Score 1/2 Four-Year Achievement Trend Slope School Performance Achievement Trend Z-Score School Content Area Index Content Index Z-score 1/4 Two-Year Average Bottom 30% - Top 30% Z-Score Gap School Achievement Gap Z-Score 1/4
How Is the Top to Bottom Ranking Calculated • For graduation rate Two-Year Average Graduation Rate School Graduation Rate Z-Score 2/3 Four-Year Graduation Rate Trend Slope School Graduation Rate Trend Z-Score School Graduation Rate Index Grad Index Z-score 1/3
How Is the Top to Bottom Ranking Calculated • Calculating a four-year slope (e.g., graduation rate) • Plot the school’s graduation rate for the last four years • Plot a linear regression line through the points • Calculate the slope of the line (gives the school’s annual improvement rate)
How Is the Top to Bottom Ranking Calculated • Calculating a four-year slope (e.g., graduation rate) • Plot the school’s graduation rate for the last four years • Plot a linear regression line through the points • Calculate the slope of the line (gives the school’s annual improvement rate)
How Is the Top to Bottom Ranking Calculated • Calculating a four-year slope (e.g., graduation rate) • Plot the school’s graduation rate for the last four years • Plot a linear regression line through the points • Calculate the slope of the line (gives the school’s annual improvement rate) Slope = 2.3%
How Is the Top to Bottom Ranking Calculated • Calculating an overall ranking for a school with a graduation rate School Mathematics Std Index 18% School Reading Std Index 18% Overall Standardized School Index Overall School Percentile Rank School Science Std Index 18% School Social Studies Std Index 18% School Writing Std Index 18% School Graduation Rate Std Index 10%
How Is the Top to Bottom Ranking Calculated • Calculating an overall ranking for a school without a graduation rate School Mathematics Std Index 20% School Reading Std Index 20% Overall School Standardized Index Overall School Percentile Rank School Science Std Index 20% School Social Studies Std Index 20% School Writing Std Index 20%
How Is the Top to Bottom Ranking Calculated • Calculating an overall ranking for a school without a graduation rate and without a writing score School Mathematics Index 25% School Reading Index 25% Overall School Standardized Index Overall School Percentile Rank School Science Index 25% School Social Studies Index 25%
For elementary and middle schools • Michigan tests in the fall. • These fall tests reflect the learning of students in the previous school year. SY 2008-2009 SY 2009-2010 SY 2010-2011 Fall 2010 Testing Fall 2008 Testing Fall 2009 Testing Fall 2011 Testing
For High Schools • Michigan tests in the spring • The spring test (MME and MI-Access) measures what students have learned from grades 9, 10 and grade 11 prior to the MME testing.
What do the 2011 Rankings reflect? • For elementary/middle schools: • Performance on the MEAP and MI-Access tests in fall 2010 (which represents learning from school year 2009-2010) and before • For high schools: • Performance on the MME and MI-Access tests in spring 2011 (which represents learning from school year 2010-2011 prior to testing) and before.
When is performance in 2010-2011 measured? • For elementary/middle schools: • Fall 2010 MEAP & MI-Access • For high schools • Spring 2011 MME & MI-Access
When is performance in 2011-2012 measured? • For elementary/middle schools: • Fall 2011 MEAP, MI-Access & MEAP-Access • For high schools • Spring 2012 MME & MI-Access
How is this different From the PLA list? TTB vs PLA
TTB versus PLA • This list represents a ranking of all schools in the state of Michigan, using our preferred methodology developed in collaboration with many stakeholders. • MDE also published, according to state statute, a list of Persistently Lowest Achieving schools. This is the PLA list. • The PLA list of schools was generated by a set of federally-approved and required rules that differ from our Top to Bottom ranking.
Resources Available • Complete list of all schools and their ranking • Individual school look-up to see your school’s results • Overview presentation with voice over • FAQ • Business rules by which the rankings were calculated • Complete data file and validation file You can access these resources at: http://www.michigan.gov/baa Click on “Michigan Schools Top to Bottom Ranking” You can also request individual assistance by calling the Evaluation, Research and Accountability unit at 517-373-1342, or emailing mde-accountability@michigan.gov