380 likes | 535 Views
Custom Reports: SCGs and VCGs. Standard Comparison Group (SCG). What is an SCG?. Custom Report Evaluates your students’ observed growth against normative group Same grade & initial score Same number of instructional weeks
E N D
What is an SCG? • Custom Report • Evaluates your students’ observed growth against normative group • Same grade & initial score • Same number of instructional weeks • Allows you to compare growth patterns across different groups of students
Digging Deeper into Growth Data • Regular reports give you high level view of growth data • SCGs break growth data down for deeper analysis • Pivot tables allow you to sort data by • Gender • Ethnicity • School • Subject
SCG Reports • Six Pivot Reports: • Growth by Achievement • Growth by School • Growth by Subgroup (ethnicity) • Growth Figure (bar graph) • Testing Conditions • Testing Conditions & Growth Reports are best used in relation to a research question that needs to be answered with data.
Using Questions to Guide Data Collection Dylan Wiliam calls it: “Question-driven data collection.” Not…. “Data-driven decision-making.”
Questions to Drive the Data • Tab: Growth by Achievement • Question: How did our kids grow in various percentile ranges of achievement compared to other kids with similar scores and similar amounts of instructional time? • Or, “Are our high-achieving students growing as much as our low-achieving students?”
Filter your Data • Filters help administrators to dig into the data
Questions to Drive the Data • Tab “Growth By School” • Question: How did students in my building grow compared to other students nationally by grade, and with similar amounts of instructional time?
Questions to Drive the Data • Tab “Growth By Ethnicity” • Question: Which subgroups of students grew average or above average compared to other subgroups nationally that had the similar scores and similar amounts of instructional time?
Growth by Ethnicity District Data: Filters always available:
Questions to Drive the Data • Tab “Growth Figure” • Question: What was the observed actual growth of our students compared to students nationally that had similar scores and instructional time?
Questions to Drive the Data • Tab “Testing Conditions” • Shows the percentages of students within each school whose MAP assessments triggered one or more “flags” • Indicates that the student was not fully engaged when taking the assessment • Low accuracy = significantly less than 50% correct (higher SEM) • Short duration = little time on test • Unusual time increase/decrease = differences between fall to spring test duration
Questions to Drive the Data • Tab “Testing Conditions” • Question: Throughout the district, are there any flags related to testing conditions that might be cause for further investigation?
Questions to Drive the Data • Tab – “Testing Conditions & Growth” • Question – What impact did low accuracy and short test duration have on the growth rates of these students?
Pricing and Support • 30¢ per student • $1,000 minimum • Includes one hour of live online support
Virtual Comparison Group (VCG)
That’s great, but… • Since my students and my school aren’t typical, how can you expect my students to make typical progress? • Need an apples to apples comparison • A proof point to demonstrate what is possible
What is a VCG? • Custom Report • Evaluates individual students’ observed growth against a virtual comparison group • Same grade & initial score • Same number of instructional weeks • Similar F/R eligibility • Same urban/rural classification
What is a VCG? • One step further…. • We apply the filters to create a group that matches each of your students • Virtual Comparison Group = virtual peer group
How we create a VCG We identify included students Identify all matching students from GRD School Income, Urban vs. Rural Classification Grade, Subject, Starting Achievement, Instructional Weeks Randomly select comparison group
What do you get? • Class Reports • Includes questions to guide interpretation • School Reports • District Reports with pivot tables
Class Report Questions to guide interpretation
School Report 8th Grade 6th Grade 7th Grade
Pivot Tables • Growth by Achievement • Growth by School • Growth by Ethnicity • Testing Conditions and Growth • Hybrid Success Metric • VCG & Hybrid Growth
Hybrid Success Metric • Hybrid Success Goal • For students above state proficiency target = average growth from norming study • For students below state proficiency target = amount of growth needed to be proficient by 10th grade
Pricing and Support • 90¢ per student • $1,500 minimum • Includes two hours of live online support