330 likes | 532 Views
Richland School District 2013 EOY Gains Analysis. Data reflects implementation by 7/16/13 export. Analysis Contents. Section 1 Executive Summary Section 2 READ 180 Student Performance Results Section 3 System 44 Student Performance Results Section 4 Appendix. Executive Summary.
E N D
Richland School District2013 EOY Gains Analysis Data reflects implementation by 7/16/13 export
Analysis Contents • Section 1Executive Summary • Section 2 READ 180 Student Performance Results • Section 3 System 44 Student Performance Results • Section 4 Appendix Prepared by Scholastic Data Analytics
Executive Summary Program Implementation During the 2012-2013 school year, the district implemented both READ 180 and System 44 across 6 schools throughout the district. • READ 180 was implemented daily for 90 minutes • System 44 was implemented daily for 60 minutes in a stand-alone classroom setting • System 44 was implemented daily for 90 minutes in a mixed-model classroom setting Indicators of Success • 303 of 504 (60%) of READ 180 students demonstrated at least one year’s reading growth on SRI • Of those students, 178 (35%) demonstrated at least two years’ reading growth on SRI • 29 of 104 (28%) of System 44 students demonstrated at least one year’s growth on SRI • 45 of 82 (55%) of System 44 students demonstrated at least one year’s growth on SPI Fluency Items For Further Discussion • Average READ 180 software usage was 102sessions with 16 Segments completed. • Average System 44 software usage was 90sessions with 60 Topics completed. • Recommended session length is 16-20 minutes; average session length was 18minutesfor READ 180 and 17minutes for System 44. • Students with more consistent software usage in both READ 180 and System 44 demonstrated higher post-test Lexile scores. Prepared by Scholastic Data Analytics
Data Included in Analysis Richland School District’s Gains Analysis includes student results from 8/28/12 to 6/6/13. To be included in the analysis, student records must: • Include at least 20 sessions (days) of software usage • Include at least two SRI tests, administered at least 6 weeks apart (READ 180 & System 44) • Include at least two SPI tests, administered at least 6 weeks apart (System 44) To promote effective data analysis through SAM reports and gains analysis, Scholastic recommends: • Regularly updating SAM rosters to reflect current student enrollment • Establishing, communicating, and monitoring district SRI testing windows Prepared by Scholastic Data Analytics
SRI Growth Expectations • SRI can be used to set reading goals and to evaluate students’ responsiveness to instruction by evaluating fall-to-spring growth expectations. • Monitoring growth helps educators to determine if students are on track to meet state and federal achievement standards. • The graph below illustrates the difference in Lexile scores for typical 7th grade students with various Lexile measures; data illustrates national norms – does not reflect students in the district. • Expected growth can be determined by fall SRI Lexile; for more on using fall Lexiles to set growth goals consult the professional paper Growth Expectations – Setting Achievable Goals Prepared by Scholastic Data Analytics
Student Level Expected Gains READ 180 & System 44 Mean Lexiles by Grade READ 180 Students System 44 Students In previous years, Scholastic set forth recommended growth of 140L, 70L and 50L for Elementary, Middle and High School students (resp.). These metrics were based upon an assumption students were operating near the 25th percentile (READ 180) or 5th percentile (System 44). Recently, Scholastic partnered with Meta Metrics Inc. to determine growth expectations based upon students’ grade levels and initial SRI Lexile scores. Gains Analyses now compare student performance to their individual potential growth rather than aggregate metrics at the school or grade level. The mean value of students’ initial Lexile percentile and mean value of students’ expected growth is above; expected growth may vary. Prepared by Scholastic Data Analytics
READ 180 Super Stars Data indicate 244 READ 180 Super Stars with evidence of both strong participation and Lexile Gains. The top 10 are shown above. To reach “Reading Super Star” status, students must have: • Include at least 40 sessions (days) of software usage • Between1 and 4 year’s approximate grade level growth • Pre-Test SRI Lexile score of over 100L. Prepared by Scholastic Data Analytics
SRI Reading Gains READ 180 Mean Lexile Gains by Site Scholastic recommends that READ 180 students complete the SRI four times a year for screening, progress monitoring, and instructional decision-making. Students included in this analysis completed at least two SRI tests. Strongest results are typically achieved when students participate in the READ 180 Instructional Model daily and when care is taken to ensure a positive testing environment. Compare results between midyear and end-of-year and between schools to spotlight successes and identify areas that need additional focus. Review the SRI Growth Summary Report for more information. Prepared by Scholastic Data Analytics
READ 180 Software Progress ResultsSegment Completion Analysis Research indicates that maximum student learning gains are achieved when students participate in the READ 180 Instructional Software daily. In each Software Segment, students are expected to complete learning activities from five zones—Reading, Word, Spelling, Success, and Writing. Typically, students should complete a Segment within five to fifteen days (or Sessions) of usage. Review results above to determine overall software usage and completion, and compare those results against student SRI reading gains. Use SAM data from the READ 180 Results Summary Report to identify areas for continued focus. Prepared by Scholastic Data Analytics
READ 180 Results by SchoolSRI and Software Results Results typically indicate a correlation between Software usage and reading growth. Use the chart below to track daily Software usage and compare against student SRI growth. When reviewing SRI growth, it is important to consider the average initial Lexile, as growth expectations vary based on initial Lexile. The approximate grade level growth column provides an average growth rate for the school based on individual growth expectations for each student, values color-coded low to high. Review the weeks between SRI tests to ensure all schools are testing within established testing windows. For Software usage, compare total sessions (days of usage) across all schools. On a standard 90-minute daily model, schools should strive for at least 100 sessions of usage. Average session length should be between 15-19 minutes. Review results to identify successes and areas that may need additional focus. Use the READ 180 Results Summary Report for more information. Prepared by Scholastic Data Analytics
Lexile Performance LevelsChanges in READ 180 Student SRI Performance Results indicate how many students had SRI scores aligned to Lexile Performance Levels; levels indicated are aligned to state assessment performance levels when state assessment alignments were available. Results are positive when lower, non-proficient reader populations decline and higher, proficient reader populations increase. Lexile performance bands used in this analysis can be found in Appendix. Prepared by Scholastic Data Analytics
System 44 Student Performance Results Prepared by Scholastic Data Analytics
SPI Proficiency ResultsSystem 44 Student Decoding Status Scholastic recommends that System 44 students complete the SPI three times a year for screening and progress monitoring. Students included in this analysis completed at least two SPI tests. Students should be moving into higher levels of decoding as they progress through the program. Strongest results are typically achieved when students participate in the System 44 Instructional Model daily and when care is taken to ensure a positive testing environment. Compare results between pre-test and post-test to spotlight successes and identify areas that need additional focus. Review the SPI Summary Progress Report for more information. Prepared by Scholastic Data Analytics
SRI Proficiency ResultsChanges in System 44 Student SRI Performance Scholastic recommends that System 44 students complete the SRI twice a year for screening and progress monitoring. Students included in this analysis completed at least two SRI tests at least 6 weeks apart. Results are positive when lower, non-proficient reader populations decline and higher, proficient reader populations increase. Students with low-level phonemic awareness likely are operating under the SRI Lexile scale. Lexile performance bands used in this analysis can be found in Appendix. Prepared by Scholastic Data Analytics
System 44 Software Progress ResultsSeries Completion Analysis Research indicates that maximum student learning gains are achieved when students participate in the System 44 Instructional Software daily. In each Software Series, students are expected to complete learning activities, called Topics, from four strands—Code, Word Strategies, Sight Words, and Success. Students who do not pass the progress monitor for a topic are cycled through the Topic again with new content, while students who pass the fast-track pre-test can skip topics. Review results above to determine overall software usage and completion, and compare those results against student SRI reading gains. Prepared by Scholastic Data Analytics
System 44 Software Progress ResultsSoftware Topic Completion Analysis Research indicates that maximum student learning gains are achieved when students participate in the System 44 Instructional Software daily. In each Software Series, students are expected to complete learning activities, called Topics, from four strands—Code, Word Strategies, Sight Words, and Success. Students who do not pass the progress monitor for a Topic are cycled through the Topic again with new content, while students who pass the fast-track pre-test can skip topics. Review results above to determine overall software usage and completion. Review the System 44 Response to Intervention Summary Report for more information. Prepared by Scholastic Data Analytics
System 44 Results by SchoolSoftware Participation and Completion Use the chart below to track student participation in System 44 by school. On a standard daily implementation of System 44, schools should strive for 100 sessions of usage. In the standard implementation model, students should participate in the Software daily for 15-19 minutes each day (or session). Regular use of software helps students complete the Topics more quickly; when all 160 Topics have been completed, the student is ready to exit System 44. Review the results below to identify successes and schools that may need additional support. Use the System 44 Response to Intervention Summary Report for more information. Prepared by Scholastic Data Analytics
Implementation Recommendations • Recognize the achievement of classrooms with strong results and take steps to replicate those results in other classrooms. • Review results with schools/classes who did not achieve at least one year’s growth or who had a significant number of students below 20 sessions (coded yellow or red on gains analysis report). • Continue to support teachers with SRI retesting procedures. • Examine enrollment to ensure maximum license usage andimpact on student achievement. • Continue building capacity of leadership with ongoing training and in-school support. • Provide ongoing training for both novice and experience teachers. • Provide monthly coaching to novice teachers and a minimum of quarterly coachingfor experienced teachers. Prepared by Scholastic Data Analytics
Appendix Prepared by Scholastic Data Analytics
Scholastic SRI Proficiency BandsLexile Grade-Level Performance Bands Lexile performance levels as determined by Meta Metrics, Inc. Prepared by Scholastic Data Analytics
SAM AYP Sub-Group Gains AnalysisResults by SAM Sub-Groups by Program READ 180 Students System 44 Students Prepared by Scholastic Data Analytics
READ 180 Student Record AnalysisData Inclusion Process by School Prepared by Scholastic Data Analytics
READ 180 Results by ClassSRI and Software Results Class data in exports may reflect non-READ 180 classes. Accuracy of exported data is dependent upon clean SAM database. If inaccurate classes appear, examine SAM to clean up enrollment. Classes below reflect READ 180-aligned class when available and global class alignment (selected alphabetically from many) when no READ 180 class alignment exists for records. Prepared by Scholastic Data Analytics
READ 180 Results by ClassSRI and Software Results Class data in exports may reflect non-READ 180 classes. Accuracy of exported data is dependent upon clean SAM database. If inaccurate classes appear, examine SAM to clean up enrollment. Classes below reflect READ 180-aligned class when available and global class alignment (selected alphabetically from many) when no READ 180 class alignment exists for records. Prepared by Scholastic Data Analytics
READ 180 Results by ClassSRI and Software Results Class data in exports may reflect non-READ 180 classes. Accuracy of exported data is dependent upon clean SAM database. If inaccurate classes appear, examine SAM to clean up enrollment. Classes below reflect READ 180-aligned class when available and global class alignment (selected alphabetically from many) when no READ 180 class alignment exists for records. Prepared by Scholastic Data Analytics
READ 180 Snapshot ReportSoftware Use for All Students with 1+ Session Prepared by Scholastic Data Analytics
System 44 Student Record AnalysisData Inclusion Process by School Prepared by Scholastic Data Analytics
System 44 SPI Gains AnalysisSPI Metrics by School Prepared by Scholastic Data Analytics
System 44 SRI Gains AnalysisSRI Metrics by School Prepared by Scholastic Data Analytics
SRI Data & Placement Recommendations Students will gain the most Lexiles when placed in the appropriate reading intervention tier. Students with BR (0-100L) SRI could have reading skills too low for SRI to measure or poor motivation. Students with low Lexile scores (0-400L) could have gaps in decoding skills that would only become apparent with a phonemic awareness assessment such as SPI. Students with SRI scores under 400L (grades 3 to 5) or under 600L (grades 6 to 12) should most likely be in Tier 3 intervention. Students with proficient SRI scores most likely need Tier 1 intervention. Prepared by Scholastic Data Analytics