1 / 11

Actions Following Disruption and Discrepancy Studies

Actions Following Disruption and Discrepancy Studies. August 20, 2013. Online Disruption. Students disrupted during online assessments on April 29 and 30. SDE needed an independent third-party study to investigate the impact of the disruptions on the test scores.

pekelo
Download Presentation

Actions Following Disruption and Discrepancy Studies

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Actions Following Disruption and Discrepancy Studies August 20, 2013

  2. Online Disruption • Students disrupted during online assessments on April 29 and 30. • SDE needed an independent third-party study to investigate the impact of the disruptions on the test scores. • HumRRO was selected by the SDE to perform the study.

  3. Technical Advisory Meeting • Technical Advisory Committee of researchers and assessment experts. • Meet twice per year to advise on accountability and assessment issues. • TAC members participated in a phone call with HumRROresearchers to recommend a design for the disruption study.

  4. Research Study • HumRROconducted the study independently of the SDE and CTB.

  5. Indiana and Minnesota Studies • Indiana disruption study conducted by another organization found similar results. • Minnesota disruption study: • Conducted by HumRRO • Similar methodology • Found no disruption effect

  6. Next Steps • The HumRRO study indicated that students appeared to do as well on the test regardless of disruptions in testing and so the state recommends retaining all scores of impacted students who scored proficient or advanced.

  7. Next Steps • Even though students as a whole did not experience depressions in scores, SDE desires no lasting effect on student performance. So SDE will not report scores for impacted students who scored limited knowledge or unsatisfactory.

  8. Next Steps • Even though the HumRRO study suggests no systematic impact of the disruption on test scores, in the event a particular student was impacted, not reporting the scores will make sure that the individual will not be harmed. • The SDE selected this response to do our best to do the right thing for students and schools.

  9. Score Discrepancies • About 1400 students received an immediate raw score that differed from the score they received on the two-week preliminary reports.

  10. Reason for Discrepancies • CTB left the winter test system as an option for districts to download. • There appeared to be short time period on the 2nd day of the interruptions when some of the student responses to questions were not saved so that they could be included on the two-week report.

  11. Next Steps • Students will receive the higher of the two scores. • Students with higher raw scores will receive a letter from CTB indicating their proficiency level. They will be included in the report card, but not in the school or district summary report. • Students with a higher two-week score will receive a traditional score report that includes performance level and performance by content standard.

More Related