1 / 18

Idaho’s Online Testing: Boots on the Ground Report CCSSO June 21, 2010

Idaho’s Online Testing: Boots on the Ground Report CCSSO June 21, 2010. Review of ISAT Matrix and Tested Population A [very] Brief History of Online Testing in the Gem State Paper vs. Online: schedule comparison

hamish-fleming
Download Presentation

Idaho’s Online Testing: Boots on the Ground Report CCSSO June 21, 2010

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Idaho’s Online Testing:Boots on the Ground ReportCCSSO June 21, 2010

  2. Review of ISAT Matrix and Tested Population • A [very] Brief History of Online Testing in the Gem State • Paper vs. Online: schedule comparison • Pressure Points: capacity, connecting students to their work, test reactivation, in-district tech. capacity • Final thoughts: provide ample practice opportunity; build in robust, ongoing training and help line support; worst of both worlds-running dual system for extended period Overview

  3. Idaho Standards Achievement Tests (ISAT)

  4. ISAT Testing Matrix • ISAT is Federally Mandated Under the No Child Left Behind Legislation • Grades 3-10 are tested in Reading, Math, and Language Usage [grade 9 not part of AYP] • These content areas form the basis of the Annual Yearly Progress [AYP] Proficiency and Participation Requirements • Grades 5, 7 and 10 are tested in Science, but Science is not part of AYP Calculations

  5. ISAT 2010 Facts • NCLB core test [Session 1]-42 to 50 MC ; Adaptive overlay [Session 2] 10-15 MC—provides strand level reporting tailored to individual student; untimed • 650 schools, 135 districts, many remote • @ 21,000 Students per grade • 570,000 Tests Delivered in 4 weeks • @ 400 Tests delivered via P/P- LP, Braille • 99% online since 2003 • Data Recognition Corporation [DRC] with Computerized Assessments and Learning [CAL] create and deliver ISAT

  6. Idaho Commitment to Technology • Late 90’s Idaho legislature begins providing technology grants to districts • Federal funds for enhancing education through technology • Albertsons Foundation trained ‘technology integration’ personnel • Investment made in ‘strong’ economic times • Idaho has 3 to 1 computer/student ratio • Rollout of online testing was gradual • Early on issues with computer speed, bandwidth

  7. Generic PAPER BASED Schedule • December 10- Initial Pre-Id data due • January 18- Final Pre-ID file Cut • Doc. creation, Print, Pack, Ship, Overage • March 1- Ship 4 separate 2 week test windows • Processing, scanning, then reporting summer or fall • Cons: Tracking millions of pieces of paper and barcodes; lead time required; you are LL Bean

  8. ISAT Online Schedule • @ April 1 Student Enrollment File Upload • April 12-May 14 Test Window [last week make-ups only] • Immediate Preliminary Reports • June 4- Final reports- 3 weeks from close of window • Pros: no shipping; proximity of data upload to testing; no paper chase; security-few hard copies; later testing/earlier reporting

  9. Testing Capacity • So online testing is all good news? • Behold the power of paper and pencil: all students in all grades in a school can test simultaneously! • Online testing depends on Computer capacity: • Traditional model- a 35 computer lab can test a single class every 1.5 hours • “Hub Approach”-dramatically increases capacity; Students are funneled into testing as others finish-no computer sits empty- Meridian District used this model to test 800+ students in a school in 4 content areas in 12 days; limits impact on instruction

  10. Connecting Students to Tests Pre-Id process is handled at District Level SEF. “Session ticket” = Pre-Id

  11. Session Tickets • Requires the right student get right ticket, hard copies • Onus on Local district personnel to manage the functionality of online testing and management-requires increased level of technology skill down to the school and proctor level

  12. District Facility with Technology Critical Full online management of Testing Process: • Data uploads • Editing exiting data • Add/Delete Students • Print tickets • Monitor/manage testing • Reactivations, invalidations • Managing Permissions and Passwords • Manage reporting • Connectivity issues • See ISAT TAM for details: http://www.sde.idaho.gov/site/assessment/ISAT/testCoordinators.htm

  13. Supporting Districts • Ongoing, real time support/problem solving prior to and through testing cycle • In–Depth Support for new District Test Coordinators • Capacity is built over time and must be renewed

  14. Reactivation: Potential Logjam • All multiple day test sessions require State Department approval • Prior approval- IEP, ELP, 540 planlogged on Reactivation Form • Time sensitive Emergency approvals: connectivity problems, sudden illness, audio accommodation, login error

  15. Reactivation Process • SDE fields emails, consults w/DRC on test details; SDE reply to districts on status • Reset one or more parts or restart entire test, or not at all • Relentless Emails-we stayed above water, just, with nearly all same day or next AM reactivation. Consider effect oflarger population of this constraint.

  16. Final Thoughts • Must allow for ample opportunity for students to ‘practice’ with testing platform, especially audio. Technology should not affect measurement. • Building capacity in technological expertise, ongoing and vital. Be sure training and ‘helpline’ is part of strategic planning, RFP. Districts must be supported in transition and beyond. • Running a dual system, half paper/half online, blunts the benefits of both systems. Try not to be caught mid-court. • Silver lining in starting now: faster connections/computers ISAT

  17. ISAT Idaho Standards Achievement Tests Contact: Scott Cook ISAT Coordinator 208-332-6976 scook@SDE.idaho.gov

  18. Questions?

More Related