Interim Assessment Training September 20 & 26, 2012

1. Interim Assessment Training September 20 & 26, 2012

2. Rhode Island Interim Assessments • RIDE Introductions • Jessica Brown, Assessment Specialist • Kevon Tucker-Seeley, Assessment Specialist • Measured Progress Introductions • Amanda Smith, Program Manager • Phil Robakiewicz, Client Services Division Director • Shelby Pouliot, Program Assistant

3. Rhode Island Interim Assessments • Purpose of Training • Training Objectives • Understand RIIA program and Fixed Form Assessments • Become familiar with RIIA Test Management system • Become familiar with online student testing software

4. Rhode Island Interim Assessments • Purpose of Training • Participant Role • Become equipped to train other users on the RIIA Test Management system and student testing system • Available resources (webinar, user guides) • Parking Lot • Use for RIIA-related questions, but not directly related to the objectives of today’s training

5. Rhode Island Interim Assessments • Overview of Today’s Training • Interim Assessment Program • Test Designs and Content • Interim Assessment Systems • Testing • Before, During, After • Scoring & Results • System Demonstrations

6. Interim Assessment Program • Two Major Components • Fixed Form Assessments • Test Construction Tool • Characteristics of Both Components • Grades 3-11 • Online or paper-based administration • Accessed through the IMS, including reports • Accessibility features available online: e.g., magnification • Multiple-choice items scored automatically in system; teachers score CR items* (Year 1 FF Measured Progress will score)

7. Interim Assessment Program • Fixed Form • Sets of tests in Math and ELA • Monitor progress toward proficiency on selected critical content and skills in the Common Core State Standards • Administered 3 times during year February November 1 - 16 April

8. Interim Assessment Program • Test Construction Tool • Locally-created tests by teachers and/or District • Grades 3-11 • Math & ELA (January 2013) • CCSS • Science & Social Studies (Sept 2013) • New Standards • Performance tasks

9. ELA Fixed-Form Test Design • Common Core State Standards • Organizing Elements in Reading • Key Ideas & Details • Author’s Craft & Structure • Integration of Knowledge • Item Types • Multiple Choice (1 pt) • Evidence-Based Selected Response (2 pts) • Constructed Response (4 pts) • Three test sessions, 30-45 minutes each • Paired reading selection and 12 items per session (36 items total)

10. ELA Fixed-Form Test Design

11. Math Fixed-Form Test Design • Common Core State Standards • Five to seven Common Core clusters were chosen to be measured at each grade level • The majority of the clusters are those identified by PARCC as major clusters in the PARCC Model Content Frameworks for Mathematics • Item Types • Multiple Choice (1 pt) • Short Answer – 1 point • Short Answer – 2 points • Constructed Response (4 pts) • Two test sessions, 30-45 minutes each • 15 items in session 1, 16 items in session 2

12. Interim Assessment Systems

13. Interim Assessment Systems Test Construction Tool Test Management Student Testing Software IMS Scanning Scoring

14. Before Testing – Test Management • Assigning and Scheduling Tests • District administrator: • Assign tests to schools (after October 16) • Option to narrow test windows • Assign and schedule practice test (after September 28)

15. Before Testing – Test Management • Student Assignment and Materials • Teacher: • Access and print teacher test materials: administrator manual, roster • Determine paper & pencil or computer testing for each student • Print test forms and answer sheets • Print computer login tickets

16. Before Testing – Test Management • Student Assignment and Materials • Teacher-Course-Student data determines test availability to teachers and student assignment • Students must be in the system to test • Contact RIDE helpdesk to update students or change student information

17. Before Testing – Student Software • Nimble Online Assessment kiosk must be downloaded to every student computer prior to testing • Browser-based software, prevents students from accessing other applications while testing • Requires login with information from Student Login Ticket

18. Before Testing – Student Software • Available for download at: • http://www.ride.ri.gov/Assessment/Interim.aspx • Instructions for download to Windows, Mac, and Apple Remote Desktop (multiple Macintosh computers) • Mac OS 10.5 to 10.7 • Windows XP, Vista, and 7

19. Before Testing – Computer Testing • Practice Test • District schedules practice test • Teacher selects and prints Student Login Tickets • Teacher prints or downloads Practice Test Manual • Student computers have Nimble Online Assessment software loaded • Students take Practice Test

20. Before Testing – Computer Testing • Practice Test Tips • Content of the test is not Common Core • Intent is to help students become comfortable using the system • Learn to navigate the system and experiment using tools • Understand two reading selections and answering questions • Practice answering math questions in text and with drawing tool

21. Before Testing – Computer Testing • Ensure every student has taken the practice test and is comfortable with the system • Print Student Login Tickets for each student for each test he or she will be taking • Print or download the Test Administration Manual • Print a paper answer sheet for any student who needs one for a math test* • *Students who find the math drawing tool difficult may elect to use a paper answer sheet for those questions

22. Before Testing – Paper Testing • Print individual Student Answer Sheets for each test • Print one copy of Test file • Use roster to determine quantity of forms • Photocopy test forms • Match correct test form with each student’s answer sheet • Print or download Test Administration Manual • Note: There is no practice test for paper testing

23. Before Testing – Paper Testing • Matching Test Forms – Answer Sheet Student Name: Demo Student Student ID: 1234567890 Grade: 03 Test Name: Fall 2012 Reading Grade 3 Form: Form 3 School Name: Demo School A Teacher Name: Demo Teacher

24. Before Testing – Paper Testing • Matching Test Forms – Test Form

25. Before Testing – Accommodations • Use NECAP Accommodations as you see fit, including extra time. Note many NECAP accommodations will not apply. • Accommodations do not need to be coded on booklets • Computer-based testing • Magnification • Answer Masking • Line Reader • Color Chooser

26. During Testing • Actively monitor testing • Manage materials and maintain security between test sessions • Ensure students start sessions 2 and 3 correctly • Receive return shipment materials for paper tests (shipped to Principal on October 29) Store until testing is complete

27. After Testing – Computer Testing • Submit all computer tests • Each student must navigate to the final summary screen and “submit” his or her test • Collect any paper answer sheets used during math tests and give them to the administrator coordinating the return of paper materials

28. After Testing – Paper Testing • Collect all used answer sheets from each classroom in the school • Sort answer sheets by content area and place in appropriate return envelope • Use original box for return shipment • Apply UPS Return Service label • Pickup on November 19th(late returns will not be scanned and scored) • Shred or recycle test forms and unused materials

29. Interim Assessment Results • Computer and paper tests will be scored by Measured Progress • Results available through IMS • Raw scores this year; scaled scores next year • Access to student responses and items • Item, Student, Classroom, School and District reports will be available

30. Interim Assessment Scoring System • Online system for teachers who gave the test by computer to practice scoring a set of items from the test. Available after test administration. • Training modules available in November • In person professional development after each administration

31. Steps after Training • Nimble Online Assessment download for every student computer • Train others in school (starting October 1st) • District assigns and schedules practice test during October • Students take online practice test • October 16 or later: district assigns and schedules November administration

32. Support • Interim Assessment system issues: • mptechhelp@measuredprogress.org • 1-855-222-8936, 7:00 a.m. – 5:00 p.m. • Login issues, incorrect student data, trouble with Instructional Management System: • RIDE Helpdesk https://support.ride.ri.gov/ • Policy and procedure questions: • Jessica Brown, RIDE • Jessica.Brown@ride.ri.gov, 401-222-8253 • Amanda Smith, Measured Progress • smith.amanda@measuredprogress.org, • 603-749-9102 x2259

33. System Demonstration • Test Management • Nimble Online Assessment Practice Test

34. Thank you!