Smarter Balanced Assessment Field Test Proctor Training

1. Smarter Balanced Assessment Field Test Proctor Training YOUR SCHOOL Edmonds School District Spring 2014 3/18/14

2. Description of the Smarter Balanced Assessment SBA is an online test with two main segments: • Computer Adaptive Test (CAT) * • Multiple Choice • Short Answer • Can be given in 1 or 2 days, depending on students’ age/needs • Performance Task (PT) with: • A 30-minute Classroom Activity (a non-scored activity that sets the context for the Performance Task) • A Performance Task (Math -- one section; ELA -- two sections) • All parts can be completed in 1 to 3 days, depending on subject, and students’ age and/or needs • It does not matter if students take the CAT before or after the PT. * The Field Test will not use the adaptive capability - students will receive a fixed set of test questions – students will not all see the same items.

3. New Terminology

4. Purpose of the Smarter Balanced Assessment Field Test • To provide an opportunity for students to interact with the new, innovative test items on the Smarter Balanced Assessment (SBA), which will be operational in Spring 2015. • For SBAC to gather data on about 22,000 items in order to create a valid and reliable test for 2015. • For OSPI to gather information about implementing this online testing system for the 2015 operational administration. • To help us, as a district, prepare for the operational SBA.

5. The Smarter Balanced Assessment Field Test • No scores will be generated from the Field Test. • Remember that this is a “Field Test.” It’s a learning experience with essentially no negative consequences if problems are encountered. • However, we should approach the test seriously so the results will be valid, since the results will be used to evaluate test items for use in the operational test and to set cut scores for meeting standard on the operational test. • We must provide the same level of security as with an operational test, since any of these items may be used in the future operational versions of the test.

6. SBA Messages to Students • It is important for students who are taking the SBA field test to understand why it is important for them to try their best. • Your principal and BTC have a handout with the messages to be given to students. • Work together to develop a communications plan that will ensure that all SBA students receive and understand this message.

7. Student Training Materials • Purpose: • Universal Tools Training Module – explanation of the tools that are available • Training Test – to learn to navigate and use the tools • Practice Test -- to emulate the size of a CAT • Practice Performance Tasks – to emulate Section 1 of an actual PT Students will login as “Guests” so will not require a user ID or password.

8. Student Training Materials • The Let’s Talk Universal Tools (14 minutes) Training Module is required as preparation for taking students through the Training Test. • The Training Test is required of all students prior to taking the SBA Field Test. The Let’s Talk Universal Toolstraining module is a narrated walk-through of all the Universal Tools available for SBA. It can be presented to your classroom as a whole, after which students can log into the Training Test and practice those tools. Let’s Talk Universal Toolsis located on the SBAC portal at: http://sbac.portal.airast.org/field-test/resources. Then go to the Training Modules section of that page to select this module.

9. Practice and Training Tests • Practice and Training Tests are available to allow students and staff members to become familiar with the format and functionality of the SBA test prior to testing. • Each grade level has: • Training Test for ELA – by grade band (about 6 – 8 items) • Training Test for Math – by grade band (about 6 – 8 items) • Practice Test – ELA (about 25 items) • Practice Test -- Math (about 25 items) • Practice ELA Performance Task (about 3-4 questions) • Practice Math Performance Task (about 3-4 questions) Proctors should go through the Training Tests themselves prior to taking students through them and prior to administering the test. Teachers should use the Practice Tests as an instructional tool.

10. Practice and Training Tests Access from PC/Laptop • From a web browser using Firefox, Chrome, Internet Explorer 10, or Safari, you can access the link to the Practice and Training Tests as follows: • SBAC Portal http://sbac.portal.airast.org • Student Interface Practice and Training Tests (Green box) From the SBAC Portal, on the next screen scroll to the bottom of the page and select this icon. The Practice and Training Tests will also be available on the SBAC Secure Browser, once the district Tech staff have installed that on school computers.

11. Practice and Training Tests Access from a Chromebook If administering the Training Test from a Chromebook it is through the same “app” as will be used for the actual test. Instead of using the login box, select AirSecureTest from the app menu at the bottom Once you select the app, you will have to select state (WA) and then the Smarter Balanced Field Test. The Practice and Training Test option is then available to you.

12. A Tip About Training Tests In the Training Test, there is an icon which, if selected, plays a short instructional piece for the student about the type of test question (no audio). Select this icon and some instructions about this type of test question are given

13. One Last Training Test Tip In case this is not mentioned elsewhere – here is an important thing to remember about all SBA tests. Students MUST answer each test question in order to move to the next page of the test. While doing the Training test, if the student does not know an answer, they should enter something in order to move on and to flag the item for review, as practice for flagging items on the actual test in a similar situation. Practice Tests Practice Tests are recommended, and can be given any time of the year.

14. The Actual Field Test

15. Directions for Administration The DFA is embedded within the Online Field Test Administration Manual (TAM) pages 42-50. It contains a script for walking students through the login process. USE THE SCRIPT. Proctors will be given a printed copy of these pages. The District will not be distributing full copies of the TAM, but it is readily available online from the SBA Portal/Resources and Documentation webpage: http://sbac.portal.airast.org/field-test/resources

16. Directions for the Performance Task Instructions about how to administer the Performance Task are in the DFA. Teachers might consider having students who have difficulty keyboarding do their long responses for the PTs on scratch paper and then entering them on the computer. The Building Test Coordinators already have the links to the Classroom Activities that the proctors will be using as the first step of each PT. This information is found on the SBAC Field Test Portal: http://sbac.portal.airast.org/field-test

17. Test Materials - Scratch Paper • Scratch paper is allowed for all SBA tests. • For ELA, this can be plain or lined paper. • For Math grade 6 and up, graph paper is required. For Math and ELA Performance Tasks, if students are taking the PT in more than one session, have them put their names on their scratch paper, collect it and securely store it at the end of each session, and give back to students at the next PT session. Once each test section is complete (CAT or PT), collect and destroy the scratch paper (your school shredding bin is fine).

18. Test Materials – Dictionary/Thesaurus • On the essay portion (Section 2) of the ELA Performance Task, provide: • English Dictionary and/or Thesaurus for all students • A bilingual dual language word-to-word Dictionary for ELL Students

19. Classroom Setup • Similar to rules for MSP, HSPE and EOC: • Remove or cover all information displayed on bulletin boards, chalkboards, or charts (e.g., wall charts that contain literary definitions, maps, etc.) that might help students answer questions. • Use visual barriers or adequate spacing between students. • Students should be seated so there is enough space between them to not view each other’s computer screens. • .

20. The Test Administration Interface The Application to be Used by Proctors You will need to use the TA (Test Administration) Interface program, accessed online from the SBAC Portal, to administer a test session. Go to:http://sbac.portal.airast.org

21. The Test Administration Interface • The TA (Test Administration) Interface allows proctors to: • Select which test is being administered • This starts a session and generates a Session ID that students need as part of their login process. Write the Session ID on the board. • Give students permission to start the test. • Monitor student progress. • The system will report how many test questions have been “delivered” to each student; ex: 24/35 • View student information from TIDE, including what accommodations have been designated for the student. • Pause an individual student’s test. • Stop the test session for all students. • Warning: If you stop the test session for all students, you will need to start a new session and to generate a new Session ID for students to log back in to finish the test.

22. The Test Administration Interface Once you are able to access the TA Interface, PLEASE do not attempt to use the TA Interface for practice. Do not create any test sessions until told to do so by your building Test Coordinator!

23. Access to the TA Interface http://sbac.portal.airast.org/field-test Access to TA Interface for Proctors (Gray means program is not active yet.) Access to Manuals and Training Modules

24. Access to the TA Interface http://sbac.portal.airast.org/field-test • At least one Proctor in each test room will need access to the TA Interface. • To access the TA Interface, proctors first need to be set up as Test Administrators in TIDE. (Your school’s BOTSS will do setup.) • When you have been set up as a user in TIDE, you will receive an automated e-mail with a temporary password and a link to the login page. • You must then log into the system and select a new password and a security question. • Your User ID is your district e-mail address: xxx@edmonds.wednet.edu

25. The TA Interface Program At this time, we will view the 15-minute SBAC TA Interface Training Module: SBAC Portal: http://sbac.portal.airast.org/wp-content/uploads/presentations/tainterface Note to Proctor Training Presenter: To start the presentation, click on link, skip “Introduction” and “Navigation” sections. Start with “Objectives.” Also skip “Print on Demand” and “Thank You” sections.

26. Starting a Test Session Summary -- Sequence of Steps • Click the appropriate check box(es) for the test(s) you are administering in that session. • Click Start Session. • The system will give you a session ID. Write this on the board. • Have students log in using the session ID you wrote on the board, along with the other info on their Test Ticket. • Once students log in, their names will appear on your student list in TA Interface. • To approve students to start testing, click the Approvals button on the Approvals screen. • Note: If any students log in AFTER you have gone to this screen, click Refresh to include them on the list.

27. TA Interface Important points to remember: • Do not navigate away from or log out of the TA Interface during testing: • It would cause all active tests to be paused. • If you need to do other tasks requiring a web browser, please open a new browser window. • If you must Stop a Test Session (say the building’s fire alarms go off and you have to evacuate), you will need to: • start a new test session, which will • generate a new Session ID which the students will need to log back in again.

28. Test Tickets for Students The Test Ticket format looks like this. The arrows show you the three pieces of information students will need for log in. Test Ticket SBA Field Test Grade: 07 ELA District: Edmonds SD School: Edmonds Middle School CDS: 31015-1111 Birthdate: 01/01/2000 ELA Group Name: Johnson Student Name: SMITH, JANE SSID: WA-11119993274633 Confirmation Code: JANE Session ID: ______________________ Student Signature: ______________________ Note that for SBA, the SSID is expanded to include “WA-” plus the school 4-digit state code. Confirmation code is usually student’s first name and will be the same on both ELA and Math.

29. Test Ticket SBA Field Test Grade: 07 ELA District: Edmonds SD School: Edmonds Middle School CDS: 31015-1111 Birthdate: 01/01/2000 ELA Group Name: Johnson Student Name: SMITH, JANE SSID: WA-11119993274633 Confirmation Code: JANE Session ID: ___________________ Student Signature: ___________________ Possible Log-In Errors Remember: Session ID is not case-sensitive.

30. Test Tickets Schools will receive two test tickets for each student: one ELA ticket and one Math ticket. Because each subject test has multiple sections (CAT/Non-Performance Task plus one or more sections for the PT), each test ticket must be re-used for subsequent sessions of that subject test. Since there is only one signature line on each test ticket, students should sign the test ticket the first time they log into the system for that subject (ELA or Math). For subsequent test sessions within that subject, teachers need to make sure each student receives their own test ticket.

31. Once students have logged in…. Follow-up screen 1: Is this You? A copy of the login screen is displayed with their confirmation code, school, and grade level; students are asked to verify the info and click “Yes” if it is correct. A “No” answer will re-direct them to the login page. For the Field Test, a student might need to say “No” to this question if their grade level is incorrect. If grade level is incorrect, it must be corrected in TIDE before student can test.

32. Once they have logged in…. Follow-up screen 2: Your Tests A list of tests the student is eligible to take (according to their grade level) is displayed; but only those tests the proctor has included in this test session that have not yet been completed can be selected. Once students have selected the test, the Proctor must approve the students’ login requests within the TA Interface. Student sees this while waiting for approval.

33. Once they are approved…. Follow-up screen 3: Is this Your Test? Student clicks on “Yes, Start My Test” to launch the test. The selections shown here are standard. But if students were assigned accommodations in TIDE, they might appear differently (such as Language: Spanish might appear for an ELL Spanish-speaking student taking the Math SBA).

34. If taking a test that requires audio Follow-up screen 4: Do you hear the voice? An audio check where students verify they can hear the audio and have a chance to adjust the sound.

35. Last screen before test starts Finally, the last thing students see before starting the test: The Help Screen These same instructions are available within each test.

36. Pause Test Rule (CAT only) Students may pause tests themselves by clicking on the Pause button. Proctors can also Pause tests via the TA Interface. Use Pause when students will finish testing at a later date or time.

37. Test Segments Each test is divided into two or more segments. (This is not the same as a test SESSION, which refers to what students complete in one sitting.) A student may not return to a segment once it is completed and submitted, even if the segments are within the same session. Below is from the Field Test User Guide, page 13:

38. Are Student Responses Immediately Saved? Student responses are saved each time students answer a question. However it is recommended that students press the SAVE button periodically when typing a long response, such as on the Performance Task.

39. Test Timeout After 20 minutes of inactivity a pop-up warning will appear that the student must respond to within 30 seconds or they will be logged out and their test will paused. “Inactivity” means student has not selected answers or used a navigation tool (just clicking on the page somewhere does not count as activity). This timeout does not apply to the Performance Task.

40. End of Test The End Test button appears on the screen when the student has selected a response to every test question on the test. If students click on the End Test button, another screen will appear allowing them to go back and review their answers. If students then choose to Submit the test – they will get one more warning screen, allowing them to return to the test before finally ending the test. If the student exceeds the 20 minute pause limit at any time during the CAT test, at the end of testing they will not be able to review the responses completed prior to the pause.

41. Accommodations • SBA has three categories of accommodations: • Universal Tools – for all students • Designated Supports – can be used for any student, but must be approved by an adult at the school; includes what we typically think of for ELL students • Accommodations – for IEP/504 students • Within each category, there are two types: • Embedded within the online system • Non-embedded – provided outside the online system IEP/504/ELL Accommodations embedded within the testing software are selected for individual students by coding them in TIDE.

42. Accommodations

43. Accommodations • Embedded Designated Supports and Accommodations include: • Color Contrast • Masking • Print Size • Translated Glossary • ASL • Closed Captioning • Text-to-Speech • Spanish translation for Math for ELL • Embedded Universal Tools include: • Highlighter • Calculator • Notepad • Math Tools • Mark for Review • Strikethrough • Zoom • English dictionary • Spell Check

44. Accommodations Training Module http://sbac.portal.airast.org/field-test/resources We highly recommend that Learning Support teachers and Test Coordinators review this video training module that describes Accommodations. • Accessibility and Accommodations (35 minutes) • Explains the differences between Universal Tools, Designated Supports, and Accommodations – those embedded within the software versus those outside the system. • Briefly covers how to view accommodations that have been assigned in TIDE (but not how to assign accommodations within the system).

45. Test Security All the same security measures we use for MSP, HSPE, and EOC apply to SBA. • Student test tickets must be locked up when not in use. • Verify student ID when distributing test tickets (through personal recognition or student photo ID). Gump, Forrest Grade 11 Edmonds-Woodway HS • If student moves to a different location, a STAFF member must carry (by hand or cart) the student’s computer. • Make sure you can account for all test tickets at all times. Pick up all test tickets as soon as students begin testing (in the order that students are sitting) and redistribute if students need to log back in.

46. Test Security • Proctors should not read test questions or student responses unless necessary for administering the test. • If you do have access to test questions or student responses, do not copy them or communicate them to others, unless necessary for administering the test. • Staff and students: make sure all cell phones are turned off before starting test (important for bandwidth as well as security). • Student backpacks, books, purses, cell phones, IPOD’s, and MP3 players must be out of reach of students until testing is complete.

47. After Testing After the Field Test, students will be directed to an Online Survey (generated by our district). Proctors should give any feedback about the Field Test to their Test Coordinator. Proctors should shred any scratch paper, paper handouts, or print-on-demand documents students had access to during testing. All Test Tickets must be collected and returned to the District Assessment Office.

48. Irregularities Report Irregularities promptly to your building Test Coordinator as you would for MSP or HSPE/EOC. (Document what occurred and allow students to continue testing, if possible.) • Although no scores will be generated for the Field Test, any irregularities that might affect the validity of students’ answers should be reported so that: • We learn steps needed for dealing with irregularities. • SBAC will know what student data might be invalid.

49. Resources - Manuals • Online Field Test Administration Manual (TAM). • Use this as your main resource. • The “DFA” portion of the manual starts on page 42, with directions and scripts for administering the SBA. • Test Administrator User Guide. • A main resource • Usability, Accessibility, and Accommodations Guidelines Manual. • Focuses on universal tools, designated supports, and accommodations for SBA. These and more are available on SBAC Field Test website: http://sbac.portal.airast.org/field-test/resources

50. Resources – Phone Numbers • Edmonds School District • District Technology • Help Desk = call SBA-0 (7220) • District Assessment Office • Nancy Katims = 7302 • Kieran Edmundson = 7303 • SBAC • SBAC Help Desk = 1-855-833-1969 BTCs and BOTSS have guidelines on when to call our own district Help Desk and when to call the SBAC Help Desk. If in doubt, use OUR Help Desk to be first line of defense…