ELPA21 Screener Test Administrator Training Module

1. ELPA21 Screener Test Administrator Training Module 2018-19 Leslie Huff, Ph.D.

2. In This Module • 1. Screener use and purpose • 2. Screener overview for 2018-19 • 3. Temporary IDs and SSIDs • 4. Administering the Screener OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

3. Training Objectives • Know the basic components and formats of the ELPA21 Screener • Understand the steps to administering the screener • Be confident in using the On-the-Fly scoring rubric. • Understand how to access resources OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

4. Screener Overview - General • The ELPA21 Screener is an online initial assessment of a student’s English language proficiency. Listening, Reading, Writing, and Speaking are tested. A paper-pencil version of the ELPA21 screener is available as an accommodation. Only students with an IEP can test using the paper-pencil accommodation. Other accommodations can be found in the GTSA on the OSPI Website. • In WA the screener is the sole tool used to determine initial EL proficiency status and ELD program eligibility. OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

5. Screener Overview – General cont. • Duration: • Once the student is logged in, it is expected that the screener will take approximately 30-40 minutes for students who complete only Steps 1 and 2. • For students who complete Steps 1, 2, and 3, the test may last an hour or more. As with any type of screening, testing times can vary greatly depending on the student’s English proficiency level, whether or not the student is proficient with the testing technology, and other factors. OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

6. Screener Overview – New in 2018 • For the 2018-19 school year, the ELPA21 screener will include a number of updates and improvements. These are outlined below . • Step 1 will have fewer questions than it did in the previous year. • Step 2 will have a new format and administration requirement • The first section of Step 2 is comprised of 4 speaking items (one task with 4 individual recordings) administered 1:1 • The remainder of Step 2 approximately 20 questions that may be administered 1:1 or independently, depending on the TAs assessment of the student’s technology skills. • Step 3 will only be administered to students whose responses indicate they may be proficient. The computer system makes this determination. OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

7. Screener Overview – New in 2018 cont. • In addition to the test format changes, there are also changes to the administration, scoring, and turnaround time in 2018. • Administration: • 1:1 decision point • Scoring • “On-the-fly” TA scoring of four speaking tasks. • Turnaround Time OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

8. Screener Overview – 10 Day Window • There is no discussion at this point of changing the timeframe in which students must be identified as ELs and placed in services. • Considering the changes to the new screener, it may be worthwhile as you plan for student testing during the beginning of the school year to have students you expect to be most proficient screen earlier and those who are likely to not be proficient to screen later in the 10 day period. This would only be an applicable strategy if school or district personnel have interactions with students prior to testing. OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

9. ELPA21 Screener: Temporary SSIDs • It will still likely be necessary to leverage the temporary ID process to get students screened. • As a reminder: it is not critical that a student have an SSID to take the screener, nor is it critical that screeners taken under temporary ID be migrated in TIDE/ORS to the student’s permanent record. OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

10. ELPA21 Screener: Permanent SSIDs • (optional) If you prefer to make sure that students taking the screener have their scores attached to their real SSID in AIR’s platform, that SSID must be present in TIDE prior to sitting for the screener. This can be done by • Generating/retrieving an SSID for a student and leveraging WAMS to move a record to TIDE. • Generating an SSID for the student via CEDARS (SSID Issuance: “Screen Entry” or “Bulk Upload), ALSO generating a temporary ID record for the student in TIDE, and PRIOR TO THE STUDENT SITTING FOR THE SCREENER, copying and pasting the SSID over the temporary ID on the record. Should you choose this option, always copy and paste the SSID rather than typing to avoid typos. OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

11. ELPA21 Screener: SSID Resources • For more information on adding records in TIDE or creating temporary SSIDs, please view the module on temporary SSIDs in the WCAP portal on the OSPI website. • Another good source of information is the ELPA21 updates. These communications can be found on the ELPA21 page on the OSPI website and you can sign up for these updates using the “sign up for updates” link on the same page. OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

12. Supports & Accommodations The ELPA21 Screener offers Universal and Designated supports as well as Accommodations. • Embedded Universal Supports are available to all testers at any time during the test • Designated Supports are available during the test if they have been established in TIDE prior to the onset of testing. • Accommodations, like designated supports, must be determined and established in TIDE prior to the onset of testing. Domain exemption must be set in TIDE prior to the onset of testing. While IEP teams designate exemption, the district assessment coordinator may be the one who must set this in TIDE. NOTE: Students who arrive with a documented disability, but no IEP, can still access accommodations for the screener through a school, district, and family collaboration process. OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

13. Setting Accommodations in TIDE • Under a student’s profile in TIDE, domain exemptions and other accommodations can be set under the Accommodations heading. OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

14. Preparing to Administer the Screener • Ensure all computers are configured with the secure browser and all headsets (speakers and microphones) have been tested on the practice test to minimize technical issues during the testing session. • Prepare a testing space that will allow the TA and the student to work together without distraction. • Prepare a short age-appropriate activity for the student to do while the TA completes the “on-the-fly” scoring portion of the process. • Prepare a clipboard with the rubric for the Step Two speaking task and a writing utensil. • Ensure all personal electronic devices are stored away from the testing space. OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

15. Preparing to Test – Creating a Test Session Option 1 is on the left. Choose the empty box next to “SCREENER” to create a test session for any grade level/grade band. Option 2 (to the right): Click on the + to get a list of specific grades to test. NOTE: The test session will expire after about 20 minutes if no one has logged on to begin a test. OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

16. Administering the Screener • In this section we will cover: • The three components of the screener • 1:1 decision making • “On the Fly” scoring” • Pausing • Students who don’t respond. • For more details on starting a test session in TIDE, using the TDS and ORS systems, please see the AIR-developed training located in WCAP. OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

17. 3 Screener Components: Step 1 • Purpose: allows students to become familiar with test item types, technology and TA. • Step 1 is not scored. • Student should be guided through available tools including how to mark for review • TA and student can freely speak/communicate during this section of the assessment • Following this section the TA decides if the student will continue with 1:1 administration, or independently navigate the test based on the student’s skill and comfort level with the required technology. OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

18. 3 Screener Components: Step 2 • Purpose: Test students’ basic language proficiency in English. • 2 sections: A 4-item Speaking task followed by machine-scored items in the domains of Listening, Reading, and Writing • After the student creates recordings for the Speaking task, the TA will immediately score the four responses to these items before the test will continue to the next section. • All students take all of Step 2. • Many screener tests will automatically end after Step 2. This is determined by the scoring engine behind the scenes. • Students whose tests end after Step 2 are eligible for ELD services and will receive scores in ORS almost immediately (within 3 hours of test submission) OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

19. 3 Screener Components: Step 3 Purpose: Present more linguistically complex items for students who are potentially proficient. The line between Proficient and Progressing is drawn in Step 3. • Step 3 includes all 4 language domains. The Writing and Speaking constructed response tasks are scored centrally by a vendor. • Only tests that include Step 3 are scored centrally by the third party vendor. These tests will take up to 7 calendar days for the scores to appear in ORS. NOTE: Students who have one or more domain exemptions, will always test on both Step 2 and Step 3. OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

20. 1:1 Decision Making • In order to minimize the effects of technology on a student’s performance, the screener was developed with both a required 1:1 testing section and an optional 1:1 testing section. • Step 1 and Step 2a (speaking items): 1:1 administration is required • Step 2b and Step 3: The TA decides if the student has the technological skills to navigate the test independently. 1:1 administration is permitted, but not required. This decision is prompted by the computer between Steps 1 and 2 2a is always a 1:1 administration even if the overall decision is for independent work through Steps 2b and 3. OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

21. “On The Fly” Scoring: How it works • Section 2a of the ELPA21 screener consists of 4 speaking items that will be scored by the TA. • The test will open to the first operational task – a Speaking task of 4 items - and the student will respond to the items as presented. • The student can re-record a response and review the recordings before finalizing them. • The TA can help troubleshoot technology if there are issues with volume or clarity of recording. • The TA takes notes on the responses for use in scoring using the Notes Sheet. • When the student is satisfied with their responses, then the TA will get a screen on the student’s computer to input scores for each of the 4 responses. This is required. • The TA will input the scores and submit. Once submitted, these scores are final. The computer will move to Step 2b OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

22. “On The Fly” Scoring: Rubric (2 points) • All of the Step 2a items are scored on this 0-1-2 rubric in all grades. • Responses at the 2 level are typically characterized by: • The student uses appropriate vocabulary that is relevant to the stimulus and effectively uses grammar and structures. Though the response may contain a few errors in usage, the student’s meaning is clear. • The student effectively answers the prompt and the response is consistent with the stimulus. *A response must meet all criteria to score at 1 or 2 point levels.* OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

23. “On The Fly” Scoring: Rubric (1 point) • Responses at the 1 point level are typically characterized by: • The response may include words and phrases related to the stimulus, but frequent errors in grammar and vocabulary may significantly interfere with listener comprehension. • The response partially addresses the prompt, though some content may be inaccurate or otherwise unconnected to the stimulus. • *A response must meet all criteria to score at that point level.* OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

24. “On The Fly” Scoring: Rubric (0 points) • Responses at the 0 point level do not address the communicative demands of the task. • Responses at the 0 level are typically characterized by: • Refusal/no response • Only in a language other than English • Response of “Yes; no; I don’t know.” • Off Task/Topic • Unintelligible OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

25. “On The Fly” Scoring: Example 1 • Question: What are the boy and the teacher doing at the table? • 1. They make a pattern. • 2. Omocha to asobu • 3. Draw • 4. They sit • 5. Build • 6. Blocks • 7. Sitting • 8. Play on the floor OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

26. “On The Fly” Scoring: Example 1b • What are the boy and the teacher doing at the table? • 1. They make a pattern. (2) • 2. “omocha to asobu” (0) • 3. Draw (1) • 4. They sit (2) • 5. Build (2) • 6. Blocks (2) • 7. Sitting (2) • 8. Play on the floor (1) OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

27. “On The Fly” Scoring: Example 2 • Questions: Where are the girls? • 1. on the carpet/rug • 2. close • 3. together • 4. building blocks • 5. in the middle • 6. behind the boy/girl • 7. Sitting • 8. Play on the floor OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

28. “On The Fly” Scoring: Example 2b • Where are the girls? • 1. on the carpet/rug (2) • 2. close (1) • 3. together (2) • 4. building blocks (1) • 5. in the middle (2) • 6. behind the boy/girl (2) • 7. Sitting (1) • 8. Play on the floor (2) OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

29. “On The Fly” Scoring: Example 3 • Question: What is on the wall? • 1. a picture • 2. star • 3. no • 4. rainbow • 5. alone • 6. window • 7. purple and yellow • 8. a shape OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

30. “On The Fly” Scoring: Example 3b • What is on the wall? • 1. a picture (2) • 2. star (2) • 3. no (0) • 4. rainbow (2) • 5. alone (0) • 6. window (2) • 7. purple and yellow (1) • 8. a shape (1) OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

31. “On The Fly” Scoring: Example 4 • Question: It’s almost time for recess. What do you think will happen next? • 1. clean up • 2. they write homework • 3. recess • 4. beautiful day • 5. the kids play recess • 6. They go home • 7. line up • 8. eat lunch OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

32. “On The Fly” Scoring: Example 4b • It’s almost time for recess. What do you think will happen next? • 1. clean up (2) • 2. they write homework (2) • 3. recess (2) • 4. beautiful day (1) • 5. the kids play recess (2) • 6. They go home (2) • 7. line up (2) • 8. eat lunch (2) OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

33. “On The Fly” Scoring: Resources • The rubric for on the fly scoring can be found on the OSPI Website: • ELPA21 Page (Preparing to Test) http://k12.wa.us/ELPA21/Preparing.aspx (in late June) • WCAP Portal (Assessment  WCAP (left menu) ELPA21  ELPA21 Resources) • TAM (on the portal) • Accommodations Manual (ELPA page, Preparing to Test) A note sheet is also available for your convenience on the Preparing to Test page linked above.Please note, once notes are taken, the sheets become secure material and must be destroyed following the testing session. OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

34. Pausing a Screener • The ELPA21 Dynamic Screener can be paused. When a test is paused and returned to at a later time, students can still access any items in the section they returned to. • Please note, a screener is not automatically submitted. It must be ended (either automatically at the end of step 2 or by clicking “end test” at the end of step 3). in order for a score report to be generated. Please ensure that students’ tests have been submitted if you are not finding scores in ORS. OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

35. Students Who Do Not Respond • Following Step 1, there will be a screen that requires the TA to choose how the screener will proceed. The TA has 3 options: • The student is able to navigate the test alone and will continue with testing independently. • The student will continue the test with 1:1 test administration • The student has not responded (in any way) to ANY item in Step 1 and testing will cease. • Option 3 will make the student eligible for services. These students will receive a new score level of 0-0-0-0 “Proficiency not Demonstrated.” OSPI is stillconsidering whether rescreening at a later dates would be advisable for these students. OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

36. Out-of-State Students • New Policy for 2018-19 • WA will start accepting scores from students who come from other ELPA21 states. • Scores must be from within the previous 12 months • Scores can be from either a screener or an annual assessment. • Annual assessment scores should determine placement over screener scores. For additional information please review the FAQ document on the ELPA21 page. OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

37. Accessing AIR Modules • AIR modules will be posted on the OSPI WCAP portal. To access the AIR modules, go to the OSPI website • Assessment  WCAP (left menu) ELPA21  ELPA21 Resources  Modules • These modules include: • Participation Reports • Using the DEI • Using ORS • Using TDS • Activating an account and navigating TIDE • Adding and editing users • Adding and editing students and student test settings • Adding student with Temp IDs • Managing Rosters • Appeals Process. OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

38. Check your Knowledge • This year OSPI is trying a new way of identifying those who have been trained to administer tests to determine eligibility for ELD services. • Upon completing this module, please continue to the site below to complete the short knowledge check. You will need a Canvas account. • Link to Canvas • Create a Canvas account: OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

39. Thank you • If you have any questions you can refer to the resources mentioned throughout this module or contact Leslie Huff at OSPI for more information. • Leslie.huff@k12.wa.us • Resources: • ELPA21 Page (on the OSPI Website): http://k12.wa.us/ELPA21/default.aspx • Preparing to Test page: http://k12.wa.us/ELPA21/Preparing.aspx • Trainings & Presentations: http://k12.wa.us/ELPA21/Training.aspx • WCAP Portal: https://wa.portal.airast.org/ OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION