Test Coordinator/Manager Training 0n-Line Tests

1. Test Coordinator/Manager Training 0n-Line Tests Spring 2013 Non-Writing

2. Agenda • Making Accreditation and AYP • Alternate Assessments • New for 2013 • Security • Before Testing • During Testing • After Testing

3. Accreditation and FAMO • Both State and Federal Accountability benchmarks and methodology has changed this year.

4. Accreditation • English is now 75% in all schools • combines reading and writing • Math remains 70% • Science is now 70% in all schools • Combines all science tests administered • 3 and 5 combined for 70% • History is now 70% in all schools • Graduation Index 85%

5. Federal Annual Measureable Objectives • Math • All Students – 64% rises to 73 in sp ‘17 • Gap 1 – 52%, rises to 73 in sp. ‘17 • Black – 51% rises to 73 in sp. ‘17 • Hisp – 52% rises to 73 in sp. ‘17 • White – 69% rises to 73 in sp. ‘17

6. Federal Annual Measureable Objectives • Reading • AMOs will be determined once scores come back and the BOE sets the rates. • Methodology- • Find the pass rate that is at the 20th percentile. That is the required AMO. • This is done for each subgroup. • Schools must meet required AMO for each subgroup

7. Other Federal Requirements • Federal Graduation Index • 80% • Includes Standard and Advanced Studies only • Continuous Improvement • Schools and subgroups must meet each year’s AMO or the prior year pass rate, whichever is higher. • 5% rule

8. Safe Harbor • Reduce failure rate of previous year by 10% • 3 year average

9. Elimination of Modified Diploma • Current grade 9 students are the last eligible. • Standard Diploma Credit Accommodations for future grads. • IEP or 504 only – includes standards-based goal • Student needs significant instructional supports • VMAST can be used for verified credit. Alg. and reading. • Locally Awarded Verified Credits expanded to reading, writing and math. • Additional course offerings for credit such as alg. I pt I and geometry pt I, and part 1 of some other courses.

10. Modifications for SPED More to Come • Requirements • 4 standard credits in English and 1 verified credit each in Reading and Writing • 3 standard credits in mathematics that include Algebra I and Geometry, and 1 verified credit in mathematics • 3 standard credits in science that include Earth Science and Biology, and 1 verified credit in science • 3 standard credits in history and social science that include Virginia and U.S. History and Virginia and U.S. Government, and 1 verified credit in history and social science

11. New Test Reminders • Reading and science are new for elementary and middle • Means late results – could be mid-june • Writing was new – • Don’t expect early May results for these either.

12. Alternate Assessments • VAAP • Due April 26 – correct stickers • See checklist • Affidavit (principal signature)– content cover sheet – scoring worksheet • VGLA (none planned?) • Due ready to score May 24 • See Checklist • Affidavit (principal signature)– Scoring Worksheet – Tracking form • Identification • VSEP due May 10 – Need eval plan now.

13. VMAST • VMAST math and reading are live • Online only • Set up sessions in regular spring non-writing administration • Students cannot take regular math and VMAST in same administration (spring window) • Student must have VMAST test assignment • Goes away after spring 2014. (except…)

14. WIDA NOW COUNTS • AMAO’s Annual Measurable Achievement Objectives • 18% must be proficient in English (score of 5) • 67% make progress. (Score higher in next year) • These #’s go up 1% annually

15. Due Dates • Elementary and Middle Answer Docs: May 24 (carefully checked) • Online : Elementary and middle May 24, including make-ups. • EOC June 11 (including make-ups) • Elementary and Middle test books and set C May 31 . EOC set C and test books by end of June. • Expedited Retake completion by June 28.

16. New and Reminders for Spring 13 • See Checklists in Manuals • Reminders before during and after tests • Not complete – read manual • Accommodations • Be sure to code on answer documents • Be sure to code for on-line students as well – after tests are completed. • Code 27 in special test accommodations • For student that needs an accommodation for this administration because of a temporary condition. Broken arm – circle in book and transcribe. • Recovery. I have indicated recovery as best I could in the data upload. After testing I will ask that you check files to ensure that I have uploaded correctly. I have not indicated recovery for algebra 1.

17. Recovery Rules • Failed SOL test in previous grade • Failed and EOC math or reading test and is retaking for the first time and has been remediated. • Benefits accreditation only. • Counts as two passes.

18. Retakes and Recovery

19. Retakes - More • Expedited retakes must be done by end of June. Scores should not be delayed. • Ideas for something different?

20. Error in Reading Manual • “Beginning with the Spring 2013 test administration, the tabbed display of paired passages will be implemented for the Grades 6, 7, and 8 SOL Reading tests in which paired passages are used.” • This information is incorrect; the grades 6 and 7 Reading SOL tests do not include paired passages in the Spring 2013 test administration. The grade 8 Reading and end-of-course Reading tests are the only tests that may include paired passages in spring 2013. The use of paired reading passages in the grades 6 and 7 Reading tests will not be implemented until the 2013-2014 school year.

21. Recording Test Sessions • Types of devices or programs include (but are not limited to): • Digital Handheld Recorders • Standard and Micro Cassette Recorders • Voice Recording Software w/ Computer • Audacity™ • Microsoft Sound Recorder • Save recording to disk as labeled audio file. • When to record • Read aloud (not audio) • It is not necessary to record if there are two proctors/examiners in the room.

22. Recording Test Sessions • Label each track. • Save to disk – erase all copies from computer or device. Send disk to Gordon • Training for examiners on how to use and save files from the electronic recording devices must be in place to avoid irregularities and the retesting of students.

23. Student Reading Test Aloud • Not an accommodation • OK, But not group administration • No reaction by proctor!! • Is this something that is done in regular instruction without correcting student?

24. More Reminders • Examiner’s manuals • On-line and paper directions • Different directions for different grade levels • Teachers must attend to and mark the sections they will use!!! • Administration field on header sheet

25. Reminders/New • Math grades 4-8 • 2 parts – follow instructions in manual • Calculator for 2nd part only • Seal codes For online • Grade 3 online does not have seal code • Form numbers are Important!! • LEP EOC 2nd attempt read aloud/audio. • If audio on other tests.

26. Things to Do Now • Materials Inventory • Pre-ID for each student using paper (arrived today- will send out shortly) • If not need to register student • VGLA and VAAP’s not there – different upload • Answer docs, manuals • Accommodations • Plan – read alouds – audio – small group • Manipulatives • Calculators, pencils, rulers, etc.

27. Testnav 7 • Who are your proctors/examiners? • Are they familiar with Testnav 7? • Have they done practice tests?

28. TestNav Tool Limits

31. Examiners become familiar with tools on the test being administered.

32. Examiner’s Manuals Update • Manuals are organized by grade level, subject and by online vs paper • Please point out to teachers the sections and ask them to read the manual ahead of time. • Online directions will be read to the students (regular and audio) prior to logging in. • Examiners will read directions for the sample item. • For students taking an online audio form, Examiners will read the sample item and answer choices to the students and then provide the correct answer to the sample item. • Examiners will instruct these students to start listening to the audio recording when they are at the first test item. • Audio only starts when the student goes to item 1

33. Plain English Math • Wida score below 3.5 • Or first year of enrollment • IEP or 504 students • Available Grades 3-8 and algebra I • You may need to assign this test to students.

34. Calculators • Part 1 math grades 4-7 • No calculator • Distribute for part 2 • Same for on-line (seal code) • Grade 8 and EOC calculator allowed for whole test • Please note the calculators that are allowed for various tests at various grade levels. In implementation manual pages 19-23. • May use handheld or online calculator.

35. Testing Over Two Days • Grade 3, 4 and 5 math and Grade 3 reading tests can be given over two days. There is a seal code. All students should be given a break at the seal code. May be short or as long as overnight. • Multiple test sessions. The multiple test session accommodation must be paper if it involves an overnight break.

36. Term Graduates • Due to graduate by August of 2013. • At least three opportunities to test. • Can’t do more by testing on paper and on-line.

37. Substitute Tests • Many CTE completer exams can be substituted for the student selected verified credit. • WISE is one of these. Given in association with Econ/Pers. Finance • Talk to me if you have questions.

38. Security • Test tickets are secure items • Do not print more than two days ahead • Keep in locked storage just like paper tests • Report any shortage of test materials to Gordon.

39. Security • Use transmittal form (Page 82-TIM) • Teachers hand individual tickets to each student – Do not pass down row. • Have students check the name on the ticket. • Take tickets back up individually. As soon as student logs in.

40. Security • Locked storage of secure materials • Bulletin boards – other helps • Security agreements • Transmittal forms • Sign-out and in of materials before and after each session • Cover sheets • confirm counts - report discrepancies immediately • Ok to break packages if necessary

41. Shortly Before Testing • Testing rooms • Arrangement • Displays • Examiner packets (renewed daily) • Tests • Answer docs • Pencils, manipulatives • Scratch paper • No use of paper tools with online tests.

42. During Testing • Handling Emergencies • Irregularities to Gordon 245-5121 836-0718 • Use form • Maintain test atmosphere if possible • Network issues to school based techs or Shaun Portlock 245-5142 • Pearson -- (866) 650-9425 • Breaks • Not standard procedure • Breaks during test – must maintain test atmosphere • Stand and stretch • Any student may have break as requested. • Behavior • Report to principal/assistant • Irregularity – can student continue?

43. Manuals Updates • NEW Troubleshooting Section page 16 (or nearby) • #1 Student requires an audio test but there is no audio • Realize that the audio begins to play at the 1st question, not at the sample item • Audio forms have an audio control box that appears for each question. If no box is present on a question, the test is not audio. • Verify the form—audio forms begin with “9” after the letter, H9039, check the session details for forms assigned to students.

44. Manuals Updates • NEW Troubleshooting Section • #2 Student should not have an audio test, but the audio is playing, or the audio box appeared at the first test question • The STC or Examiner should SAVE and EXIT the student from the test but keep the student seated at their workstation and immediately contact the DDOT, I can change the student’s form to the correct non-audio form while the student waits.

45. Manuals Updates • NEW Troubleshooting Section • #3 Shading is not visible on the test questions • Some test questions refer to the “shaded section” of a map, graph, etc. If the shading is not apparent to the student, the Examiner may adjust the contrast setting on the student’s monitor until the shading is visible. If this adjustment does not resolve the problem, Examiners should contact their STC.

46. Requirements for Tests In Paper/Pencil Format • The accommodation specified in the student’s IEP, 504 Management Plan, or LEP Student Assessment Participation Plan requires a paper/pencil test. Accommodations requiring a paper/pencil test include large-print test, Braille test, and flexible schedule (multiple testing sessions requiring more than one school day).

47. Requirements for Tests In Paper/Pencil Format • The student has a documented medical condition such as a seizure disorder where exposure to a computer will aggravate the student’s condition. This documentation must be kept on file locally at the division. • For other reasons the DDOT must obtain prior approval from VDOE. • These guidelines can be found in the Non-Writing TIM.

48. Documented Need for Paper Test • The student attends school in a location where a secure network connection or the required technology is not available to access an online test. Such locations include the following: special-situation schools; homebound, residential, or hospital placement; night school or Governor’s school. • The accommodation specified in the student’s IEP, 504 Plan, or LEP Student Assessment Participation Plan requires a paper/pencil test. Accommodations requiring a paper/pencil test include large-print test, Braille test, and flexible schedule (multiple testing sessions requiring more than one school day). • The student has a documented medical condition, such as a seizure disorder, where exposure to a computer will aggravate the student’s condition. This documentation must be kept on file locally at the division.

49. Testing Schedule • Communicated clearly with tech? • Due to me May 3. • Hall proctors • Emergencies? • How many small groups???

50. e-Readers • Test examiner’s manuals direct students to sit quietly or read when they finish testing. • e-Readers, such as the Nook and Kindle, are not approved for use in an SOL test session because they can contain additional features that could distract students still testing or possibly compromise test security. • Students should not have access to cell phones or other electronic devices, including e-readers, in the active testing room.