The Oregon Kindergarten Assessment Test Administrator Training

1. The Oregon Kindergarten AssessmentTest Administrator Training (Required for District Test Coordinators (DTCs), School Test Coordinators (STCs), and Test Administrators (TAs) Oregon Kindergarten Assessment Fall 2014

2. Today’s purpose • Become trained in giving the Oregon Kindergarten Assessment • Be prepared to train others to give the OKA • Learn what’s new with the OKA this year • Get any questions answered

3. The Oregon Kindergarten Assessment • Provides baseline local and statewide information • Provides essential information on all children as they enter kindergarten • Helps to identify achievement gaps early • Provides a consistent tool to be used across the state The Oregon Kindergarten Assessment is not: • It is not an entrance exam • It is not a high-stakes test • It is not a competition • It is not a way to separate children into performance groups

4. Oregon Kindergarten Assessment Test Administrator Training • Assessment Administration • Assessment Accessibility Supports • Assessment Security • English Learners and the Kindergarten Assessment • Administering the Early Literacy Assessment • English Letter Names • English Letter Sounds • Spanish Letter Names • Administering the Early Math Segment • Numbers and Operations • Administering the Approaches to Learning Segment • The Child Behavior Rating Scale Oregon Kindergarten Assessment Fall 2014

5. Assessment Administration • Assessment Accessibility Supports • Assessment Security • English Learners and the Kindergarten Assessment • Administering the Early Literacy Assessment • English Letter Names • English Letter Sounds • Spanish Letter Names • Administering the Early Math Segment • Numbers and Operations • Administering the Approaches to Learning Segment • The Child Behavior Rating Scale Oregon Kindergarten Assessment Fall 2014

6. 2014-15 Kindergarten Assessment Updates • The Spanish syllable sounds measure has been replaced with Spanish Letter Names • Districts are required to administer Spanish Letter names to all Spanish-Speaking ELLs • Virtual Schools are required to administer the kindergarten assessment • English Letter Sounds chart adjusted to 100 possible sounds

7. Test Administrator Roles and Responsibilities Before assessing: • Provide students with an opportunity to become familiar with the assessment format and procedures • Review student Individualized Education Programs (IEPs) or education plans to identify appropriate assessment formats and accommodations • Make arrangements for students who are not being assessed • Review Test Administration Manual During assessment: • Ensure that students receive the appropriate assessment (includes settings such as language) • Enforce assessment environment requirements

8. Assessment Environment Requirements • Supervision at all times by a trained Test Administrator (TA) • Quiet environment void of distractions • Only Universal Tools made available to students upon request • Limited interaction with students • Read student directions • Administer accessibility supports appropriately • No coaching

9. Test Administrators Must: • Read the Test Administration Manual • Receive annual test administration and security training (BE TRAINED BY YOU!) • Sign an Assurance of Test Security form • Only provide students with Universal Tools listed in the Test Administration Manual • Read verbatim the student directions provided in the Assessor Booklet

10. Test Administrators May Not: • Allow untrainedaides, volunteers, or substitutes to assist with assessment administration • Coach students • Allow students access to non-allowable supports • Allow students to help other students during assessment

11. Assessment Administration • Assessment Accessibility Supports • Assessment Security • English Learners and the Kindergarten Assessment • Administering the Approaches to Learning Segment • The Child Behavior Rating Scale • Administering the Early Math Segment • Numbers and Operations • Administering the Early Literacy Assessment • English Letter Names • English Letter Sounds • Spanish Letter Names Oregon Kindergarten Assessment Fall 2014

12. Accessibility Supports • “Practices and procedures that, when used in an assessment, provide equitable access to all students” • Accessibility Supports do not compromise the learning expectations, construct, grade-level standard, and/or measured outcome of the assessment • Only supports approved by the Accessibility Panel are allowed during assessment • Accessibility supports must be identified and implemented during classroom instruction prior to the student’s participation in the state assessment, unless precluded by the local assessment window

13. Universal Tools, Designated Supports, Accommodations, and Modifications • Universal Tools: Available to all students based on student preference and selection • Designated Supports: Access features available for use by any student for whom the need has been indicated by an educator or team of educators • Accommodations: Changes in procedures or materials that increase equitable access during assessment. Must be documented on student’s Individual Education Plan (IEP) or Section 504 plan • Modifications: Practice or procedure that compromises the intent of the assessment

14. Five Step Process • Expect participation in statewide assessments for all students • Learn accessibility supports • Select accessibility supports • Administer accessibility supports • Evaluate and improve use of supports

15. Decision Tree

16. Examples of Kindergarten Assessment Accessibility Supports Changes in assessment directions: • Sign directions • Interpret directions orally • Simplify language in directions Changes in how questions are presented: • Large print version of assessment • For Early Math, TA may point to each answer choice to support students who need this option

17. Documenting Accessibility Supports • Accessibility Supports can be addressed in four sections of the Individual Education Plan: • “Consideration of Special Factors” • “Present Levels of Academic and Functional Performance (PLAAFP)” • “Participation in Assessments” • “Supplementary Aids and Services”

18. Test Administrators Must: • Refer to the Oregon Accessibility Manual for accessibility supports implementation guidance • Refer to student’s Individualized Education Plan (IEP), 504 Plan or cumulative file to determine which accessibility supports must be provided

19. Test Administrators May Not: • Indicate “as needed” or “as appropriate” when documenting accessibility supports • Choose every accessibility support available for an assessment “just to be safe” • Provide accessibility supports for the first time on the day of testing • Provide the same accessibility supports for every student in the class, grade, or program • Provide a designated support or accommodation to a student that was not selected based on an assessment of individual student need

20. Test Administrators May Not: • Provide instruction or give suggestions regarding process • Read response choices aloud • Translate assessment items Remember, if you can’t find it in the Test Administration Manual (TAM) or the Oregon Accessibility Manual (OAM), don’t do it.

21. Summary • All accessibility support decisions must bebased on individual student need • Designated Supports are available to any student for whom the need has been indicated by an educator or team of educators • Accessibility supports must be documented on student’s Individual Education Plan (IEP) or Section 504 Plan • Accessibility Supports used during state testing must be selected from the 2014-2015 Test Administration Manual or the Oregon Accessibility Manual • Administration of supports for one student must notinterfere with the assessment conditions of another student

22. Assessment Administration • Assessment Accessibility Supports • Assessment Security • English Learners and the Kindergarten Assessment • Administering the Early Literacy Assessment • English Letter Names • English Letter Sounds • Spanish Letter Names • Administering the Early Math Segment • Numbers and Operations • Administering the Approaches to Learning Segment • The Child Behavior Rating Scale Oregon Kindergarten Assessment Fall 2014

23. Assessment Security • Protects the integrity and confidentiality of secure assessment items, prompts, and passages. • A test impropriety occurs when an assessment is not administered in a manner consistent with the Test Administration Manual • Improprieties include: • student coaching • mishandling of secure assessment materials • student given wrong assessment • unsecure assessment environment • missing the data entry deadline

24. Secure Assessment Environment • A quiet environment, void of distractions and supervised by a trained test administrator • Student access to only universal tools • All paper assessment materials collected and accounted for after each assessment event • Student data is treated as confidential

25. Student Coaching • Providing students with any type of assistance that may affect how a student responds • Includes both verbal cues and nonverbal cues to the correct answer • Test Administrators (TA) should limit interactions with students to the student directions included in the Assessor Booklets and to identified accessibility supports

26. Potential Consequences of Impropriety • Assessment opportunities may be invalidated • If the district determines that the testing impropriety qualifies as gross neglect of duty, then the district must report it to Teacher Standards and Practices Commission (TSPC) within 30 days • Districts may also evaluate cases according to their own Human Resource policies

27. Test Administrators Must: • Ensure that students take the correct assessment and data is are entered with the correct SSID • Securely shred assessment materials • Securely store assessment materials at all times • Report test improprieties within 1 day of learning of them (the district investigation must be completed within 30 days)

28. Test Administrators May Not: • Review or analyze secure assessment items • Allow students access to non-allowable accessibility supports • Allow students to remove assessment materials from the assessment environment • Provide students with unscripted feedback during the assessment • Copy or retain any assessment materials, including secure assessment booklets

29. Maintaining Assessment Security • Review universal tools prior to assessment • Examine the assessment environment to ensure that all non-allowable accessibility supports are removed • Limit interactions with students to the verbatim student directions in the Test Administration Manual and Assessor Booklets • Identify students designated to take the assessment in Braille or English-Spanish • Review IEP or 504 plan to identify needed accessibility supports

30. Maintaining Assessment Security, Continued • Do not leave the assessment environment unsupervised or allow untrained staff to enter the assessment environment • Communicate with staff ahead of time about upcoming deadlines • Cross-train staff in case of unplanned staff absences • Ensure that all necessary materials are collected several days before the deadline

31. Summary • Only authorized staff who have signed an Assurance of assessment Security Form may have access to the assessment environment or secure assessment materials • Test Administrators must limit interactions with students during testing to what is permitted by the Test Administration Manual or the Oregon Accessibility Manual • District Test Coordinators s must report all test improprieties to ODE within 1 day of learning of them

32. Online Resources for Administration, Accessibility, and Security • Kindergarten Assessment Resource Webpage: http://www.ode.state.or.us/go/ka • Test Administration Manual: http:www.ode.state.or.us/go/tam • Oregon Accessibility Manual: http://www.ode.state.or.us/search/page/?=487 • Assessment Security Forms: http://www.ode.state.or.us/go/testsecurity

33. Assessment Administration • Assessment Accessibility Supports • Assessment Security • English Learners and the Kindergarten Assessment • Administering the Early Literacy Assessment • English Letter Names • English Letter Sounds • Spanish Letter Names • Administering the Early Math Segment • Numbers and Operations • Administering the Approaches to Learning Segment • The Child Behavior Rating Scale Oregon Kindergarten Assessment Fall 2014

34. English Learners and the Kindergarten Assessment Objectives • Understand proper English Learner identification • Understand proper identification of Spanish language • Understand which measures an identified Spanish-speaking English Learner must be administered for 2014-15 Oregon Kindergarten Assessment Fall 2014

35. Proper Identification • Only English Learner students that have been identified with Spanish as their primary language should receive the Spanish Literacy segment (Spanish Letter Names) of the assessment • Upon enrollment to Kindergarten, students should receive a Home Language Survey to properly identify primary language. If a primary language other than English is identified, then Title III procedures should also be followed to determine proper ELD supports • Proper identification must happen within 30 days of the start of school, or within 2 weeks of a student’s enrollment in a district

36. Decision Matrix

37. Test Administrator Roles and Responsibilities Please be mindful of the Test Administrator’s (TA’s) roles and responsibilities. These need to be considered in addition to the following: • Proper administration of the Spanish portion should be done by a fluent bilingual Spanish and English assessor • If an Educational Assistant will administer the Spanish portion of the Kindergarten Assessment, please assure that they are properly trained, properly supervised, and are bilingual in both Spanish and English • If the district lacks the resources to provide a bilingual Spanish/English assessor, please contact the Regional ESD Helpdesk staff for assistance

38. Accessibility Supports Please be mindful of the approved Kindergarten Assessment accessibility supports which can be found in the 2014-15 Test Administration Manual and the Oregon Accessibility Manual For example: • Directions can be signed • Directions can be interpreted into student’s language of origin

39. Summary • All entering Kindergarten students should have a completedHome Language Survey upon enrollment • Students should be identified within 30 days of enrollment at the beginning of the school year, or with in 2 weeks of the student being enrolled in a district • If the student’s primary language is identified as Spanish, they are required to take the Early Spanish Literacy measure (Spanish Letter Names) in addition to the English Literacy, Early Math, and the Approaches to Learning Segments • The Early Spanish Literacy measure is not optional, it must be administered to all identified Spanish Speaking English Learners

40. Assessment Administration • Assessment Accessibility Supports • Assessment Security • English Learners and the Kindergarten Assessment • Administering the Early Literacy Assessment • English Letter Names • English Letter Sounds • Spanish Letter Names • Administering the Early Math Segment • Numbers and Operations • Administering the Approaches to Learning Segment • The Child Behavior Rating Scale Oregon Kindergarten Assessment Fall 2014

41. Early Literacy: English Letter Names • A direct fluency assessment that measures students' ability to name the letters of the English alphabet, in both lower case and capitalized forms • It is strongly suggested that districts administer English Letter Names early in the test window • All students participate in the assessment • Students are shown letters in a chart • This is a 60 second timed assessment • Students have 60 seconds to name as many letters as they can

42. Preparation Assessors need: • Clipboard • Stopwatch/ timing device • Pencil • Place marker or cover sheet • Assessor booklet (A2) • Student booklet • English (S1) or • Spanish/English (S2) • A quiet location

43. Setting the Stage • Seat yourself across the table from the student who is also seated • Position yourself so the student cannot see the documents on the clipboard or the stopwatch/timing device • Place the Student Booklet in front of the student • Open to the “English Letter Names” chart • Read the directions to the student • Start the stopwatch when the student says the first letter

44. Sample Student Chart Sample *Not the actual chart in the 2014-2015 kindergarten assessment

45. Directions in Assessor Booklet (A2) • Start the stopwatch when the student says the first letter name • Record student responses on the assessor chart

46. Directions in Assessor Booklet (A2) , continued • After 60 seconds mark the last letter with a bracket ] • Let the student finish the row or come to a natural stopping point before saying “Stop” • Record the number attempted and number correct

47. Scoring If the student: • Is correct, do not mark the letter and count as correct • Clearly loses his/her place, point to the next letter • Self corrects, write SCabove the letter and count as correct • Says incorrect letter name, slash through the letter, and count as incorrect • Hesitates more than 3 seconds, slash through the letter, supply the letter name and count as incorrect • Skips letter, circle the letter and count as incorrect • Record number of correct letters in # correct • Record number of attempts in # attempted

48. Additional Considerations If a student: • Provides the letter sound instead of the letter name, repeat the directions verbatim (allowed one time): “Say the name of each letter” • Provides the letter name in a language other than English, repeat the directions verbatim (allowed on time): “Say the name of each letter in English” • Loses his/her place and skips a line, redirect the student to the correct row • Does not name a letter in the first row, move to second row. If the student still does not identify a letter in the second row, the timed fluency assessment can be discontinued

49. Early Literacy: English Letter Sounds • A direct fluency assessment that measures students' ability to produce common sounds associated with letters of the English alphabet and common digraphs • It is strongly suggested that districts administer English Letter Sounds early in the test window • All students participate in the assessment • Students are shown letters and digraphs in a chart • This is a 60 second timed assessment • Students have 60 seconds to produce as many of the corresponding sounds as they can

50. Preparation Assessors need: • Clipboard • Stopwatch/timing device • Pencil • Place marker or cover sheet • Assessor booklet (A2) • Student booklet • English (S1) or • Spanish/English (S2) • A quiet location