TELPAS Training for Principals 2014

1. TELPAS Training for Principals2014

2. Disclaimer • This presentation does not take the place of reading the manuals • Campus test coordinators, raters, verifiers, and reading test administrators are responsible for reading the appropriate manual(s) and complying with all the instructions

3. Components of Today’s Training • Scope and Purpose of Training • General Testing Procedures • Test Security & Confidentiality • Overview of TELPAS • Principal’s Role • Online Reading Test • Final Documentation Submission

4. District and Campus Coordinator Manual(DCCM, pg. T-13)

5. Principal’s Role in TELPAS

6. General Testing Procedures • Test security • Test security procedures and oaths • Active monitoring • Consequences of cheating • Scheduling test administrations • Testing window • Time limits • Breaks • Make-up testing • Preparing for test administrations • Identifying eligible students • Managing secure materials • Preparing for online administrations

7. General Testing Procedures(Continued) • Testing with accommodations • Allowable test administration procedures and materials • Accommodations for students with disabilities • Linguistic accommodations • Ensuring students receive appropriate accommodations • Monitoring test administrations • Availability of test coordinator and principal • Completing the testing process • Documentation

8. Test Security And Confidentiality • Test Security • Must secure and account for all secure materials and confidential student information before, during, and after each test administration • Writing samples • Rating rosters • Student authorization letters • Paper-based tests (if applicable) • Access must be limited to personnel who meet the requirements to participate in the testing, have been trained, and have signed the appropriate oath • Holistic raters • Writing collection verifier(s) • Reading test administrator(s) • Rating entry assistant • Technology staff

9. Test Security and Confidentiality • Confidentiality • Before handling secure materials, testing personnel must be trained and sign the appropriate oath • Personnel working in the AMS must read and accept a statement of confidentiality • No person may view, reveal, or discuss the contents of an online assessment before, during, or after a test administration unless specifically authorized by TEA • If circumstances necessitate that an online assessment be examined, permission must first be obtained from TEA • No person may duplicate, print, record, write notes about, or capture by electronic means any portion of a secure assessment without prior approval from TEA • No individual other than the student may respond to test items • No person may review or discuss student responses or performance data during or after a test administration unless specifically authorized to do so by the procedures outlined in the test administration materials

10. Test Security and Confidentiality • Two categories of irregularities: • Serious • Procedural • Serious irregularities constitute severe violations of test security and/or confidentiality and can result in the individual(s) responsible being referred to the TEA Educator Standards and Certification Legal Division for consideration of disciplinary action including: • Placement of restrictions on the issuance, renewal or holding of a Texas educator certificate, either indefinitely or for a set term • Issuance of an inscribed or non-inscribed reprimand • Suspension of a Texas educator certificate for a set term • Revocation or cancellation of a Texas educator certificate without opportunity for reapplication for a set term or permanently

11. Test Security and Confidentiality • Testing Irregularities (Serious) • Directly or indirectly assisting students with responses to reading test questions or holistic writing samples • Tampering with student responses or writing samples • Falsifying TELPAS holistic ratings • Unauthorized viewing of secure test content • Discussing secure test content, student responses, or student performance • Scoring student reading tests, either formally or informally • Unauthorized duplicating, recording, or electronically capturing secure test content (online reading test) • Teachers sharing answers to the online calibration activities or practice rating activities (online training)

12. Test Security and Confidentiality • Testing Irregularities (Procedural) • Eligibility errors • Testing ineligible students • Failure to test eligible students in all appropriate domains • IEP Implementation Errors • Failure to provide a prescribed accommodation • Providing an unauthorized accommodation • Improper accounting for secure materials • Lost or misplaced writing samples or other confidential or secure materials • Rating rosters and writing samples must be secured until the assessments are complete • Rosters should be given to CTCs to be stored • Writing samples remain confidential but should be placed in the student’s permanent folder after the assessment has been recorded in the AMS

13. Test Security and Confidentiality • Testing Irregularities (Procedural) • Monitoring errors • CTC did not require raters to return confidential materials • Test administrator left a room unattended when students or secure materials were present or when secure online tests were visible • Secure online tests were left open and visible during a lunch break, short break in room, or restroom break • Testing personnel did not monitor students during a break • Testing personnel did not ensure that students worked independently during the online reading test • Students were not prevented from using cell phones or other electronic devices to take pictures or send messages • A student was allowed to remove secure materials

14. Test Security and Confidentiality • Testing Irregularities • Procedural errors • Test administrator failed to issue the correct materials or non-allowed materials were provided to students • Untrained or improperly trained personnel were allowed to rate students or administer tests • Test administrator failed to use the test administrator manual or failed to read the bolded test administration instructions verbatim • Displays that might provide assistance were visible • TELPAS writing collection was not submitted in accordance with the required assembly criteria • Test administrator failed to provide a student with the correct student authorization to access the reading test

15. Test Security and Confidentiality • Reporting Testing Irregularities • Contact Teresa Daugherty immediately upon discovery • Incidents involving disciplinary actions taken against students for cheating • Contact Teresa Daugherty

16. Overview: What is TELPAS? Texas English Language Proficiency Assessment System TELPAS is the assessment tool that fulfills federal requirements for assessing the English language proficiency of ELLs in grades K-12

17. What Does TELPAS Measure? TELPAS assesses the proficiency of students in four domains and reports student performance in terms of four English language proficiency levels: Domains Assessed • Listening • Speaking • Reading • Writing Proficiency Levels • Beginning • Intermediate • Advanced • Advanced High

18. Assessment Components • Grades K–1 • Holistically rated observational assessments of listening, speaking, reading, and writing • Grades 2–12 • Holistically rated observational assessments of listening and speaking • Holistically rated writing collections • Multiple-choice online reading tests in six grade clusters: 2, 3, 4–5, 6–7, 8–9, 10–12 Students’ online reading test answers, holistically rated assessments, and all other student data are submitted through the Assessment Management System

19. TELPAS Student Rating Roster Principal’s signature verifies: • Rater is a trained and calibrated rater • Additional rater meets the requirements • Roster is completed properly • Ratings are accurately displayed

20. Rater Credentials • Rater must: • Have the student in class at the time of the spring assessment window • Be knowledgeable about the student’s ability to use English in both instructional and informal settings • Hold valid educational credentials • Be appropriately trained in the holistic process • Rate the student in all eligible domains • May include bilingual teachers, ESL teachers, general education teachers, special education teachers, G/T teachers, and teachers of enrichment subjects Paraprofessionals may NOT serve as raters!!

21. Grades K–12 Holistic Rating Training Flowchart Fall ELPS-TELPAS Professional Development (For new teachers and new prospective raters -- recommended) Spring TELPAS Administration Procedures Training Covers holistic rating training requirements and procedures for conducting TELPAS New Raters Returning Raters Online Basic Training Course Online Calibration Activities Sets 1 and 2: Set 2 required if not successful on Set 1 Online Calibration Activities Sets 1 and 2: Set 2 required if not successful on Set 1 If not calibrated: Supplemental Holistic Rating Training Final Online Calibration Activity Set 3

22. Online Training Components R A T E R R E S P O N S I B I L I T I E S • Online Basic Training Course • Required for: • All NEW raters • All raters who have not completed training within the last three school years • Any rater who failed to calibrate on the 1st or 2ndattempt last year • Two basic courses • K-1: Covers all four language domains (listening, speaking, reading, and writing) • 2-12: Covers the listening, speaking, and writing domains • Must be completed before attempting the online calibration • Approximate time to complete: 4-5 hours

23. Online Training Components R A T E R R E S P O N S I B I L I T I E S • Online Calibration • Required for ALL raters (new & returning) • Consists of 3 sets of (10) students to be rated in all applicable domains • Approximate time to complete: 1 hour

24. Training Certificates & Professional Development Credit • Training certificates are generated for raters who complete training courses and calibration activities • *Certificate of completion issued when a rater completes an online course • *Certificate of successful completion issued when a rater demonstrates sufficient calibration (70 percent or better) on a calibration set • Five hours are awarded for the K–1 and 2–12 basic training courses • Two hours are awarded (in all) for calibration * Raters must provide a copy to the CTC for documentation

25. Supplemental Support Providers • Purpose: • To provide a system of supplemental support to assist raters who have not successfully calibrated by the end of the second set • Each campus must assign at least one SSP • Requirements for SSP • Be a 2012-2013 fully trained rater in the applicable K-1 or 2-12 grade span • Complete the recorded web-based training • Calibrate successfully on either set 1 or set 2

26. End Dates for Holistic Rating Training • TEA recommends completion of training requirements by the first day of the TELPAS assessment window (March 17) • Basic training courses and calibration activities will be open throughout TELPAS assessment window to: • allow districts to handle extenuating circumstances • allow raters to refer back to course information and practice activities as they rate their students

27. Key Holistic Training Dates * KISD window closes on April 4th to provide adequate time for verification of completion

28. Monitoring Course Completions & Calibration Activities (CTC Responsibility) • Statewide rater lookup tool: Texas TrainingCenter • Reports for online training and calibration • TELPAS Returning Rater Planning Roster • Uses records from the last five school years to generate a list of previously trained raters • TELPAS Confidential Course Completion Roster • Lists online basic training course status and performance by user for the current year • TELPAS At-a-Glance Training and Calibration Report* • Lists training course and calibration status for all registered users for the current year • Identifies “Time Spent” on calibration activities • TELPAS Confidential Calibration Summary Report • Provides calibration summary information by grade cluster (K–1, 2, 3–5, 6–8, 9–12) and for grade clusters combined

29. *TELPAS At-a-Glance Training and Calibration Report • New: “Time Spent” column documents how long the rater spent on the calibration activities • If “Time Spent” field indicates an unlikely value for successfully working through the scenarios and rating the students, CTC must investigate • If the rater did not perform the calibration activities independently, CTC must report this irregularity • These types of irregularities fall into the “Serious” category that could result in severe consequences

30. *TELPAS At-a-Glance Training and Calibration Report

31. Assembly & Verification of Grades 2-12 Writing Collections CTC appoints individual(s) to verify the collection of writing samples meets the criteria required

32. Writing Collection Verifier Credentials • May be LPAC administrators, school counselors, or other suitable staff • May NOT be paraprofessionals • May NOT be teachers serving as TELPAS raters this year

33. Assembly & Verification of Grades 2-12 Writing Collections • Raters are responsible for assembling writing collections that accurately depict the ability of the students to communicate in writing • Writing samples should come from a variety of core content areas • Writing samples should be taken from authentic classroom activitiesthat are grounded in content area TEKS and ELPS • Recent writing samples should be weighted more heavily in the event that a student’s rating is borderline between two levels of proficiency • Classroom observations are not used for these grade levels

34. Assembly & Verification of Grades 2-12 Writing Collections • Requirements for samples: • Must contain at least 5 writing samples • At least 1 narrativewriting sample about a past event • At least 2 academic writing samples from math, science, or social studies • Assigned on/after February 17, 2014 • Should reflect current proficiency • Each sample must include student’s name anddate • Cover sheet and verification checklist (Appendix C) must be completed and stapled to student’s writing samples • Photocopies of classroom writing assignments may be used if clear and legible • Writing samples may be typed if spelling/grammar checkers disabled

35. Writing from Authentic Classroom Activities • Do not gather all of your LEP students and have a “writing party” for TELPAS • Writing samples should be collected from classroom assignments in which all students participate

36. Assembly & Verification of Grades 2-12 Writing Collections The district coordinator is required to submit a testing irregularity incident report to TEA if the student writing samples submitted are based on incorrectly assembled writing collections

37. Validity and Reliability • CTC oversees procedures to ensure validity and reliability of holistic ratings Killeen ISD’s policy is to implement the 1st and 4th recommendations of TEA

38. Validity and Reliability Procedures to Ensure Validity & Reliability • As was the case last year, there must be a second set of eyes reviewing the rater’s assessment for each student • Writing samples must be reviewed by a trained and calibrated 2nd rater, but he/she does not have to have the student in class • Other holistic domain ratings can be corroborated by any certified professional who has a knowledge of the student’s listening and speaking capabilities in an academic and social environment • UNLIKE primary raters, 2nd raters need not rate all domains; each needs to sign appropriate form

39. TELPAS Assessment Eligibility Requirements • Campuses are required to assess all K-12 ELLs enrolled during the TELPAS testing window*: • Currently identified as LEP • LEP code = 1 in eSchoolPlus • Includes parent denials • Includes homebound students • Does NOT include students who have been exited from the program and who are in their 1st or 2nd year of monitoring • LEP codes F, S in eSchoolPlus are NOT tested * In rare instances due to ARD specifications or other unusual circumstances, a student may not be required to participate in one or more TELPAS domains--see DCCM Page T-4

40. Identifying Eligible ELLsCTC Responsibility • Use the Advanced Search tab in eSchoolPlus to find currently identified LEP students • KISD Connect Precode report (filtered on LEP = C) should match the students found in #1 • *Use KISD Reporting (SSRS) to identify students who were previously enrolled as LEP and who were not exited from the program * Use this report with either of the other two methods to make sure your list is complete.

41. Key Dates in Determining Which Campus is Responsible for Assessing Students • Responsibility for assessing students who enroll or withdraw before the testing window • Student withdraws/enrolls before March 17 • Sending campus: • Do NOT enter any ratings • Remove student from all online test sessions and holistic rating entry groups • If student has writing samples, give them to receiving campus • Receiving campus: • Responsible for assessing all domains • Enter holistic ratings • Administer online reading test

42. Key Dates in Determining Which Campus is Responsible for Assessing Students • Responsibility for assessing students who enroll or withdraw during the testing window • Student withdraws/enrolls on or after March 17 • Sending campus: • Responsible for entering all holistic ratings • If student has not taken the online reading test, remove student from all test sessions • Receiving campus: • Responsible only for administering the online reading test (if student has not already completed the test) • Note: Students whose last day is March 7th, are not officially withdrawn until March 17th so the sending campus must enter holistic ratings for these students

43. Important Dates • Timeline • Holistic rating completion/rating roster turn-in to CTC • Earliest Date: 3/17/2014 • Deadline: 4/4/2014* • Assembling & verifying writing collections (grades 2-12) • Earliest Date: 3/17/2014 • Deadline: 4/4/2014* * KISD window closes on April 4th to provide adequate time for verification of completion

44. TELPAS Student Rating Roster Rating Section Legend Signatures

45. Properly Completing the TELPAS Student Rating Roster (Rating Section) • Place one name—the entire name—on one line (if possible) • Grade level must be K, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, or 12 • Rating domain entries must be B, I, A, H, E, or X • NO substitutions or other abbreviations allowed • The Reading (K-1 only) column should be blank for grades 2-12 • There should be NO other blank entries

46. Properly Completing the TELPAS Student Rating Roster(Rater Information Section) • Rater A and Rater B Information columns must be completed • Rater A entries must be 1, 2, 3, 4, 5, 6, 7, OR 8 • Rater B entries must be 1, 2, or 3 • Consult the Rater Information listed below the roster to determine the correct value for each

47. Properly Completing the TELPAS Student Rating Roster (Signature Section) • Rater must sign and date the roster • Additional rater (almost all should have one) must sign and date the roster • Principalmust sign and date the roster • Nobody else may sign for the principal • Campus Name must be written on the roster

48. What’s Wrong with this Picture?

49. What’s Wrong with this Picture? . .

50. What’s Wrong with this Picture?