TELPAS 2015

1. TELPAS 2015 Kristen Joslin, DTC

2. This training does not replace your responsibility to read and follow all manuals and supplements.

3. Manuals to consider: 2015 DCCM Test Security Supplement TELPAS: Rater Manual TELPAS: Reading Test Administrator Manual

4. General Information • Grades K-12 LEP students including parent denials • Components • K-1 reading, writing, listening and speaking • 2-12 writing, listening, speaking and on-line reading test • Test Dates • Writing Collection: Feb 16 - March 26 • Reading online: March 16 - April 8 (should not have “absent” students) • Late arrivals – _________ or later, reading test only

5. Who Takes TELPAS All ELLs in grades K–12, including those whose parents decline bilingual/ESL program services, are assessed annually. In extremely rare cases, an ELL receiving special education services may be exempted from particular TELPAS domain(s) by the ARD committee in conjunction with the LPAC.

6. LEP & SpEd Students • The ARD and LPAC committee meet TOGETHER to determine domain by domain for rating and testing students. • Documented on “ESL/Bilingual & Special Education Test Assignment and Accommodations” Form • Deadline is February 21, 2014 NO BLANKET EXEMPTIONS.

7. Years in U.S. Schools • Years in US Schools is often confusing because pre-K and Kinder are not included in the count. It starts with grade 1 • Keep in mind the 60 day rule • Years in U.S. schools are important because they are used to determine accountability performance requirements for AYP and the Progress Measurement • For more information refer to the LPAC Manual

8. TEA Dates 4

9. Test Security and Confidentiality • Protect the contents of all online assessment and student performance (ratings and writing samples) documentation • Train and sign oath prior to handling testing materials. • No viewing, discussing, providing answers to secure testing materials (paper or on-line) • This also includes sharing answers to the raters training in Tx Training Center.

10. Campus Test Coordinator Responsibilities TELPAS

11. Campus Coordinator Responsibilities • Read all manuals • You will act as the writing collection verifier • Enter/verify student information in the online system • Ensure computer systems have been checked before testing • Contact Jamie Scott if you have computer issues

12. Campus Coordinator Responsibilities • Ensure that all eligible students are identified and tested (Howard) • Oversee the implementation of validity and reliability • You and your principal are responsible for test security on your campus • Supervise and actively monitor testing • Be the campus contact for all questions about testing • Report testing irregularities and security violations immediately • Campus documentation will go into the notebook and returned by May 1.

13. Things to Know About TELPAS Rater Training and Administration Procedures

14. Overview of the Rating Process • Districts identify ELLs in grades K–12 and designate raters to assess students • Test administration procedures and holistic rating training conducted to prepare grades K–12 raters to assess English language proficiency consistent with the holistic scoring rubrics, the Proficiency Level Descriptors (PLDs) • Raters gather writing samples for ELLs in grades 2–12 to include in each student’s writing collection • Raters use PLDs to assign students a rating in each language domain assessed

15. Rater Credentials Each teacher selected to rate an ELL must • have the student in class • be knowledgeable about the student’s ability to use English in instructional and informal settings • hold valid education credentials such as a teacher certificate or permit • be appropriately trained, as required by TEA

16. TELPAS Rater Responsibilities • A student’s TELPAS rater is the teacher designated by the district as the official rater of the student’s English language proficiency. • The student’s rater must rate the student in all domains for which the student is eligible. A student is not permitted to have one rater for some domains and another rater for other domains.

17. Collaboration with Others In determining the proficiency ratings of their assigned students, raters are highly encouraged to collaborate with other teachers and school personnel who have knowledge of the students’ English proficiency.

18. New and Returning Rater Definitions for K–1 and 2–12 A returning rater who has not completed the basic online training within the past three years will be required to complete training as a new rater. TEA

19. Two Types of Training Online basic training courseThis course isfor new raters. It provides instruction on using the PLD rubrics and gives raters practice rating students in each language domain. There are separate courses for K–1 and 2–12. Online calibration This is for all raters. Raters use the PLDs to rate students in each language domain. Raters have three opportunities to calibrate on assigned grade cluster. TEA

20. Fall ELPS-TELPAS Foundational (Awareness) Training For teachers who will be trained as new TELPAS raters in the spring if they lack this foundation Spring TELPAS Administration Procedures Training As a key part of this training, information from the TELPAS Manual for Raters and Test Administrators is reviewed to prepare raters to proceed with online holistic rating training Returning Raters New Raters Online Basic Training Course Online Calibration (Sets 1 and 2*) Online Calibration (Sets 1 and 2*) If not calibrated: Supplemental Holistic Rating Training Final Online Calibration (Set 3) *Set 2 required only if not successful on Set 1

21. When and where do raters take the online training? • I will notify raters of which training they will be required to attend by Feb. 30. • March 2 or 3: New Raters (all day) • March 4 or 5: Returning Raters (half day) • If calibration is not completed, raters may do so during school hours, at home after school, or on weekends. • The online training system allows raters to access the training from any computer that meets the minimum system requirements. TEA

22. Why is calibration necessary? • Calibration helps ensure that raters have adequate training, including ample practice and feedback, before they assess their students in the spring. • Calibration ensures that raters clear their heads and consider only the elements of student performance included in the PLDs. • Calibration supports assessment validity and reliability and is an important part of holistically scored assessment processes. TEA

23. Is calibration a test? No, it is a training method that ensures that raters have enough guidance, practice, and support to assess students consistently and accurately. Preparing for Calibration Sets • New raters must complete the online basic training course before beginning calibration. • Returning raters have the option to review the online basic training course (which includes rating activities) before beginning calibration. TEA

24. Other Things to Know About Calibration • Raters affirm online that they will keep the contents of the calibration sets secure and confidential. • Calibration activities are taken from a bank and randomized. Trainees will rate different sets of students. • Raters can work at their own pace, go back and review students, and change ratings as they work. TEA

25. Other Things to Know About Calibration • Raters can exit and return later to finish. They click a “submit” button when they are finished with a set. • After completing a calibration set, raters immediately see results. Results show the rating assigned by the rater and the correct rating. • Raters see annotations explaining the ratings. Raters should use the annotations to go back and review any incorrectly rated students. TEA

26. Will raters be able to refer to any resources during calibration activities? Yes, raters should use their rating rubrics (PLDs) and refer to, as needed, information from the: • online basic training course • holistic rating PowerPoints produced by TEA • TELPAS Manual for Raters and Test Administrators • Educator Guide to TELPAS TEA

27. Proficiency Level Descriptors (PLDs) • The PLDs are the rubrics teachers use to determine students’ English language proficiency for ongoing formative assessment and the spring TELPAS administration. • Originally developed for TELPAS, the PLDs were incorporated into the Texas English language proficiency standards (ELPS) in the 2007–2008 school year to reinforce their use in instruction. TEA

28. 6 Sets of PLDs • Listening Grades K–12 • Speaking Grades K–12 • Reading Grades K–1 Grades 2–12 (online) • Writing Grades K–1 Grades 2–12 (writing collection) TEA

29. Key Features of Each Proficiency Level Beginning Little or no English ability Intermediate Limited ability, simple language structures, high-frequency vocabulary, routine contexts Advanced Grade appropriate, with second language acquisition support Advanced High Grade appropriate, with minimal second language acquisition support TEA

30. How many students must be rated successfully? To be successful, raters need to rate students in their assigned grade cluster with at least 70% accuracy. TEA

31. Supplemental Holistic Rating Training • Raters not successful after sets 1 and 2 must receive supplemental training. • After the rater has received supplemental training, he or she will be able to access the third and final calibration set. TEA

32. Recap of Calibration Process • There are 3 sets of 10 students. • Raters who calibrate on set 1 are done. • Raters who don’t calibrate on set 1 go on to set 2. Raters who calibrate on set 2 are done. • Raters who don’t calibrate on set 2 receive supplemental training. • Raters attempt third and final calibration set. • Raters who calibrate on set 3 are done. TEA

33. Two outcomes are possible for individuals who complete the calibration activities but are not successful: • The district may choose not to assign the individual to be a TELPAS rater. • If the individual is needed to serve as a rater, the district must implement rater support procedures to ensure that the rater’s students are evaluated consistent with the rating rubrics. What happens if a rater is unsuccessful in calibrating? Individuals are not authorized to serve as raters unless they complete the required training components. TEA

34. Rating Roster An Additional Rater is required if the Rater did not pass the Calibration set with a 70% or higher after the 3rd attempt There must be teacher collaboration on ratings as part of the Validity & Reliability process

35. TELPAS Validity and Reliability Procedures • TEA mandated district procedures • For all language domains – grades K-12: • Raters will collaborate with other teachers of the students in determining the student’s rating. One collaborator will initial the TELPAS Rating roster for each child • For writing – grades 2-12: • All writing collections will be approved/verified before raters may begin the rating process.

36. Course and Calibration Certificates • Raters who take the basic training course get a certificate from the online TxTrainingCenter after completing the course components. • Raters will receive a certificate of successful calibration when they calibrate. • They will be given direction to print them off and turn into you. • All certificates will go in the TELPAS Documentation notebook TEA

37. Assembling and Verifying Writing Collections

38. Assembling and Verifying Writing Collections • 2 – 12 • Five writing samples • At least one narrative about a past event • At least two academic writing samples from math, science, or social studies. • All samples must have student’s full name and date accomplished on them • Only writing samples on or after February 16th may be used

39. Assembling and Verifying Writing Collections • May be a “clean” copy from work by the student to include a journal • No corrections by teacher or peers • May be typed but spelling and grammar checker must be off • The writing collection cover sheet and verification from Appendix A must be completed and attached on top of the samples for each student

40. What Not to Be Include in Collections • Copied from a textbook, lesson, or other written sources. • Papers done with heavy use of a dictionaries or thesaurus • Papers with teacher’s, peers, or parents corrections • Written primarily in another language than English • Worksheets or Q and A writing assignments • Brief, incomplete, or rushed papers

41. Verifier Responsibilities • Attend training on administrative procedures • Obtain access to Texas Training Center • Complete online training “Assembling and Verifying Writing Collections” • Print Certificate of Completion and put in notebook • Verify student writing collections in accordance with the checklist • Sign Oath • Verifier cannot be a TELPAS Rater

42. Online Training- Verifiers • Verifiers need self register for an account in the Texas Training Center https://texas.pearson.desire2learn.com • Site Code: telpas2015 Returning users that have forgotten their login information click on the “Login Help” link New Users click on the “Self Registration” link Page 57 in Rater Manual

43. Online Training- Verifiers • Verifiers need to self register for an account in the Texas Training Center https://texas.pearson.desire2learn.com • Site Code: telpas2015 • Click on TELPAS 2015 under the “My Texas TrainingCenter Program” header then:

44. Verifying the Writing Collection • Verifiers ensure that the writing collections meet all of the criteria based on the Verification Checklist by initialing each item (checklist is on the back of the Writing Collection Cover Sheet) page 54 of Rater Manual • Verifiers sign the bottom of checklist • Writing Collections are secure materials

45. TELPAS Reading

46. TELPAS Reading • TELPAS reading is conducted as an online only assessment • Administered to all LEP students in grades 2-12 • Since it is online, there are no test booklets or answer documents to handle or process

47. TELPAS Reading Accommodations • Refer to on-line accommodations • It is possible that a required accommodation is not available with online testing. In those cases, we will have to request approval from TEA to give a paper version of the test and order the materials. This is not a last minute process. Plan Ahead!!

48. TELPAS Reading Make-Ups • All students must be assessed within the assessment window • If a student is absent the day you have them scheduled to take TELPAS reading then move them to another session that will test later within the TELPAS assessment window • The TEA expectation is that we test every eligible student within the TELPAS assessment window

49. Tutorials • All students are required to take the tutorial prior to the day of the test. May take as many times as campus wants. • Tutorials are about how to use the computer not necessary the type of test questions • Keep a student roster for documentation of the tutorials for the TELPAS Documentation notebook • http://www.texasassessment.com/TELPAS/tutorials/ • Student Tutorial Administration Directions are available at the bottom

50. Ratings