Rater Training Requirements January 2013

1. Rater Training Requirements January 2013

2. This training does NOT replace the requirement of reading the 2013District and Campus Coordinator Manual and the TELPAS Manual.

3. Topics • Rater credentials and responsibilities • Overview of holistic rating training requirements and process

4. Determine Your Raters • Generate campus LEP roster • Determine who are their teachers • Teachers = TELPAS raters

5. Rater Credentials Each teacher selected to rate an ELL must: have the student in class; be knowledgeable about the student’s ability to use English in instructional and informal settings; hold valid education credentials such as a teacher certificate or permit; and, be appropriately trained, as required by TEA.

6. TELPAS Rater Responsibilities A student’s TELPAS rater is the teacher designated as the official rater of the student’s English language proficiency. The student’s rater must rate the student in ALL domains for which the student is eligible. A student is not permitted to have one rater for some domains and another rater for other domains.

7. Training Requirements Online Basic Training CourseThis course isfor NEW raters. It provides instruction on using the PLD rubrics and gives raters practice rating students in each language domain. There are separate courses for K–1 and 2–12. Online Calibration This is for ALL raters. It ensures that all raters are prepared to use the PLDs to accurately and consistently assess students for TELPAS.

8. Training Requirements If teachers have not rated since 2009, they MUST complete the Online Basic Training Course again.

9. TELPAS Holistic Rater Training The TELPAS Manual for Raters and Test Administrators must be read to prepare raters for online holistic rating training and may be used during calibrations and rating students. Returning Raters New Raters Online Basic Training Course Available Jan. 28th Online Calibration Sets 1 and 2* *Set 2 only required if not successful on Set 1 Available Feb. 18th If unsuccessful on Set 2, must attend Supplemental Support Holistic Rating Training by the Bilingual/ESL Department. Final Online Calibration Set 3

10. Rater Training Deadlines *Rater must attend Supplemental Support training before attempting final Set 3. Participants will be provided with an access code to attempt final set.

11. New and Returning Rater Definitions for K–1 and 2–12

12. Why is calibration necessary? • Calibration helps ensure that raters have adequate training, including ample practice and feedback, before they assess their students in the spring. • Calibration ensures that raters clear their heads and consider only the elements of student performance included in the PLDs. • Calibration supports assessment validity and reliability and is an important part of holistically scored assessment process.

13. How many students must be rated successfully during calibration? To successfully calibrate, raters need to rate students in the Training Center in their assigned grade cluster with at least a 70% accuracy rate.

14. Will raters be able to refer to any resources during calibration activities? Yes, raters should use their TELPAS rubrics (PLDs) and refer to, as needed, information from the: • online basic training course • holistic rating PowerPoints produced by TEA • TELPAS Manual for Raters and Test Administrators • Educator Guide to TELPAS

15. What happens if a rater is unsuccessful in calibrating set 2? The rater MUST attend Supplemental Support Training provided by the Bilingual Department Teachers are not authorized to serve as raters unless they complete the required training components.

16. Recap of Calibration Process • In each set, there are 10 students to calibrate • Raters who calibrate on set 1 are done • Raters who don’t, attempt set 2 • If still unsuccessful after set 2, must attend supplemental support • Third and final set

17. If Unsuccessful After Set 3 • Rater will be provided with rating support by a second rater who has successfully calibrated. • Second rater will ensure students are assessed consistently with the scoring rubrics (PLDs). • Second rater will sign rating roster as “Additional Rater”.

18. Grade Clusters of Training and Calibration • Raters must know their assigned grade cluster to select the appropriate online training. • Raters should consult with their campus testing coordinator if they are unsure of their assigned cluster. Grade Clusters Grades K–1Grade 2 Grades 3–5 Grades 6–8 Grades 9–12

19. When and where do raters take the online training? • Depending on campus arrangements, raters may either complete the online training course and calibration during school, after school, weekends, or on professional development day. • The online training system allows raters to access the training from any computer that meets the minimum system requirements.

20. Preparing for Calibration Sets • New raters must complete the Online Basic Training Course before beginning calibration. • Returning raters are highly encouraged to review the Online Basic Training Course (which includes rating activities) before beginning calibration.

21. Other Things to Know About Calibration • Raters affirm online that they will keep the contents of the calibration sets secure and confidential. • Calibration activities are taken from a bank and randomized. Trainees will rate different sets of students. • Raters can work at their own pace, go back and review students, and change ratings as they work.

22. Other Things to Know About Calibration • Raters can exit and return later to finish. They click a “submit” button when they are finished with a set. • After completing a calibration set, raters immediately see results. Results show the rating assigned by the rater and the correct rating. • Raters see annotations explaining the ratings. Raters should use the annotations to go back and review any incorrectly rated students.

23. Course and Calibration Certificates • New Raters -who complete the Online Basic Training Course are issued a course certificate of completion. • All Raters- Upon successful calibration, are issued a certificate of successful completion. It is NOT necessary for raters to print certificates! Coordinators have online access to view course and calibration progress of all raters.

24. Where To Access Online Training • Texas Training Center • Testing Department website “Quick Links” • TexasAssessment.com/TelpasOnlineTraining • Returning raters use same login. • Update “My Info” tab if new to school • New Raters will create a new account • Select “Self-Registration” below login • Site Code: telpas2013

25. TELPAS Administration Procedures Training • As part of annual spring TELPAS administration procedures training, holistic rating training requirements are reviewed with raters, as well as information about how to access the online training and calibration components. • In addition, raters receive training on assessment procedures such as how to assemble writing collections, how to record students’ proficiency ratings, etc.

26. TELPAS Verifier • To assemble and verify writing collections are acceptable for rating. • Cannot be a rater or paraprofessional • Must complete online course: • “Assembling and Verifying Grades 2-12 Writing Collections” • Click on TELPAS 2013 below “My TexasTraining Center Program”. • Click on Other Training (top center)

27. Assessment Window Begins: Monday, March 18th (After Spring Break) Ends: Wednesday, April 10th Use TELPAS Calendar to Plan!