CAASPP Training: Roles and Responsibilities

1. CAASPP Training February 3 / 5, 2015 http://goo.gl/SQOXz6

3. CAASPP CAASPP is comprised of the Smarter Balanced online assessment (CAT), pencil-paper science tests (CST & CAPA) and the California Alternate Assessment (CAA). http://goo.gl/SQOXz6

4. Agenda Introduction (Nicole) 5 min Training Plan / Cluster Support (Nicole) 5 min Roles and Responsibilities 5 min Planning/Scheduling (Amy) 10 min Technology (Amy) 5 min Accommodations and Designated Supports (Pam) 20 min Practice Tests (Amy) 45 min Security (Pam) 10 min CAPA / CMA / CST (Pam) 20 min TOMS (Pam) 30 min http://goo.gl/SQOXz6

5. Test Administrator Training and Support http://goo.gl/SQOXz6

6. Test Administrator Training We are working on finalizing support: • Training dates (based on request) • Instruction support for training and first week of testing at site See the “Support Schedule” tab on http://goo.gl/qu7fnx

7. Roles and Responsibilities (Pam) http://goo.gl/SQOXz6

8. Roles and Responsibilities Test Site Coordinator • Maintain security policies. • Manage Test Administrators into TOMS (template provided). • Manage testing schedules in collaboration with Administration and Tech Specialist. • Manage student test settings (Designated Supports and Accommodations) in TOMS. • Monitor testing progress and ensure that all eligible students participate • Address testing problems at the school site • Mitigate and report all test security incidents to the LEA CAASPP coordinator • Make sure resources are available (scratch paper, pencil, headphones). • Manage paper/pencil tests (CST). • Ensure all students participate in all appropriate tests.

9. Roles and Responsibilities Test Administrator • Read and sign the CAASPP Test Security Affidavit. • Complete training and review all Smarter Balanced policy and administration documents prior to administering any Smarter Balanced assessments. • Review student information prior to testing to ensure that the correct student receives the proper test with the appropriate supports/test settings. • Administer the Smarter Balanced assessments. • Report all potential test security incidents to the SC and LEA CAASPP Coordinator in a manner consistent with Smarter Balanced, state, and LEA policies.

10. Roles and Responsibilities Tech Specialist • Install the most current secure browser on testing devices and verify they are working. • Help troubleshoot during time of testing. • Collaborate with administrator and test site coordinator on schedules. • Secure browsers properly installed a minimum two weeks before testing (uninstall old browsers, if necessary). • Necessary hardware available and working (i.e., headphones, external keyboards, printers).

11. Roles and Responsibilities LEA CAASPP Coordinator: Nicole Johnston • Oversee adding of Test Site Coordinators and Test Administrators (TAs) into TOMS • Ensure Test Site Coordinators and TAs are trained LEA CAASPP Coordinator: Pam Lehto • Add Test Administrators into TOMS • Questions regarding test procedure • Report test security irregularities and/or breaches to the CDE LEA Technology Coordinator: Amy Wong • Technology related questions

12. Checklists • Appendix J and K in the Test Administrator Manual details responsibilities for: • Test Site Coordinator • Test Administrator • Appendix B in the CAASPP Technical Specifications Manual for Online Testing for: • Tech Specialist

13. Planning and Scheduling (Amy) http://goo.gl/SQOXz6

15. CAASPP Testing Schedule • The estimates do not account for any time needed to start computers, load secure browsers, and log in students • To help estimate number of days and associated network bandwidth required, schools should access the Smarter Balanced Technology Readiness Calculator athttp://www3.cde.ca.gov/sbactechcalc/ • Based on number of students, computers, and hours per day computers are available • Number of items will vary on CAT portion of test

16. CAASPP Testing Schedule • Scheduling is a collaborative effort • Recommended: CAT first, PTs second • The classroom activity should be completed within 3 days prior to administering a PT • ELA PTs have 2 parts and can be completed over 2 days • Mathematics PTs have 1 part and can be completed in 1 day • Recommended: PTs should not be administered on the same day as the CAT

17. CAASPP Testing Schedule Example 1 Example 2

18. Recommended Assessment Sequence - ELA

19. Recommended Assessment Sequence - Math

20. Make-Up Sessions • If a student is absent during the classroom activity, a make-up session must be scheduled • Should be similar to that of his or her peers • Provide students an opportunity to interact with the teacher or TA and his or her peers • Must be administered by a TA

21. Technology (Amy) http://goo.gl/SQOXz6

23. Secure Browser • Specifically designed for CA to provide secure access • Prevents students from accessing other hardware and software functions • A secure browser must be installed on all student computers/devices • Updated and reinstalled annually • Test Administrator computers uses standard browser • External keyboards required for iPads • Refer to the Secure Browser Installation Manual http://goo.gl/SQOXz6

24. Precautions • Close External User Applications • Prohibit Testing on Computers with Dual Monitors • Don’t use force-quit commands http://goo.gl/SQOXz6

25. Printers (Accommodation) • Print out test session information • Print test stimuli or items for students with the print-on-demand accommodation • Only the TA’s computer should have access to a single local or network printer in the testing room http://goo.gl/SQOXz6

26. Headphones • Headphones are required for each test station • English language arts/literacy (ELA) tests • Text-to-speech accommodation • Job Access with Speech (JAWS) • Supported headphones: • Wired headphones with a 3.5 mm connector • USB headphones with a wired or wireless connection • Microphones not required http://goo.gl/SQOXz6

27. Sample Parent Newsletter Text The new Smarter Balanced online assessment, part of the California Assessment of Student Performance and Progress, requires headphones for the English Language Arts portion of the test. For ease and comfort, please have your child bring in his or her own headphones for testing. If your child is unable to bring in headphones, school headphones will be made available for use. The headphones should be wired headphones with a 3.5 mm connector. http://goo.gl/SQOXz6

28. Accommodations and Designated Supports (Pam) http://goo.gl/SQOXz6

29. Universal Tools Universal Support are available to any student (see video) and include: • Highlighter (E) • Digital Notepad (E) • Expandable Passages (E) • Mark for Review (E) • Scratch Paper • Simplified Directions (does not apply to test questions) • Strikethrough (E) • Zoom (E) • Breaks during the test • Keyboard Navigation (E) The embedded supports (E) are chosen by the student at the time of testing. Non-Embedded supports are provided by the test administrator. http://goo.gl/SQOXz6

30. Designated Supports • Designated Supports are available to any student with parent or teacher recommendation and include: • Color Contrast (E) • Magnification (visual magnifying equipment) • Masking (E) • Noise Buffers • Read Aloud (Items not passages) • Scribe • Text-to-Speech for items, not passages • Turn off Any Universal Tool (E) • Designated Supports must be configured in TOMS at least 24 hours prior to beginning testing. http://goo.gl/SQOXz6

31. Accommodations Accommodations are only available to students with an IEP or 504 Plan and must be added to TOMS at least 24 hours prior to beginning testing. • Abacus • Alternate Response Options • American Sign Language (E) • Braille (E) • Calculator • Closed Captioning (E) • Large Print • Read Aloud - Test Questions/Answer Options Only • Scribe • Speech-to-Text (Essay responses dictated Orally) http://goo.gl/SQOXz6

32. Accommodations (cont.) • Print on Demand • must be pre-approved and set in TOMS in order to be used (2 week lead time). • Using the print-on-demand function does not necessarily allow something to be printed due to the adaptive nature of the test. • Specific information has to be set by the vendor. • Any other accommodation must be pre-approved by CDE at least 10 days prior to testing. • Additional accommodations may result in a student’s score not counting for accountability or participation. http://goo.gl/SQOXz6

33. Practice Tests and Training Tests (Amy) http://goo.gl/SQOXz6

34. Practice and Training Tests

35. Accessing Practice and Training Tests • There are two means for accessing the Practice and Training Tests: • Throughhttp://caaspp.org on a Web browser • Through the secure browser • Simulates operational online testing environment • TAs may create test sessions for the Practice or Training Tests on the TA Practice and Training Site • Students may return to a Practice Test and/or Training Test session

36. http://caaspp.org Students and parents who wish to access the Practice Test and/or Test via an Internet browser will select the button below

37. Your turn! How to Administer a Test Session Handout: http://goo.gl/ymSOmQ (Amy)

38. Directions • Pair up. Identify one person to be the TA and one person to be the student. • Go to http://caaspp.org and click on “Practice and Training Tests.” • TA: Click on “Test Administrator Practice and Training Site” and log on to the TA interface with your login. • Student: Click on “Student Practice and Training Tests.” • Follow on-screen or go at your own pace: http://goo.gl/ymSOmQ

39. Things for Students to Try on the Practice and Training Tests • Find the tutorial for help with how to answer a question • Try highlighting text • Mark a question for review • Pause your own test (note: you will have to start over)

40. Things for TA to Try on the Practice and Training Tests • Set embedded accommodations • Monitor student progress • Pause a student

41. Smarter Balanced Manuals Site Coordinators and Test Administrators Must Review: • Smarter Balanced Online Test Administration Manual • Smarter Balanced Usability, Accessibility, and Accommodations Guidelines • Test Administrator (TA) Reference Guide (not yet available)

42. Training Teachers • Sign security affidavits. • Provide teachers with log-ins and website availability. • All teachers must complete the Smarter Balanced Assessment Administration training by viewing the applicable videos and webcasts at http://caaspp.org/training/caaspp . NOT AVAILABLE YET • On completion, teachers will fill out this form to verify they completed the videos (applicable if watching videos independently) • All teachers must review policy and administration documents. • All teachers must view their students’ data prior to test administration to verify they are receiving the appropriate additional supports.

43. Training (con’t) • Classroom activity should be downloaded 2-3 days before teachers present it to their class. • All paper materials related to the classroom activity must be collected and destroyed prior to students doing the Performance Task. • For all parts of CAASPP testing, Test Administrator scripts must be followed exactly. • If a student is off task, the teacher says, “It is important that you do your best. Do you need to pause the test and take a break?” • If a student asks for assistance in answering or manipulating an item, the teacher may: • Suggest pausing the test (per above). • Gently instruct the student to review the tutorial for help. • Remind the student to reread the instructions. • Say “I can’t help you with your test. Try to do the best that you can.”

44. Training (con’t) • Anyone administering the paper-pencil science tests (grades 5 and 8) must be trained and watch the appropriate videos.

45. Practice and Training Tests • http://caaspp.org/practice-and-training/index.html • ALL students MUST be given the opportunity to use the practice sessions. • It provides an opportunity to see various test types. • The site simulates operational testing environment. • Students can try different universal tools (strikethrough, highlighter, • Teachers can create test sessions and students can practice logging in. • Practice and training sessions can be paused by students and reopened later.

46. Security (Pam)

47. Who takes CAASPP? All enrolled students must take the CAT except: • Students taking CAA (California Alternate Assessment) • EL students enrolled in US schools for less than 12 months are not required to take the ELA portion of CAASPP. • Students whose parents have submitted a letter requesting they be exempt from testing. The letter should be addressed to the principal and must specify the student name, grade, teacher, and which tests or parts of tests they do not want the student to participate in.

48. Test Environment • Cell phones or other electronic devices are not allowed to be used during testing (e.g., turned off and put away) • For testing purposes, any electronic device that is not specifically designated in the student’s Individual Education Plan (IEP) or Section 504 plan is unauthorized. • Post an “Unauthorized Electronic Devices May Not Be Used at Any Time During the Testing Session” sign so that it is clearly visible to all students • Place a “TESTING—DO NOT DISTURB” sign on the door

49. Testing Guidelines Students: • Must answer all test items on a page before moving on to next page • May not return to a test segment once it has been completed and submitted • Must answer all test items before the test can be submitted • Students may use scratch paper on the Performance Task, but it must be turned in at the end of the classroom activity.

50. Guidelines (cont.) Test Administrators (TAs): • Must follow the “SAY” script exactly each time a test session is administered.Refer to the “SAY” boxes of the Online Test Administration Manual and/or Online Directions for Administration. • Teachers must actively supervise students during all testing and monitor progress on the CAT. • Teachers are not allowed to review student responses. • Teachers must cover materials on walls that may aid in the test.