CAASPP 2015–16 Summative Assessment Coordinator Workshop

1. California Assessment of Student Performance and Progress (CAASPP) 2015–16 CAASPPCoordinator Trainer of Trainers February-March 2016 Presented by Melody Hartman-Palmero Assessment, Research & Evaluation

2. By the end of this workshop, attendees will understand: • Appropriate procedures for administration of the CAASPP summative assessments • Technology requirements for the local educational agency (LEA) • Student test registration in the Test Operations Management System (TOMS) • Identifying students that need designated supports and accommodations Purpose

3. Overview

4. Summative Assessment:One Part of an Integrated System

5. The Smarter Balanced Summative Assessments consist of the following: • English Language Arts/Literacy (ELA) and mathematics tests • Includes computer adaptive portion of the test, a classroom activity, ANDa performance task in each content area • The California Alternate Assessments (CAAs) consist of the following: • English Language Arts and mathematics tests for students with significant cognitive disabilities Student Participation: General

6. All students in grades 3–8 and grade 11 take the Smarter Balanced Summative Assessments with the following exceptions: • Students enrolled in or assigned to grades 3–8 and grade 11 whose IEP team designates the use of the California Alternate Assessments (CAAs) for ELA and mathematics • English learners who have been enrolled in a school in the United States less than 12 months (ELA only) Student Participation: General

7. The Early Assessment Program (EAP) uses the high school Smarter Balanced Summative Assessments forELA and mathematics. • Students taking the Smarter Balanced Summative Assessments in high school may choose to release their testscoresto the California State University (CSU) and participating California Community Colleges at the end of the computer adaptive tests. • Students who do not authorize the release of their testscoresto CSU and CCC at the time of testing may need to provide a copy of the CAASPP score report to the campus, upon request. Student Participation: (11th grade)Early Assessment Program

8. Parents must annually submit a written request specifying the tests to be exempted. • Should be delivered to school dated and signed by parent. • Need to send copy of request to CAASPPSupport@scusd.edu. • Condition Code needs to be marked in TOMS Parent Opt Outs

9. Computer adaptive test (CAT): • Students complete the CAT portion of the assessment for both ELA and mathematics. • The CAT includes a wide variety of question types. • As a student progresses, the difficulty of questions is adjusted on the basis of the student’s responses. • A student who answers a question correctly will receive a more challenging question • An incorrect answer will generate an easier question Smarter BalancedSummative Assessments

10. Classroom Activity for ELA and mathematics: • California will utilize the 2015–16 year as a transition year and will continue to assign classroom activities in ELA and mathematics. • In 2015–16, failure to administer the classroom activity is not considered a testing incident. • The CDE will not require LEAs to report failure to administer the classroom activity in the Security and Test Administration Incident Reporting System (STAIRS). Smarter BalancedSummative Assessments

11. Performance Task: • Students complete a performance task for both ELA and mathematics. • The Performance Task is designed to provide students with an opportunity to demonstrate their ability to apply their knowledge and higher-order thinking skills to explore and analyze a complex, real-world scenario. Smarter BalancedSummative Assessments

12. User roles • Secure browser used for administration of CAAs • Validation of selected test administration window • Validation rules for CAAs, IEP indicator, and accommodations • Process for requesting unlisted resources (previously called “individualized aids”) • Enrollment grade cutoff date • No accountability consequence for classroom activity not given to students What’s New for 2015–16

13. Security and Test Administration Incident Reporting System (STAIRS) • Deadline for condition codes and Appeals • Demographic snapshot • Student Score Reports available in Spanish What’s New for 2015–16

14. Changes to http://www.caaspp.org What’s New for 2015–16

15. What’s New for 2015–16

16. What’s New for 2015–16

17. Roles and Responsibilities

18. Available User Roles: New for 2015–16 2015–16 User Roles View-only roles

19. All Coordinators were added to TOMS • Test site coordinators have the ability to: add test administrators, test examiners, and other user roles for their assigned site. • Ensure that each user assigned either a Test Examiner or Test Administrator & Test Examiner role is a credentialed or licensed employee. • Ensure that all staff receive necessary training. LEA CAASPP Coordinator Responsibilities

20. Identify test administrators and test examiners and ensure that they have submitted signed CAASPP Test Security Affidavits. • Review and assign if needed site staff test administrators and test examiners roles in TOMS. • Adhere to local policies for protecting student information when assigning user roles. • Ensure that test administrators and test examiners are properly trained so they can administer the assessments. • Ensure that test examiners view the test administration tutorial and collect the certificate of completion and/or attend a training provided by the LEA. Test Site Coordinator Responsibilities

21. Enter and/or verify student test assignments and test settings in TOMS. • Create or approve testing schedules and procedures for the school site. • Work with technology staff to ensure that necessary secure browsers and supported operating systems are installed and any other technical issues are resolved. • Provide student login information on cards (i.e., login tickets) to assist test administrators with student login. • New: Login tickets can include any information as long as they are consider secure test materials and securely destroyed. Test Site Coordinator Responsibilities

22. Monitor testing progress and ensure that all eligible students participate. • Address testing problems that arise at the school site. • Mitigate and report all test security incidents to the LEA CAASPP coordinator. • Oversee CAASPP administration activities in the school. • Collect any print-on-demand questions and other secure testing materials (e.g., student login information and Directions for Administration[DFAs] for CAAs) following testing and securely destroy them. Test Site Coordinator Responsibilities

23. Read and sign the CAASPP Test Security Affidavit. • Complete training and review all Smarter Balanced policy and administration documents prior to administering any Smarter Balanced assessments. • Review student information prior to testing to ensure that the correct student receives the proper test with the appropriate supports and test settings. • Administer the Smarter Balanced Summative Assessments. • Report all potential test security incidents to the test site coordinator and LEA CAASPP coordinator in a manner consistent with LEA and state policies. Test Administrator Responsibilities

24. Are trained by the LEA and/or view the test administration tutorial, print the certificate, and submit it to the LEA. • Read and sign a CAASPP Test Security Affidavit and submit it to the test site coordinator. • Review and/or assign accessibility supports in TOMS for each student being tested. • Note: Test site coordinators may assign the accessibility supports or the LEA CAASPP coordinator may provide test examiners with temporary CAASPP test site coordinator-level access to TOMS. • Download and read the DFAsbefore testing. Test Examiner Responsibilities

25. TOMS User Roles and Definitions http://www.caaspp.org/administration/toms/toms-users.html • Instructions for Adding Users http://www.caaspp.org/administration/toms/toms-upload-users.html • 2015–16 User Role Guidance http://www.caaspp.org/administration/toms/index.html User Resources

26. User Resources • Guides & Templates • http://www.caaspp.org/administration/toms/index.html • 2015–16 Adding and Managing Users Guide • User template for batch upload • User file specifications for batch upload • TOMS Test Administration and User Setup Webcast • http://www.caaspp.org/rsc/videos/archived-webcast_102015.html

27. Technology Infrastructure

28. Prior to test administration,CAASPP coordinators with technology support should: • Check for a stable, high-speed, Internet connection (wired or wireless) because the Test Delivery System (TDS) administers tests via the Internet. • Check that testing devices are working. • Ensure that secure browsers are properly installed a minimum of two weeks prior to testing. • Make sure the necessary hardware is available and working (i.e., headphones, external keyboards, printers). Technology Infrastructure

29. Secure browsers are specifically designed for California to provide secure access. • New: Secure browsers for all supported operating systems now update annually; no need to reinstall every year. • Secure browsers prevent students from accessing other hardware and software functions while testing. • Secure Browser 8.0 must be installed on all computers/devices used to administer CAASPP tests. Note: Test administrator computers may use a standard Web browser. Secure Browsers

30. Students must use the secure browser to log on to take any CAASPP online test, including summative assessments, interim assessments, and the CAAs. • Prior to testing, test administrators and test examiners should verify that: • External user applications are closed. • The secure browser will not work if the computer detects that a forbidden application is running. • Testing does not occur on computers with dual monitors • Mirror mode can be used in the case of a read aloud but cannot be used otherwise. Secure Browsers

31. Print out test session information. • Print test stimuli or questions for students with the print-on-demand accommodation. • Only the test administrator’s computer should have access to a single local or network printer in the testing room. On-site printers

32. Headphones are required for each Smarter Balanced test station. • English languagearts/literacy (ELA) tests • Text-to-speech accommodation • Job Access with Speech (JAWS) • Version 16 supported • Supported headphones: • Wired headphones with a 3.5 mm connector • USB headphones with a wired or wireless connection • Bluetooth headphones: Logitech H800, SoundBot SB270, and ECO Sound ECO-V300 Note: Microphones are not required. Hardware Requirements

33. CAASPP Secure Browsers http://ca.browsers.airast.org/ • Diagnostic testing tool to test school’s bandwidth http://www.caaspp.org/about/testing/index.html • Secure Browser Installation Manual http://www.caaspp.org/rsc/pdfs/CAASPP.secure-browser-manual.2016.pdf • Technology Specifications Manual http://www.caaspp.org/rsc/pdfs/CAASPP.tech-specs-manual.2016.pdf • Preparing Technology for 2015–16 Webcast http://www.caaspp.org/rsc/videos/archived-webcast_111715-2.html Technology Resources

34. Practice Tests and Training Tests

35. There are multiple ways to prepare students and staff for the summative assessments: • Smarter Balanced Practice Tests • Smarter Balanced Training Tests • New: CAA Training Tests, coming soon Note: Practice tests for the CAAs are not available for 2015–16. Preparing Students and Staff

36. Practice Tests and Training Tests: • Do not assess all of the standards that will be in the operational tests. • Do not predict or gauge a student’s success on the operational assessments. • Do not produce overall scores. Important Notes About Practice and Training Tests

37. Smarter BalancedPractice Tests vs. Training Tests

38. CAAs Training Tests

39. Purpose of the Smarter Balanced Practice Tests Allow students and administrators to become familiar with: • The experience of a grade-level assessment • A variety of grade-specific questions and difficulty levels • Performance tasks • The format and structure of the operational assessments

40. Practice Test are available in each grade level for grades 3–8 and grade 11 for ELA and mathematics. • Each Practice Test contains approximately 30 questions. • Performance tasks are available for both ELA and mathematics. • Scoring rubrics and answers are available on the Test Administrators Resource Web page at http://www.caaspp.org/ta-resources/index.html. • All universal tools, designated supports, and accommodations are available. • Text-to-speech only available through secure browser. • Print-on-demand only available in proctored session. About the Smarter BalancedPractice Tests

41. Purpose of the Smarter Balancedand CAAs Training Tests • Designed to try out the universal tools, designated supports, and accommodations to establish the most optimal test setting experience for the student • Allow students and administrators to become familiar with the test delivery system and interface features • Allow students to become familiar with: • Accessing the tests (log on process) • The testing software • The navigational tools • Embedded supports

42. Training Tests are available by grade bands for grades 3–5, grades 6–8, and high school. • Each Training Test contains approximately 14 or 15 questions: • 6 ELA questions • 8 or 9 mathematics questions • There are no performance tasks included in the Training Tests. • There are no scoring rubrics or answer keys. • All universal tools, designated supports, and accommodations are available. • Text-to-speech only available through secure browser. • Print-on-demand only available in proctored session. About the Smarter Balanced Training Tests

43. Accessing the Practice and Training Tests • There are two means for accessing the Practice and Training Tests: • Through http://www.caaspp.orgon a Web browser • Through the secure browser, which simulates operational online testing environment. • Test administrators may create test sessions for the Practice Tests or Training Tests on the Test Administrator Practice and Training Site. • Students may return to a Practice Test and/or Training Test session.

44. Students and parents who wish to access the Practice Test and/or Test via an Internet browser will select the button below Accessing the Practice and Training Tests 1 2 3

45. Practice and Training Tests Resources • Test Administrator (TA) Resources for the Smarter Balanced Practice and Training Tests http://www.caaspp.org/ta-resources/practice-training.html

46. Using the Test Operations Management System (TOMS)

47. Verify all Test Administrators and Examiners are in TOMS • Review student data. • Assign students Science Tests—California Modified Assessment (CMA), CAAs/California Alternate Performance Assessment (CAPA) • Enter condition codes for Parent/Guardian Exemption (PGE) and Not Tested due to Medical Emergency (NTE). • Assign or modify online test settings to students. Tasks to Complete in TOMS for the 2015–16 Administration

48. Test Administration Windows

49. Testing windows for 2015–16 Smarter Balanced Summative Assessments: • Grades 3–8 for ELA and mathematics • The day on which 66% of a school’s annual instructional days have been completed • Grades 11 for ELA and mathematics • The day on which 80% of a school’s annual instructional days have been completed Note: Grade 11 scores used for Early Assessment Program (EAP) purposes. Test Administration Windows

50. Test Administration Windows • Testing windows for 2015–16 Science (CST/CMA/CAPA) and STS for RLA • Testing window of 25 instructional days, which includes 12 instructional days before and after completion of 85% of the school’s, or track’s, annual instructional days • Testing window for 2015–16 CAAs • April 11 through June 17, 2016, for all LEAs and schools