California Assessment of Student Performance and Progress (CAASPP)

1. California Assessment of Student Performance and Progress (CAASPP) 2015 CAASPP Online Test Administration Workshop January 28, 2015

2. Agenda

3. Purpose • By the end of this workshop, attendees will understand: • The administration of the Smarter Balanced summative assessments using appropriate procedures • Proper technology infrastructure for the local educational agency (LEA) • Student test registration in the Test Operations Management System (TOMS) • Identifying and documenting students that need designated supports and accommodations • The Smarter Balanced interim assessments and the Digital Library

4. Overview

5. Student Participation Q: Who will take the online Smarter Balanced summative assessments? A: All students in grades 3–8 and 11 are required to take the summative assessments.

6. Student Participation: Early Assessment Program • The Early Assessment Program (EAP) will be using the grade 11 Smarter Balanced summative assessments in English language arts/literacy (ELA) and mathematics in place of the grade 11 CSTs in ELA and/or mathematics, additional 15 test questions and the ELA essay • Grade 11 students taking the Smarter Balanced summative assessments may choose to release their test results to the California State University (CSU) and participating California Community Colleges (CCC) at the end of the computer adaptive tests • Students who do not authorize the release of their test results at the time of testing may need to provide a copy of the score report upon request of the campus.

7. Student Participation (cont.) • The only students exempt from participating in the Smarter Balanced summative assessments are: • Students participating in the California Alternate Assessments (CAA) in English language arts/literacy (ELA) and mathematics • English learners (ELs) who have been attending school in the United States for less than 12 months (for the ELA test only)

8. About the Summative Assessments • Content areas: • English language arts/literacy (ELA) • Mathematics • Two components per content area: • Computer adaptive test (CAT) • Performance task (PT)

9. About the Summative Assessments (cont.) Q: What is the CAT component of the online summative assessment? A: The computer adaptive portion of the online test includes a wide variety of item types. As students progress throughout a CAT, the computer program adjusts the difficulty of questions throughout the assessment based on their responses. For example, a student who answers a question correctly will receive a more challenging item, while an incorrect answer generates an easier question.

10. About the Summative Assessments (cont.) Q: What is the PT component of the online summative assessment? A: The PT is designed to provide students with an opportunity to demonstrate their ability to apply their knowledge and higher-order thinking skills to explore and analyze a complex, real-world scenario. Prior to the PT, teachers or instructional staff conduct a Classroom Activity for all students to ensure that a lack of understanding of the context of the task does not interfere with a student’s ability to address the content of the task.

11. Systems and Processes for Online Administration 1 2 3 • CALPADS • (California Longitudinal Pupil Achievement Data System) • Manage student demographic data • TOMS • Set up test administration windows • Verify student demographic data • Configure online test settings (designated supports and accommodations) • Test Administrator Interface & Student Testing Site • Administer online Smarter Balanced assessments

12. Roles and Responsibilities

13. Important Roles • LEA CAASPP coordinator • Test Site Coordinator (SC) • Test Administrator (TA) • Technology Coordinator • CALPADS Administrator

14. LEA CAASPP Coordinator • Add SCs and TAs into the TOMS • Ensure that SCs and TAs are appropriately trained regarding the state and Smarter Balanced assessment administration as well as security policies and procedures • Report all test security irregularities and/or breaches that occur before, during, or after test administration to the California Department of Education (CDE) • Oversee all CAASPP administration activities in schools • Note: LEA CAASPP Coordinators were designated by the district superintendent at the beginning of the 2014–15 school year.

15. Test Site Coordinator • Identify TAs, ensure that they have submitted signed CAASPP Test Security Affidavits • Add TAs into TOMS • Ensure TAs are properly trained so they can administer the assessments • Enter and/or verify student test settings in TOMS • Create or approve testing schedules and procedures for the school

16. Test Site Coordinator (cont.) • Work with technology staff to ensure that necessary secure browsers are installed and any other technical issues are resolved • Monitor testing progress and ensure that all eligible students participate • Address testing problems at the school site • Mitigate and report all test security incidents to the LEA CAASPP coordinator • Oversee CAASPP administration activities in the school

17. Test Administrator • Read and sign the CAASPP Test Security Affidavit • Complete training and review all Smarter Balanced policy and administration documents prior to administering any Smarter Balanced assessments • Review student information prior to testing to ensure that the correct student receives the proper test with the appropriate supports/test settings • Administer the Smarter Balanced assessments • Report all potential test security incidents to the SC and LEA CAASPP Coordinator in a manner consistent with Smarter Balanced, state, and LEA policies

18. Technology Coordinator • Assist LEAs in setting up and overseeing technology infrastructure • Support each school site • Work closely with the LEA CAASPP Coordinator to ensure network and testing devices are properly prepared by installing the most current secure browser • Help troubleshoot during time of testing

19. CALPADS Administrator • Ensure student demographic, enrollment, and program participation data is correct in the CALPADS (3 files total) • Work closely with the LEA CAASPP Coordinator

20. Technology Infrastructure

21. Technology Infrastructure • Prior to the test administration, LEA CAASPP coordinators with technology coordinators should review the technology infrastructure at their schools. • Testing devices are working • Secure browsers properly installed a minimum two weeks before testing (uninstall old browsers, if necessary) • Necessary hardware available and working (i.e., headphones, external keyboards, printers) • Content filters, firewalls, and proxy servers configured • Stable (wired or wireless) Internet connection

22. Internet and Network Requirements • For testing to occur, a stable, high-speed Internet connection is required since the Test Delivery System (TDS) administers tests via the Internet.

23. High-level Technology Overview State hosted-test delivery servers Internet TA using standard Web browser Student using Smarter Balanced California Secure Browser software application

24. Secure Browser • Specifically designed for California to provide secure access • Prevents students from accessing other hardware and software functions • A secure browser must be installed on all student computers/devices • Updated and reinstalled annually • Note: Test Administrator computers will use a standard Web browser

25. Secure Browser Availability • Windows XP (Service Pack 3), Vista, 7, 8.0, and 8.1, Server 2003, 2008 • Mac 10.4 (PowerPC or Intel processors) • Mac 10.5 (Separate versions for PowerPC and Intel processors) • Mac OS X 10.6–10.10 • Linux Fedora 16–20, openSUSE 13.1, Red Hat 6.5, and Ubuntu (LTS) 10.04, 12.04, and 14.04 • Apple iOS 6.0–8.0 • Android 4.0.4–4.4 • Chrome OS 31–39

26. Secure Browser (cont.) • Students must use the secure browser to log on to take a summative test • Prior to testing, TAs should verify that: • External user applications are closed • The secure browser will not work if the computer detects that a forbidden application is running • Testing does not occur on computers with dual monitors

27. Hardware Requirements • Device displays • 10″ diagonal display or larger (iPads with 9.5″ screens are acceptable) • 1024 x 768 display resolution or better • Check monitor settings and brightness • On-site printers • Print out test session information • Print test stimuli or items for students with the print-on-demand accommodation • Only the TA’s computer should have access to a single local or network printer in the testing room

28. Hardware Requirements • Headphones are required for each test station • English language arts/literacy (ELA) tests • Text-to-speech accommodation • Job Access with Speech (JAWS) • Supported headphones: • Wired headphones with a 3.5 mm connector • USB headphones with a wired or wireless connection • Bluetooth headphones: Logitech H800, SoundBot SB270, and ECO Sound ECO-V300 • Microphones not required

29. Hardware Requirements • External keyboards required for tablets • Mechanical • Manual • Bluetooth-based • Avoid keyboards with additional “shortcut” buttons

30. Technology Resources • Diagnostic testing tool to test school’s bandwidth: • Available on the CAASPP Web site at http://caaspp.org • Secure Browser Installation Manual: • http://caaspp.org/rsc/pdfs/CAASPP.secure-browser-manual.2015.pdf • Technology Specifications Manual: • http://caaspp.org/rsc/pdfs/CAASPP.tech-specs-manual.2015.pdf

31. Technology Resources (cont.) • Preparing Technology for 2015 Online Testing archived Webcast: • http://caaspp.org/rsc/videos/archived-webcast_101514.html • Call or e-mail CalTAC for help with troubleshooting • E-mail:caltac@ets.org • Phone: 800-955-2954

32. Practice Tests and Training Tests

33. Preparing Students and Staff • There are multiple ways to prepare students and staff for the Smarter Balanced summative assessments: • Practice Tests • Training Tests

34. Important Notes About Practice and Training Tests • Practice Tests and Training Tests do not: • Assess all of the standards that will be in the operational tests • Predict or gauge a student’s success on the operational assessments • Produce scores

35. Purpose of the Practice Tests • Allow students and administrators to become familiar with: • The experience of a grade-level assessment • A variety of grade-specific items and difficulty levels • Performance tasks (PTs) • The format and structure of the operational assessments

36. About the Practice Tests • Practice Tests are available in each grade level for grades 3–8 and 11 for English language arts/literacy (ELA) and mathematics • Each Practice Test contains approximately 30 items • Performance tasks are available for both ELA and mathematics • Scoring rubrics and answers are available on the TA Resource Web page at http://caaspp.org/ta-resources/index.html • All universal tools, designated supports, and accommodations are available

37. Purpose of the Training Tests • Allow students and administrators to become familiar with the test delivery system and interface features • Allow students to become familiar with: • Accessing the tests (log on process) • The testing software • The navigational tools

38. About the Training Tests • Training Tests are available by grade bands for: • Grades 3–5 • Grades 6–8 • High school • Each Training Test contains approximately 14–15 items • 6 ELA items • 8–9 math items • There are no performance tasks included in the Training Tests • No scoring rubrics or answer keys • All universal tools, designated supports, and accommodations are available

39. Practice Tests vs. Training Tests

40. Accessing the Practice and Training Tests • There are two means for accessing the Practice and Training Tests: • Through http://caaspp.org on a Web browser • Through the secure browser • Simulates operational online testing environment • TAs may create test sessions for the Practice Tests or Training Tests on the TA Practice and Training Site • Students may return to a Practice Test and/or Training Test session

41. Accessing the Practice and Training Tests 1 Students and parents who wish to access the Practice Test and/or Test via an Internet browser will select the button below 2 3

42. Practice and Training Tests Resources • Using the Online Practice and Training Tests archived Webcast • http://caaspp.org/rsc/videos/archived-webcast_110514.html

43. Using the Test Operations Management System (TOMS)

44. Tasks to Complete in TOMS for the Online Administration • Add and manage SCs and TAs • Set up test administrations • Review student data • Demographic data from CALPADS • Test enrollment • Assign online test settings to students

45. Accessing TOMS • LEA CAASPP coordinators were given access to TOMS after the superintendent designation form and test security agreement were submitted to the California Technical Assistance Center (CalTAC) • LEA CAASPP coordinators received an e-mail with a username and temporary password that allows access to TOMS • If an LEA CAASPP coordinator has not received the e-mail with temporary password, he or she should contact CalTAC. • TOMS can be accessed from the CAASPP portal at http://caaspp.org

46. Adding and Managing SCs and TAs • LEA CAASPP coordinators are responsible for adding SCs and TAs to TOMS • Two methods: • One by one in TOMS • Template upload through online form • Template: http://caaspp.org/rsc/pdfs/CAASPP.toms-user-upload-file.2015.xlsx • Online form: http://caaspp.org/administration/toms/users/

47. Adding and Managing SCs and TAs

48. Adding and Managing SCs and TAs Resources • TOMS Adding and Managing User Guide: • http://caaspp.org/rsc/pdfs/CAASPP.adding_managing_users.2015.pdf • Adding and Managing Users in TOMS video tutorial: • http://caaspp.org/rsc/videos/archived-webcast_toms-users.html

49. Setting Up Test Administrations • Testing windows for 2015 Smarter Balanced online summative assessments: • Grades 3–8 • At least 66% of a school’s annual instructional days must be completed • Grade 11 • At least 80% of a school’s annual instructional days must be completed • EAP information is derived from a subset of the students’ summative assessment item responses

50. Setting Up Test Administrations • Steps to take in TOMS: • Set non-delivery and non-working dates • Set instructional start and end dates • Set non-instructional dates • Set and activate testing administrations • Assign schools to testing administrations