California Assessment of Student Performance and Progress Pre-Test Workshop 2014

1. California Assessment of Student Performance and Progress Pre-Test Workshop2014 February 14, 2014; 8:00-11:00 am; E-116 February 14, 2014; 1:00-4:00 pm; E-116 February 19, 2014; 1:00-4:00 pm; E-116 February 21, 2014; 8:00-11:00 am; E-116 February 21, 2014; 1:00-4:00 pm; E-116 Cin Rogers, Ed.D. District Coordinator for State Assessments 457-3828 cin.rogers@fresnounified.org

2. Agenda • Overview • Roles and Responsibilities • Technology Infrastructure • Preparing Students and Staff for the Field Test • Field Test Registration • Field Test Administration • Designating Student Accessibility and Accommodation Options • Test Security • Questions

3. Emergency Test Regulations for CAASPP Administration in 2013-14 • New regulations were adopted by the State Board of Education on January 15, 2014 • The new regulations address: • New security agreements and affidavits • Testing windows • Use of universal tools, designated supports, and accommodations • Coordinator roles and responsibilities • Available on the CDE Web site: • http://www.cde.ca.gov/re/lr/rr/caaspp.asp

4. Objectives CAASPP School Test Coordinators will: Schedule and administer the SBFT tests using appropriate procedures, including security. Ensure all materials are handled securely and appropriately. Identify and document students who need designated supports and accommodations. Train Test Administrators to conduct testing consistently.

5. CAASPP ** See hand out for assigned Test Windows

6. Smarter Balanced Schedule Downtime • Scheduled downtime to perform system maintenance of the SB Field Test • Thursday, April 10 – Sunday, April 13, 2014 • Thursday, May 8 – Sunday, May 11, 2014 • Scheduled downtime for the Practice and Training Tests • Saturday, April 26 – Tuesday, April 29, 2014

7. Purpose of SBFT • “Test the test” • Evaluate testing software • Ensure quality of test questions • Evaluate the effectiveness of the test administration • Establish scoring and reporting levels • “Dress rehearsal” for operational assessments in 2015

8. Field Test Participation • Who will take the Field Test? • Grades 3–8: All students • Grades 9 and 10: Only students selected for the scientific sample (e.g., Hoover High School) • Grade 11: All students • The only students exempt from participating in the Field Test are: • Students participating in the California Alternate Performance Assessment (CAPA) • For the English language arts/literacy (ELA) test only, English learners (ELs) who have been attending school in the United States for less than 12 months

9. Field Test Participation – Content Area • 5% of students will take Field Test items from one content area (ELA or mathematics) . • 95% of students will take Field Test items from both content areas. • All students will receive one Performance Task (PT) in either ELA or mathematics. • There is roughly same amount of testing time for all students. • Content areas will be assigned by grade and school level. • Content area assignments will be available in March (projected availability, 3/10). There are four scenarios:

10. Examples of Field Test Participation • Example 1: Elementary School X • Grade 3 was assigned a single content area (ELA), which includes an ELA performance task (PT). • Grade 4 was assigned both ELA and math, with a mathematics PT. • Grade 5 was assigned both ELA and math, with an ELA PT. • Example 2: High School Y • Grade 10 was selected to participate and is taking a single content area (math), which includes a math PT. • Grade 11 was assigned ELA and math with an ELA PT.

11. Field Test Format • Note: The Field Test is computer-based, not computer adaptive. • Need to try out the test questions during the Field Test before tests can be made adaptive for the first operational administration in 2015. • Two components: • Performance task (PT) • A set of complex questions that is centered on a common theme or problem; requires classroom activity • Non–performance task (non-PT) • E.g., Selected Response, Drag and Drop, Matching Tables

12. Roles and Responsibilities

13. New Terminology for Roles • Other important roles: • LEA Technology Coordinator • LEA CALPADS Administrator LEA is Local Education Agency. We refer to it as District.

14. Collect security agreements from Test Site Coordinators (SCs) and retain at LEA. Designate SCs; add them to TIDE. Coordinate with SCs so that tests are administered in the appropriate grade(s) and content area(s). Guide appropriate supports and accommodations in TIDE Ensure that the SCs are appropriately trained regarding test administration and security policies. Report test security incidents to the CDE. Work closely with the Technology Coordinator. Relay issues/questions to the CalTAC call center. LEA CAASPP Coordinator (DC)

15. Collect security affidavits from Test Administrators (TAs) and send to Tami Whaley in REA. Train TAs and add them to TIDE. Set appropriate supports and accommodations in TIDE with assistance from TA. Ensure that testing in the school is conducted in accordance to test security policies. Create/approve test schedules and procedures for the school. Work with technology staff to ensure network capacity and devices are ready in accordance with test schedules. Monitor testing and address problems, as needed. Report test security incidents to the DC. Increase comfort levels and reduce anxiety of TAs. Test Site Coordinator (SC)

16. Carefully and completely read and sign new security affidavit. Complete test administration training. Take Training and Practice Tests. View student information prior to testing, to ensure it is correct. Ensure that appropriate designated supports and accommodations have been set prior to testing. Set up and proctor testing. Report all potential test security incidents to the SC who will report to LEA CAASPP Coordinator. Increase comfort levels and reduce anxiety of students. Encourage students to do their best. Test Administrator (TA)

17. Assist LEAs in setting up and overseeing technology infrastructure for the SBFT. Support each school site. Work closely with the LEA CAASPP Coordinator to ensure network and devices are ready for testing. Be available for troubleshooting during testing. SC will call (457-2600) help desk for technology problems IT has developed a routing process to get your questions answered quickly Technology Coordinator

18. Secure Browser • Specifically designed by Smarter Balanced to provide secure access to the Field Test. • Prevents students from accessing other hardware and software functions. • A secure browser has been installed on all student computers/devices. • Updated and reinstalled annually • Technology Coordinators: Ensure the secure browsers are correctly installed • ‘CA’ will need to be selected on each instance of secure browser the first time it is run. • Test Administrator computers will use a standard Web browser.

19. Secure Browser • Students must use the secure browser to log in to the Student Interface and access the Field Test. • Prohibits access to external applications or navigation away from the test • Prior to testing, TAs should verify that: • External user applications are closed • The secure browser will not work if the computer detects that a forbidden application is running. • No testing on computers with dual monitors • Students must not take the test on computers connected to more than one monitor.

20. Field Test Item Types • Selected response • one correct response • multiple correct responses • two-part • Matching tables • yes/no • true/false • Fill-in tables • Select or order text or graphics • Drag and drop • Graphing • Equation or numeric response • Short text • Long essay

21. Practice Tests • Released in May 2013. • Available for grades 3–8 and grade 11 in ELA and mathematics. • Requires headphones for English Language/Literacy • Approximately 30 items per test, including PT and scoring guide. • Archived Practice Test Webcast is available on http://californiatac.org.

22. Training Tests • Released on January 30. • Available by grade band (3–5, 6–8, and high school) • There are 6–8 items per content area per grade band • EL/Literacy items require headphones • Allow students to experience interface features and functionality. • Do not include PTs or scoring guides. • Highly encourage teachers and students access the Training Test Site before the SBFT. • Teachers are encouraged to conduct a group walk-through with students. • Two ways to access Training Tests: • Web • TA interface

23. Accessing Practice and Training Tests • CDE Web site: http://www.cde.ca.gov/ta/tg/sa/index.asp OR • California Smarter Balanced Portal: http://sbac.portal.airast.org/ca/practice-test-ca

24. Practice and Training Tests

25. Field Test Registrations

26. Test Information Distribution Engine (TIDE) TIDE is a password-protected Web site that provides administrators with tools to manage users and students participating in the Smarter Balanced Field Test. • Repository for student information, including initial test settings and accommodations • Different levels of user access • Just for the Field Test, not remaining paper-pencil tests

27. Field Test Student Registration Student demographic data 3 Designated supports and accommodations Student registration

28. Importance of CALPADS • CALPADS is the sole source for student demographic and program participation data for TIDE. • Districts/schools cannot update student demographic or program participation data in TIDE; must be updated in CALPADS. • Processing time from CALPADS to TIDE is 48 hours. • SC must set designated supports and accommodations for students in TIDE; it cannot be directly entered in CALPADS.

29. Student Registration • The student’s grade level must be correct in TIDE before testing. (Only correctable in CALPADS.) • Eligible students must appear in TIDE. • If a student’s designated supports and accommodations information is incorrect, it must be updated in TIDE before he or she can test.

30. Accessing TIDE • Users may access a link to the California Smarter Balanced Portal on the California TAC website at http://californiatac.org. Selecting the portal link will bring you to the page below. • To access TIDE, select the Field Test link. • A direct link to the California Smarter Balanced Portal may be found in the TIDE User Guide. • Note: DCs add SC users; SCs add TA users

31. Accessing TIDE • Select the Online TIDE System for California Users card. • When logging into TIDE for the first time, users will be prompted to change their password.

32. TIDE: First Time Users • When a user is added to TIDE, the user will receive an automated email from Smarter-CA-DoNotReply@airast.org that contains the following: • User role • Temporary password that must be changed upon initial login • If user has not received the e-mail with temporary password, he or she should contact CalTAC. • Note: The domain airast.org should be whitelisted to ensure users receive these e-mails.

33. Accessing TIDE

34. TIDE: Logging In • To log in, the user should enter his or her username and password.

35. Navigating TIDE • The TIDE interface uses tabs as the principal means of navigating between tasks. Some tasks in the TIDE interface contain multiple sub-tasks. • TIDE shows only the features that are available to the user based on his or her role.

36. TIDE: Manage Users Tab • The Manage Users tab may be used to: • Upload users (group of users) • Add new user (individual user) • Search for existing user records • Export a list of existing user records • View and/or edit existing user records • Delete an existing user record

37. TIDE: Uploading a Group

38. TIDE: Adding an Individual User The Add User tab allows you to enter details for a single individual and add them to the system. DCs and SCs can add users, TAs cannot.

39. TIDE: Export a List of Users • For reference purposes, a user may choose to export a list of users in his or her school or district. • Users may conduct a search for other users. • To export the resulting list of users, select [Export] and select the desired format (Excel or CSV). • You may select a subgroup of users for export by selecting the check box next to each record you want to include in the export.

40. TIDE: Student Information Tab • The Student Information tab may be used to: • Search for existing student records • Export a list of existing student records • View an existing student record • View and update student test settings

41. TIDE: View Student Information • To search for existing student records, select the sub-tab [View Students]. • Select a school from the drop-down menu. Note: Users only have access to students in schools with which they are associated in TIDE

42. TIDE: View Student Information • To help narrow results, search by First Name, Last Name, SSID, Confirmation Code, and/or grade. • You can select Add Additional Search Criteria to include Test Settings in your search.

43. TIDE: Export a List of Students • The search will result in a table similar to the one shown below. • Results may be sorted by selecting the column header above the data. • It may be helpful to export a list of students in order to verify the correctness of their information and assist them in logging in to the test. • Users may export the full results table or a subset of those results in Excel or CSV format

44. TIDE: View a Student Record • To view a student’s record, select the [View] button for that record.

45. TIDE: View Student Information • Student demographic data is read-only. • Changes must be submitted to CALPADS and will be reflected within 48 hours.

46. Field Test Administration

47. Scheduling Testing Time: Things to Note • Non-PT items and PTs will be presented in up to three separate tests. • For 95%, 3 tests total: 2 condensed non-PT tests (ELA and math) and 1 PT • For 5%, 2 tests total: 1 non-PT test (ELA OR Math) and 1 PT in same content area • ELA PTs have 2 parts; math PTs have 1 part • Reminder: Overall testing time will be the same, regardless of content assignment (approximately 3.5–4 hours).

48. Scheduling Testing Time • Estimated testing times are available in the California Online Field Test Administration Manual. • Note: The estimates do not account for any time needed to start computers, load secure browsers, and log in students. Scheduling is a collaborative effort. Headphone volume should be checked before starting the Field Test • Each school is assigned a 6-week window. • Recommended: Non-PT first (ELA requires headphones; math does not unless student has Text-to-Speech), PT second. • Classroom activity should be completed within 3 days prior to starting the PT. • ELA PTs have 2 parts and can be completed over 2 days. • Math PTs have 1 part and can be completed in 1 day. • Recommended: PT should not be administered on the same day as non-PT.

49. Scheduling Considerations for Special Populations • Students taking CAPA will appear in TIDE but should not be tested. • English Learners in US schools for 12 months or less should not be given any ELA items. • SCs must ensure that TAs know which students are not to take the FT. • NOTE: TIDE export function may be helpful for this purpose. • Schedule activities for students not taking exam (or that finish early). Activity cannot involve using computers.

50. Example Testing Schedules • Example 1: For a grade taking both content areas and an ELA PT. • Example 2: For a grade taking onecontent areas and assigned mathematics PT.