T ransitioning from STAR to CAASPP

1. 2014SmarterBalanced Field TestIn-Service Transitioning fromSTARto CAASPP February27, 2014

2. Agenda • New Testing System: California Assessmentof Student PerformanceandProgress (CAASPP) • General Overview of Smarter Balanced System • Smarter Balanced Field Test Overview • Site Coordinator and Test Administrator Responsibilities • Test Security, Planning and Logistics for Field Test • Overview of Student Supports & Accommodations • Preparing Teachers & Students • On-line Test Administration • Classroom Activity & Performance Task • After Smarter Balanced Testing • California Standards Tests (CSTs) for Science and CAPA

3. Components of 2014 State Tests Grades 3-8 Math and English Language Arts Grades 5&8 CST/CMA Science Identified Special Education Students Math and English Language Arts Grades 2-8

4. Smarter BalancedAssessments: Improving Teaching & Learning Summative:Collegeandcareer readiness assessmentsfor Common accountability CoreState Standards specify K-12 expectations for college and career readiness All students leave highschool college and career ready Teachers and schools have information andtools they need to improveteaching and learning Formative resources: Supporting classroom-based assessmentsto improve instruction Interim:Flexible andopen assessments,used for actionable feedback

5. 2014 SBAC Field Test

6. Field Test Purpose Afieldtest isnotdesignedto beavalidand reliablemeasureof studentachievement; rather, it isdesignedto helpthetest developers evaluatewhetherthetests, individualitems, andthetechnologyplatformworkasintended beforethefirst operationaladministration. — DeborahS. Delisle U.S. Departmentof Education

7. Benefits of Field Test Participation • Students willhavehands-onexperiencewith thefunctionalityof acomputer-based assessment. • Teachersand administratorswillgainvaluable exposureto administrationlogisticsduringatrial run. • Local educational agencies(LEAs)will benefit from havinglearnedwheretechnologygaps mayexist, andthencanfullypreparefor operationalassessments.

8. Smarter BalancedSpring 2014 FieldTest Overview CA TAM 7, 29-30 • Field Test window for BCSD: April 7– May 16, 2014 • April 10-11 and May 8-9 are black-out days for testing • April 14-21 Spring Break • 20 school days for testing • Grades 3–8: All students are expected to participate with the exception of • CAPA students • EL less than 12 months do not test in ELA but do test in math • (R&E to provide translation of SAY Boxes upon request) • Parent exemptions • Signed parent letters

9. Smarter Balanced Spring 2014 Field Test Overview • Test willbeapproximately3.5-4.5hourslongthough it is untimed • Nopaper-and-pencilversionwillbeavailable • Nostudent,school,ordistrictscorereportswill beproduced • Resultswillnotbefactoredintoanystate or federalaccountabilitycalculations

10. Smarter Balanced Spring 2014 Field Test Overview • Eachparticipatingstudent inGrades3-8will • experience: • 25ELAquestions • 25mathematics • 1 performancetask • Either ELA or Math • We will be assigned one by March 10, 2014 • R&E to inform schools

11. Smarter Balanced Spring 2014 Field Test Overview • Item Types • Selected Response (SR) • Previously multiple choice • Constructed Response (CR) • Items of greater complexity than SR. Require more analytical thinking and reasoning; develop answers without suggested answer choices. • Extended Response • Short text and essay • Performance Tasks (PT) • Requires a classroom activity and independent student response. Measure capacities such as depth of understanding, interpretive and analytical ability, basic recall, synthesis, and research • Technology-­Enabled • Video, animation, sound • Respond with SR or CR • Technology-­Enhanced • Students manipulate information • Require students to do something other than write text or numbers, or select from among a set of options such as reordering text, selecting and changing text, selecting text, and selecting from drop-down menus CA TAM 71

12. Roles and Responsibilities

13. New Terminology for Roles Other important roles • LEA Technology Coordinator (John Deaton) • LEA CALPADS Administrator (Robert Burks)

14. Roles and Responsibilities CA TAM 9-10 Test Site Coordinator (SC) Test Administrator (TA) Read and sign new security affidavit. Attend test administration training. Confirm student information prior to testing, to ensure it is correct. Ensure that appropriate designated supports and accommodations have been set prior to testing. Set up test sessions & proctor testing. Report test security incidents to SC. Encourage students to do their best. • Collect security affidavits from Test Administrators (TAs) and retain at your test site. • Train TAs • Submit appropriate supports and accommodations to R&E. • Ensure that testing in the school is conducted in accordance to test security policies. • Create test schedules and procedures for the school. • Report test security incidents to R&E • Monitor testing and address problems, as needed.

15. Test Security

16. New Test Security Forms for the2013–14 School Year • Site Coordinators must sign the new CAASPP Test Security Agreement and retain at the LEA. • Test Administrators must sign the new test security affidavit and provide a copy for LEA. • Forms specify no reviewing, discussing, or analysis of test items, reading passages, or writing prompts at any time during between, or after sessions. • Agree to not email, fax, or replicate items. • No form or type of answer key may be developed for items CA TAM 20-22

18. Test Security CA TAM 23-24, 63-70 • There are three different types of test security incidents that must be reported: • Impropriety • Irregularity • Breach • Notify R&E within 24 hours for processing and next steps.

19. Test Impropriety • Unusual circumstance that has a low impact on the testing individual or group of students • Low risk of affecting student performance, test security, or test validity • Correctable and containable at local level • Example: Students talking during testing

20. Test Irregularity • Unusual circumstance that impacts the testing individual or group of students • May affect student performance, test security, or test validity • Correctable and containable at the local level • Submitted in the online system for resolution of the Appeal for testing impact • Examples: Student cheating or providing answers to another; student accessing or using electronic equipment (e.g., cellphone)

21. Test Breach • Event that threatens test validity (e.g., release of secure materials) • External implications for the Consortium • Examples: • Administrator or coordinator modifying student responses or record at any time • Administrator allowing students to take home test items, passage, prompts, or scratch paper

22. Planning and Logistics CA TAM 9 • Field TestDetails • Preparation Checklist in CA TAM page 79-89 • Secure Web Browser has been downloaded for you. • TestAdministrator & Proctors= State-certifiedschoolstaff that have been trainedto usethe Smarter Balanced Testing system needto bepresentineach testingroom.

23. Planning and Logistics • Integration of LEA and CDE Student Information Systems • IntegrationwithCALPADS • CALPADS is the sole source for student demographic data • Frequent dataextracts from CALPADS • First data pull was February 18, 2014 • Test registrationsystem • CALPADS information is transferred to TIDE (Test InformationDistributionEngine) • TIDE is the system used to manage student information and user accounts for online testing. • Since data is already loaded in TIDE, school coordinators will primarily utilize this system for look-up. • Username and passwords will be emailed to you. • Studentdemographic/programdatacannotbe changedbyLEAsonceinTIDE • LEAswillberesponsiblefor providingaccommodationsdata CA TAM 28

24. Testing Times and Scheduling CA TAM 35-36 The Field Test is expected to take 3.5 to 4 hours to complete • April 7 – May 16 • Field Test • Black-out daysApril 10-11 & May 8-9 24

25. Scheduling Testing Time: • Recommended administration: • First: Non-PT section • Second: Classroom Activity • Third: Individually administered on-line PT (Classroom & PT not on the same day) • Administering the PT section: • Classroom activity should be completed within 3 days prior to starting the PT. • ELA: 2 parts; can be completed in 2 days. • Math: 1 part; can be completed in 1 day. CA TAM 37 25

26. Tentative Schedules

27. Scheduling Considerations for Special Populations • Ensure that TAs know which students are not to test. • Willappear in TIDE but should not be tested: • CAPA students. • Students with Parent Exemptions will not be tested • English Learners 12 months or less should not take ELA • Schedule activities for students not taking exam (or that finish early). CA TAM 29-30

28. Smarter Balanced Usability, Accessibility, and Accommodations Guidelines

29. Smarter Balanced Usability, Accessibility, and Accommodations Guidelines CA TAM 45-47 reference Threetypesof studentsupportoffered: Universaltools DesignatedSupports Accommodations The Guidelinesdocumentisavailableonthe CDESmarterBalancedAccessibilityand AccommodationsWebpageathttp://www.cde.ca.gov/ta/tg/sa/access.asp. Accommodations Module

30. Universal Tools, Designated Supports, and Accommodations Embedded Breaks, Calculator, Digital Notepad, English Dictionary, English Glossary, Expandable Passages, Global Notes, Highlighter, Keyboard Navigation, Mark for Review, Math Tools, Spell Check, Strikethrough, Writing Tools, Zoom Embedded Color Contrast Masking Text-to-speech Translated Test Directions Translations (Glossary) Translations (Stacked) Turn off any Universal Tools Non-embedded Breaks, English Dictionary, Scratch Paper, Thesaurus Non-embedded Abacus, Alternate Response Options, Calculator, Multiplication Table, Print on Demand, Read Aloud, Scribe, Speech-to-text Embedded American Sign Language, Braille, Closed Captioning, Text-to-speech Non-embedded Bilingual Dictionary, Color Contrast, Color Overlay, Magnification, Read Aloud, Scribe, Separate Setting, Translation (Glossary)

31. Usability, Accessibility, and Accommodations Guidelines UAA Guide Glossary 6-17 1. Universaltools: availableto all students.

32. Usability, Accessibility, and Accommodations Guidelines • Grades3–5CalculatorPolicy • Do notallowforcalculatorusage. • Grades6–8CalculatorPolicy • Mathematics assessments are dividedintotwosections:CalculatorAvailableandCalculatorNot Available. • Grade 6 allows anonlinefour-­‐functioncalculatorduringthe CalculatorAvailable section. • Grades 7 and 8 allowanonlinescientificcalculatorduringthe CalculatorAvailable section.

33. Usability, Accessibility, and Accommodations Guidelines UAA Guide Glossary 6-17 2.Designatedsupports, availabletoidentifiedstudents, including Englishlearners,strugglingreaders, andstudentswithattentiondeficitsthat the student has been using during instruction or other assessments. Examplesincludecolor-contrasttext, the blockingof distractingcontent,stacked translations,andbilingualdictionary. Translation of test math instructions and items are available.

34. Usability, Accessibility, and Accommodations Guidelines UAA Guide Glossary 6-17 • 3. Accommodations, availableto students with anindividualizededucationprogram or a 504planthat specifiestheneedfor suchanaccommodation.Examples includeclosedcaptioning,Braille, calculator, andscribe. • R&E staff will input designated support and accommodations, process is on next slide.

35. Accommodations & Supports Checklist for IEPs, 504s & ELs* Highlight all that apply for students currently using these tools during instruction *ELs less than twelve months Complete and return to R&E no later than March 24th

36. Preparing Staff and Students for the Field Test

37. CA TAM 17-18 Recommended Training Modules

38. CA TAM 30 Resources: Training Test and Practice Test

39. Practice and Training Tests • California Smarter Balanced Portal: http://sbac.portal.airast.org/ca/practice-test-ca/ For student Interface option: “Guest User” is defaulted and sign in For TA Interface option: Uncheck default “Guest User” to practice authentically creating session and student login.

40. Field Test Administration

41. Establishing Appropriate Testing Conditions • Remove or cover displayed information that might be used by students to help answer questions including: • Rubrics, vocabulary charts, student work, posters, graphs, charts, etc. • Cell phones or other electronic devices are not allowed to be used during testing (i.e., turned off and put away). Post an “Unauthorized Electronic Devices May Not Be Used at Any Time During the Testing Session” • Place a “TESTING—DO NOT DISTURB” sign on the door. • May also be helpful to post signs in halls and entrances rerouting hallway traffic. CA TAM 28, 48-51

42. Establishing Appropriate Testing Conditions • Establish procedures to maintain a quiet testing environment throughout the test session. • Remember that some students will finish more quickly than others. • Plan quiet activities for students who finish early

43. Basic Test Rules During the Field Test CA TAM 32 • Students must answer all test items on a page before moving on to next page. • Within each test there may be segments. A student may not return to a segment once it has been submitted. • Students must answer all test items before ending their test. • Students may not return to a test once it has been submitted. • Students may flag a response and return to it before ending their test. • Students may use scratch paper but it must be collected and shredded at the end of each test session.

44. Accessing the Field Test: http://sbac.portal.airast.org/ca/field-test-ca/ • Select [Field Tests]. • Select [TA Interface for California Users]. 44

45. TA Interface: Teacher Login • User Names & Passwords will be emailed once uploaded. • Confirm teachers who need administration access. • Default will be all teachers • Submit names to R&E no later than March 7, 2014 • The first time logging on, you will be required to change your password. Write it down, we do not have access to it. 45

46. Starting a Test Session • Click ‘Start Session’ • Select test to be administered • Tab will turn red and will change name to“Stop Session” • Write Session ID on the board for students to log into your test session

47. Student Login: Joining TA’s Session • Click Secure Browser icon • All other applications must be closed • Prior to Student Login: TAs must follow the “DFA SAY” script exactly each time a test is administered. Refer to the DFA section of the CA TAM page 51. • Please contact R&E for Spanish Translation of “DFA SAY” boxes • Student will need: • Confirmation Code: Student’s legal first name as spelled in CALPADS • State-SSID: State abbreviation (CA) followed by a hyphen and the student’s Statewide Student Identifier • Session ID

48. Student Login Data Cards • R & E will provide a Sign-In Card with Student Login Data • Junior High/Middle Schools consider how you want cards sorted • Delivered to school sites prior to testing window • Use the information cards during the “Training Test” for students • Students will type information EXACTLY as printed • Collect students cards after each administration and keep secure 48

49. Student Login: Verify & Select Test • Students will be prompted through a series of questions prior to starting their test session

50. Student Login: Sound Check • Students may be prompted to do a sound check if taking ELA test with listening portions. • If prompted, students should have headphones on and press green button to test volume and then press ‘Yes, I heard the voice’ or adjust as needed.