2013 STAR Nuts & Bolts Grades 6-11

1. 2013 STAR Nuts & Bolts Grades 6-11 Traditional Calendar Assessment Services, SDUSD

2. Agenda New for 2013 Test Security Before Testing During Testing After Testing

3. What’s New for 2013? • Emphasis on heightened security • New security affidavit • No unauthorized electronic devices • New and updated videos at http://www.startest.org/training/index.html • Quick return of results (2-3 weeks after receipt of scorables)

4. What’s New for 2013? • Answer Document Changes: • No CBEDS (section 14), collected in CALPADS • No ASAM • No SEID (statewide educator ID) • English-learner program participation (section 17) definitions changes • CAPA Section A1 added

5. Security • Security Audits • Security Agreements • Security Affidavits • All materials must be kept in a LOCKED, SECURE area NEW In RED Envelope BLM Assessment Services, SDUSD

6. Security BLM Assessment Services, SDUSD

7. Security Audits • At randomly selected schools and district offices • Auditors will check that materials are secure, accounted for, and locked up in a central location when not in use • Auditors will check that correct administrative procedures are being followed • Instructional materials have been removed or covered. • Students are not being coached through the exams. • Only appropriate accommodations and/or modifications are being provided. • No unauthorized electronic devices are being used.

8. Security Audits Continued • Possible visit from ETS/Global Compliance Service • Before testing (pages 62-63 in manual) • During testing (pages 63-64 in manual) • After testing (pages 64-69 in manual) • Ask for “official” letter from the representative when he/she comes to your school

9. Before Testing Identifying Students to Test? Accommodations & Modifications Receiving & Ordering Materials Providing Training for Staff Preparing Materials & Locations

10. Who should participate in the STAR Program? ALL students in grades 2-11 except those exemptby parent or guardian Parent Exemption Request form in BLM • Students participate in STAR by taking either the CSTs, CMA, or CAPA

11. California Standards Tests (CSTs) = grades 2-11; most students take CSTs California Modified Assessment (CMA)= grades 3-11; must meet SBE eligibility criteria; must be in IEP California Alternate Performance Assessment (CAPA) = grades 2-11; students with severe cognitive disabilities; must be in IEP 2013 STAR: Identifying Students See CMA & CAPA rosters Page 74 in manual for CMA criteria STAR Item & Estimated Time Charts, pages 105-110 in manual

12. Identifying Tests for Non-CAPA Students: Required CST and CMA Tests at Each Grade See Handout STAR Item & Estimated Time Charts, pages 105-110 in manual

13. Required Tests for CST/CMATests (non-CAPA students) See Attachments G, H, & I of Administrative Circular #59

14. Identifying Students for theStandards-based Tests in Spanish (STS) Eligible students take the STS inaddition to the CST and/or CMA (CAPA students do NOT take STS) • Eligibility Criteria • Spanish-speaking EL students enrolled less than 12 months in a US school • Spanish-speaking EL students receiving instruction in Spanish regardless of months enrolled • see rosters and directions • Reading & Lang. Arts (Grades 2-11) • Grade Level Math (Grades 2-7) • Algebra 1 STS (Grades 7-11) • Geometry STS (Grades 8-11)

15. Special Education, 504 Students, and English Learners Identify CAPA & CMA test-takers Review IEP and 504 Plans for accommodations & modifications that must be made available to students Plan for any variations that EL students will use during testing Identify English Learners who must take the STS

16. Accommodation vs. Modification • Accommodations • Change conditions for testing, but do not change what is being measured • Count as-is; have no impact on API & AYP • Modifications • Change testing conditions and what is being measured • Reported “as is” on the Student Report • Count as far below basic (200) for API • Do not count as proficient or as a participant for AYP

17. Modifications are NOT ALLOWED on the CMA Modifications are only allowed on CST & STS (if in 504 or IEP) See Attachment D of Administrative Circular # 59 Page 86 in manual See Handout

18. SAVE BOXES Receiving Materials INVENTORY UPON RECEIPT ORDER ADDITIONAL MATERIALS SECURE ALL MATERIALS Reseal Boxes Store in a SECURE, LOCKED area Verify Quantity Note missing materials; contact Denise ASAP if there are discrepancies Fax Form BLM Count each booklet; packs of 20 don’t always contain 20

19. Identifying and Training Staff • CST Examiner= employee of SDUSD who has been trained and has signed a STAR Security Affidavit • CMA Examiner = employee of SDUSD who has been trained and has signed a STAR Security Affidavit • CAPA Examiner = certificatedemployee of SDUSD who has received CAPA examiner training and has signed a STAR Security Affidavit • STS Examiner = employee of SDUSD who has been trained, has signed a STAR Security Affidavit, and is bilingual in English and Spanish • Proctor = employee of SDUSD who has been trained and has signed a STAR Security Affidavit. See page 10 in manual

20. Required Training for Staff See Handout • Ensure Consistency • Directions For Administration (DFA) must be read verbatim • Ensure Test Security • Monitor students; actively supervise • Collect test booklets and answer documents before dismissing students • Ensure there is enough time to complete a part before beginning the part • Do not send unsupervised student(s) with test materials to alternate location • Report all irregularities/incidents ASAP Examiner Training PowerPoint on Website

21. Required Training for Staff • Test Examiners CANNOT: • Review test questions before, during, or after testing • Leave instructional materials up in the classroom • Check students’ answers • Advise students of a wrong answer or advise student to check an answer • Withhold answer docs until students demonstrate they have the right answers • Divulge the contents of the test(s) to anyone Ensure that all examiners READ & UNDERSTAND the AFFIDAVIT

22. Required Training for Staff Examiners MUST monitor students throughout testing to make sure students are: • On correct part • Not going on to other parts or back to a previously completed part • Not skipping a question on their answer document (so that they are off by one or more) • Not using unauthorized electronic devices during testing session

23. Prepare Testing Locations • Create an ideal testing environment- free from noise with good lighting & ventilation • Remove or cover all instructional materials visible to students related to the content of the test • Make arrangements for students w/IEPs & 504s (i.e. read aloud) • Prepare a separate room(s) for CMA test-takers • Set up a quiet room where students who need more time to test can be escorted by an adult • Arrange an activity and separate room for students not tested (exempt by parent)

24. Preparing & Distributing Materials Page 65 in manual • Materials provided by school: • No. 2 pencils with erasers • “Testing- Do Not Disturb” signs • Scratch paper for math & science tests • Highlighters may be used (caution to grades 2 & 3) • Make arrangements for students w/IEPs & 504s (i.e. Braille version, large-print, calculator, same version test for students with ”read aloud”, etc.) BLM • Check materials out and in DAILY– see Inventory Control form; excel version on our website at http://www.sandi.net/page/1545 BLM

25. During Testing Test Booklet Versions Directions For Administration Managing Emergency Situations Required Fields on Answer Docs.

26. CST, CMA, & STS Test Booklets- Multiple Versions • Each grade level has multiple versions of the test • Schools will receive only one version at grade 2 • Schools will receive multiple versions for grades 3-11 • For students who are eligible for the “read aloud” accommodation/modification, make sure you test with the same version when administering to a small group Students MUST hand-grid the version number used on the answer document Students MUST receive the same test version for the entire duration of the test CRITICAL

27. Directions For Administration (DFA) • Grade 2 CST DFA is SECURE and cannot be distributed to teachers BEFORE testing; the nonsecure version may be used for training • Additional DFAs may be downloaded at: • “SAY” boxes must be read exactly as written • “T” in “SAY” boxes indicates that everything in the box may be orally translated for EL students if regularly done in the classroom; can translate “SAY” boxes only and may not assist students with test questions • http://www.startest.org/dfa.html

28. Test administration incident = any situation that occurs before, during, or after testing that does not conform to the instructions stated in the DFA or the coordinator’s manual Disruption in testing (fire alarm, power outage, evacuation) Test administration error (randomly distributing Pre-ID’d answer documents) Student cheating (mark A2, Special Conditions) Complete a Test Administration Incident Report form Make copy of report form for your files; send original in RED envelope to Assessment Services Managing Emergency Situations and Testing Incidents Pages 64 and 81 in manual BLM See Handout

29. Testing irregularities = circumstances that may compromise the reliability and validity of test results; could negatively impact API and AYP Coaching students, leaving instructional material up during testing, allowing students to use additional materials not specified in the IEP/504, etc. Inappropriate test preparation Breach in security (i.e. copying tests) Contact Erin Gordon ASAP Testing Irregularities Pages 79-80 in manual See Handout

30. Answer Documents • Pre-ID answer documents = for students enrolled before 2/05/13;will be included in your initial shipment • Pre-ID labels = for students enrolled between 2/05/13and 3/28/13;pick up from Annex 10 after they arrive in the district (week of 4/15/13) • Hand-grid blank answer documents = students enrolled after 3/28/13until the first day of testing; demo guides will be provided for students enrolled between 4/08/13 and 4/12/13

31. Answer Documents Continued • There are separate answer booklets/documents for CMA and CST at grades 3 and grades 8-11 • If there have been changessince the pre-id file submission, a blank answer document must be hand-grid • There are minimalfieldsrequired to match CMA and CST for students (grades 3 & 8-11) with one Pre-ID’d answer document who will be taking both a CST and CMA: • Name (last, first, and middle initial) • Birth date • Gender • Statewide Student Identifier (SSID)

32. CST/CMA Answer Docs- FRONT Students must use the correct answer document; check barcode label Sample answer document on page 123 in manual Barcode Label ID = Included in Pre-ID = Must Be Completed by HAND = Hand-grid ONLY if applicable

33. Answer Documents- FRONT Box 1 = completed by the student Box 7c = hand-grid for students taking the CMA = Must Be Completed by HAND = Hand-grid ONLY if applicable

34. Answer Documents INSIDE Version # must be hand-grid For Content-Specific Math and Content-Specific Science the Math/Science CST or Math CMA taken MUST be hand-grid

35. Answer Documents ContinuedEarly Assessment Program (EAP) • Grade 11 ONLY • To receive status for ELA, students must complete: • Writing essay in March; and • CST multiple choice questions; and • Additional EAP multiple choice questions. • For mathematics, students must complete additional questions on the Algebra II CST or Summative High School Mathematics CST • Students must mark ONLYONE circle

36. AnswerDocuments- BACK = Included in Pre-ID = Hand-grid ONLY if applicable = Hand-grid ONLY if used by student

37. AnswerDocuments- BACK Box A1: only complete if directed by Erin (testing irregularities) Box A2:Special Condition codes on page 117-118 in manual (i.e. absent, parent exempt, cheated, refused to test) = Hand-grid ONLY if applicable

38. Answer Documents- BACK Box A3a: must be completed for ALL students who have an IEP or 504 Box A3b: hand-grid only if used by student;no modifications allowed on the CMA; codes on pages 118- 119 in manual Box A4: hand-grid only if used by student; no glossary use allowed on ELA; codes on page 119 in manual = Hand-grid ONLY if applicable = Hand-grid ONLY if used by student

39. After Testing Account for ALL Materials Prepare Answer Documents Complete Required Forms Pack Materials Properly Return Materialsto Annex 10

40. Prepare SCORABLE Answer Documents An answer document must be submitted for everystudent (grades 2-11) enrolled on the 1st day of testing • Check that the demographic information is complete & correct – get demo guides • Hand-grid A2, A3, & A4 if applicable • Check that version #s and math/science testtakenhas been completed (grades 7-11) • Check for tears, stray marks, pen marks • Check for paper clips, science reference sheets, scratch paper • Transcribe answers to clean answer document if original is damaged

41. Prepare SCORABLE Answer Documents Continued • Separate all answer documents by GRADE • Within each grade, separate by TEST TYPE (CST/CMA, CAPA, STS) • Within each test type separate documents for students who were EXEMPT by parent (P on A2) and who were ABSENT(A on A2) for the entire test window Grade 10 CST/CMA Grade 10 STS Grade 10 CAPA = ABSENT = EXEMPT

42. Apportionment Form • Complete one grade level at a time • Indicate your school’s first day of testing • Sign and have principal sign • Return in RED envelope

43. Principal’s Certification Return in RED envelope Principal’s signature

44. School & Grade Identification (SGID)- side 1 Complete 1 SGID per grade level and test type: 1) CST/CMA; 2) CAPA; and 3) STS Pages 25 & 92 in manual Hand-grid appropriate test When was STS given? If no STS, leave blank Hand-grid grade level; leave blank for CAPA Number of answer docs. under this SGID First day of testing

45. School & Grade Identification (SGID)- side 2 Complete top ONLY for grades 2-8 Pages 98-104 in manual for coding instructional materials Teacher Reports are no longer available, so don’t complete bottom portion

46. Master File Sheet Submit with SCORABLE materials- Box 1 For CAPA = all grades and levels are stacked together under 1 SGID Page 94 in manual Totals

47. The Master File Sheet should be the first thing we see when we open Box #1 of your scorables

48. Packing Scorable Materials Master File Sheet on Top SGID on top of each stack of answer docs • SCORABLE materials returned • inORANGElabeledboxes • Packing Order = • CAPA • CST/CMA (lowest grade level on top) • STS (lowest grade level on top) See pages 64-68 in manual

49. Preparing Non-Scorable Materials • VOID answer documents if: • Student transferred to a different school before your first day of testing • Demographic information on PreID was incorrect & blank document was used • Original answer document was damaged and transcribed to new answer document Damaged- transcribed VOIDED answer documents go in NON-SCORABLES

50. Packing NON-Scorable Materials TOP Page 67-69 in manual BOTTOM