460 likes | 516 Views
2012 Standardized Testing and Reporting (STAR) Program Multiple Choice Tests Pre-Test Workshop for Test Site Coordinators. Middle and K-8 schools Session One: 3:3 0-5:30 PM Wednesday, 2/15 /12–Montana Room Session Two: 9:00-11:00 AM Thursday, 2/16/12–Montana Room. Presented by:
E N D
2012 Standardized Testing and Reporting (STAR) Program Multiple Choice TestsPre-Test Workshop for Test Site Coordinators Middle and K-8 schools Session One: 3:30-5:30 PM Wednesday, 2/15/12–Montana Room Session Two: 9:00-11:00 AM Thursday, 2/16/12–Montana Room Presented by: Mao J. Vang, Ed.D. Sacramento City Unified School District Assessment, Research and Evaluation, Box 780 5735 – 47th Ave. Sacramento, CA 95824 Tel. 916-643-9420 Fax. 916-643-9474
Agenda • Introductions • Objectives • New in 2012 • Test Security • STAR Program Overview • Test Site Coordinator Responsibilities • Multiple Choice Tests • Documents and Coding • Test Variations, Accommodations & Modifications • Preparing Documents for Return • Additional Resources • Questions & Answers
Objectives • Provide an overview, key requirements, and administration information for the 2012 Standardized Testing and Reporting (STAR) Program • Present the requirements for ensuring test security • Review required student demographic information • Preview required forms and how to complete them • Review how to package and return all testing materials • Visit Training Resources for Test Site Coordinators Webpage
Key Dates Test materials must be ready for pick-up by 8:00 AM on the specific date(s) for pick-up. If you complete testing ahead of schedule, contact AR&E to arrange for early pickup.
New for 2012 • Testing window: 23 days • Answer documents • Front: SEID added • Back: NPS moved • CAPA (shading of “5”) for Level I ONLY • Writing tests • Reading aloud prompt now accommodation • Writing test can only be given in 1 day • CMA • Braille for all • Grades 8–11 if Pre-ID, receive both CST and CMA Pre-ID answer documents
New for 2012 • District home, hospital, independent study has a school code • If district has a program • Use new district CDS code http://www.cde.ca.gov/ds/sp/cl/documents/ calpadsupdflash41.doc • Security Audits • Mark Discrimination Analysis
STAR Program Overview • California Standards Tests (CST) Grades 2-11 for most students, includes separate writing test in grades 4 & 7 • California Modified Assessment (CMA) Grades 3-11 for students with IEP specification, includes separate writing test in grades 4 & 7 • California Alternate PerformanceAssessment (CAPA)for students with significant cognitive disabilities • Standards-based Tests in Spanish (STS) English learners grades 2-11 whose primary language is Spanish and: • Receive instruction in Spanish, or • Have been enrolled in US school < 12 months
Testing Requirements • All students enrolled on the first day of testing for each district in grades 2-11 needs to be assessed with one of the following: • CST/CMA • CAPA
CMA Participation • Current IEP specifying CMA & content area(s) • Previous participation • Previous CST Score of FBB or BB in subject area assessed and may have taken the CST with modifications; and • 2 years scoring Proficient or Advanced on CAPA • Not be eligible to take the California Alternate Performance Assessment (CAPA). • Response to appropriate instruction • Receiving grade level instruction and has goals written to grade level standards
CAPA Overview • Performance-based, one-on-one test • For students with significant cognitive disabilities unable to take the CSTs even with accommodations and/or modifications or the CMA with accommodations • Student must have an IEP • IEP specifies CAPA and level • Do not take STS • Answer document: • Use only 2012 answer document • Ensure correct CAPA Levelis marked in 7a
CAPA Overview Continued • CAPA is to be administered by trained licensed or certificated individuals • 10% of the CAPA tests by level must be second rated • CAPA testing window is the same as the multiple-choice window. • CAPA materials are include with multiple-choice materials. • For questions regarding training for CAPA examiners, contact: • Linda Kawahara-Matsuo, District CAPA trainer • Special Education Department • 643-9122
CAPA Observers • Districts must double-rate at a minimum of ten percent (10%) of the CAPA students per level, per site (including NPS) • Double ratings are randomly selected • Observers must markObserverand BOTH examiners and observers must sign the answer document
Preparing To Administer the CAPAObserver’s Answer Doc Use blank from overage.Observers must mark sections 1 – Name, etc. 3 – Date of Birth 5 – Name 6 – Gender 7a – CAPA Level 7b – Grade 11 – Student ID 12a – SSID
STS Overview • Required for English learners (ELs) in grades 2-11 whose primary language is Spanish and who either: • Receive instruction in Spanish regardless of the length of time they have been enrolled in the U.S.; or • Have been enrolled in a school in the U.S. less than 12 cumulative months. • Not to be administered to English-only, I-FEP, R-FEP, or dual immersion who do not meet the inclusion criteria stated. • Students taking the STS must also take CSTs or the CMA • Students who take CAPA do NOT take STS
View Training Video • Site Coordinator Segment • General, first part about security only • Refer to Site Coordinator Updates for 2012 Handout
Security Documents • The STAR Security Agreements from STAR test site coordinators (principals) MUST be received by AR&Ebefore test materials may be delivered to test sites. • Principals must review and sign the 2012 STAR Test Security Agreement and send it to STARSupport@sac-city.k12.ca.us • STAR test site coordinators MUST have a completed 2012 STAR Test Security Affidavitfrom test examiners before giving them testing materials.
Test Security Agreement and Affidavit Send copies of all Test Security and Affidavits to STARSupport@sac-city.k12.ca.usor Box 780 by first day of multiple choice testing. Sign by Principal or Designated Test Site Coordinator Sign by all others having access to STAR Tests
Security Audits • At randomly-selected schools and district offices • Before, during, or after testing • Are materials secure, accounted for, and when not in use locked-up • Are correct administrative procedures being followed: • Materials have been removed or covered • Students are not being coached through the exams • Only appropriate accommodations and or modifications are being provided, et. al.
Mark Discrimination Analysis • An automated process completed at the time of test booklet (grades two and three) and answer document scanning • Identifies erasures to determine if the response has changed from: • Correct to wrong, or • Wrong to wrong, or • Wrong to correct, or • From the analyses a report is produced and forward to the CDE who in turn requests districts to conduct an investigation based on the analyses • Wrong left wrong, or • Correct left correct, or • No response
Test Site Coordinator (TSC)Responsibilities Overview • Attend training provided by district STAR coordinator (Assessment, Research and Evaluation-ARE) • Study and become familiar with the documents and procedures: • 2012 STAR District and Test Site Coordinator Manual • Directions for Administration for at least one-grade level CST and CMA • STAR Test Site Coordinator Summary of Responsibilities Handout
TSC Responsibilities Overview Continued • Schedule all tests and make-ups within the testing window (See sample schedules posted at Website) • Inform teachers, students and parents of the testing schedule and where students are to report on the day tests are administered • Train personnel at your site • Use Examiners Training Videos with Updates for 2012 Handout posted on Website • Use Test Examiners and Proctors Training Presentation posted on Website • Obtain Security Affidavits from all personnel involved
TSC Responsibilities Overview Continued • Monitor test administration • Handle defective test materials • Manage emergency situations • Use Appendix C: STAR Program Irregularities and Incidents, pages 80-84 of manual • Complete the appropriate report form and send a copy to the district coordinator
TSC Responsibilities Overview Continued • Maintain the security of all testing materials • When conducting inventory, begin with Box 1 and use the Test Site Packing List to verify that all materials were packaged accurately • Lock Freight Kit packet in secure place with test materials until needed • Contact Assessment, Research and Evaluation (643-9420) immediately for any discrepancies. • Save original boxes for returning materials • Distribute/collect test materials daily at your site • No test materials should be left in a classroom overnight • Use Inventory Forms posted at Website • Ensure testing of all students in grades 2-11 • Act as liaison between your site and district coordinator • Obtain/return all test materials to/from district on time
Pre-identified (Pre-ID) Documents • Pre-identified students have pre-printed answer documents • Newly enrolled students (02/01-04/18/12) • Check for pre-printed label, if available, put it on answer document and treat document the same as if pre-ID. • If no pre-printed label, hand-bubble all demographic fields.
CMA Materials 2012 • CMA booklets for grade 3 • Separate scorable test booklet • If no CST taken, return CST test booklet with nonscorables • CMA for Grades 4–7 • CST and CMA in same answer document • Grade 5 ONLY allows calculator(if written into the IEP) • CMA for grade 8 if at least one CMA test is pre-identified for a student, the student will receive both the CMA and the CST pre-identified answer documents • If both CST and CMA taken, must mark Section 7c for CMA tests taken
CST/CMA Answer Document Right side of inside of answer doc grades 4−7 • CMA section has: • Different subject icons from CST • Alternate row shading for the response bubbles • Three options choices • Fewer number of questions
CMA Grade 7 Answer DocumentMathematics Section Grade 7 mathematics and Algebra I have different numbers of questions
Coding Student InformationPre-ID Answer Documents Pre-ID Barcode: Check student name and give to correct student On the first day of testing, per teacher-read instructions, all students must complete Section 1
Coding Student InformationBlank Answer Documents On the first day of testing, per teacher-read instructions, all students must complete Section 1 All demographic information must be hand-gridded.
Coding Student InformationTest Version Numbers (Gr. 8) • Students will have 2 answer docs if they are taking CMA • Must mark version # for grade level tests and EOC tests Gr. 8 CST, pp. 2 & 3 Gr. 8 CMA, p. 2 34
Coding Student InformationAfter Each Test • A2: Special Conditions • Test coordinator completes A, E, M, P, & T • Teacher completes C, F, L, X, Y, & Z • A3: Accommodations and Modifications • Examiner marks • whether student has IEP or 504 Plan and • which accommodations were used A4: English Learner (EL) Test Variations Examiner completes if any EL variations were used
Testing Variations • Two types of testing variations • ALL – available for all students • 1 – available if regularly used in the classroom
Accommodations & Modifications • Students may use accommodations and/or modifications if • Specified in IEP or Section 504 Plan and • Regularly used in the classroom • Accommodations and modifications are to be used only to allow a student to access the test, not to provide an advantage • Accommodations do not change what the test is measuring • Modifications change what the test is measuring Note: Refer to Appendix E: Allowable Test Variations, Accommodations, and Modifications, pp. 87-91 in Coordinator Manual
Preparing Documents for ReturnTranscribing and Voiding Documents • Transcribe braille and large print (or not processed) • Write VOID on any answer document(s), with marks,not to be scored; return with nonscorables
Preparing Documents for ReturnSchool Grade Identification Sheet (SGID) • Complete for each set of answer documents or test booklets • Check counts to be accurate • Place on answer documents for correct • Grade • School (school code machine-marked) Pre-printed
Preparing Documents for ReturnComplete Master File Sheet Write in: • Number of SGID • Number of Scorable Documents • Totals • Return with each school • Check counts to be accurate • Required with scorables if materials were ordered: • Write “0” (zero), no blanks • If not tested, note that school did not test
View Training Video • Site Coordinator Segment • CST Middle School • Refer to Site Coordinator Updates for 2012 Handout
Additional Resources: Rosters • Rosters will be sent from STARSupport@sac-city.k12.ca.us: • Pre-ID roster • Students’ demographic information that have been pre-coded on answer documents or late labels • STS test roster • Students who need to take STS • CMA test roster • Students who have been identified to participate using CMA on one or more tests • End-of-course test roster (Grades 7-11) • End-of-course tests based on student enrollment. Test site coordinators need to verify • Pre-ID roster Code Conversion
Resources & Contact Information All training materials and updates will be posted on the district’s Internet: http://scusd.s468.sureserver.com/training-resources-test-site-coordinators • STAR Support Contact: • Assessment, Research, and Evaluation • 5735 – 47th Ave. • Serna Center, Box 0780 • Phone: 643-9420 • Fax: 643-9474 • Email: STARSupport@sac-city.k12.ca.us