430 likes | 829 Views
CAPA. Training of CAPA Examiners. Objectives. Page 1. Train trainers who will ensure that Examiners administer CAPA accurately and consistently Examiners and observers score CAPA accurately and consistently Audience Examiners Observers (second raters). Agenda. Page 1. Introductions
E N D
CAPA Training of CAPA Examiners CAPA Examiner Train-the-Trainer
Objectives Page 1 Train trainers who will ensure that • Examiners administer CAPA accurately and consistently • Examiners and observers score CAPA accurately and consistently Audience • Examiners • Observers (second raters) CAPA Examiner Train-the-Trainer
Agenda Page 1 • Introductions • CAPA – Past, Present, and Future • Preparing To Administer CAPA • Administering CAPA • Scoring CAPA • Practice CAPA Examiner Train-the-Trainer
Introduction Video Jack O’Connell State Superintendent of Public Instruction Deb Sigman California Testing Director Mary Hudler California Special Education Director CAPA Examiner Train-the-Trainer
CAPA Past, Present, and Future • 1997 • IDEA 1997 – Alternate Assessment for those not able to take regular assessments • 2002 • Fall field test • 2003 • First operational CAPA test administered • Based on K–2 standards CAPA Examiner Train-the-Trainer
CAPA Past, Present, and Future • 2003 (cont.) • CAPA recognized as Alternate Assessment for students with significant cognitive disabilities for NCLB accountability calculations • 2004 • No significant changes! • 2005 • CAPA testing dates aligned with CST testing dates CAPA Examiner Train-the-Trainer
CAPA Past, Present, and Future • 2006 • State Board of Education adopted new blueprints for CAPA aligned to alternate achievement standards • 41,965 tested with CAPA • ~0.86% of all students tested in STAR • 8,923 tested with CAPA level I • ~21% tested at CAPA level I CAPA Examiner Train-the-Trainer
CAPA Past, Present, and Future • 2007 – Transition year • Operational items based on old K–2 content standards • Field test items based on new blueprints • ELA and Math • 8 Operational items • Based on existing K–2 content standards • 4 field test items • Based on new blueprints • Science • 12 field test items • Based on new blueprints CAPA Examiner Train-the-Trainer
CAPA Past, Present, and Future • 2008 – New CAPA • New standards settings • Help to ensure continuity of reporting performance • All test items based on new blueprints 12 items per content area • 8 Operational • 4 Field test CAPA Examiner Train-the-Trainer
Students Eligible To Take CAPA Page 2 • Severe cognitive disabilities • Served under IDEA • IEP team determines if CAPA is applicable • Eligibility guidelines • CAPA Examiner’s Manual – Appendix A CAPA Examiner Train-the-Trainer
CAPA Levels Page 1 Students who repeat grade eleven for multiple years continue to take CAPA Level I or Level V as their statewide assessment until enrolled in grade 12 CAPA Examiner Train-the-Trainer
Examiners • Must meet examiner qualifications • Training – Live session or DVD/Video • Sign security affidavit • Practice with colleagues CAPA Examiner Train-the-Trainer
Observers/Double Raters • Must meet examiner qualifications • Training – Live session or DVD/Video • Sign security affidavit • Practice with colleagues • Purpose of Observers/Double Raters • Double rate a student’s responses • Data used to document Inter-Rater Reliability • Provides credibility/confidence to scores CAPA Examiner Train-the-Trainer
Double Rating • Choose students randomly at each school • 10% per CAPA level • Selected students should be double rated in all content areas tested CAPA Examiner Train-the-Trainer
When To AdministerCAPA • Same test window as STAR CSTs • 85% of instruction completed • 10 days before or 10 days after • Plan for classroom coverage • Allow enough time • Work testing into daily activities CAPA Examiner Train-the-Trainer
Preparing To Administer CAPA Pages 4–6 • Study CAPA Examiner’s Manual • Assemble manipulatives • Determined by version, level, and content area • Organize stimulus cards • Some require cutting • Determine what, if any, adaptations are required for each student CAPA Examiner Train-the-Trainer
VideoAdaptations CAPA Examiner Train-the-Trainer
Preparing To Administer CAPA Page 13 • Prepare the answer document – Examiner • Mark any demographic information not provided in Pre-ID file • At time of test – complete name, sign, date, and mark “Examiner” CAPA Examiner Train-the-Trainer
Preparing To Administer CAPA Page 13 • Prepare the answer document – Observer • At time of test – complete name, sign, date, and mark “Observer” CAPA Examiner Train-the-Trainer
Preparing To Administer CAPA Observers must mark sections Page 11 1 - Name, etc. 3 - Date of Birth 5 - Name 6 - Gender 7a - CAPA Level 7b - Grade 11 - Student ID 12 - SSID CAPA Examiner Train-the-Trainer
CAPATest Security • Examiner’s Manual includes test items • Examiners receive test materials at least one week prior to testing period • Store in a locked cabinet when not in use for preparation or test administration • Not secure: manipulatives, stimulus cards CAPA Examiner Train-the-Trainer
Break 10 minutes CAPA Examiner Train-the-Trainer
How To Administer CAPA Page 7 • Task preparation • Cue/directions • Scoring rubric CAPA Examiner Train-the-Trainer
VideoBest PracticesLevel I CAPA Examiner Train-the-Trainer
Cue/Directions Level I Page 8 • Cue/directions • Wait minimum of 5 seconds for verbal response; Wait minimum of 7 seconds for physical response • Repeat cue/directions • Wait minimum of 5 seconds for verbal response; Wait minimum of 7 seconds for physical response CAPA Examiner Train-the-Trainer
Cue/Directions Level I (continued) Page 8 • Verbal/gestural prompt; repeat cue/directions • Wait minimum 5 seconds for verbal response; Wait minimum 7 seconds for physical response • Physical prompt or model; repeat cue/directions • Wait minimum 5 seconds for verbal response; Wait minimum 7 seconds for physical response CAPA Examiner Train-the-Trainer
VideoBest PracticesLevels II – V CAPA Examiner Train-the-Trainer
Cue/Directions Levels II-V Page 9 • Cue/direction • Wait minimum 5 seconds for verbal response; Wait minimum 7 seconds for physical response • Repeat cue/direction • Wait minimum 5 seconds for verbal response; Wait minimum 7 seconds for physical response CAPA Examiner Train-the-Trainer
Practice Explaining Flowcharts Pages 8–9 Work with a partner: Round 1: Partner A explains Level I scoring flow chart Round 2: Partner B explains Level II–V scoring flow chart CAPA Examiner Train-the-Trainer
Rubrics Page 7 • Scoring points • Level I : Based on prompting required by student to complete task • Score 1–5 • Levels II–V : Based on number of correct responses • Score 1–4 • Red line score of 5 on answer document CAPA Examiner Train-the-Trainer
Practice Administering CAPA Page 10 • Decide how to score video example • Practice with a partner CAPA Examiner Train-the-Trainer
VideoLevel I Math CAPA Examiner Train-the-Trainer
Practice Administering CAPA Page 10 • Decide how to score Jesus CAPA Examiner Train-the-Trainer
Practice Administering CAPA Page 10 • Correct score for Jesus CAPA Examiner Train-the-Trainer
VideoLevel V ELA Scoring Rubric Score 4 - 4 Correct student responses Score 3 - 3 Correct student responses Score 2 - 1 or 2 Correctstudent responses CAPA Examiner Train-the-Trainer
Practice Administering CAPA H 10 • Decide how to score Stephan CAPA Examiner Train-the-Trainer
Practice Administering CAPA H 10 • Correct score for Stephan CAPA Examiner Train-the-Trainer
After Test Pages 13–14 • Complete Sections A2 and A4 if appropriate • Section A2 – Special Testing Conditions • Reasons student not testedP, A, T, E, M, F • L: Enrolled after first day of testing; test taken at your school • Section A4 – English Learner Test Variations • A: Student given directions in language other than English CAPA Examiner Train-the-Trainer
After Test • Return: Secure materials • CAPA Examiner’s Manuals (Non-scorable) • CAPA answer documents (Scorable) • Examiner • Observer (Do not compare to examiner’s document) • Retain or destroy: Non-secure materials • Manipulatives • Stimulus cards CAPA Examiner Train-the-Trainer
Summary • Introduction • CAPA – Past, Present, and Future • Preparing To Administer CAPA • Administering CAPA • Scoring CAPA • After-Test Procedures • Complete Evaluation • Thank you Page 15 CAPA Examiner Train-the-Trainer
For more information go to: http://www.cde.ca.gov/ta/tg/sr/capa.asp http://www.startest.org/capa.html CAPA Examiner Train-the-Trainer