140 likes | 238 Views
Training -- Short-Cycle Assessment Evaluation (Part 2). New Mexico Public Education Department February 2010. SCAs Are Evaluated on Technical and Functional Quality. The SCA Evaluation Rubric specifies technical criteria for approval: Aligned with content standards or SBA;
E N D
Training -- Short-Cycle Assessment Evaluation (Part 2) New Mexico Public Education Department February 2010
SCAs Are Evaluated on Technical and Functional Quality The SCA Evaluation Rubric specifies technical criteria for approval: • Aligned with content standards or SBA; • Psychometrically reliable; • Unbiased to subgroups; • SCA and SBA correlated.
Only Lead Districts Submit Rubric & Evidence for Technical Requirements • Alignment Studies on PED High School Redesign Webpage: http://www.ped.state.nm.us/HighSchoolRedesign/ • Report on SCA reliability on vendor webpage or request from vendor. • Report on item bias on vendor webpage or request from vendor. District developed SCA do own study of bias. • Analyze correlation between SBA and SCA. • Technical Requirements Certification Form
How to Complete the Rubric -- Guidance • Explains what evidence is required. • Special conditions related to scoring or collection of information.
How to Complete the Rubric -- Evidence • Explains what reports, data, or information is needed. • Specifies formats of submission (PDF, web link, form, etc.).
How to Complete the Rubric -- Data • Spreadsheet space for recording required information.
How to Complete the Rubric -- Scoring • Explains simple scoring schema.
How to Complete the Rubric – Points Awarded • Spreadsheet space for recording scores. • Districts score all categories but Alignment (Districts complete=“Information Needed”, PED complete=“For PED Use”).
How to Complete the Rubric – Status • PED reviews evidence and scores and assigns status based on rubric. • Additional information or clarification might be necessary. • If approval not granted, district negotiates needed improvements for next evaluation cycle. • If approval not received in next evaluation cycle, select an approved SCA.
Which SCAs Evaluated in Spring 2010? • NWEA MAP • Riverside Assess2Learn • Pearson Learnia • Scholastic • Discovery • ACT Compass
Which SCAs Evaluated in Summer/Fall 2010? • Basic Achievement Skills Inventory • CTB McGraw-Hill • Ed Performance • District Develop SCA (Clovis Municipal Schools)
How Do I Access the Web Tool? • Use Monitoring login and password or contact Web EPSS helpdesk to obtain access. • Web EPSS Monitoring User Guide
Is Guidance Provided? • Short-Cycle Assessment Evaluation Guidebook in Web EPSS. • Q & A Teleconferences. • Questions about Evidence or Rubric: • Robert Romero 505.827.6524 or robert.romero1@state.nm.us • Diana Jaramillo 505.827.6570 or diana.jaramillo@state.nm.us • Dr. Tom Dauphinee 505,827.6528 or tom.dauphinee@state.nm.us • Questions about the Web Tool: • Web EPSS Helpdesk at PED-WebEPSSHelp@state.nm.us • Questions about SCA Scale Scores or SCA/SBA Correlation: • Dr. Cindy Gregory 505.827.6508 or cindy.gregory@state.nm.us