Fall Assessment Workshop: District Test Coordinator Training

Fall Assessment Workshop:District Test Coordinator Training New Mexico Public Education Department Assessment & Evaluation Bureau August – September 2006

Your Presenters • Janet Haas • Brett Gies • Dan Farley • Doug Knox • Bernadette Gomez • Gladys Herrera-Gurule • Robert Romero • Margaret F. Delgado

Training Objectives • Be familiar with the New Mexico Statewide Assessment Program (NMSAP) • Understand test security and training requirements • Know the basic processes and procedures of test administration • Be familiar with the process for determining Adequate Yearly Progress (AYP)

NM Statewide Assessment Program New Mexico High School Competency Examination (NMHSCE) • New Test Vendor: Harcourt Assessment Inc. • Reading, Language Arts, Mathematics, Science, Social Studies, Written Composition • English and Spanish versions for fall and spring administration • Test Windows: October 23-November 17 January 16-February 2

NM Statewide Assessment Program New Mexico Standards-Based Assessment (NMSBA) • Grades 3-9 • Reading, Writing, Math, Science (only Reading and Math count for AYP) • English and Spanish versions • Test Window: February 26 - March 23

NM Statewide Assessment Program New Mexico Standards-Based Assessment (NMSBA): Grade 11 • Replaces the New Mexico High School Standards Assessment (NMHSSA) • Reading, Writing, Mathematics, and Social Studies; English version • Reading, Writing, and Math; Spanish version • Science Field Test • Test Window: February 26 - March 23

NM Statewide Assessment Program Original and New Mexico Alternate Performance Assessment (NMAPA) • Grades 3-12+ • Available only to students with significant cognitive disabilities who meet the eligibility criteria established by the NMPED • Test windows: November 1 - 30 March 5 - April 6

NM Statewide Assessment Program New Mexico English Language Proficiency Assessment (NMELPA) • Three testing windows per year • Students tested once per year • Test Windows: October 30 - November 17 January 15 - February 2 April 16 - May 4

Test Security and Training • Be informed on best practices, procedures and requirements • Requirements outlined in NMPED rule at 6.10.7 NMAC • The rule may be found on the web at: http://www.nmcpr.state.nm.us/nmac/parts/title06/06.010.0007.htm • 2006-07 NMSAP Procedures Manual

DTC Responsibility: Training • Required to attend semiannual workshops held by NMPED • Provide training for all district personnel involved in administration, preparation, distribution, and security • All training administered prior to fall and spring test administration windows • Implement and monitor test security practices

DTC Responsibility: Training • No one can administer or proctor without completing the in-service • Sign-in forms must be maintained for 5 years for all individuals who attend training • Sign-in forms must be available for PED audit

Who can administer the tests? • Only trained, certified staff are permitted to administer tests: • Licensed school instructors and administrators • Teachers on waivers or intern licenses • Long-term substitutes with a valid teaching license • Coaches and contractors with a valid teaching license • Licensed counselors and related service providers

Who can serve as atest proctor? • Any staff or community member who has been trained in proper test administration and test security may serve as a proctor. • Parents cannot proctor in their own child’s classroom. • Proctors can assist, but may not act as test administrators. • All proctors must sign a non-disclosure form.

Test Security: The Basics • It’s everybody’s responsibility. • Keep test booklets secure before, during, and after testing. • Keep track of and return every test booklet, used and unused. • Do not fill out Biogrid for students taking the alternate assessment.

Security of Student Test Booklets • DTCs should inventory student test booklets when they arrive in districts. • If there is a discrepancy in the test booklet serial numbers and the contractor’s inventory list, report the problem immediately to the contractor.

Security of Student Test Booklets • Before returning materials to contractors, DTCs should inventory serial numbers and, if any booklets are missing notify the NMPED. • Following scoring and reporting test results to districts, contractors will notify the PED of missing test booklets. • Districts on this list will be required to conduct a full investigation into the reported loss and submit a report, including a cover letter from the District Superintendent, to the NMPED.

Assessment Support System • Always refer to the Test Coordinator Manual (TCM) & Directions For Administration (DFA) first. • If the Test Administrator (TA) still has questions, ask the School Test Coordinator (STC). • If the STC has questions, ask the DTC.

Assessment Support System • If the DTC has questions about policies or procedures, check the Procedures Manual. If the DTC still has questions, call NMPED: 1-505-827-6683 • If the DTC has questions about materials, contact the appropriate contractor as directed in Test Coordinator’s Manual.

Test Security: Non-Disclosure Forms • Use non-disclosure forms for test review when permission has been granted by the NMPED. • Parents/Guardians cannot view the tests before they are administered and they must sign a non-disclosure form.

Test Security: During Testing • Post signs near copy machines warning that tests cannot be copied. • Remove multiplication tables, spelling words, vocabulary, or similar assistance material from test settings during the test administration. • Have a plan to assist with medical emergencies or obtaining additional test materials.

STC Responsibilities • Review manuals • Schedule testing for schools • Notify parents of test administration • Plan for accommodations • Plan for make-ups • Verify receipt of sufficient test materials

Scheduling Considerations • Optimal Testing Times • Mornings • Tuesdays, Wednesdays, Thursdays • May adjust order of content area tests or test sessions to accommodate scheduling needs of school. • Students within the same grade must take the same session(s) at the same time.

Scheduling Considerations EXCEPTIONS: • NMSBA Writing Subtest, Grades 4-9: scheduled on two consecutive days (without a weekend in between). • Students who are provided with accommodations.

Parental Refusal Form • Parents have the right to refuse participation of their child in the New Mexico State-mandated Assessment Program. • Parents take the refusal to the principal. • The school notifies the district office personnel. • District office personnel should counsel the parent. • If parent still refuses, the Parental Refusal form must be completed and kept on file.

Testing Irregularities • A testing irregularity is “any circumstance within or beyond the control of a school district that in the opinion of the PED or a school district, raises doubts about the propriety of standardized testing procedures, preparation materials, standardized test administration, standardized testing security, student scores attained from standardized testing, or teacher or student conduct observed during standardized testing.” (6.10.7.7 (A) NMAC)

Reporting Testing Irregularities • Suspected testing irregularities should be reported in accordance with procedures in NMPED rules at 6.10.7.13 NMAC • School officials report to the DTC within 3 working days • The DTC submits report to the NMPED that contains the allegations, findings, and corrective actions taken, if any

2007-08 NMSAP Calendar • NMHSCE Oct. 22-Nov. 16, 2007 Jan. 14-Feb. 1, 2008 • NMAPA Nov. 1-30, 2007 March 3-April 4, 2008 • NMSBA Feb. 25-March 21, 2008 • NMELPA Oct. 29-Nov. 16, 2007 Jan. 14-Feb. 1, 2008 April 14-May 2, 2008

Winter DTC Training DateLocationTime January 4 Albuquerque 9:00-3:30 January 5 Las Vegas 9:00-3:30 January 8 Farmington 9:00-3:30 January 10 Las Cruces 9:00-3:30 January 11 Roswell 9:00-3:30

BREAK • 10:00 AM to 10:15 AM Break • 10:15 AM to 11:15 AM Alternate Assessment and Accommodations Please be seated and ready to begin by 10:15 AM.

New Mexico Alternate Assessments • Original New Mexico Alternate (NMALT) • phasing out – last administration is fall 2006 • New Mexico Alternate Performance Assessment (NMAPA) • under development – live administration in spring of 2007 • standardized performance tasks • revised expanded grade band expectations • math, reading/writing, science • designed to meet Title 1 requirements

Original NMALT • Online ordering process for the fall • Can ship to district or school • Need to only specify number of assessments needed • Expect ordering instructions to be distributed to DTCs by e-mail and memorandum in the coming weeks • Fall test window: November 1–30, 2006

NM Alternate Performance Assessment Spring trainings for TAs of NMAPA (tentative) • February 7, 2007 – Taos • February 8-9, 2007 – ABQ (two sessions) • February 12, 2007 – Las Cruces • Built from newly revised Expanded Grade Band Expectations (EGBEs) in reading/writing, math, and science • Spring test window is March 5 - April 6, 2007

Participation Criteria • IEP teams must answer three questions related to the student having a significant cognitive disability, and requiring extensive and pervasive support across settings. • IEP must include a statement as to why the alternate assessment selected is appropriate. • IEP must include a statement that parents have been informed regarding the potential consequences of having their child assessed against alternate achievement standards.

When in Doubt . . . • If unsure of student’s ability to take the assessment, attempt the general assessment. • Monitor students to make sure that they are attempting the test. • If student received advanced scores in last year’s alternate assessment, IEP teams should consider additional assessment options.

Test Administration Variations • Adaptations/Timing/Scheduling/Setting:variations on standardized test administration that do not need to be documented or reported as accommodations • Accommodations/Presentation/Response:allowable changes in administration procedures that do not change the construct intended to be measured • Note: Accommodations must be coded (01-24) on the Student Biogrid. • Modifications:prohibited changes that cause the measurement of the intended construct to be invalid

Allowable Accommodations • All allowable accommodations for the NMSBA have been given a code (see HANDOUT). • 23 accommodations available

Allowable Accommodations • 24 codes • 1-24 are on your accommodations handout. • 24= an accommodation that is not listed, but is approved in writing by the NMPED • DTC must submit memo to the Deputy Secretary of Assessment and Accountability describing the accommodation (ensuring instructional relevance, 3-month expectation, skill deficit). • The NMPED will return a written response with approval status.

Prohibited Modifications: All Tests • Paraphrase stimulus material, questions, and/or response choices • Restate questions with more appropriate vocabulary or define unknown vocabulary • Clarification of English words • Use of a dictionary to look up words

Prohibited Modifications: Reading • Reading aloud, tape recording, or signing of stimulus material, questions, and/or response choices • Using communication devices (e.g., text talk converter) to read stimulus material, questions, and/or response choices More . . .

Prohibited Modifications: Reading • Reading aloud in the student’s native language or translation of stimulus material, questions, and/or response choices • Use of assistive technology in which voice output has not been disabled

Prohibited Modifications: Writing • Use of a spell checker • Use of assistive technology in which spell-checking and grammar-checking have not been disabled • Use of a scribe to translate a student’s oral response from a language other than English into the test book

Prohibited Modifications: Math • Use of a calculator on a test or test session in which calculator use is not permitted • Use of arithmetic tables • Sharing calculators in the same test session

Assessment Audits and Monitoring • Focused Monitoring through Special Education • Prescribed 10% random audits (Online Verification) • On-site Assessment System Audits • random selection • 14 districts in 2005-2006 (follow-ups this year) • 29 schools in 2005-2006 • Coding Accommodations

Participation of Students with Disabilities Three Options • Participation with allowable accommodations • Participation in standard administration without accommodations • New Mexico Alternate Assessment: for students with significant cognitive disabilities who are unable to participate in general assessment, even with accommodations

ELL Students: New to U.S. • May receive language exemption from Reading test • Language proficiency assessment substituted for participation • Must take Math and other assessments • Option available first year in U.S. only • Does not affect AYP performance results

ELL Students 3 or More Years in U.S. Schools. . . • However, a waiver is available for up to two additional years to continue testing student in his or her home language. • Students must participate in English language assessment (with or without accommodations).

Waiver Requests • Must be submitted by district superintendent to NM Secretary of Education • Effective for current year only • Approved for a maximum of two years

Let’s Do Lunch! • 11:45 PM to 1:00 PM • 1:00 PM to 2:00 PM - Accountability

AYP Data Collection & Reporting Academic Growth and Analysis Bureau NMPED – Assessment & Evaluation Bureau

Dec Data Collection and Reporting Year-Round Process • Data Reporting in STARS & SIS (80th day) • Precoded Labels (December & January) • Biogrid (February & March) • Biodata Review (April & May) • Graduation and Attendance Rates (June) • AYP Calculations & Designations (July & August)

Fall Assessment Workshop: District Test Coordinator Training