250 likes | 415 Views
2009 MEPA Reporting Teleconference September 2009. Presenters. Kit Viator, Director of Student Assessment Dan Wiener, Administrator of Inclusive Assessment Bob Lee, Chief Analyst. Welcome MEPA Overview and Updates 2009 MEPA Reporting: What’s New and Why?
E N D
2009 MEPA Reporting Teleconference September 2009
Presenters • Kit Viator, Director of Student Assessment • Dan Wiener, Administrator of Inclusive Assessment • Bob Lee, Chief Analyst
Welcome MEPA Overview and Updates 2009 MEPA Reporting: What’s New and Why? New Performance Levels and Reporting Scale Standard Setting: Setting the Cut Score What the Scores Mean Making Reclassification Decisions Planning Instruction Important New Resources Questions and Answers Today’s Agenda
MEPA Overview • The state’s English language proficiency assessment of LEP students in grades K-12, based on English Language Proficiency Benchmarks and Outcomes • MEPA-R/W and MELA-O • Fall testing: Test only those LEP students in grades 1-12 who did not participate in spring 2009 (no fall testing for Kindergarten) • Spring testing: Test all students in K-12 reported as “LEP” in October 2009 or March 2010 SIMS • Sub-scaled scores in four tested areas • Reading: 0-30 points • Writing: 0-30 points • Listening: 0-5 points • Speaking: 0-20 points NOTE: Sub-scaled scores Overall scaled score
By January 31, 2010, all QMT/QMAs must be requalified in order to continue to report MELA-O scores for MEPA Purpose: To improve consistency and reliability of student ratings Fall 2009 QMT Training schedule Retrain current QMTs: October 13, Westborough Train new QMT (if no QMT in district): September 21-22, Westborough November 3-4, Norwood MELA-O (Listening and Speaking)QMT/QMA Retraining and Requalification
Spring 2009 MEPA:What’s New? • Redesigned tests for grade spans 3-4, 5-6, 7-8, and 9-12 • New K-2 tests • New test questions based primarily on authentic reading passages • Wide range of difficulty of test questions, and more constructed responses • Locator survey (K-2)/locator tests (3-12) • New reporting scale: 400-550 • New performance levels: Levels 1-5
New Tests for Students in K-2 • Student takes either Level A or B, depending on • Level of English proficiency and literacy • Results of K-2 Locator Survey • What’s tested on K-2 MEPA-R/W: • Level A:(R) alphabet recognition; match high-frequency words with pictures; answer questions based on story read aloud; (W) write or complete a dictated word; write the word for a picture; write a two-sentence story • Level B:(R) match or write a word/sentence that matches picture; questions based on story read by student; (W) correct punctuation; letter writing to complete sentence; write a story based on 3 pictures
MEPA Reporting: 2005-2008 MEPA Performance Levels Early Inter-mediate Inter-mediate Beginning Transitioning 300 400
Why We Needed New MEPA Performance Levels 2005-2008 MEPA Early Inter-mediate Inter-mediate Beginning Transitioning 305 395 400 300 Many students begin to demonstrate proficiency on MCAS ELA tests
MEPA 2005-2008: Distribution of Scaled Scores • Students at low Beginning and high Transitioning levels were clustered into lower and upper ends of scale. 5,000 4,000 3,000 # STUDENTS 2,000 1,000 0 300 320 340 360 380 400 SCALED SCORE
MEPA Reporting: 2009 MEPA Performance Levels Level 2 Level 5 Level 3 Level 4 Level 1 400 550
New MEPA Performance Levels A student at: • Level 1 cannot yet communicate in English • Level 2 communicates using simple written and spoken English, with frequent errors • Level 3 communicates using basic English with occasional errors • Level 4 is generally fluent, with few errors • Level 5 communicates effectively in English across all academic subjects
Standard Setting: Summer 2009 • Performance levels describe performance at five levels • Panels of ELL and general educators spent 3 days last summer with ESE determining where one performance level ended and another began (“cut score”) • Recommendations of panelists for Levels 1-4 were adopted. • Level 5 was based on panelists’ recommendations plus other evidence, including • Percent of LEP students Proficient on MCAS ELA • Statewide reclassification rate …and was fixed at 500-550 on each test.
2009 MEPA Grade K-12 Overall Scaled Score Distribution 400 # STUDENTS 550 SCALED SCORE
Level 3 Level 5 Level 4 Level 1 Level 2 Sample Parent/Guardian Report: Grade 7 • Very similar in appearance to 2005-2008 P/G Report, showing: • student’s score • location within the performance level • likely range of scores if student took the test multiple times
Sample Parent/Guardian Report: Grade 7 (Continued…) • Relative strengths and weaknesses in four tested areas
Sample Parent/Guardian Report: Grade 7 (Continued…) • Score compared with other students who have been in Massachusetts for 1 to 5+ years • About 45% of students who have been in Massachusetts for 3 years were in Level 3 on this MEPA test, as was this student.
Using MEPA Results to Make Reclassification Decisions • Level 1 and Level 2: Not a candidate for reclassification • Level 3: Not a likely candidate for reclassification • Level 4: May be a candidate for reclassification, if other indicators are aligned* • Level 5: Reclassification recommended, if other indicators are aligned* *MCAS scores, grades, local assessments, observations
Available Now • Guidance on Using MEPA Results to Plan Sheltered English Immersion (SEI) Instruction and Make Reclassification Decisions for Limited English Proficient (LEP) Students (2009) • Guide to Interpreting the 2009 MEPA Reports for Schools and Districts (Both available at: www.doe.mass.edu) • School “Drop Box” with pre-loaded student results for 2009 MEPA and 2008-2009 MCAS (Department’s Secure Internet Portal)
Accessing MEPA Results • Go to www.mcasservicecenter.com • Click “MEPA” • Then “MEPA Reporting” • Then “Continue” • Log In
Accessing MEPA Results (Continued…) • Choose your district from the dropdown menu • Select your school or District Office from the school menu • Enter your MCAS/MEPA five-digit password and login
Accessing MEPA Results (Continued…) • Select “All Grades” under Administration • Check the reports you want to view; then “Download” • If you have trouble viewing the zipped files, click the blue “here” link for help uploading free unzipping software
Accessing “Dropbox Central” for Principals or their designees • https://www4.doemass.org • Log in with your Security Portal password • Principals and those assigned the MEPA school role by your directory administrator can access “Dropbox Central” • Select the “2009 MEPA and 2008-2009 MCAS” folder • Download the .TXT file which can be opened using Excel or other spreadsheet software