680 likes | 807 Views
2007-08 Post-Test Workshop. Wisconsin Student Assessment System and Accountability Updates. Workshop Overview. Topics: General Information WKCE WAA-SwD ACCESS AMAOs NAEP Adequate Yearly Progress (AYP) Questions & Answers Send your questions anytime.
E N D
2007-08Post-Test Workshop Wisconsin Student Assessment System and Accountability Updates
Workshop Overview • Topics: • General Information • WKCE • WAA-SwD • ACCESS • AMAOs • NAEP • Adequate Yearly Progress (AYP) • Questions & Answers • Send your questions anytime
If you cannot hear the presenter check to be sure: • The volume on MediaSite is turned up. The Volume button is located below the speaker box • The volume on your computer is turned up. Adjust on the toolbar on lower right side of screen • Contact your IT Staff
1 2 3 4 5 6 Getting Around in MediaSite
OEA Website • OEA’s Web site - http://dpi.wi.gov/oea • Organized by Accountability, Assessments, and Resources • DAC Corner: • MediaSite/Webcast Trainings • DAC correspondence • DAC responsibilities and New DAC information • Calendar/Important Dates • Quick contacts
Update Your Contact Information • DACs will receive a DAC Update Form via email on May 1, 2008; • Please complete this form by May 31, 2008 & return (even if you are not a new DAC as this keeps our email records current. )
Online Reporting System (ORS) • To access data through the ORS (“TurnLeaf site”) new DACs may receive usernames & passwords, from Phil Cranley at (608) 266-9798. All other DACs should have their usernames and passwords. • The “ORS 101” presentation covers general use and navigation and is available in the DAC corner of the OEA website at http://dpi.wi.gov/oea/webcasts.html
TEST SECURITY During WKCE Item Analysis Workshops & Data Retreats • Test books from this year and previous years have LIVE ITEMS and should be secured at all times • NO COPIES should be made! • Participants must sign a Confidentiality Agreement Form available at http://dpi.wi.gov/oea/dacforms.html
TEST SECURITY continued • Do NOT alter/modify items for student practice or any other use – There are released items available for use at (http://dpi.wi.gov/oea/releaseitems.html) • Account for and secure all test books • Explain consequences of security violations to participants • More information is available in the Test Security Webcast training at http://dpi.wi.gov/oea/webcast.html.
Fall 2008 Testing Window • Fall 2008 WKCE & WAA-SwD testing window is October 27 – November 28 • Testing windows through 2014-15 are available at http://dpi.wi.gov/oea/calendar.html.
Fall 2008 Testing Window • Testing for both the WKCE and the WAA-SwD may not begin before the testing window based on the recommendation of the Wisconsin Technical Advisory Committee.
Fall 2008 Testing Window • DPI suggests scheduling the WSAS during the first 2 weeks of the window and using the remaining time to give make-ups. This will eliminate some of the problems with students moving in the middle of the window.
Participation in the WKCE or the WAA-SWD • Beginning with Fall 2008 a student must participate in either the WKCE or the WAA-SwD based on the decision of the IEP team as to which set of standards is appropriate for that student. • A student who is taught from the Extended Grade Band Standards must take the WAA-SwD. • A student who is taught from the Wisconsin Model Academic Standards must take the WKCE. • A student may not take part of the WKCE and part of the WAA-SwD • Please consider this prior to the testing window and during IEP planning.
Accommodations • The “Accommodation Matrix” (describing allowable testing accommodations and practices) will be updated and re-posted shortly. See http://dpi.wi.gov/oea/pdf/accom08.pdf. • Braille – Reading the reading test to newly blind students • Minor Clarifications The matrix will also appear in the Guide for District Assessment Coordinators (“DAC Guide”), distributed before Fall 2008 testing.
Review of 2007-08 WKCE Testing • The Office of Educational Accountability (OEA) would like to thank you for your work in ensuring a successful & timely administration in conjunction with other responsibilities • WKCE Test books were returned on time • RES was earlier to allow for IPRs in districts by the end of February.
WKCE Development Process • Extensive input from Wisconsin educators is part of the year-round development process of the WKCE: • Passage review • Item content and bias review • Range finding • ELL Translations
WKCE Scale Scores • 2007-08 WKCE scale scores remain the same as 2005-06 administration. • Scale scores are available online at http://dpi.wi.gov/oea/wkce-crtcuts.html
Schedule for the Release of the 2007-08 WKCE data: • Phase III (final set of reports) are available and were posted on the Online Reporting System (ORS) website on April 21. • Phase II reports were available through ORS on March 28. • Individual Profile Reports (IPRs) were shipped to districts on February 29, and should have been sent home to parents shortly after receipt in the district.
Public Release of Data • No public release of WSAS data is permitted until May 30, 2008. • This date is later this year due to the late administration of the WAA-SwD and the need to wait until WAA-SwD Standard Setting was held in April. • Results may be shared internally with educators but not released to the public • WINSS will be updated with the 2007-08 data on May 30, 2008.
Fall 2008 WKCE • Fall 2008 WKCE testing times similar to last year • Science will still be tested only at 4, 8, & 10 • Two WKCE test books at grades 4, 8, & 10 • After testing, please check for merged records during Record Editing System
Wisconsin Alternate Assessment for Students with Disabilities (WAA-SwD)
WAA-SwD The Office of Educational Accountability (OEA) would like to thank you for your work in ensuring a successful & timely administration in conjunction with other responsibilities THANK YOU!
WAA-SwD Development Process • Extensive input from Wisconsin educators is part of the year-round development process of the WAA-SwD: • Extended Grade Band Standards • Item Content and Bias Review • Standard Setting
WAA-SwD Standard Setting • A process that lets experts make judgments about the content that students in each achievement level should know. • Achievement standards define what students should know and be able to do at each proficiency achievement level (minimal, basic, proficient, advanced) . • Extended Grade Band Standards
Review of 2007-08 WAA-SwD • Overall, positive feedback and a successful administration • WAA-SwD Trainings • Extended Grade Band Standards • WAA-SwD Administration • First time administration concerns • Correct quantity of materials per grade level – we are addressing this with our vendor
WAA-SwD Survey Results • Approximately 500 educators participated in the survey • 77% were classroom teachers • How long did it take to PREPARE for the test administration. In general, Mathematics, Reading, and Science: • 73 % 0-29 minutes • 23 % 30-59 minutes • 3 % 60-89 minutes • 2 % 90 or more minutes *Percentages are rounded
WAA-SwD Survey Results • How long did it take your student to COMPLETE the test per content area (indicate average if more than one student)? • In general, Mathematics, Reading, and Science: • 21% 0-29 minutes • 52% 30-59 minutes • 20% 60-89 minutes • 7 % 90 or more minutes *Percentages are rounded
WAA-SwD Survey Results • How appropriate was this test in measuring the academic knowledge of the students to whom it was administered? • 21% Too difficult • 48% Appropriate • 31% Too easy *Percentages are rounded
WAA-SwD Survey Results • Some comments: “ I liked this assessment much better than those we have used in the past. I felt that it gave an accurate picture of my student's abilities.” “ Much preferred giving a test like this as opposed to having to collect evidence. Like the extended band standards also.” “ In general I felt the test was appropriate. The range of the students abilities that will be taking this test makes it difficult to develop a test that is appropriate for all students.” “ I am very happy that we now have expectations for students with cognitive disabilities. I like the changes but do see the difficulties some teachers are having administering it to very severe students.”
Schedule for the Release of the 2007-08 WAA-SwD data: • WAA-SwD Individual Profile Reports (IPRs) have been sent out to districts and should be arriving shortly. IPRs should be sent home to parents shortly after receipt. • District Assessment Coordinators will be able to check the WAA-SwD reports on the Online Reporting System (ORS – “TurnLeaf site”).
Public Release of Data • No public release of WSAS data is permitted until May 30, 2008. • This date is later this year due to the late administration of the WAA-SwD and the need to wait until WAA-SwD Standard Setting was held. • Results may be shared internally with educators but not released to the public • WINSS will be updated with the 2007-08 data on May 30, 2008.
Fall 2008 WAA-SwD • Performance-Task assessment • Reading and Mathematics at grades 3-8, and 10 • Science at grades 4, 8, and 10 • Rater Form Assessment • Social Studies and Language Arts/Writing at grades 4, 8, and 10 • Knowledge and skills inventory • Record the results on the WAA-SwD answer document • WAA-SwD will be given during the SAME window as the WKCE.
Fall 2008 WAA-SwD • Participation Checklist • IEP Team decision • A student must participate in either the WKCE or the WAA-SwD based on the decision of the IEP team as to which set of standards is appropriate for that student. • Available at: http://dpi.wi.gov/sped/assmt-waa.html
Office of Educational Accountability Brian Johnson brian.johnson@dpi.wi.gov 608-267-1290 Kristen Kehoe kristen.kehoe@dpi.wi.gov 608-267-3164 Special Education Team Sandy Berndt sandra.berndt@dpi.wi.gov 608-266-1785 Eva Kubinski Eva.kubinski@dpi.wi.gov 608-266-2899 WAA-SwD Questions?
English Language Learners (ELLs)
Assessment of English Language Learners • Spanish and Hmong Pilot Translations - DPI provided for 2007 administration • 2008 Administration similar to 2007 with incorporated suggestions from survey and educators • ELL students will continue to take the WKCE with allowable accommodations
Accommodations for ELLs • Spanish & Hmong Pilot: testing scripts and audio recordings • Survey indicated that the scripts were used in more frequency than the audio recordings • Audio recordings were useful to some but had some technical quality issues. • Will re-evaluate process and procedures for next years administration. • Content-specific word-to-word glossaries in Spanish and Hmong
Accommodations for ELLs • Accommodations Matrix • DPI recognizes that 15% of the Wisconsin ELL population speaks a language other than Spanish or Hmong. Districts who serve students who speak languages other than Spanish or Hmong may use qualified translators to provide oral translation support to students.
Assessment of ELL Students For Fall 2008: use same procedures as Fall 2007: • ELL Levels 1 and 2 less than 1 year in country: must take Mathematics and Science; may take Reading • Levels 1 and 2 more than 1 year in country: must take Mathematics, Science, and Reading
ACCESS for ELLs • New Electronic data clean-up window was used due to district requests. • April 15-April 25 • All paper reports will be delivered the week of May 12. • After paper reports are delivered districts will have two more weeks to make any additional corrections.
ACCESS for ELLs • 2008-2009 Testing Window • December 1, 2008- February 13, 2009
ELL AMAO’s - What are they? • Annual Measurable Achievement Objectives (AMAOs) for the Attainment of English Language Proficiency • AMAOs are used for Title III Accountability – not for AYP
Specific Targets for each AMAO • AMAO 1 → Progress ELP Assessment • AMAO 2 → Attainment • AMAO 3 → Title I AYP → Content Assessment • Must meet each of the required indicators to meet AMAO’s. If one of the components is not meet than the district or consortium does not meet their AMAO.
ELL AMAO Calculations • Three specific AMAO target areas have been established under the law: • AMAO 1: Progressing in English language acquisition annual increases in the number or percentage of students making progress in learning English • AMAO 2: Exiting or reaching English language proficiency annual increases in the number or percentage of students attaining English language proficiency by the end of each school year ELL exit rate is calculated as: 100% of students who achieve ELP level 6 100% of students eligible to achieve Level 6 • AMAO 3: ELL-Adequate Yearly Progress (AYP)AYP for the ELL subgroup (under Title I) in meeting grade-level academic achievement standards in English Language Arts (Reading) and Mathematics • The above Title III AMAOs are not used for school/district accountability (AYP purposes).
AMAO Timeline • AMAO results will be distributed at the beginning of the school year. • 30-day appeal process after results are given to districts.