Upcoming Science Assessments: the 2011 HSPE and the 2012 Biology End-of-Course Exam

1. Upcoming Science Assessments:the 2011 HSPE and the 2012 Biology End-of-Course Exam December 10, 2010 Elaine Wood, Science Assessment Specialist

2. Science Assessment Office • Elaine Wood—Secondary Specialist • elaine.wood@k12.wa.us • Kara Monroe—Elementary Specialist • kara.monroe@k12.wa.us • Troi Williams—Administrative Assistant • troi.williams@k12.wa.us

3. Topics • Grade 5 & 8 Measurements of Student Progress • New Standards • Standard Setting • High School Update • 2011 High School Proficiency Exam • 2012 Biology End-of-Course Exam • Student Performance • Resources available

4. Measurements of Student Progress Assessing new standards in 2011

5. From WASL to Measurements of Student Progress Embedded pilot items bring the item total to 40. The K-12 Science Learning Standards will be assessed for the first time in 2011.

6. Science Assessment Development Cycle Develop Item and Test Specifications Scenario & Item Writing Scenario & Items Reviewed for Content & Bias/Sensitivity by Committees Scenario & Items Reviewed for Content by OSPI Scenario & Item Pilot Testing Pilot Rangefinding Operational Testing Data Review Pilot Scoring Operational Rangefinding Operational Scoring

7. Standard Setting for Science MSP in 2011

8. Science Standard Setting Plan

9. Science Standard Setting Plan

10. Science Standard Setting Plan

11. “Contrasting Groups” method affords broader involvement in standard setting • Everyone in the state who teaches science in grades 5 and 8 is invited to help set the performance standards. • Performance Level Descriptors (PLDs) are developed for “Basic” and “Proficient” • Web-based training on PLDs is provided to participating teachers • In April, participating teachers judge each of their students as being “Basic or below” or “At or above Proficient” • Two distributions of scores are produced: Scores obtained by students rated as “Basic”, and scores for “Proficient” • Where the two distributions merge represents the separation point between “Basic” and “Proficient.”

12. Students rated as “Basic or below” using criteria in PLD for Basic Number of students Raw score points

13. Students rated as “Proficient or above” using criteria in PLD for Proficient Number of students Raw score points

14. Intersection indicates a region for where “Basic” separates from “Proficient” Number of students Raw score points

15. Upcoming Events – Grade 5 & 8 • Scenario and Item Writing – Feb. 14-18, 2011 • Content Review – April 4-8, 2011 • PLD Training – Available via Moodle, Feb. 1, 2011 • Learn to use evidence to evaluate 5th or 8th grade students’ proficiency • Takes 3 hours; 3 free clock hours are available • To sign up, go to link and create an account • http://moodle.ospi.k12.wa.us/course/view.php?id=19 • Contrasting Groups Study – Available via EDS, April 11-29 • After completing the PLD Training, 5th or 8th grade teachers can predict their students’ performance on the MSP • 5th and 8th grade science teachers can gain access to the EDS application by contacting a District Assessment Coordinator • Standard Setting – August 1-4, 2011

16. High School Proficiency Exam A graduation requirement for sophomores in 2011

17. From WASL to High School Proficiency Exam to End of Course Embedded pilot items bring the item total to 45. Completion items will be piloted in 2011 and will be operational in 2012. The K-12 Science Learning Standards will be assessed beginning in 2012.

18. Implementation Timeline • HSPE for 2011 will assess the 2005 GLEs • April 12, 2011 • Biology EOC in 2012 will be administered to any student enrolled in a course credited as high school level biology • K-12 Science Learning Standards • Online participation will be voluntary • Goal: 50% Online in 2012 • First retake opportunity for biology EOC is likely to be January/February 2013 • Possible additional science EOCs? • TBD by Legislature • Superintendent to make recommendation

19. Science Graduation Requirement: Classes of 2013 and Beyond • Under current rules, the students in the classes of 2013 and beyond can meet the science graduation requirement by: • Passing the science HSPE in spring 2011 and/or summer 2011 • 9th graders are not eligible to take science HSPE • Passing the biology EOC • Begins in spring 2012; scores available August 2012 • Meeting comparison scores on the SAT 2 or ACT • Scores set during the 2012-13 school year • Passing a science Collection of Evidence • Becomes available in the 2011-12 school year

20. Science Assessment Development Cycle Develop Item and Test Specifications Scenario & Item Writing Scenario & Items Reviewed for Content & Bias/Sensitivity by Committees Scenario & Items Reviewed for Content by OSPI Scenario & Item Pilot Testing Pilot Rangefinding Operational Testing Data Review Pilot Scoring Operational Rangefinding Operational Scoring

21. Upcoming Events – High School • Scenario and Item Writing • Feb. 21-25, 2011 • June 20-24, 2011 • Content Review • March 28 – April 1, 2011 • Aug. 15-19, 2011 • Test Map – Spring 2011 • PLD Development – September 2011 • PLD Training – Winter 2011/12 • Standard Setting – August 2012

22. Patterns in Student Performance High School WASL and HSPE

23. Strengths Areas to Improve Writing conclusions 52% to 58% earn full points Identifying variables in investigations 72% to 88% correct Writing constructed response items related to investigations or solving human problems. Explaining energy transfers or transformations in a system Addressing persistent misconceptions

24. Resources Available From the OSPI website www.k12.wa.us

25. OSPI Science Assessment Webpage www.k12.wa.us www.k12.wa.us/science Select Science Assessment from Assessment Drop-down www.k12.wa.us/Science/Assessments.aspx Select Assessments

26. Science Assessment Resources • Test and Item Specifications—more information about: • Grade 5 & 8: • Types of scenarios • Test map • Item specifications • Vocabulary lists • Cognitive complexity • High School: • Item specifications for 2005 GLEs • Vocabulary lists • NOTE: Test and Item Specifications for EOC coming late fall 2011

27. www.k12.wa.us/Science/Assessments.aspx Grade 5 & 8 Test and Item Specs www.k12.wa.us/Science/TestItemSpec.aspx Select Test and Item Specifications Select a Grade

28. www.k12.wa.us/Science/Assessments.aspx 2011 HSPE Test and Item Specs www.k12.wa.us/Science/TestItemSpec.aspx Select Test and Item Specifications Select GLEs with MSP and HSPE Evidences of Learning Science Item Specifications

29. Science Assessment Resources • Updates for 2011—each grade level contains: • General information on the 2011 test • Sample items • Scoring information, including rubrics

30. Updates for 2011 www.k12.wa.us/Science/Assessments.aspx Select Educator Resources http://www.k12.wa.us/Science/EducatorResources.aspx Select a Grade

31. Science Assessment Resources • Teacher Resource tool: • Types of scenarios • Generic questions • Item specifications (2005 GLEs) • Cognitive complexity Note that all tests posted here assess the 2005 GLEs.

32. Teacher Resource Tool www.k12.wa.us/Science/Assessments.aspx www.k12.wa.us/TeacherResourceTool2009-10/default.aspx Select Teacher Resource Tool Select Science Select a Grade and a Year

33. Teacher Resource Tool Percent correct or mean score Type of scenario Generic question, rolls over to item specification

34. Additional Resources • Powerful Classroom Assessments (PCAs)— • Teaching materials developed from WASL released items • New PCAs will be developed in future for K-12 Science Learning Standards • Each PCA includes: • Sample items • Scoring information, including rubrics • Item Analysis from the Assessment OverviewWebsite https://eds.ospi.k12.wa.us/WASLTestItems/ Summary of performance on released WASL items by school, district and state

35. Thank you.