End Of Course Assessments Field Test Spring 2008

1. End Of Course Assessments Field Test Spring 2008 By The Missouri Department of Elementary and Secondary Education Assessment Section April 2008

2. PowerPoint Overview This presentation is geared toward the Spring 2008 Field Test and contains the following information: • A brief history of End-Of-Course (EOC) • EOC guidelines and calibrations with No Child Left Behind (NCLB) • An overview of the test development process • The design of the EOC Field Test • The EOC Blueprints • Information about ancillaries and reference sheets

3. Why End of Course? • DESE responded to feedback from Missouri districts regarding large scale assessments for secondary school. • EOC Assessments were created to adapt testing to the needs of Missouri districts, schools, teachers and students while meeting state and federal requirements.

4. EOC Assessments were created in conjunction with national standards of excellence and Show-Me Standards. Both Course Level Expectations (CLE’s) and the EOC Assessments are a continuous collaborative effort with: Missouri teachers Administrators Regional Instructional Facilitators The Missouri Department of Elementary and Secondary Education (DESE) Assessment Resource Center (ARC) The Riverside Publishing Company

5. Missouri educators are playing a key role in the development of EOC assessments: • Authoring items • Reviewing and revising items for content, sensitivity, and bias • Revising items, when needed • Approving items to be on the final operational test forms.

6. Specific Guidelines In order to ensure the best assessments possible, the advisory committee and DESE have set specific guidelines for the tests. The items must: • Be in full compliance with the federal legislation, No Child Left Behind (NCLB) • Be aligned to the Missouri Course Level Expectations (CLE’s) • Be aligned to Norman Webb’s Depth of Knowledge (DOK) cognitive levels • Include multiple choice and performance events. (Algebra I, Biology, and English II are the only tests that will have performance events). • Have both stand-alone and passage-based items • Be criterion-referenced tests

7. Missouri State Board of Education The Missouri State Board of Education identified the following purposes for EOC: • Measuring and reflecting student mastery toward post-secondary readiness • Identifying students’ strengths and weaknesses • Communicating expectations for all students • Serving as the basis of state and national accountability plans • Evaluating programs

8. CLE’s instead of GLE’s • Course Level Expectations are goals for a particular course rather than a grade level. • A course such as Algebra I could be delivered in 8th grade or any grade level in secondary school. • Districts can offer courses with different titles which cover the same CLE’s.

9. The right test at the right time • The responsibility for testing students belongs to the school district. • The district has the responsibility to match its course content with the CLE’s that are being tested in the EOC Assessment. • When the content of the assessed information is covered, the test can be administered regardless of student grade level. • Examiners will deliver the EOC assessment at the appropriate time for their students.

10. 1st Field Test Spring 2008Algebra IBiologyEnglish II

11. A full census field test will be administered in three content areas in approximately 2000 Missouri schools in the Spring of 2008. The first operational administration of EOC will follow during the 2008-2009 school year.

12. Online Version • A small group of students will trial the online version of the Spring 2008 EOC Field Test. • An online version of each test will also be available in the operational test to school districts wishing to use this format.

13. District Reports • No reports will be produced for the districts from this Spring 2008 Field Test. • The EOC Assessment Field Test will be used to provide future operational tests.

14. Braille/Large Print • For the field test, the EOC will not have a Braille/Large Print edition. Therefore, students needing Braille/Large Print editions may have all content areas, including the English II assessment, read to them without invalidating the test. • The Examiner must mark the new bubble on the SIS for the above accommodation.

15. Forms • EOC Field Test consists of ten forms for both Sessions I and II of testing. • The forms are spiraled (distributed in roughly equal numbers) within each content area and should not be separated.

16. Two Sessions The EOC Field Tests are not strictly timed and are designed to fit into a normal class period. EOC Field Test consists of two sessions for each content area • Session I = 55 minutes • Session II = 55 minutes 55-minute class period (times are approximate) • 10 minutes for test distribution, directions, collection, etc. and • 45 minutes for actual test taking

17. Session I • Selected-response items (also known as multiple choice questions) • Each item (question) has four response options – one correct answer and three plausible distracters

18. Session II • Performance Event • Requires students to work through more complicated items • Makes allowances for more than one correct answer • Allows for insight to be garnered about the student’s ability to apply their knowledge and understanding to real-life situations

19. Writing Prompt • This is a special type of performance event that appears in the English II assessment • It is open-ended • It is scored holistically

20. Field Test Specifications Essential content and statistical considerations are aligned to: • Depth of Knowledge cognitive levels • Content Strand/Course Level Expectations

21. Algebra I Field Test Specifications • 20 Forms • 10 multiple-choice forms each with 18 items • 10 performance-event forms each with one performance event • Each student being field tested will take: • 1 multiple-choice form (Session I) and • 1 performance event form (Session II)

22. Field to Operational Field Tested Items will be reviewed and selected for the Operational Test based on: • Content appropriateness • Statistical performance (Appendix A) • Depth of Knowledge alignment

23. Operational Test The field test items will be processedinto 4 operation forms for the Operational EOC Assessment. Each operational form will consist of 2 sessions: • Session I = 35 multiple-choice items • Session II = 1 performance event

24. Operational Algebra I Blueprint

25. Guiding Principles for Test Construction • Each performance event will be aligned to one CLE from the Algebraic Relationships strand. • On the operational tests, a balance of items written for particular CLEs will be sought. • Particular CLEs may be only assessed once on a form while other forms may contain several items for that CLE. • Some CLEs may be assessed more frequently because the skills are integral to the course.

26. Operational English II Blueprint

27. Guiding Principles for Test Construction • Each form will contain 5 passages: Either 2 fiction passages and 3 non-fiction passages or vice versa. • The writing form/type will vary depending on the writing prompt selected. Writing prompts will be aligned to a primary CLE. Multiple writing CLES may be assessed to reflect the holistic rubric. • Some CLEs can be used for both fiction and nonfiction passages. • Particular CLEs may be only assessed once on a form while other forms may contain several items for that CLE. • The goal will be to balance the CLEs across the forms. Since English II is passage-based, including every assessable CLE in this round of operational forms may not be possible.

28. Operational Biology Blueprint

29. Operational Biology Blueprint

30. Breakdown by DOK for all content areas • DOK levels for each CLE were determined by groups of Missouri educators during an alignment review, facilitated by Norman Webb. • At least 80% or more of the items on the operational form should be at the designated DOK level. • The other 20% may fall below the designated DOK level.

31. Non-secure materials • Non-secure materials will be delivered to the districts the week of April 14th • Non-secure materials include: Test Coordinator Manuals, Examiners Manuals, barcode labels, return kits, and answer documents for Session I Assessments

32. Manipulatives for the field test • Algebra I: • Students can use a calculator during both Session I and Session II. A four-function calculator is sufficient for the needs of this assessment. • The testing materials include an Algebra I reference sheet for use during both Session I and Session II. • Biology: • Students are not provided nor do they need a reference sheet. • Students can NOT use a calculator. • English II, Session II only: • Students can use a standard dictionary, thesaurus, or grammar handbook only for Session II. • These tools are not allowed in Session I. NOTE: For students taking either the Algebra I or Biology test, their writing, spelling and grammar will not be evaluated.

33. Labels • Each content area will have 2 labels, one for Session I and the second for Session II • The labels will be pre-coded based on the MOSIS core data • The labels are sorted by District, School, Grade, Last Name, First Name

34. Secure Materials • Session I and Session II test books will arrive in the Districts the week of April 21st

35. Rules • The rules for EOC testing are basically the same as MAP testing regarding calculators, highlighters, erasures, all testing environments, etc. • The same rules apply for test security and test administration in the EOC as in MAP.

36. Glossary • Open-ended question - the student’s answer can vary depending on the student’s thought process. An example of an open-ended item might be to write a friendly letter to a friend telling them about the sports event you just watched • Holistically scored – Scored on the overall impression of how well a response reflects the scoring criteria.