1 / 112

Benchmark Assessment Pilot

Benchmark Assessment Pilot. January 10, 2014 2:30 p.m. Benchmark Pilot Dates. January 10 Training Workshop January 16 – 17 Materials Arrive at School January 27 Testing Window Opens March 7 Testing Window Closes

verdad
Download Presentation

Benchmark Assessment Pilot

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Benchmark Assessment Pilot January 10, 2014 2:30 p.m.

  2. Benchmark Pilot Dates January 10 Training Workshop January 16 – 17 Materials Arrive at School January 27 Testing Window Opens March 7 Testing Window Closes March 11 Materials Returned to Warehouse

  3. Purpose of Benchmark Assessment Pilot • Develop and evaluate the quality of items • Determine if scoring rubrics function properly • Provide districts with a resource for future use • Collect student responses to serve as exemplars • Students and schools are NOT being evaluated. • Questions reflect the rigor of the state standards and provide a resource for teachers to prepare students for the end-of-year assessment. • One benchmark test form will be constructed per grade/subject, with remaining items housed in the OAS for district use.

  4. Purpose of Benchmark Assessment Pilot • The Spring 2014 Benchmark Assessment Pilot represents Phase II of a two-phase project. For this second phase, items have been developed and will be piloted in the following grade levels and subjects/courses: • ELA: Grades 4, 5, 9th Literature, American Literature • Math: Grades 4, 5, 6, 7, 8, Analytic Geometry, Advanced Algebra • Social Studies: Grades 3-8 • Science: Grades 3-8 and Biology

  5. Benchmark Assessment ProductionSchedule • ELA • Grades 1, 2, 3, 6, 7, 8, and 10 • Mathematics • Grades 1, 2, 3, and Coordinate Algebra • U.S. History • ELA • Grades 4, 5, 9, and 11 • Mathematics • Grades 4, 5, 6, 7, 8, Analytic Geometry, and Advanced Algebra • Science Grades 3-8 & Biology • Social Studies Grades 3-8 Phase I Fall 2013 Pilot Available Spring 2014 Phase II Winter 2014 Pilot Available Fall 2014

  6. Benchmark Assessment Available Resources • ELA • Grades 1 - 11 • Mathematics • Grades 1-8, Coordinate Algebra, Analytic Geometry, Advanced Algebra • U.S. History • Biology • Science Grades 3-8 • Social Studies Grades 3-8 Benchmark Assessments (one per grade/subject) plus additional item bank Item Bank Only

  7. Comparison to Formative Item Bank Formative Item Bank Benchmark Assessments ELA, Mathematics, Science and Social Studies Grades 1 – High School Item Bank and one benchmark test form per grade/subject Housed in OAS Level 3 (for district-use) Variety of item types Mostly multiple-choice and short-answer • ELA and Mathematics • Grades 3 – High School • Item Bank only • Housed in OAS Level 2 (for teacher-use) • Variety of item types • Mostly constructed response

  8. Types of Items • Items are aligned to the state-mandated content standards in each subject area. • There are four types of items: • Multiple-Choice (MC) • Short-Answer (SA) • Constructed-Response (CR) • Performance Tasks (PT)

  9. Types of Items • Multiple-Choice(MC) • Require student to select the one best answer • Four answer choices • Short-Answer(SA) • Require students to write a short answer. • In ELA, SS, and Science the answer may be a word, a phrase, or even a sentence or two, depending on the question. • In Math, the answer may be a number, a number sentence, a few words or a sentence to explain.

  10. Types of Items • Constructed-Response(CR) • Performance-based tasks • May address multiple standards, multiple domains, and/or multiple areas of the curriculum • May allow for multiple correct responses and/or varying methods of arriving at a correct answer • Scored through use of a rubric and associated exemplars

  11. Types of Items • Performance Tasks(PT) • Include a sequence of items or tasks • Designed to demonstrate deeper understanding • May be multi-standard and multi-domain • May guide a student to map out a response to a more extended task • Scored through use of a rubric and associated exemplars

  12. ELA Items • Reading and writing assessed together • Text complexity and rigor is increased • Single passage or multiple passages • Text provides detail and depth and requires student to: • Read closely and comprehend • Extract details, themes, author’s messages, etc. • Then write a response using information from passage as support.

  13. ELA Sample Items Short-Answer What is the primary purpose of the second and third stanzas of the poem? • Student response may be a few words or possibly a sentence. Constructed-Response Explain how Steven’s actions affect the outcome of the story. • Student response should be several sentences or a paragraph. Students should write in complete sentences and use correct punctuation and grammar.

  14. ELA Sample Items Performance Task Part A Identify the primary point of view from which the speech was written. Give examples of two sentences from the speech that support your answer.  Then identify the primary point of view from which the newsletter was written. Give examples of two sentences from the newsletter that support your answer. Part B Write an article for your school newsletter. In the first paragraph, describe the personal views and feelings of Dr. Patel that led to her founding the center. In the second paragraph, provide for your readers a summary of how the center carries out its important work.

  15. Mathematics Items • Assess students’ conceptual understanding • Tasks require students to • Apply the mathematics they know to real world problems • Express mathematical reasoning by showing their work or explaining their answer

  16. Mathematics Sample Items Short-Answer Lisa has a square sandbox. The perimeter of the sandbox is 28 feet. What is the length of each side of Lisa’s sandbox? • Student response will be a number. An office building has 14 rooms. There are 3 windows in each room. Explain how the expression 14 x 3 can be used to find the total number of windows in the office building. • Student response will be a short explanation.

  17. Mathematics Sample Items Constructed-Response Larry sells hats for $7 each.  Part AOn Monday, he sells 3 hats. How much money did Larry make? Show your work.  Part BOn Tuesday, he made a total of $49 from selling the hats. How many hats did Larry sell? Show your work by writing a multiplication problem.  Part COn Wednesday and Thursday, Larry sold 5 hats each day. Write a multiplication problem that could be used to find the total amount of money he made on these two days.

  18. Mathematics Sample Items Performance Task Frank has a small waterfall in his garden. The waterfall moves 1 liter of water every 2 minutes. Part AOne day, Frank runs the waterfall for 10 minutes. How many liters of water does the waterfall move in 10 minutes? Show your work. Part BThe next day, Frank lets 8 liters of water move through the waterfall. How long does it take for the waterfall to move 8 liters of water? Show your work. Part CHow long did the waterfall run on both days? Show your work. Part DHow much water did the waterfall move on both days? Show your work.

  19. Social Studies Items • Require students to use critical thinking skills to demonstrate understanding of the state content standards • Many items require students to synthesize content from multiple standards • Incorporate Information Processing, Map and Globe, and Literacy skills when appropriate

  20. Social Studies Sample Items Short-Answer Explain how the Whiskey Rebellion during Washington’s presidency and anti-British protests prior to the Revolutionary War were similar in their causes. • Student response will be a short explanation The list below describes world events that happened during the presidency of Jimmy Carter (1977–1981). • Egypt regained the Sinai Peninsula. • Egypt recognized Israel’s right to exist. • Egypt withdrew its troops from Israel’s border.  What agreement between Israel and Egypt caused these events to happen? • Student response will be the name of the agreement

  21. Social Studies Sample Items Constructed-Response Part A How did the Treaty of Paris, 1783 affect the relationship between the United States and Great Britain? Part B How did the Treaty of Paris, 1783 change the size of the United States? Part C The territorial terms of the Treaty of Paris, 1783 contained the potential to impact the diplomatic future of the United States. Explain why and how the Treaty of Paris, 1783 impacted future diplomatic relations between the United States and Spain OR between the United States and Native American groups.

  22. Science Sample Items Short-Answer

  23. Science Sample Items Constructed-Response Students use a slide, a rubber swing seat and the wooden seesaw on the school playground to learn about sound and pitch. The students tap each with a wooden spoon and observe what they hear. Part A What causes the sound they hear? Part B Why is the sound so different for the three objects they tap? Part C Which object would have the highest pitch? Explain your answer. Part D How would the sound pitch of the slide change if a student was sitting on the slide when it was tapped with the spoon? Explain your answer.

  24. Pilot Forms • Pilot test forms are designed to minimize the amount of instructional time needed to administer the pilot. • Some schools have been assigned two pilot test forms. In these cases, the two forms assigned are for different grade levels. • Schools should administer the pilot test to the designated number of students in the grade and subject/course assigned. • The number of students to test at each school is noted in the District Form Assignments spreadsheet. • This spreadsheet also contains information regarding format of the assigned form (MC, SA, CR, PT) and the required response method (Online, Answer Document).

  25. District Form Assignments Some schools are assigned two forms.

  26. District Form Assignments Your Form Assignment spreadsheet contains the following information for each school: • Assigned Grade (s) to Test • Assigned Subject (s) to Test • Number of Students to Test • Assigned Form Name (s) • Assigned Form Number (s) • Type of Form (MC, SA, CR, and/or PT) • Response Method (Online or Answer Document) • Answer Document Version, if applicable

  27. High School CoursesBlock Schedule Issues • For high schools on a block schedule, it may be necessary to test students who have previously completed the assigned course, rather than (or in addition to) students currently enrolled in the course. • For example, if a school is assigned 9th Grade Literature, they may choose to test students who are currently enrolled in 10th Grade Literature. • Schools assigned Advanced Algebra will most likely need to test students currently enrolled in Math 3 or Math 4.

  28. Overview of Pilot Tests • Pilot Forms • Students will view all items online in the OAS. • Details regarding the number and type of items on each form can be found in the Examiner’s Manual. • English Language Arts • Forms contain one or two reading passages followed by items. • Passages and items must be read independently by each student. • Students will respond to all ELA items in Grades 3-12 online via the OAS. • For multiple-choice items, students will select the appropriate response option. • For open-ended items (SA, CR, PT), students will type their response within the text box provided on the OAS screen. • A few Student Answer Documents will be provided for students with disabilities who require a paper-pencil answer document as an accommodation.

  29. Overview of Pilot Tests • Pilot Forms • Students will view all items online in the OAS. • Details regarding the number and type of items on each form can be found in the Examiner’s Manual. • Mathematics • Forms contain either 30-31 MC/SA items OR 3-4 CR/PT items. • Students will respond to all Multiple-Choice and Short-Answer math items online via the OAS. • For multiple-choice items, students will select the appropriate response option. • For short-answer items students will type their response within the text box provided on the OAS screen. • Students must respond to all Constructed-Response and Performance Task math items on the Student Answer Document. • These items require students to show work and/or explain their answer.

  30. Overview of Pilot Tests • Pilot Forms • Students will view all items online in the OAS. • Details regarding the number and type of items on each form can be found in the Examiner’s Manual. • Social Studies • Most forms contain 3-4 CR/PT items. Other forms contain either 9-12 SA items or 6-9 MC items. • Students will respond to all Social Studies items in Grades 3-12 online via the OAS. • For multiple-choice items, students will select the appropriate response option. • For open-ended items (SA, CR, PT), students will type their response within the text box provided on the OAS screen. • A few Student Answer Documents will be provided for students with disabilities who require a paper-pencil answer document as an accommodation. These answer documents are provided only for forms with CR/PT items. All forms with MC/SA items must be answered online.

  31. Overview of Pilot Tests • Pilot Forms • Students will view all items online in the OAS. • Details regarding the number and type of items on each form can be found in the Examiner’s Manual. • Science (Grades 3-8) • Most forms contain 3-4 CR/PT items. Other forms contain either 7-11 SA items or 5-8 MC items. • Students will respond to all Science items in Grades 3-12 online via the OAS. • For multiple-choice items, students will select the appropriate response option. • For open-ended items (SA, CR, PT), students will type their response within the text box provided on the OAS screen. • A few Student Answer Documents will be provided for students with disabilities who require a paper-pencil answer document as an accommodation. These answer documents are provided only for forms with CR/PT items. All forms with MC/SA items must be answered online.

  32. Overview of Pilot Tests • Pilot Forms • Students will view all items online in the OAS. • Details regarding the number and type of items on each form can be found in the Examiner’s Manual. • Science (Biology) • Forms contain either 30-31 MC/SA items OR 3-4 CR/PT items. • Students will respond to all Science items in Grades 3-12 online via the OAS. • For multiple-choice items, students will select the appropriate response option. • For open-ended items (SA, CR, PT), students will type their response within the text box provided on the OAS screen. • A few Student Answer Documents will be provided for students with disabilities who require a paper-pencil answer document as an accommodation. These answer documents are provided only for forms with CR/PT items. All forms with MC/SA items must be answered online.

  33. Test Forms for Read-Aloud • Test examiners who need to read test items aloud as an accommodation must log into the OAS using a generic student logon ID and read the test questions from the screen. • Each school has been assigned an overage of generic student Logon IDs. Any Logon IDs not used by students may be used by test examiners for the purpose of reading the test aloud.

  34. Pilot Test Window • Testing Window: • January 27 – March 7, 2014 • Schools have flexibility in scheduling the pilot within this window • Schools may schedule the testing at times convenient to their schedule; they are not required to test all students at the same time. • Pilot timing is only a suggestion. If possible, allow students to complete all questions if they are productively engaged.

  35. Test Materials • All test forms will be delivered and viewed through the Georgia Online Assessment System (OAS). • Examiner’s Manual • Online Test Tickets (see p. 8 in Examiner’s Manual) • Answer Documents • Several additional slides provide details about these. • School/Building Transmittal Forms • System Test Coordinators – Instructions for Returning Benchmark Assessment Pilot Answer Documents • Formula Sheets – Middle and High School Math only • Materials to arrive in schools on January 16-17, 2014

  36. Examiner’s Manual You should have received a prompt to download this PowerPoint and the Examiner’s Manual for the pilot. You may also go to Window, File Transfer to download these files.

  37. Examiner’s Manual Includes detailed written directions for: • Completing answer documents • Administering the pilot tests • Specific directions based on grade level/subject • Using the OAS • Logging in • Taking a test • Pausing and resuming a test • Logging out • Returning the answer documents • Examiner returns test materials to the School Test Coordinator • School Test Coordinator returns all answer documents to System Test Coordinator

  38. Examiner’s Manual Specific directions are provided based on the Subject, Grade Level, and Form assigned to a school. Test Examiners should review these specific directions prior to administering the pilot.

  39. Online Test Ticket Each unique student Logon ID consists of the following: 100 = Student Number (101-220) 123 = System Code 1234 = School Code sp = Spring pilot 05 = Grade Level to Test 13 = Form Number Test Examiners may choose to have students fill in their Last Name, First Name, and GTID

  40. Answer Documents • Student Answer Documents will be provided for students in the following cases: • Grades 3-12 Math CR/PT Forms • Students will respond to constructed-response items and performance tasks on the Student Answer Document. • Grades 3-12 ELA, Social Studies, and Science • A small number of Student Answer Documents (10% of students to test) will be provided for students with disabilities who require a paper-pencil answer document as an accommodation (only for test forms that include CR or PT items). NOTE: Not every student uses an answer document.

  41. Answer Documents • In ELA, there are multiple versions of the Student Answer Document. • These versions will be identified as A, B, C, etc. • Refer to the District Form Assignments Spreadsheet to identify the answer document that corresponds to an assigned pilot form. • Verify that the correct answer document has been received for the assigned pilot form. • Schools will receive a 10% overage of Student Answer Documents, based on the ‘Number of Students to Test’ shown in the District Form Assignments spreadsheet.

  42. District Form Assignments For ELA, there are multiple versions of the Student Answer Document.

  43. Answer DocumentsFirst page requires same information, regardless of grade/subject. • Students must enter all demographic information on answer documents: • Last Name, First Name, Middle Initial, DOB, School Name, System Name • Write and bubble in Last Name, First Name, and Middle Initial • Write and bubble in DOB • Select Ethnicity and Race • Select Gender • Select Grade (of test form) Enter Form Number here (2 digits following Fm in form name selected in OAS) 1 2 3 4 Schools may choose to pre-fill some or all of the student demographic information. Form Number and GTID Number are critical! 5 6 Enter GTID Number Student FTE ID Number is NOT needed

  44. Grades 3-12 Answer Documents • In Grades 3-12, paper answer documents will be used for: • Math forms containing constructed-response items and/or performance tasks. • ELA, SS, or Science forms only as an accommodation and only for forms containing constructed-response items and/or performance tasks. • Grades 3-12 ELA Answer Documents are designed specifically to match the assigned form. • Please verify that the version (A, B, or C) matches the form assigned to the school.

  45. Grades 3-12 ELA Answer DocumentFor use only by SWD whose IEP requires paper version as accommodation. Only a few of these are provided. Multiple-Choice Short-Answer Constructed-Response

  46. Grades 3-12 ELAAnswer Document Performance Tasks: For forms that contain only PT items, it is important for students to enter the question number in the box. Students may use more than one page to answer a question. Many questions have multiple parts and students must label parts within the lined area as “Part A”, “Part B”, and so forth.

  47. Grades 3-5Math Answer Document (CR/PT items) It is important for students to enter the question number in the box. Students may use more than one page to answer a question. Many questions have multiple parts and students must label parts within gridded area as “Part A”, “Part B”, and so forth.

  48. Grades 6-12 Math Answer Document (CR/PT items) It is important for students to enter the question number in the box. Students may use more than one page to answer a question. Many questions have multiple parts and students must label parts within gridded area as “Part A”, “Part B”, and so forth.

  49. Answering MC Items on Answer Documents On answer documents, multiple-choice options are labeled A, B, C, and D. A B In OAS, however, the answer choices are not labeled. The first answer choice corresponds to choice A, the second answer choice corresponds to choice B, and so forth. C D

  50. Math Formula Sheets • Formula sheets will be provided for Middle and High School Math only • These formula sheets are to be used ONLY for the Benchmark Assessment Pilot and are NOT appropriate for use with any other assessments (CRCT, EOCT, etc.) • Using these formula sheets on any state-mandated test will result in an invalidation

More Related