230 likes | 543 Views
Smarter Balanced: Test Specifications, Performance Tasks, Rubrics, oh My!. October 15, 2012 Portland, OR. Rachel A. Aazzerah Science and Social Sciences Assessment Specialist Oregon Department of Education Email: rachel.aazzerah@state.or.us. Audience Survey. Raise your hand if:
E N D
Smarter Balanced: Test Specifications, Performance Tasks, Rubrics, oh My! October 15, 2012 Portland, OR Rachel A. Aazzerah Science and Social Sciences Assessment Specialist Oregon Department of Education Email: rachel.aazzerah@state.or.us
Audience Survey • Raise your hand if: • You work in elementary grades K-5 • You work in middle school 6-8 • You work in high school • You are a TOSA • You work in the district office • You are a curriculum specialist • You are just interested • Using one hand (0-5), show your knowledge of: • Common Core Standards • Smarter Balanced Assessment in General • Smarter Balanced Assessment Performance Tasks
Overview • Introduction to Smarter Balanced • Claims • Targets • Test Specifications • Summative Assessment Item Types • Performance Tasks • Rubrics • Public Release of Sample Smarter Balanced Items • Resources • Questions
OAKS-Smarter Balanced Assessment Transition Timeline • OAKS • Reading based on 2002 ELA Content Standards • Writing based on current scoring guide • Mathematics based on 2007/2009 Math Content Standards • Smarter Balanced Assessment • Based on Common Core State Standards adopted by Oregon in 2010 • OAKS • Reading based on 2002 ELA Content Standards • Writing based on current scoring guide • Mathematics based on 2007/2009 Math Content Standards • Smarter Balanced Assessment • Based on Common Core State Standards adopted by Oregon in 2010 • OAKS • Reading based on 2002 ELA Content Standards • Writing based on current scoring guide • Mathematics based on 2007/2009 Math Content Standards • Smarter Balanced Assessment • Based on Common Core State Standards adopted by Oregon in 2010
Smarter Item Types Overview TEXT TEXT TEXT EXT TXT
Smarter ELA Claims Place text here
Smarter Balanced Assessment Targets • For each of the different claims, Smarter Balanced has developed assessment targets (i.e. assessable content that will be on the summative assessments). • Math: Claim 1- By Grade Level (In Packet)* • Claim 2, 3, 4- Mathematical Practices • (Same for all grade levels) • ELA: Targets by Grade Level for each Claim
SummAtive Assessment Test Specifications Math ELA *Computer Adaptive Test (CAT) with SR, CR, TE items *Performance Task(s) Given last 12-15 weeks of school year • *Computer Adaptive Test (CAT) with SR, CR, TE items • *Performance Task(s) • Given last 12-15 weeks of school year
Sample Math Items • *Number Line • *Painting a Barn • *Soybean Field • *Julie’s Jackets • *Frogs and Flies • *All sample items are found in the presentation packet. • Additional Sample Items can be found on the Smarter Balanced website: www.smarterbalanced.org (Assessments).
Sample ELA Items • *Excerpt from Summer on Wheels (ELA Selective Response Item) • *Sojourner Truth (ELA Technology Enabled Item) • *Annie John (ELA Constructed Response Item) • *All sample items are found in the presentation packet • Additional Sample Items can be found on the Smarter Balanced website: www.smarterbalanced.org(Assessments).
Guidelines for Development of Smarter Balanced Performance Tasks • Represent content that is relevant and meaningful to students • Allow for demonstration of important knowledge and skills, including such 21st century skills as critically analyzing and synthesizing information presented in a variety of formats, media, etc. • Incorporate knowledge and skills of prior grades, even though the major focus is on the standards for the current grade level. • Allow for multiple points of view and interpretations. • Are scored using multiple rubrics uniquely matched to the primary content claims and targets identified by the task developer in the task forms. • Be feasible for the school/classroom environment. • (From: Smarter Balanced Assessment Consortium: Performance Task Specifications, April 16, 2012)
Performance Tasks Performance Tasks • Extended projects demonstrate real-world writing and analytical skills • May include online research, group projects, presentations • Require 1-2 class periods to complete • Included in both interim and summative assessments • Applicable in all grades being assessed • Evaluated by teachers using consistent scoring rubrics The use of performance measures has been found to increase the intellectual challenge in classrooms and to support higher-quality teaching. - Linda Darling-Hammond and Frank Adamson, Stanford University
Performance tasks: should incorporate real-world, college- and career-related skills that require students to accomplish complex goals during multiple testing sessions. involve a significant interaction of students with stimulus materials leading to an exhibition of the students’ application of knowledge and skills, often in writing or spoken language. should be multi-stepped and allow for reflection and revision. are used because the ability to integrate knowledge and skills across multiple content standards is a critical skill that cannot be assessed with selected response or constructed response items. Performance Tasks Summary
Math Performance Task Preview Sample Smarter Math Performance Task Grade 5: School Festival You serve on a committee that is in charge of planning a school festival. The following tasks need to be completed by committee members as part of the planning for the school festival. • Determine the budget for the festival. • Choose the food and drinks for the festival. • Determine amounts of supplies for making a dessert. • Make a schedule of the different activities. • Make some decisions on the games and prizes used during the festival. * Details and rubrics are in the session packet. Up to two class sessions (90 minutes) are suggested for this task, with no pre-teaching necessary.
ELA Performance Task Preview Sample Smarter English Language Arts Performance Task • Robot Pets • Session 1 (60 minutes) • Read 1 article and watch 2 brief videos on robots as pets, taking notes • Respond to 3 constructed-response questions: 1 addressing reading comprehension, 2 addressing research skills • Session 2 (45 minutes) • Read 1 article and watch 1 short video, taking notes • Small discussion group work • Session 3 (90 minutes) • Compose full-length argumentative essay on robots as pets • May use notes and refer back to articles • Pre-writing, drafting, and revising will be involved
ELA Performance Task Preview Sample Smarter English Language Arts Performance Task • Robot Pets • Video 1: Fujitsu’s cute teddy-bear robot shows what it can do, May 2010. • http://www.youtube.com/watch?v=AwWeN1ARy74 • Video 2: Pleo: Robot, pet or both? December 2007 • http://www.youtube.com/watch?v=F6LCEFr8SxQ • Video 3: Maya’s Human Interaction • http://www.youtube.com/watch?v=9b4jx5RzqAk
Smarter Generic Writing Rubric Five Attributes (4-point scale) Statement of Purpose/Focus Organization Elaboration of Evidence Language and Vocabulary Conventions Individual scores contribute to the overall score on the summative assessment
Resources • Smarter Balanced Website • http://www.smarterbalanced.org/ • Smarter Sample Items and Performance Tasks • http://www.smarterbalanced.org/smarterbalanced-assessments/#item • Smarter Item Writing and Review Materials • http://www.smarterbalanced.org/smarter-balanced-assessments/item-writing-and-review/ • Common Core State Standards Toolkit • http://www.ode.state.or.us/search/page/?id=3430 • Common Core State Standards Assessment Resources • http://www.ode.state.or.us/search/page/?id=3298
Public Release of Sample Smarter Balanced math and ELA Items • *Smarter Balanced will release 60 Math and 60 ELA Sample items (both Computer Adaptive Test items and Performance Tasks) for all grade levels (3-8 and High School (11) on October 9, 2012 • http://www.smarterbalanced.org/sample-items-and-performance-tasks/. • *The public will be able to take a sample test, in which they can score some of the questions to see if they answered it correctly or not (rubrics included). http://www.smarterbalanced.org/sample-items-and-performance-tasks-questions-and-feedback/.
Questions • Thank you for attending this presentation! • Rachel Aazzerah: rachel.aazzerah@state.or.us • Additional ODE Contacts- • Mark Freed (Math): mark.freed@state.or.us • Ken Hermens (English): ken.hermens@state.or.us • Derek Brown (Essential Skills): derek.brown@state.or.us • ODE Webpage: www.ode.state.or.us