360 likes | 468 Views
Update on the State-Led and State-Governed Comprehensive Assessment Consortia: PARCC and Smarter Balanced. Pascal (Pat) D. Forgione, Jr., Ph.D. Executive Director, K-12 Center at ETS Austin, TX. Presentation Outline. Stimuli for the Development of Next Generation Assessments
E N D
Update on the State-Led and State-GovernedComprehensive Assessment Consortia:PARCC and Smarter Balanced Pascal (Pat) D. Forgione, Jr., Ph.D. Executive Director, K-12 Center at ETS Austin, TX
Presentation Outline • Stimuli for the Development of Next Generation Assessments • The Comprehensive Assessment Consortia • PARCC • Smarter Balanced • Key Similarities and Differences in Designs and Approaches
Part One • Stimuli for the Development of Next Generation Assessments • The Comprehensive Assessment Consortia • PARCC • Smarter Balanced • Key Similarities and Differences in Designs and Approaches
Game Changer #1: Common Core State Standards Initiative In 2009, NGA and CCSSO launched the Common Core State Standards Initiativeto, “provide a consistent, clear understanding of what students are expected to learn, so teachers and parents know what they need to do to help them.” • 48 states joined the initiative in 2009-10 • 42 states, the District of Columbia, four territories, and the Department of Defense Education Activity (DoDEA) have adopted the Common Core State Standards* National Governor’s Association and Council of Chief State School Officers. “Common Core State Standards Initiative.” www.corestandards.org/assets/Common-Core-State-Standards-March-2010.ppt March 2010. * www.coresandards.org July 11, 2014
The Uniqueness of This Moment: Inflection Point CA Interactive Digital Library NC CT NJ IL RI State silos of cost, effort, expertise Shared platform for collaboration, cost and effort efficiencies, sharing of best practices Thomas Friedman in “The World is Flat” points out the importance of “inflection points” in history, such as the invention of the printing press. TheCommon Core State Standards (CCSS) may become an “inflection point” for American public education - establishing a common foundation for building excellence and equity for all students.
Game Changer #2: RTTT Assessment Program Groups of 15 or more states could apply for a grant to develop online, next-generation assessment systems that: • Assessshared standards in mathematics and ELA/literacy for college- and career-readiness • Measure individual growth as well as proficiency; • Utilize technology to the maximum extent appropriate; and • Provideinformation that is useful in informing: • Teaching, learning, and program improvement; • Determinations of school effectiveness and of principal and teacher effectiveness for use in evaluations and support; and • Determinations of individual student college and career readiness, such as determinations made for high school exit decisions, college course placement to credit-bearing classes, or college entrance. • Operational by 2014 – 2015 school year
Membership in Comprehensive Assessment Consortia Membership as of July 11, 2014 PARCC 14 states & DC* Smarter Balanced 22 states and USVI** Both: Pennsylvania Neither: 15 states District of Columbia Hawaii *Indiana and Pennsylvania have not been active of late. ** Pennsylvania has not been active of late.
Part Two • Stimuli for the Development of Next Generation Assessments • The Comprehensive Assessment Consortia • PARCC • Smarter Balanced • Key Similarities and Differences in Designs and Approaches
The Partnership for Assessment of Readiness for College and Careers (PARCC)
PARCC Assessment System English Language Arts/Literacy and Mathematics, Grades 3-8 and High School PARTNERSHIP RESOURCE CENTER: Digital library of released items; formative assessments; model content frameworks; instructional and formative tools and resources; student and educator tutorials and practice tests; scoring training modules; and professional development materials 4 week test window 4 week test window DIAGNOSTIC ASSESSMENT MID-YEAR ASSESSMENT • PERFORMANCE- • BASED ASSESSMENT • ELA/literacy • Mathematics Student results inform instruction, supports, & professional development Mid-Year Performance-Based Assessment Speaking/ Listening Assessment • END-OF-YEAR/COURSE • ASSESSMENT • ELA/literacy • Mathematics Flexible timing Flexible timing Flexible timing Retest option Optional assessments to inform instruction Required for grades 3-8 and 11 but not used for accountability Summative assessment for accountability
PARCC Summative Assessments: Performance-Based Assessments 4 week test window • Taken after at least 75%of instructional year • 3 ELA/literacy tasks over 3 sessions • 1 narrative writing task • 1 literary analysis task • 1 research simulation task • 2 math test sessions with multiple tasks • complex, real-world application problems • emphasis on mathematical practices and modeling • Electronic and distributed human scoring • Results by end of school year • PERFORMANCE • BASED ASSESSMENT • ELA/literacy • Mathematics
PARCC Summative Assessments: End-of-Year Assessment 4 week test window • Taken between 75%and 90% of instructional year • Multiple item types including constructed • response and technology enhanced • Fixed-form, with multiple forms per grade level/course • Will include items that measure the full performance continuum • Electronically scored • High school: Also, available at end of 1st semester to support block scheduling END-OF-YEAR/COURSE ASSESSMENT
PARCC:Summative Components 4 week test window 4 week test window • Timed, spread over nine testing sessions • Estimated testing time, ELA + math: • 8 hours in grade 3 • 9 hours in grades 4 - 5 • 9.5 hours in grades 6 – 8 • 9.5 - 10 hours in high school • END-OF-YEAR/COURSE • ASSESSMENT • ELA/literacy • Mathematics • PERFORMANCE- • BASED ASSESSMENT • ELA/literacy • Mathematics • PT and EOY scores combined for accountability • 1 Retest in 3 – 8 and up to 3 in HS, as State/locally approved • Paper and pencil version as accommodation and for schools with • State DOE approval
PARCC: Speaking/Listening Assessment • ELA/Literacy • Speaking • Listening Flexible timing • Available for grades K-12, and required in grades 3 - 11, but not used for accountability • Scored by classroom teacher using standardized rubric • Scores may be used within students’ grades
PARCC Supports: Interim Assessments DIAGNOSTIC ASSESSMENT MID-YEAR ASSESSMENT Flexible Timing • Optional Diagnostic Assessment, grades 2 – 8 • Two-stage adaptive assessment designed to inform instruction • Optional Mid-Year Performance Tasks, grades 3 – 11 • Designed to mirror summative Performance Tasks • Scored by teachers
PARCC Supports: The Partnership Resource Center PARTNERSHIP RESOURCE CENTER: Digital library of released items, formative assessments, model content frameworks, instructional and formative tools and resources; student and educator tutorials and practice tests, scoring training modules; and professional development materials. • Online practice tests for each grade/course • Formative assessment items and tasks • Professional development materials – scoring, use of data • Instructional tools and resources developed by Partner states • Optional “ready-to-use,” instructionally embedded formative • tasks and tools for K-1
PARCC Assessment System English Language Arts/Literacy and Mathematics, Grades 3-8 and High School PARTNERSHIP RESOURCE CENTER: Digital library of released items; formative assessments; model content frameworks; instructional and formative tools and resources; student and educator tutorials and practice tests; scoring training modules; and professional development materials. 4 week test window 4 week test window DIAGNOSTIC ASSESSMENT MID-YEAR ASSESSMENT • PERFORMANCE- • BASED ASSESSMENT • ELA/literacy • Mathematics Student results inform instruction, supports, & professional development Mid-Year Performance-Based Assessment Speaking/ Listening Assessment • END-OF-YEAR/COURSE • ASSESSMENT • ELA/literacy • Mathematics Flexible timing Flexible timing Flexible timing Retest option Optional assessments to inform instruction Required for grades 3-8 and 11 but not used for accountability Summative assessment for accountability
PARCC: Supports and Timeline Plans as of July 1, 2014, subject to change 2014 – 2015 school year • College readiness tools released • Partnership Resource Center launches • Mid-Year and Summative assessments ready 2015 – 2016 school year • K-1 formative tools ready • Diagnostic and Speaking/Listening assessments ready
Smarter Balanced Assessment System English Language Arts/Literacy and Mathematics, Grades 3-8 and High School* 12 week testing window DIGITAL LIBRARY of formative tools, processes and exemplars; model curriculum units; educator training; professional development tools and resources; and teacher collaboration tools. INTERIM ASSESSMENT INTERIM ASSESSMENT • PERFORMANCE TASKS • ELA /Literacy • Mathematics • COMPUTER ADAPTIVE ASSESSMENT • ELA/Literacy • Mathematics Computer Adaptive Interim Assessment System Computer Adaptive Interim Assessment System Scope, sequence, number, and timing of interim assessments locally determined Re-take option available Summative assessment for accountability Optional Interim assessment system. • Summative and interim assessments for grades 3 – 8 and 11, with ability for states to create additional assessments for grades 9, 10, and 12. 20
Smarter Balanced Summative AssessmentPerformance Tasks 12 week testing window • One 12-week statewide testing windowfor administration of both summative • components, extends up to last day of • school • One ELA task and 1 math task per year, • 90 – 120 minutes per content area • Focus on hard-to-measure standards • Combination of machine and human scoring • Results within two weeks, depending on state scoring contract. • PERFORMANCE TASKS • ELA /Literacy • Mathematics
Smarter Balanced Summative AssessmentComputer Adaptive End-of-Year Assessment Last 12 weeks of year* 12 week testing window • Multiple item types including constructed • response and technology enhanced • Adaptive delivery can, if needed, present items • above or below grade level to gain accuracy and • clearer profile of strengths and needs (most • students will see only grade-level items) • COMPUTER ADAPTIVE ASSESSMENT • ELA/Literacy • Mathematics
Smarter Balanced Summative Components 12 week testing window • Untimed, over multiple testing sessions • Estimated testing time, ELA + math: • 7 hours in grades 3 – 5 • 7.5 hours in grades 6 – 8 • 8.5 hours in grade 11 • PERFORMANCE TASKS • ELA /Literacy • Mathematics • COMPUTER ADAPTIVE ASSESSMENT • ELA/Literacy • Mathematics Re-take option available • PT and Computer Adaptive scores combined for accountability • 1 Retake, if locally approved, for testing irregularities • Paper and pencil version for 3 years; thereafter as • accommodation
Smarter Balanced Supports: Optional Interim Assessment System • Two Options: • Interim Comprehensive Assessments use the same design as the summative assessments, assess the same range of standards, and provide scores on the same scale. • Interim Assessment Blocks focus on smaller sets of related concepts and provide more detailed information for instructional purposes. There are between five and seventeen blocks per subject per grade • Test questions are not secure, and there are no restrictions on the number of times that teachers or students may access assessments INTERIM INTERIM INTERIM
Smarter Balanced Supports:The Digital Library Last 12 weeks of year* DIGITAL LIBRARY of formative tools, processes and exemplars, model curriculum units, educator training; professional development tools and resources, and teacher collaboration tools. • Created “by teachers, for teachers”, with some commissioned materials • Assessment literacy modules • Formative assessment process descriptions, exemplar instructional modules, vetted and rated instructional resources and professional learning resources • Social media functionality allows teachers to rate materials and share their expertise with educators across the state or across the country
Smarter Balanced Assessment System English Language Arts/Literacy and Mathematics, Grades 3-8 and High School* 12 week testing window DIGITAL LIBRARY of formative tools, processes and exemplars; model curriculum units; educator training; professional development tools and resources; and teacher collaboration tools. INTERIM ASSESSMENT INTERIM ASSESSMENT • PERFORMANCE TASKS • ELA /Literacy • Mathematics • COMPUTER ADAPTIVE ASSESSMENT • ELA/Literacy • Mathematics Computer Adaptive Interim Assessment System Computer Adaptive Interim Assessment System Scope, sequence, number, and timing of interim assessments locally determined Re-take option available Summative assessment for accountability Optional Interim assessment system. Summative and interim assessments for grades 3 – 8 and 11, with ability for states to create additional assessments for grades 9, 10, and 12. 26
Smarter Balanced: Timeline Plans as of July 8, 2014, subject to change Summer 2014 • Digital Library preview for teachers in all governing states (June through September) Fall 2014 • Initial Achievement Level Setting performed • Comprehensive Suite of Software Applications launched (Digital Library, Assessment Delivery, Item Banking, etc) • Interim assessments available (late Fall) Spring 2015 • Summative assessments available
Part Three • Stimuli for the Development of Next Generation Assessments • The Comprehensive Assessment Consortia • PARCC • Smarter Balanced • Key Similarities and Differences in Designs and Approaches
Key Similarities SUMMATIVE ASSESSMENTS • Online assessments for Grades 3-8 and high school, ELA/literacy and mathematics • Use of a mix of item types including selected response, constructed response, technology-enhanced and complex performance tasks • Two components, both given during final weeks of the school year • Delivery supported on computers, laptops and tablets and a limited variety of operating systems
Key Similarities (cont.) OTHER ASSESSMENTS, RESOURCES, AND TOOLS • Online practice tests by grade/course • Optional diagnostic/interim tests • Professional development modules • Formative items/tasks for classroom use • Online reporting suite • Digital library for sharing vetted resources and tools • State ownership and control of all individual student data, as is currently the case for state assessments
Key Differences, continued * Based on review conducted by the Michigan Department of Education and published in “Report on Options for Assessments Aligned to the Common Core State Standards”, Michigan Department of Education, December 1, 2013
www.k12center.org • Thank you. • Pascal (Pat) D. Forgione, Jr., Ph.D. • Distinguished Presidential Scholar and Executive Director • Center for K-12 Assessment & Performance Management at ETS • 701 Brazos Street, Suite 500 • Austin, TX 78701 • E-Mail: pdforgione@k12center.org • Nancy Doorey • Director of Programs • Wilmington, DE • E-Mail:ndoorey@k12center.org