460 likes | 557 Views
PARCC National Title I Conference February 2, 2014 Doug Sovde, Director Content and Instructional Supports PARCC, Inc. Session Objectives. Disseminate actionable advice and information to support implementation of PARCC assessments and field test administration
E N D
PARCC National Title I Conference February 2, 2014 Doug Sovde, Director Content and Instructional Supports PARCC, Inc.
Session Objectives • Disseminate actionable advice and information to support implementation of PARCC assessments and field test administration • Provide a deeper understanding of the PARCC design and supports • Engage with PARCC items, first hand
Where We Started, Where We Are and Next Steps SEPTEMBER States launch PARCC SUMMER Model Content Frameworks Released AUGUST Item Prototypes Released APRIL Test Blueprints released AUGUST Sample Items Released 2013 2012 2011 2010 DECEMBER Governing Board meets SUMMER Educator Leader Cadres Launched OCTOBER College and Career Ready Determination Policy Adopted SUMMER PARCC becomes independent nonprofit We are here! Next year 2014 2016 2015 FALL Release of Diagnostic and Formative Assessments FALL Use of Cut Scores for IHE Placement WINTER/SPRING Field Testing/Release of Practice Test SPRING First Administration of New Tests SUMMER Establishment of Cut Scores
The PARCC Consortium • 18 states and the District of Columbia • 15 million students in tested grades • Aligned to the Common Core State Standards • Developed by educators in nearly two dozen states • 2013-14 field testing • 2014-15 roll out
PARCC’s Priorities • Determine whether students are college and career ready or on track • Measure the full range of the CCSS and full performance continuum • Support educators in the classroom with timely data • Make better use of technology in assessments • Advance accountability at all levels • Provide comparable data from school-to-school and state-to-state • Be affordable and sustainable
Assessment DesignELA/Literacy and Mathematics, Grades 3–11 Beginning of School Year End of School Year Flexible administration Performance-Based Assessment DiagnosticAssessment Mid-Year Assessment End-of-Year Assessment Speaking and Listening Assessment Key: Optional Required
The Purpose of the Field Test: Ensuring Test Quality • The field test will generate the data needed to allow PARCC to ensure item quality and to select items/build forms for operational assessments in 2014-2015 • PARCC will use the field test data to evaluate: • Accessibility/Fairness: Are items accessible to SWDs and ELs? • Comparability : Can computer-and paper-based tests, desktop and tablet-based tests be put on the same reporting scale? • Construct validity: Do the assessments measure the concepts they were designed to measure? • International benchmarking: What are the best ways to link PARCC assessments with national and international assessments? • Quality of test administration: Are the manuals and directions clear? • Various psychometric studies: What are the best ways to combine PBA and EOY results? Is vertical scaling feasible?
Field Test: Scope • “Testing the Test” • 14 States and DC • AR, AZ, CO, DC, IL, LA, MA, MD, MS, NJ, NM, NY, OH, RI, TN • Approximately 1.2 million students PARCC-Wide • 10,000 items covering 21 different tests • ELA, grades 3-11 • Math grades 3-8 and high school end-of-course (Algebra, Geometry, and Algebra II, Integrated Math I, II, III) • Field Test Window • Performance-based component: March 24-April 11 • End-of-Year component: May 6-June 6
Field Test Administration: Participating Schools • Most students participating in the PARCC Field Test will take one component (Performance Based Assessment orEnd of Year) in one content area (ELA or mathematics). • A small percentage of students will take both components (Performance Based Assessment and End of Year) in one content area only (ELA or mathematics). • Some students will take the field test on a computer, while others will take it on paper.
Preparing Students • Tutorial and Sample Items (January 17) • Familiarize students with how to navigate in the TestNav 8 computer-based environment (e.g., advancing, going back, flagging and reviewing items, calculators, tool bar, accessibility features) • Familiarize students with new item types (PCRs, EBSRs, Type II, Type III) and item functionalities /tools (drag and drop, hot spot, multiple select, text extraction, equation editor, rulers, protractors, calculators, and accessibility features). • Practice Tests • The practice test will enable students and teachers who are not participating in the field test to become familiar with the PARCC assessments and to practice with the different item types and computer-based interactions that students will encounter with PARCC items.
TestNav 8 Readiness Tools and Materials • System Check Tool (Available Now) • Audience: PARCC States, LEA’s, Schools, and Technology Staff • Verifies whether the school’s devices meet the requirements for running TestNav 8 • Evaluates capacity of school’s bandwidth for testing directly over the Internet or through Proctor Caching • Full-Scale Infrastructure Trial (January 17) • Audience: Computer-based PARCC Field Test Participants • Designed to be a ”dress rehearsal” exercise where LEAs will simulate their full testing environment before the operational test administration • Performed by the school using a full size model test form and mocked up student information to simulate a full testing load with the devices and network configuration at the school.
TestNav 8 Readiness Tools and Materials • Proctor Caching Software and Proctor Caching Users’ Guide (Available Now) • Audience: Any PARCC States, LEA’s, Schools, and Technology Staff • Proctor Caching is a a low bandwidth test administration solution available to all PARCC schools as part of the Pearson TestNav 8 delivery platform. • Caching places secure test content on a designated administrative computers that then serves test forms to student devices through the local school network. • PARCC encourages broad use of Proctor Caching as a strategy to manage against possible Internet connection disruptions during testing. Caching is also recommended for student forms requiring accommodations.
TestNav 8 Readiness Tools and Materials • Compatible Assistive Technology List (Available Now) • Audience: Any PARCC States, LEA’s, Schools, and Technology Staff • Additional assistive technologies may be needed for students requiring accommodations. PARCC has published a list of Assistive Technologies that have no known compatibility conflicts with the TestNav 8 test delivery system. • The list will be continually updated as ongoing assistive technology usability research is conducted and can be found here: www.pearsononlinetesting.com/AssistiveTechnology or www.pearsononlinetesting.com/AT
Professional Development and Supports for Teachers: Educator Leader Cadres • State Teams: Building local capacity to sustain implementation • 24 members per state totaling almost 600 across PARCC States • Members include: K-16 educators and district-level administrators • Provided with training and tools to understand, support and own the implementation of the CCSS and PARCC assessments • Models of State Engagement: • New Mexico: Classroom and district level ELCs have presented at over 75 functions, events or trainings to date. • Louisiana: Expanded ELC teams locally by training and placing PARCC and CCSS advocates in every state school—bringing the number of ELC members to almost 2,000 across the state. • Building Collaboration and Partnerships • Item reviewer partnership with NEA and AFT • iTunes U Common Core Resources Project with ELC members
Implementation Resources for Teachers • Model content frameworks • www.parcconline.org/parcc-model-content-frameworks • Blueprints • http://www.parcconline.org/assessment-blueprints-test-specs • Sample items for every tested subject and grade • http://practice.parcc.testnav.com/# • Educator Leaders Cadres • Public ELC portal for educator resources! • http://parcc.nms.org/ • Practice Test • Spring 2014, PARCC practice test will be available to students, teachers and parents via PARCConline.org
Data Privacy and Security Policy The PARCC consortium’s Data Privacy and Security Policy is designed to ensure that PARCC and any PARCC contractors: • Only have access to personally identifiable student information for specific purposes authorized by states needed to carry out assessment programs • Implement specific stringent policies and procedures that protect the security of data • Limit access to personally identifiable student information to only those contractors who need it for specific purposes authorized by states • Ensure compliance with federal privacy laws, including FERPA
Accessibility and Accommodations PARCC Accessibility Features And Accommodations Manual • Guidance for Districts and Decision-Making Teams to Ensure that PARCC Mid-Year, Performance-Based, and End-of-Year Assessments Produce Valid Results for All Students PARCC Translation Policy: • PARCC will develop translations of its mathematics assessments in Spanish and other languages for states requesting the translations • Use of the translated assessments will be a state decision. The additional costs associated with translating and administering assessments in languages other than English will be shared by the states that use them
Accessibility All students will have equitable opportunities to access and respond to PARCC assessment items and tasks.
Strategies for Increasing Student Access • Provide clearguidelinesfor writing unbiased items • Utilize Equity Technical Working Group expertise • Use principals of Universal Design • Conduct bias and sensitivity reviews and statistical procedures • Develop common test accommodation and participation policies for SWDs and ELLs • Use technology • Conduct research
Committees on Accessibility • Operational Working Group • Technical Working Group • There are three sub-groups: • Students with disabilities • English learners • Equity
Accessibility, Accommodations, & Fairness Operational Working Group Operational Working Group members represent the following states: * Co-chairs of the AAF OWG
Accessibility, Accommodations, & Fairness Students with Disabilities Sub-TWG *Chair of the AAF TWG and liaison to the AAF OWG
Accessibility, Accommodations, & Fairness English Language Learner Sub-TWG *Chair of the AAF TWG and liaison to the AAF OWG
Accessibility, Accommodations, & Fairness Equity Sub-TWG *Chair of the AAF TWG and liaison to the AAF OWG
Accessibility as Part of the Development Process Accessibility guidelines • Design review and feedback • Test blueprint development • Technology development and selection • Passage and media review committee involvement
Accessibility as Part of the Development Process Item review & bias and sensitivity committee involvement • Review for bias and sensitivity • State leads with diverse backgrounds
Accessibility as Part of the Development Process Cognitive labs & item development research • Testing efficacy of assessment items with accommodations in pilot and field testing • Including sufficient number of students with identified needs • Data review committee involvement
Embedded Supports Being Discussed Examples include: • Highlighting • Customized colors • Graphic organizers or representations • Home language supports/tools • Captions for audio • Braille (tactile/refreshable) • Signing supports (ASL) • Assistive technology
PARCC Sample Items • http://practice.parcc.testnav.com/#
Learn More About & Follow PARCC Partnership for Assessment of Readiness for College and Careers www.parcconline.org On Twitter: @PARCCPlace #askPARCC & #PARCCELC ELC Portal: http://parcc.nms.org
Overall Design of the PARCC Assessment System • Summative Assessments • Performance-based (PBA) component • End-of Year (EOY) component • Speaking and Listening component • Optional Assessments • Diagnostic • Mid-year assessment (MYA)
Summative Assessment Components Beginning of School Year End of School Year Performance-Based Assessment End-of-Year Assessment Results of both the PBA and EOY will be combined to generate a student’s overall score (performance level) • After 75 percent of the school year • Short and extended tasks • ELA/literacy: Writing effectively when analyzing sources • Math: Solving multistep problems with an emphasis on the mathematical standards for practice: reasoning and modeling • After 90 percent of the school year • Short-answer items • ELA/literacy: Reading comprehension • Math: Concepts, skills, and fluency (grades 3-6)
Optional Assessments Beginning of School Year End of School Year Flexible administration DiagnosticAssessment Mid-Year Assessment • Computer-based • Target grades 2-8 in reading, writing, and mathematics • Determine students’ learning needs in order to tailor instruction • Design will be similar to required Performance-Based Assessment • Could serve as a benchmark or interim assessment
PARCC Assessment SystemELA/Literacy and Mathematics, Grades 3–11 Beginning of School Year End of School Year Flexible administration Performance-Based Assessment DiagnosticAssessment Mid-Year Assessment End-of-Year Assessment Speaking and Listening Assessment Key: Optional Required
ELA/Literacy: Performance-Based Assessments • At each grade level include three tasks • Research Simulation Task • Literature Analysis Task • Narrative Writing Task • Each task will require students to • Read one or more passages, one of which may be a multi-media stimulus (e.g. video) • Answer short answer reading comprehension questions, and • Write an extended response to a prompt that requires the student to draw evidence from the passage(s) to support their response
Minimum Guidelines for Hardware Purchases • Hardware • 1 GHz or faster processor • 1 GB of RAM or greater memory • 9.5 inch (10 inch class) or larger screen • 1024 X 768 of better screen resolution • Operating System • Windows 7 • MAC 10.7 • Linux (Ubuntu 11.10, Fedora16) • Chrome OS • Apple iOS • Android 4.0 • Networking • Wired or wireless Internet connection • Devices • Desktops, laptops, netbooks, thin client, and tablets that meet the hardware, operating system, and networking specificaitons