580 likes | 710 Views
Getting Ready 2008-2009 PSSA Math. 1. 2008–2009 PSSA Testing Window. 2. 2009-2010 PSSA Testing Window. 3. Academic Standards – Revised Mathematics Reading, Writing, Speaking and Listening Assessment Anchors/Eligible Content Existing Anchors Have Not Changed
E N D
Getting Ready 2008-2009 PSSA Math 1
Academic Standards – Revised Mathematics Reading, Writing, Speaking and Listening Assessment Anchors/Eligible Content Existing Anchors Have Not Changed Assessment Anchors for Writing will be developed Academic Standards and Anchors 4
Data Recognition Corporation (DRC) is contractor Embedded Field Test Multiple Choice and Open Ended Items Equating Block Items that enable scores to be compared from last year to this year Matrix has been eliminated PSSA Test Design 5
Multiple Choice Items are Machine Scored Open Ended Items are Hand Scored Item Specific Scoring Guidelines for Math, Reading, and Science Mode Specific Scoring Guidelines for Writing Scoring 6
Accommodations Guidelines for Students with IEPs and 504 Plans Posted on PDE website Training presentation January 7, 2009 Broadcast from 3 PaTTAN sites Accommodations Guidelines for ELLs Accommodations 7
Braille and Large Print Books Order from DRC Spanish Side By Side Translated Versions for Math and Science Modified Test Format 8
Cut Scores remain the same for all subjects. Performance Level Descriptors remain the same for all subjects. Performance Levels 9
All student information for pre-code labels will come from PIMS. IMPORTANT – Information in PIMS must be correct. Questions about PIMS, contact the PIMS Help Desk. http://remedyweb.state.pa.us/PDESubmit.jsp Pennsylvania Information Management System (PIMS) 10
In 2007, PDE began monitoring schools and districts regarding test security, administration, etc. This process will continue in 2009 and beyond. All visits will be unannounced. PDE representatives were treated very well. MONITORING 11
Student score comes from: 60 Multiple Choice questions 3 Open-Ended questions Students take: 72 MC at grades 3 - 8 and 11 4 Open-Ended All Grades will alternate subject areas with Math coming first. 2008-2009 13
2008-2009 Scores come from the COMMON ONLY. 14
Criterion Referenced Based on the Assessment Anchor Content Standards 5 Reporting Categories Numbers and Operations Measurement Geometry Algebra Data Analysis 2008-2009 16
MC items are based solely on the Eligible Content OE items are based on the Anchor. The Content comes from EC but what students are asked to do, the Verbs (such as show, explain, create), can come from the Eligible Content, the Descriptor, or the Anchor. Have students read the OE items carefully and answer exactly what is being asked. 2008-2009 17
Examples of how OE items might be phrased: Show or explain all your work. Show all your work. Explain why you did each step. Explain why [something is true or false] Explain how [doing something affects something else; to find something, etc] 2008-2009 18
Examples of how OE items might be phrased: (cont.) List… Graph… Determine… Tell… Shade… Complete… 2008-2009 • Describe… • Solve… • Complete… • Show…. • Create… • Estimate… 19
Embedded Field Test Open-Ended items scored on a 0-4 scale Item-specific scoring guidelines but no general rubric. Formula sheets will be provided for grades 7, 8 and 11. Formulas needed in grades 5 and 6 are provided with the item. See Resource Materials on our website for the formula sheets and item samplers. 2008-2009 20
Roy is running for class president. He polls 50 students. 60% of them say they will vote for him. A. There are 350 students in Roy’s class. Based on his survey, how many students should he expect to vote for him? Show or explain all your work. B. Roy will sell fruit drinks to raise money for his campaign. A fruit drink cost $0.10 and he sells it for $0.50. How many fruit drinks does Roy need to sell to earn $80? Show all your work. Explain why you did each step. Example OE Item 21
Part A: ½ point for correct answer 1 point for complete and correct work OR ½ point for correct but incomplete work. Part B: 1/2 point for correct answer 1 point for correct and complete work OR ½ point for correct but incomplete work. 1 point for correct and complete explanation. ½ point for correct but incomplete explanation. Rubric 22
Total Points (within) Score (on) 4 4 3 – 3 ½ 3 2 – 2 ½ 2 ½ - 1 ½ 1 0 0 Rubric Metric 23
Testing time is approximately 2.5 – 3 hours for Math. Testing in Grades 3 - 8 and 11. Can have a “blemish” and still get a score of 4. “e.g. missing $” may or may not be a blemish depending on the item and grade. 2008-2009 24
Grade 4 and up: calculators ARE permitted on all but the beginning few items. Rulers will be provided at grades where needed. Students must use the rulers provided for the PSSA. Rulers scaled in Metric and US Customary. Protractors are provided as needed within the item itself. 2008-2009 25
Rulers 26
CALCULATOR POLICY The PSSA is designed so that calculators are not necessary for students to be successful. If students choose to use a calculator on the portions of the PSSA for which calculators are permitted then they must adhere to the guidelines listed below. It is incumbent upon the school test coordinator to ensure that all calculator policies are implemented and followed, including making sure calculators have no programs stored in their memory. Please note that if a student wants to restore the deleted programs he or she will have to back them up prior to the assessment. 2008-2009 27
The following are NOT allowed for the PSSA: Non-calculators such as cell phones, PDAs, laptops, minicomputers, pocket organizers, etc. Beaming capabilities. (These must be disabled.) Wireless communication technologies. Calculators having wireless communication technologies may be used if those technologies are disabled. Calculators with QWERTY keyboards or other typewriter-like keyboards or keypads (e.g. Dvorak). Calculators with built in Computer Algebra Systems – CAS. Calculators that make noise, have paper tape, need to be plugged in or talk unless these specific calculators are required as an accommodation. (Please refer to the Accommodations Manual.) Sharing calculators by students during a test session. All programs / information stored in a calculator. These must be deleted prior to using that calculator on any section of the PSSA. Typically these are graphing calculators but scientific calculators may also contain stored programs. 2008-2009 28
This is intended to be a general description of what is not allowed. It is not meant to be an exhaustive list of specific calculators, devices or technologies that cannot be used on the PSSA. As technology changes this policy will be reviewed and may also change. 2008-2009 29
Grade 3: Cannot use calculators Mark answers in the test booklet 2008-2009 30
Those who qualify to take the PASA Students must meet 6 criteria in order to take the alternate assessment for students who have significant cognitive disabilities. See www.pasaassessment.org . ELLs in their first 12 months of enrollment in a US School (not including PR) Must take PSSA Math. Participation counts for AYP; performance does not. Are not required to take PSSA Reading Reading scores will not count for AYP performance. See www.pde.state.pa.us/esl/ . Who is Excused? 32
Who oversees the ACCESS for ELLs? Pennsylvania participates in the WIDA consortium; the consortium provides tester training and manages the test development, distribution, scoring, and score reporting processes with its partner, Metritech. WIDA is accessible at this web address: http://www.wida.us/, by emailing help@wida.us, or calling toll free 1-866-276-7735. At the PDE website you can find more information about ACCESS and testing for ELLs at the ESL program page, http://www.pde.state.pa.us/esl/ . 33
Data Recognition Corporation (DRC) is test contractor Field tests in all grades. May 18-22, 2009 Operational in 2010 Focused Sample Cognitive Labs PSSA - Modified 34
Has been approved for determining AYP If a subgroup does not make AYP by any of the existing 7 methods, then the Growth Model (really Projections) are applied. The projection for each student to a future PSSA is calculated – the target grade is specified in the proposal. If the student does not have enough data to calculate a projection, the student’s actual test score is used. Actual score for 3rd grade and 11th grade are used since projections cannot be calculated for these grades. The percent of students in the subgroup that are projected to be proficient (or actually proficient only if no projection can be calculated) is then computed. If this percent is greater than or equal to the AMO target for that subject, the subgroup is identified as making AYP. PVAAS
NAEP is a congressionally mandated project overseen by the National Center for Education Statistics (NCES) to continuously monitor the knowledge, skills, and performance of the nation’s children and youth. As the “Nation’s Report Card” it measures and reports on a regular basis what America’s students know and can do in core subjects like reading, mathematics, writing and science http://nces.ed.gov/nationsreportcard National Assessment of Educational Progress (NAEP) 37
In Pennsylvania, NAEP is required of the randomly selected schools. Grades tested are 4, 8 and 12. Main subjects are Mathematics, Reading & Science Additionally – U. S. History, Civics, Geography, Science (hands on test -HOT), Science (interactive computer test-ICT), and a high school transcript study (HSTCS) NAEP 2008-2009 38
NAEP is administered by Westat Inc., the contractor for the U. S. Department of Education. Testing window January 26 to March 6, 2009. Testing time is usually 90 minutes. Additional time may be needed for Science HOT & ICT and students with special needs. NAEP 2008-2009 39
Grades and schools are randomly selected according to criteria from the U. S. Department of Education Reporting for Mathematics will be in the Fall of 2009 Reporting for Reading will be in the Spring of 2010, due to new framework for NAEP. Reporting for Science will be in the Summer of 2010. NAEP 2008-2009 40
TIMSS 2007 http://nces.ed.gov/timss/results07.asp
Overall • Significant progress in 4th & 8th Grade Math • US performed above the international avg • US scores have risen since 1995 • # of countries outperforming US declining • US’s relative standing in math increase • US’s relative standing in science steady
Overall • US is heading in the right direction in math and science • Still has a ways to go to catch up to high-performing Asian counterparts • US had made greater achievement gains over the past 12 years than Japan and Singapore
4th Grade Math • Performed as well or better than 23 of 35 participating countries • Outperformed Australia, Italy, Sweden & Hungary, which outperformed US in 2003 • US outperformed by 8 countries compared to 11 in 2003 • Scores have risen 11 points since 1995 (increase all came b/w 2003 & 2007). Singapore had an increase of 9 points. • 10% of students score at the Advanced level. Only 7 other countries had a greater percentage.
8th Grade Math • Performed as well or better than 37 of 47 participating countries • Outperformed Australia, Sweden, Scotland & Malaysia, which outperformed US in 2003 • US outperformed by just 5 countries compared to 9 in 2003 • Scores have risen 16 points since 1995. Only 3 countries made greater gains. Hong Kong (4 pts), Japan (-11 pts), Russia (-11 pts), Singapore (-16 pts) • 6% of students score at the Advanced level. Only 7 other countries had a greater percentage.
Keep in mind….. • Similar students are not being compared (e.g. a country may score higher b/c it enrolls more students from a higher SES) • Differences in scores may be a result of differences in curricula, not quality of instruction