Pennsylvania Value-Added Assessment System (PVAAS): A Compass for Improvement

1. Pennsylvania Value-Added Assessment System (PVAAS):A Compass for Improvement Oxford Area School District February 14, 2013

2. PVAASIS: • Analysis of existing assessment data • Longitudinal PSSA scores in available content areas • Math, Reading, Science, Writing • Provides reliable estimates • A measure of a school’s effectiveness • Critical Relationship: Growth Data vs. Achievement Data

3. PVAAS IS NOT Another test Able to provide a measure of growth for an individual student A comparison of single test scores

4. Current Data Collection Approaches High Achievement Average Achievement Low Achievement Achievement is based on each student’s ending point.

5. OASD/State 2012 Reading PSSA Disaggregated Groups

6. Key Concepts Achievement Progress • Measures students’ performance at a single point in time • Compares student performance to a standard • Critical to students’ post-secondary opportunities • Highly correlated with demographic factors, such as socioeconomic status • Measures students’ progress across time/years • Compares student performance to his/her own prior performance • Critical to ensuring students’ future academic success • Not correlated with demographic factors

7. Key Concepts • PVAAS reporting reflects the effectiveness of your district’s or school’s Standards-Aligned System • PVAAS reporting reflects the district’s or school’s system regarding curriculum, assessment, and instruction

8. Key Concepts • There is NO relationship between demographic variables such as socioeconomic status and growth. • There are high achieving schools making high growth; • There are high achieving schools making low growth; • There are low achieving schools making high growth; • There are low achieving schools making low growth. • Growth reporting reflects what WE do with students in terms of academic growth in schools/districts. • -- VAAS can remove the effects of factors not under the control of the school. (McCaffrey, Lockwood, Koretz & Hamilton, 2003; Ross, Wang, Sanders, Wright & Stringfield, 1999a; Wright, Horn & Sanders, 1997).

9. PVAAS Adds Another Variable To Achievement…Progress Below Growth Standard At or Above Growth Standard 0 = Growth Standard Progress is based on each cohort’s starting point.

10. TWO Types of PVAAS Information Looking Forward/Planning… PVAAS Projection Reports For Individual Students and Groups of Students Looking Back/Evaluation… Value-added Growth Reports For Groups of Students Today

11. What questions does PVAAS answer? • Did each group of students make a year’s worth of growth in reading (grades 4-8 and 11), math (grades 4-8 and 11), science (grades 4, 8 and 11), and writing (grades 5, 8 and 11)? • Did each subgroup of students make a year’s worth of growth in reading (grades 4-8 and 11), math (grades 4-8 and 11), science (grades 4, 8 and 11), and writing (grades 5, 8 and 11)? • Is each student on a trajectory to reach proficient or advanced on a future PSSA reading, math, science, and writing?

12. SAS PVAAS Website Professional Development Opportunities, New Features, Guide to District/School Reports, Guide to Public Reporting, IU Point of Contact . . . https://pvaas.sas.com

13. Overview of PVAAS Reporting

14. PVAAS Reporting Value-Added Reports and Projections • Reading, Math, Science and Writing • District Level Reporting • School Level Reporting • Grade Level Reporting (4-8, 11) • Subgroups Reporting (ex. IEP, ED, ELL) • Performance Levels (Advanced, Proficient, Basic, Below Basic) • Student Level Reporting – Only for projections • Reading, Math, Science, Writing

15. Did students make one year’s academic growth last year?

16. Scatter Plot Quadrants and Their Meanings Quad 2 - Slipping Higher Achievement, Negative Growth Quad 1 - Excelling Higher Achievement, Higher Growth Quad 4 - Improving Lower Achievement, Higher Growth Quad 3 - Underperforming Lower Achievement, Lower Growth

17. School to CountyGrade 4 Math

18. School to CountyGrade 4 Reading

19. School to CountyGrade 5 Math

20. School to CountyGrade 5 Reading

21. School to CountyGrade 6 Math

22. School to CountyGrade 6 Reading

23. School to CountyGrade 7 Math

24. School to CountyGrade 7 Reading

25. School to CountyGrade 8 Math

26. School to CountyGrade 8 Reading

27. School to CountyGrade 11 Math

28. School to CountyGrade 11 Reading

29. Publicly Released Data: School Search • Allows users to find and compare the achievement and gains of grade levels in all schools in PA (grades 4-8 & 11) • Will display the school’s quintile relative to all schools in Pennsylvania • Can search for “comparable schools” • Similar demographics January 2011

30. Average Growth Index • Math (Grades 4-8) • AGI 10.7 (19th out of 553 districts) • *Significant evidence that the district exceeded the standard for PA Academic Growth • Range of growth 20.5 – (-55.9) • Only 1/12 other Chester County school district ranked higher.

31. Average Growth Index • Reading (Grades 4-8) • AGI 5.6 (38th out of 553 districts) • *Significant evidence that the district exceeded the standard for PA Academic Growth • Range of growth 15.4 – (-46.3) • Only 3/12 other Chester County school districts ranked higher.

32. https://pvaas.sas.com 333 Market Street Harrisburg, PA 17126 Gerald L. Zahorchak, D.Ed. Secretary of Education Commonwealth of Pennsylvania