1 / 42

PVAAS Webinar

PVAAS Webinar. Pennsylvania Value-Added Assessment System (PVAAS) High Growth, High Achieving Schools: Is It Possible ? Fall, 2011. Misconception: High achieving students/schools cannot show growth!. One Question:.

ray
Download Presentation

PVAAS Webinar

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. PVAAS Webinar Pennsylvania Value-Added Assessment System (PVAAS)High Growth, High Achieving Schools: Is It Possible?Fall, 2011

  2. Misconception:High achieving students/schools cannot show growth!

  3. One Question: If PSSA is designed to discriminate proficient from non-proficient, how can it be used to calculate growth for students at the extremes? PVAAS Statewide Core Team

  4. About the PSSA Exams The PSSA is designed to discriminate proficient from non-proficient, and also to have sufficient stretch to discriminate between Below Basic, Basic, Proficient and Advanced. Other critical facts: There is NO ceiling on the PSSA! Each year, test scores are scaled using a lowest score of 700 and the previous year’s cut scores for the proficient category. The high end is allowed then to be scaled based on the distribution of the data – not a fixed, pre-determined value. PVAAS Statewide Core Team

  5. My students are SO high achieving already…What is the reality of student performance on PSSA?

  6. Student NCE Scores in Mathematics 4th Grade vs. 5th Grade Each dot represents multiple students with the same scores. PVAAS Statewide Core Team

  7. Student NCE Scores in Mathematics 4th Grade vs. 5th Grade Each dot represents multiple students with the same scores. PVAAS Statewide Core Team

  8. Student NCE Scores in Mathematics 4th Grade vs. 5th Grade Each dot represents multiple students with the same scores. PVAAS Statewide Core Team

  9. Student NCE Scores in Mathematics 4th Grade vs. 5th Grade Notice the variation at the extremes… PVAAS Statewide Core Team

  10. How does PVAAS address growth for high achieving students and schools?

  11. PVAAS’s Criteria for Tests Three conditions on assessments to be included in PVAAS analyses as required by the statisticians at SAS, Inc. The tests must be aligned to curriculum standards. The tests must be reliable and valid. The tests must demonstrate sufficient stretch to show growth of low and high performing students. PVAAS Statewide Core Team

  12. PVAAS Checks for Stretch • Number of different scaled scores at the top end and at the bottom end: • Sufficient to differentiate growth at both ends • Percentages of students scoring each score at the top end and at the bottom end: • Ensures no ceilings or floors SAS, Inc. does these checks each year! PVAAS Statewide Core Team

  13. PVAAS Methodology The whole is more precise than the sum of its parts! Multivariate Longitudinal Mixed Effect Model (MRM) This type of model exploits the Covariance structure of the data points to dampen the error that is related to each measurement in the model. That is, the result of the modeling process, the estimated achievement (and therefore, the estimated gain), is more precise than any of the individual measures that are used as predictors in the estimation process. PVAAS Statewide Core Team

  14. So Can High Performing Groups of Students Show Growth? YES!!!

  15. To Answer This Question… Two Sources of Evidence: Actual Pennsylvania Scatterplots School Search of Actual PA Schools PVAAS Statewide Core Team

  16. Actual Statewide 4th Grade Math Scatterplot SY2009-10 PVAAS Statewide Core Team

  17. Actual Statewide 4th Grade Math Scatterplot SY2009-10 PVAAS Statewide Core Team

  18. PVAAS School Search For our purposes: We will display actual school-wide data available on the PVAAS Public web site. You can perform School Searches on the PVAAS secure site to allow you to view grade level results. PVAAS Statewide Core Team

  19. School Search Report PVAAS Statewide Core Team

  20. School Search Report PVAAS Statewide Core Team

  21. School Search Report PVAAS Statewide Core Team

  22. School Search Report PVAAS Statewide Core Team

  23. School Search Report PVAAS Statewide Core Team

  24. Now Let’s Sort The Last Column PVAAS Statewide Core Team

  25. Grades 9-11 Math PVAAS Statewide Core Team

  26. A Visual Representation High Growth PVAAS Statewide Core Team

  27. Compacting Simulation Suppose we have a population of high performing students whose mean performances range from 85 to 100 (100 being the highest value). What happens to the mean of these performances as we strive to move all students to higher performance levels? PVAAS Statewide Core Team

  28. Watch the Mean as the Low Increases… PVAAS Statewide Core Team

  29. Opportunities for Growth? Your School’s DaTa PVAAS Statewide Core Team

  30. Consider Your Own Data Investigate PSSA Data Interactive Graphical Summary: Performance Levels Matched Comparison PVAAS Statewide Core Team

  31. PSSA Graphical Summary:Performance Levels Even very strong schools/districts have the opportunity to increase the percent of Advanced students. PVAAS Statewide Core Team

  32. PSSA Matched Comparison Even in high achieving schools, some students can slip! PVAAS Statewide Core Team

  33. An Important Illustration PVAAS Statewide Core Team

  34. An Important Illustration PVAAS Statewide Core Team

  35. An Important Illustration PVAAS Statewide Core Team

  36. The Report

  37. The Report PVAAS Statewide Core Team

  38. In Summary… There are high achieving schools in Pennsylvania making high growth PVAAS provides a means to view this evidence There are opportunities for growth in Pennsylvania’s schools There are PA data tools to use to show where there may be opportunities for growth PVAAS Statewide Core Team

  39. But, but, but… What if my school is high achieving but not showing acceptable growth? Remember: • Advanced and Proficient categories are ranges – students can improve or slip within those ranges… PVAAS will document those changes. • Use School Search on the PVAAS Public or Secure site to identify and connect with schools yielding different results… PVAAS Statewide Core Team

  40. Benefits of Value-Added • Offers an objective, more accurate way to measure the influence districts and schools have on students’ academic progress: • Administrators and Teachers can: • Monitor the progress of all groups of students • Make more informed data-driven decisions • Align professional development efforts in the areas of greatest need • Identify best practices and implement most productive instructional strategies and programs PVAAS Statewide Core Team

  41. Questions:PVAAS Materials or Statewide Implementation pdepvaas@iu13.org 717-606-1911 PVAAS Statewide Core Team

  42. www.pde.state.pa.us PVAAS Statewide Core Team

More Related