PVAAS Overview: Evaluating Growth, Projecting Performance Faculty Introduction

1. PPT Presentation Template:This PPT includes all slides to present a district-level overview of PVAAS. This was used with a district-wide elementary faculty group.

2. PVAAS Overview:Evaluating Growth,Projecting PerformanceFaculty Introduction

3. PVAASIS: • Analysis of existing assessment data • Longitudinal PSSA scores in available content areas • Math, Reading, Science, Writing • Provides reliable estimates • A measure of a school’s effectiveness • Critical Relationship: Growth Data vs. Achievement Data

4. PVAAS: • Is not another test • Is not a comparison of single test scores • Critical concept: Does not provide a measure of growth for an individual student

5. Current Data Collection Approaches High Achievement Average Achievement Low Achievement Achievement is based on each student’s ending point.

6. PVAAS Adds Another Variable To Achievement…Progress Below Growth Standard At or Above Growth Standard Progress is based on each student’s starting point.

7. Viewing Achievement and Progress Together Scatter Plots: Grades 4-8 Reading and Math

8. The Scatter Plot Coordinate System Vertical Axis PSSA Percent Proficient or Advanced Growth Standard Boundary One Year Growth AYP Percent Proficient Target Horizontal Axis PVAAS Growth Measure

9. Scatter Plot Quadrants and Their Meanings Quad 2 Adequate Achievement Negative Growth Quad 1 Adequate Achievement Positive Growth Quad 4 Below Adequate Achievement Positive Growth Quad 3 Below Adequate Achievement Negative Growth

10. District Scatter Plots District vs. IU Region vs. State Math and Reading Grades 4 – 8

11. District Scatter Plot – Grade 4

12. District Scatter Plot – Grade 5

13. District Scatter Plot – Grade 6

14. District Scatter Plot – Grade 7

15. District Scatter Plot – Grade 8

16. Viewing Achievement and Progress Together Scatter Plots: Grade 11 Reading and Math

17. Grade 11 Scatter Plots The PSSA-PVAAS Scatter Plots visually display the following data from the statewide distribution of PSSA results for the most current school year. • Achievement • The mean predicted performance of the cohort. • The actual mean performance of all students in the state is displayed for reference • Growth • School Effect ≈ Observed Mean – Predicted Mean • Standardized School Effect = School Effect relative to its error – displays degree of confidence The following two slides explain the meaning of each of the regions of an 11th grade scatter plot.

18. The Scatter Plot Coordinate System for Grade 11 Vertical Axis Mean Predicted Scaled Score Growth Descriptor Boundaries (±2SEs) Horizontal Axis Growth Measure in Standard Errors 2010 Mean Scaled Score

19. Scatter Plot Regions and Their Meanings for Grade 11

20. District Scatter Plot – Grade 11

21. The TWO Types ofPVAAS Information Looking Forward/Planning… PVAAS Projection Reports For Individual Students and Cohorts of Students Looking Back/Evaluation… Value-Added Growth Reports For Cohorts of Students Today NO individual measure of student growth. .

22. Student Projections

23. PVAAS Reporting Projections to Basic, Proficient, and Advanced Grade Last Tested Grade Last Tested Grade Last Tested

24. How do I know that the projectionis accurate? • The projection is precise, and is created using a model that has been reviewed and approved by four different peer review panels and the GAO (US Government Accountability Office). • The most recent 2008 growth model proposal to USDOE includes information regarding the statistical model and projection reliability study. (http://www.ed.gov/admins/lead/account/growthmodel/pa/index.html) • Recent studies have confirmed that the PVAAS projections (even as far as 3 years into the future) are more reliable at looking at the future performance of a student than the most recent PSSA score.

25. PVAAS Student Projection Report

26. PVAAS Projections for Groups of Students Student Search

27. Identified Students Meeting Search Requirements

28. District (Single Grade) Projection Summary Report – Grade 3 District (Single Grade) Projection Summary Report for Grade 3 to be inserted here

29. District (Single Grade) Projection Summary Report – Grade 4 District (Single Grade) Projection Summary Report for Grade 4 to be inserted here

30. District (Single Grade) Projection Summary Report – Grade 5 District (Single Grade) Projection Summary Report for Grade 5 to be inserted here

31. District (Single Grade) Projection Summary Report – Grade 6 District (Single Grade) Projection Summary Report for Grade 6 to be inserted here

32. District (Single Grade) Projection Summary Report – Grade 7 District (Single Grade) Projection Summary Report for Grade 7 to be inserted here

33. District (Single Grade) Projection Summary Report – Grade 8 District (Single Grade) Projection Summary Report for Grade 8 to be inserted here

34. Value-Added Wouldn’t it be great to know if you made at least one year’s growth with students last tested in grades 4-8 and ingrade 11?

35. Value-added Measure ofCohort GrowthGrades 4 through 8 in Reading and Math • Comparison to a State Growth Standard • The Growth Standard specifies the minimal acceptable academic gain from grade to grade for a cohort of students. • The use of a Growth Standard creates the possibility that ALL schools can demonstrate appropriate growth.

36. Four Important Issues Difference in scores in consecutive years. 1. Measuring Gain 2. Growth Standard Convert all scores to same scale – NCE scale 3. Comparing Scores from year to year Combine current observed scores with all previous scores in students’ histories. 4. Estimating Achievement

37. PVAAS Value-Added Growth Descriptors – Grade 4 – 8 Math and Reading

38. PVAAS District ReportGrades 4 through 8 - Math and Reading

39. What Value-added Gain Means! Cohort’s Achievement 6th grade 64.6 Cohort’s Achievement 5th grade 60.7 0 10 20 30 40 50 60 70 80 90 100 NCE Scale State Mean = 50 PVAAS Gain ≈ Change in position from 5th to 6th grade ≈ 64.6 – 60.7 ≈ 4.0 NCE points

40. PVAAS School ReportHigh School Math and ReadingScience and Writing Based on a predictive methodology: • A predicted score is calculated for each student; • Mean of predicted scores is calculated for students in a cohort; • Mean of observed scores of students in the cohort; • School Effect is the difference between the Observed and the Predicted Scores.

41. Writing, Science & Grade 11 Reading/Math Growth Descriptors

42. PVAAS District ReportGrades 11- Math and Reading Grades 4, 8 & 11 – Science Grades 5, 8 & 11 – Writing

43. PVAAS Performance Diagnostic ReportThe Key is the RED Whisker!

44. Growth Standard MethodologyWhat the whiskers tell us… Exceeded Growth Standard; More than One Year’s Growth Green Met the Growth Standard; Made One Year’s Growth Yellow Growth Standard (One Year’s Growth) Below Growth Standard; Less than One Year’s Growth Rose

45. Predictive MethodologyWhat the whiskers tell us… ABOVE Expectations -- Observed Score Was Greater Than Predicted Score NDD – No Detectable Difference Between Observed Score and Predicted Score Observed – Predicted (One Year’s Growth) BELOW Expectations -- Observed Score Was Less Than Predicted Score

46. Performance Diagnostic Report

47. Greater Detail – based on % of students

48. Click on Hot Keys for lists of students.

49. Student Lists from Performance Diagnostic Reports