1 / 73

Agenda

Agenda. Student Learning Growth Teacher VAM School Growth PYG Area Scorecards. PYG, and other Performance Indicators. Florida Department of Education’s “Value-Added Model (VAM)”. Marc Baron, Chief, Performance Accountability Mark Howard, Director, Research, Evaluation, and Assessment.

ivana-cummings
Download Presentation

Agenda

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Agenda • Student Learning Growth • Teacher VAM • School Growth • PYG • Area Scorecards. PYG, and other Performance Indicators

  2. Florida Department of Education’s “Value-Added Model (VAM)” Marc Baron, Chief, Performance Accountability Mark Howard, Director, Research, Evaluation, and Assessment

  3. FLDOE Value-Added ModelEstablished by Student Success Act (SB 736) • Evaluation Criteria for All Instructional Personnel and School Administrators • Professional Practice • Student Learning Growth • FCAT Classroom Teachers: 40%-50% • Non FCAT Classroom Teachers: 30%-40% • Non Classroom Teachers: 20%-30% • Principals: 50% • JTEC & Principal Evaluation Committee

  4. SDPBC Must Classify Instructional Personnel and School Administratorsinto these Four Categories • Highly Effective • Effective • Needs Improvement • Unsatisfactory

  5. VAM & Student Learning Growth • Contribution to a change in a student’s achievement • Calculated from a measure of student learning growth

  6. What is the Student Learning Growth Score? The difference between Current test score and Predicted test score What is the Predicted Student Score?

  7. What is the Predicted Student Score? It is score you would predict a student to achieve based on the student’s performance on prior tests and other information available on the student

  8. FLDOE Value-Added ModelVariables determining student learning growth • Two or more years of prior achievement scores • Gifted status • Student Attendance (Days) • Mobility (number of transitions) • Difference from modal age in grade (indicator of retention) • Class size • The number of subject-relevant courses in which the student is enrolled • Homogeneity of entering test scores in the class

  9. FLDOE Value-Added ModelVariables determining student learning growth • Students with Disabilities (SWD) status • Language impaired • Hearing impaired • Visually impaired • Emotional/behavioral • Specific learning disability • Dual sensory impaired • Autism spectrum disorder • Traumatic brain injury • Other health impaired • Intellectual disability • English Language Learner (ELL) status • LY

  10. FLDOE Value-Added ModelVariables not determining student learning growth Gender Race Ethnicity Socioeconomic status

  11. FLDOE Value-Added Model Variables determining student learning growth TERMS District Data Base of All Student Records

  12. What is the Predicted Student Score? …100 200 300 400 500 600 700 800 900 1000… (FY11 FCAT) CURRENT TEST …100 200 300 400 500 600 700 800 900 1000… PRIOR TEST (FY10 FCAT)

  13. What is the Predicted Student Score? …100 200 300 400 500 600 700 800 900 1000… (FY11 FCAT) 900 800 CURRENT TEST 700 …100 200 300 400 500 600 700 800 900 1000… PRIOR TEST (FY10 FCAT)

  14. W What is the Predicted Student Score? …100 200 300 400 500 600 700 800 900 1000… (FY11 FCAT) 900 800 CURRENT TEST 700 600 500 400 300 …100 200 300 400 500 600 700 800 900 1000… PRIOR TEST (FY10 FCAT)

  15. What is the Predicted Student Score? …100 200 300 400 500 600 700 800 900 1000… (FY11 FCAT) Answer: Average of current scores of similar students 900 800 CURRENT TEST 700 PREDICTED SCORE 600 600 500 400 300 …100 200 300 400 500 600 700 800 900 1000… PRIOR TEST (FY10 FCAT)

  16. Student Learning Growth is the Amount Above or Below Predicted Score …100 200 300 400 500 600 700 800 900 1000… (FY11 FCAT) 900 800 ACTUAL SCORE CURRENT TEST Above Predicted Score 700 PREDICTED SCORE 600 600 500 Below Predicted Score 400 ACTUAL SCORE 300 …100 200 300 400 500 600 700 800 900 1000… PRIOR TEST (FY10 FCAT)

  17. What is the Predicted Student Score? Based on Prior Achievement Based on Prior Achievement Only Based on Prior Achievement & ELL (FY11 FCAT) …100 200 300 400 500 600 700 800 900 1000… 10 20 30 40 50 60 70 80 90 100… Each prior year test score has a Predicted current year test score. 90 800 CURRENT TEST 70 CURRENT TEST 600 50 400 10 20 30 40 50 60 70 80 90 100… …100 200 300 400 500 600 700 800 900 1000… PRIOR TEST (FY10 FCAT) PRIOR TEST

  18. FLDOE Value-Added ModelVariables determining student learning growth Two or more years of prior achievement scores Attendance Mobility (number of transitions) Difference from modal age in grade (indicator of retention) Class size The number of subject-relevant courses in which the student is enrolled Homogeneity of entering test scores in the class LY Gifted status Language impaired Hearing impaired Visually impaired Emotional/behavioral Specific learning disability Dual sensory impaired Autism spectrum disorder Traumatic brain injury Other health impaired Intellectual disability

  19. Reading Grade 7Indicators Ranked By Statistical Significance

  20. Illustrative Growth Points All other variables being equal *adapted from AIR materials presented at August 2, 2011,meeting These are illustrative values, not actual values

  21. What is the Predicted Student Score? …100 200 300 400 500 600 700 800 900 1000… Based on Prior Achievement Only Based on Prior Achievement & ELL (FY11 FCAT) 10 20 30 40 50 60 70 80 90 100… 90 800 CURRENT TEST 70 CURRENT TEST 600 50 400 10 20 30 40 50 60 70 80 90 100… …100 200 300 400 500 600 700 800 900 1000… PRIOR TEST (FY10 FCAT) PRIOR TEST

  22. What is the Predicted Student Score? …100 200 300 400 500 600 700 800 900 1000… …100 200 300 400 500 600 700 800 900 1000… Based on Prior Achievement Only Based on Prior Achievement & ELL (FY11 FCAT) (FY11 FCAT) 900 800 CURRENT TEST 700 CURRENT TEST 600 500 400 …100 200 300 400 500 600 700 800 900 1000… …100 200 300 400 500 600 700 800 900 1000… PRIOR TEST (FY10 FCAT) (FY10 FCAT) PRIOR TEST

  23. What is the Predicted Student Score? …100 200 300 400 500 600 700 800 900 1000… …100 200 300 400 500 600 700 800 900 1000… Based on Prior Achievement Only Based on Prior Achievement & Low Attendance (FY11 FCAT) (FY11 FCAT) 800 700 CURRENT TEST CURRENT TEST 600 500 400 300 …100 200 300 400 500 600 700 800 900 1000… …100 200 300 400 500 600 700 800 900 1000… PRIOR TEST (FY10 FCAT) (FY10 FCAT) PRIOR TEST

  24. How to calculate the student learning growth score? …100 200 300 400 500 600 700 800 900 1000… The diagonal line is the predicted growth observed among similar students. (FY11 FCAT) CURRENT TEST …100 200 300 400 500 600 700 800 900 1000… PRIOR TEST (FY10 FCAT) DRE

  25. How to calculate the student learning growth score? …100 200 300 400 500 600 700 800 900 1000… (FY11 FCAT) CURRENT TEST FY10 FY11 FY11 FY11 FCAT FCAT FCAT FCAT …100 200 300 400 500 600 700 800 900 1000… PRIOR TEST (FY10 FCAT) DRE

  26. W How to calculate the student learning growth score? …100 200 300 400 500 600 700 800 900 1000… (FY11 FCAT) CURRENT TEST FY10 FY11 FY11 FY11 FCAT FCAT FCAT FCAT 100 550 450 300 …100 200 300 400 500 600 700 800 900 1000… PRIOR TEST (FY10 FCAT) DRE

  27. Y How to calculate the student learning growth score? …100 200 300 400 500 600 700 800 900 1000… (FY11 FCAT) CURRENT TEST FY10 FY11 FY11 FY11 FCAT FCAT FCAT FCAT ? ? ? ? …100 200 300 400 500 600 700 800 900 1000… PRIOR TEST (FY10 FCAT) DRE

  28. How to calculate the student learning growth score? …100 200 300 400 500 600 700 800 900 1000… (FY11 FCAT) CURRENT TEST FY10 FY11 FY11 FY11 FCAT FCAT FCAT FCAT …100 200 300 400 500 600 700 800 900 1000… PRIOR TEST (FY10 FCAT) DRE

  29. How do you calculate the teacher growth score? • Identify the students assigned to the teacher • Determine the learning growth of each of the assigned students • Calculate the average learning growth of the students TERMS

  30. Teacher Growth Score …100 200 300 400 500 600 700 800 900 1000… (FY11 FCAT) CURRENT TEST Typical FY10 FY11 FY11 FY11 FCAT FCAT FCAT FCAT …100 200 300 400 500 600 700 800 900 1000… PRIOR TEST (FY10 FCAT) DRE

  31. Teacher Growth Score …100 200 300 400 500 600 700 800 900 1000… (FY11 FCAT) CURRENT TEST Above FY10 FY11 FY11 FY11 FCAT FCAT FCAT FCAT …100 200 300 400 500 600 700 800 900 1000… PRIOR TEST (FY10 FCAT) DRE

  32. Teacher Growth Score …100 200 300 400 500 600 700 800 900 1000… (FY11 FCAT) CURRENT TEST Below FY10 FY11 FY11 FY11 FCAT FCAT FCAT FCAT …100 200 300 400 500 600 700 800 900 1000… PRIOR TEST (FY10 FCAT) DRE

  33. Teacher Growth School Growth Teacher Growth Avg Growth = (A+B+C+D)/4

  34. Teacher Effect School Growth Teacher Effect

  35. Calculating Teacher Value-Added ScorePart 1 Teacher Effect ( ) - = School Growth Score Teacher Growth Score DRE

  36. How do you calculate the school learning growth score? • Identify the students assigned to the school • Determine the learning growth of each of the assigned students • Calculate the average learning growth of the students

  37. FY10 FY11 FY11 FY11 FCAT FCAT FCAT FCAT School Growth Score …100 200 300 400 500 600 700 800 900 1000… (FY11 FCAT) CURRENT TEST …100 200 300 400 500 600 700 800 900 1000… PRIOR TEST (FY10 FCAT) DRE

  38. Calculating Teacher Value-Added ScorePart 1: AKA Teacher Effect Tcheffect = (Tchgrowth score – Schgrowth score ) DRE

  39. What is a Teacher Value-Added Score? and How is it calculated? DRE

  40. FLDOE Teacher Value-Added Score Conceptual Teacher Effect ) ( ) ( - + .5 X = School Growth Score School Growth Score Teacher Growth Score Tchvas = (Tchgrowth score – Schgrowth score ) + ( .5 x Schgrowth score) DRE

  41. Teacher Value-Added Score Tchvas = (Tchgrowth score – Schgrowth score ) + ( .5 x Schgrowth score) DRE

  42. State Average Student Learning Growth Teacher Growth = 20 The greater a teacher’s growth score is from the state’s average and the school’s growth score, the higher a teacher’s VAS VAS = 15 VAS = 20 VAS = 25 -20 -15 -10 -5 0 5 10 15 20 Tchvas = (Tchgrowth - Schgrowth ) + ( .5 x Schgrowth)

  43. State Average Student Learning Growth Schoo l Growth = 0 At a school with a growth score of 0, the teacher’s VAS equals the teacher’s growth VAS = 20 VAS = 0 VAS = -20 -20 -15 -10 -5 0 5 10 15 20 Tchvas = (Tchgrowth - Schgrowth ) + ( .5 x Schgrowth)

  44. State Average Student Learning Growth Schoo l Growth = 10 What is the significance of the green line? At a high VAS school, a teacher’s growth must exceed half the school’s growth to have a positive VAS VAS = 15 VAS = 5 VAS = 0 VAS = -5 VAS = -10 -20 -15 -10 -5 0 5 10 15 20 Tchvas = (Tchgrowth - Schgrowth ) + ( .5 x Schgrowth)

  45. State Average Student Learning Growth Schoo l Growth = -10 At a low VAS school, a teacher’s growth must exceed half the school’s growth to have a positive VAS VAS = -15 VAS = -5 VAS =0 VAS = 5 VAS = 10 -20 -15 -10 -5 0 5 10 15 20 Tchvas = (Tchgrowth - Schgrowth ) + ( .5 x Schgrowth)

  46. A Real Picture is Worth a Thousand Words =

  47. Teacher VAM

  48. SDPBC Teacher VAM (Grade 5 Subject: Reading) Mean = 3.3 N = 561 Class >= 10

  49. State Teacher VAM (Grade 5 Subject: Reading) Mean = 0.1 N = 12182

  50. Teacher VAM Distribution for Reading

More Related