Understanding Value-Added as a Student Growth Measure

1. Whiteboard Zoom Out TLE Value Added Training

2. Whiteboard Zoom In AGENDA Introduction Value Added as a Student Growth Measure What is Value Added? Building Conceptual Understanding about Value-Added Results Interpreting the Teacher Report Interpreting the Administrator Report Training on Value Added

3. Whiteboard Zoom Mid What is value added • “Value added” is a measure of a teacher’s contributions - the amount of value he or she adds - to students’ academic growth. • One of multiple measures that will be used • to evaluate the performance of teachers and administrators in Oklahoma’s TLE evaluation system. • Designed to isolate a teacher’s contribution from other factors that might affect a student’s scores but that are outside the teacher’s control.

4. Whiteboard Zoom In Alternative Measures of Student Growth

5. Whiteboard Zoom In Average Grade 4 Reading Scores Minimum performance standard Teachers

6. Whiteboard Zoom In % of students who scored proficient or higher Teachers

7. Whiteboard Zoom Mid Shortcomings of Single-Year Outcomes

8. Whiteboard Zoom Mid Shortcomings of Single-Year Outcomes

9. Whiteboard Zoom Mid Shortcomings of Single-Year Outcomes

10. Whiteboard Zoom In Class Average Grade 5 Math Scores for Ms. Smith

11. Whiteboard Zoom Mid Shortcomings of Cohort-to-Cohort Comparisons

12. Whiteboard Zoom Mid Shortcomings of Cohort-to-Cohort Comparisons

13. Whiteboard Zoom In Previous Grade vs. Current Grade Average Math Scores for Mr. Jordan’s 5th Grade Students

14. Whiteboard Zoom Mid Shortcomings of Single Cohort Comparisons

15. Whiteboard Zoom Mid Shortcomings of Single Cohort Comparisons

16. Whiteboard Zoom In Value Added as a Student Growth Measure

17. Whiteboard Zoom In AGENDA Introduction Value Added as a Student Growth Measure What is Value Added? Building Conceptual Understanding about Value-Added Results Interpreting the Teacher Report Interpreting the Administrator Report Training on Value Added

18. Whiteboard Zoom In

19. Whiteboard Zoom In

20. Whiteboard Zoom In • Coach John Robinson • Wilson High School • Win-Loss Record: 5-9

21. Whiteboard Zoom In Wilson High School Home of the Tigers 0: 05 12 12

22. Whiteboard Zoom In Wilson High School Home of the Tigers 0: 00 18 12

23. Whiteboard Zoom In • Players’ stats, win-loss record, observations from games and practice. • How can he isolate the impact of his program from other factors and get an overall picture of its effectiveness on a team full of different players?

24. Whiteboard Zoom In • Players’ stats, win-loss record, observations from games and practice. • How can he isolate the impact of his program from other factors and get an overall picture of its effectiveness on a team full of different players? • Value added measures are designed to help answer these types of questions!

25. Whiteboard Zoom In Examples factors that may impact players’ performance: • Performance last season • Attendance at practice • Years experience • Weightlifting stats • Enrollment in summer football camp

26. Whiteboard Zoom In Weightlifting Stats Performance last season Attendance at practice Enrollment in a summer camp Years of experience

27. Whiteboard Zoom In Estimated “typical performance” of similar players Andy’s actual sophomore year performance

28. Whiteboard Zoom In

29. Whiteboard Zoom In Wilson High School Home of the Tigers 0: 00 12 18

30. Whiteboard Zoom Mid What is Value Added? Wilson High School Home of the Tigers 0: 00 12 18

31. Whiteboard Zoom In AGENDA Introduction Value Added as a Student Growth Measure What is Value Added? Building Conceptual Understanding about Value-Added Results Interpreting the Teacher Report Interpreting the Administrator Report Training on Value Added

32. Whiteboard Zoom In Key Concepts

33. Whiteboard Zoom In Meet Ms. Alero Grade 5 Math Teacher Peabody Public Schools Red River Elementary School

34. Whiteboard Zoom In OCCT Math Scores for Ms. Alero’s Students James

35. Whiteboard Zoom Out James - Actual score on grade 4 OCCT math assessment: - Actual score on the grade 5 OCCT math assessment: - Typical-peer score on grade 5 math OCCT assessment: 850 830 …?

36. Whiteboard Zoom In At present, the student characteristics used to determine typical-peer scores will include: • Prior Achievement • Free/Reduced Lunch Status • Limited English Proficiency • Individualized Education Plan (IEP) • Race/Ethnicity • Gender • Mobility • Prior attendance

37. Whiteboard Zoom In All OK grade 5 students

38. Whiteboard Zoom In Prior Achievement Relationship

39. Whiteboard Zoom Out Prior achievement 810 815 800 805 820 810 825 Free and Reduced Lunch Status Mobility Limited English Proficiency Prior Attendance Race/Ethnicity Gender

40. Whiteboard Zoom In Meet Ms. Alero OCCT Math Scores for Ms. Alero’s Students 800 530 640 710 500 636 650

41. Whiteboard Zoom In Ms. Alero’s Value-Added Result Value-Added Result = +14 650 636

42. Whiteboard Zoom In True or False

43. Whiteboard Zoom In True or False Value added is designed to isolate a teacher’s contributions to student academic growth, or value added, from other factors that might affect a student’s scores but that are outside the teacher’s control.

44. Whiteboard Zoom In True or False During the two-year value added pilot, teachers of all grades and subjects will receive a value-added result. False. Only teachers with at least 10 tested students who meet requirements for inclusion in the model in the following grades and subjects will receive a value-added result:

45. Whiteboard Zoom In True or False The value-added model relies on a direct comparison of two different tests in order to show a teacher’s contribution to a student’s academic growth. False. The value-added model does not relay on a direct comparison of two different tests to estimate a teacher’s contribution to a student’s academic growth. A teacher’s value-added result is determined by comparing the average actual score and the average typical-peer score on the same test.

46. Whiteboard Zoom In True or False The 2014-15 school year value-added results are based on pilot data from the previous school year. True. Value-added results are based on pilot data from the previous school year.

47. Whiteboard Zoom In AGENDA Introduction Value Added as a Student Growth Measure What is Value Added? Building Conceptual Understanding about Value-Added Results Interpreting the Teacher Report Interpreting the Administrator Report Training on Value Added

48. Whiteboard Zoom In Interpreting the Teacher Value-Added Results Report The teacher value-added results report aims to…

49. Whiteboard Zoom Mid Mr. Thompson’s Value-Added Results Report • Overall value-added results section • Subject-specific section(s), including • Value-added results for the subject • Relative Performance Graph • Student Performance vs. Teacher Value-Added Result Comparison Graph • Student Roster • Value-added by Subgroups Table

50. Whiteboard Zoom In Whiteboard Zoom In Value Added TLE Component Score A teacher's overall value added (above) given by the TLE component score is a weighted average of the teachers' subject-specific component scores (below), where the weight is the number of student equivalents for the subject. Student Equivalent (overall) The sum of students' dosages overall. Unique Student Count (overall) The number of students overall. Each student is only counted once even if taught in multiple subjects.