1 / 130

Evidencing an accurate and comprehensive picture of teaching practice

MAKING SUMMATIVE DECISIONS: Teacher Evaluation. Evidencing an accurate and comprehensive picture of teaching practice. Main Components. performance standard. performance INDICATORs. performance APPRAISAL RUBRIC. Teacher Performance Standards. Data Sources. Rating Performance.

danil
Download Presentation

Evidencing an accurate and comprehensive picture of teaching practice

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. MAKING SUMMATIVE DECISIONS: Teacher Evaluation Evidencing an accurate and comprehensive picture of teaching practice

  2. Main Components performance standard performance INDICATORs performance APPRAISAL RUBRIC

  3. Teacher Performance Standards

  4. Data Sources

  5. Rating Performance

  6. Rating Levels Proficient is the performance standard and is the expected level of performance.

  7. Summative Performance Report (abbreviated) Performance Standard 1: Professional Knowledge 12

  8. Standards 1-6 Standard 7

  9. Recommended Standard Weighting

  10. Weighting Example

  11. Overall Rating • Regardless of overall total points earned: • Three or more “developing/needs improvement” ratings on individual performance standards will result in an overallDEVELOPING/NEEDS IMPROVEMENT or UNACCEPTABLE • One “unacceptable” rating on any one performance standard may result in an overall UNACCEPTABLE

  12. What’s in a Rubric? Performance Standard 1: Professional Knowledge • The teacher demonstrates an understanding of the curriculum, subject content, and the developmental needs of students by providing relevant learning experiences.

  13. What’s in a Rubric?

  14. What’s in a Rubric?

  15. What’s in a Rubric? Therefore, one could say: A rating of unacceptableon professional knowledge means the teacher uses materials that lack accuracy and/or currency and fails to adequately address needs of students.

  16. What’s in a Rubric...Your Turn Handout Pages 2-5

  17. Connecting Teacher Evaluation to Student Academic Progress Implementing Standard 7

  18. Standard 7: Student Academic Progress • Code of Virginia School boards shall develop a procedure for use by division superintendents and principals in evaluating instructional personnel that is appropriate to the tasks performed and addresses, among other things, student academic progress [emphasis added] and the skills and knowledge of instructional personnel, including, but not limited to, instructional methodology, classroom management, and subject matter knowledge. Article 2, §22.1-295

  19. Standard 7: Student Academic Progress • The work of the teacher results in acceptable, measurable, and appropriate student academic progress.

  20. Standard 7: Student Academic Progress • Sample Performance Indicators • Examples of teacher work conducted in the performance of the • standard may include, but are not limited to: • 7. 1 Sets acceptable, measurable and appropriate achievement goals for student academic progress based on baseline data. • 7.2 Documents the progress of each student throughout the year. • 7.3 Provides evidence that achievement goals have been met, including the state-provided growth measure when available as well as other multiple measures of student growth. • 7.4 Uses available performance outcome data to continually document and communicate student academic progress and develop interim learning targets.

  21. Standard 7: Student Academic Progress

  22. Standard 7: Student Academic Progress • Include multiple measures of student academic progress (at least two) • Use student achievement goal setting or other measures of student progress • Include Student Growth Percentiles (SGPs) when available and appropriate • Account for 40% of the teacher’s Summative Performance Evaluation Source: 2011 Guidelines for Uniform Performance Standards and Evaluation Criteria for Teachers

  23. Standard 7: Student Academic Progress Source: 2011 Guidelines for Uniform Performance Standards and Evaluation Criteria for Teachers

  24. Standard 7:What We Need to Know • What should we know in using student achievement goal setting in a teacher’s performance evaluation? • What should we know when including student growth percentiles in a teacher’s performance evaluation? • What should we know to include other measures of student academic progress? • How do we synthesize multiple measures of student academic progress to rate a teacher on Standard 7: Student Academic Progress?

  25. Decision Rules: Developed for Pilot Use Standard 7* * Subject to change ** SGPs can be considered a relative growth score in that it compares students across the state; Student Achievement Goal Setting can be considered an absolute measure in that it measures growth against a defined level. Handout Page 6

  26. Determining Goal Achievement What should we know to use student achievement goal setting in a teacher’s performance evaluation?

  27. Goal-Setting Process Step 3: Create and implement leadership and management strategies Step 4: Monitor progress through ongoing data collection Step 5: Determine whether students achieved the goal Step 1: Determine needs Step 2: Create specific learning goals using baseline data

  28. Baseline Data, Midyear Data, and End of Year Data: Teacher H Handout Pages 7-8

  29. Summary Goal Data For the evaluation year, 83% of students met or exceeded the goal. Handout Page 9

  30. Rating a Teacher’s Performance on Standard 7 Using Student Achievement Goal Setting • Exemplary • 50% or more students exceeded the goal with no more than10% not meeting the goal • Proficient • At least 80% of students met or exceeded the goal • Developing/ Needs Improvement • Less than 50% of students failed to meet the goal and 50% or more met or exceeded the goal • Unacceptable • More than 50% of students did not meet the goal

  31. Calculating Rating: Teacher H

  32. Evaluation Practice • Teacher W: Fourth-Grade Math Handout Pages 10-15

  33. Evaluation Practice • Teacher W: Fourth-Grade Math 8 32 8 32 36 9 Teacher W’s rating for Student Achievement Goal Setting is Developing/Needs Improvement Handout Page 16

  34. Student Growth Percentile Model What should we know when including student growth percentiles in a teacher’s performance evaluation?

  35. Student Growth Percentile Model Question Answered How much did Miguel improve from sixth-grade to seventh-grade relative to his academic peers (students with the same score in sixth-grade or similar achievement histories)?

  36. Student Growth Percentile Characteristics • Percentiles express the percentage of cases that fall below a certain score • SGPs are reported between 1 and 99. • Higher numbers represent higher growth and lower numbers represent lower growth. • Uncorrelated with prior achievement • Low achieving students can show high growth • High achieving students can show low growth

  37. Can students who perform at high levels have a negative achievement result? Lower than expected growth 400 350 300 250 200 Student A YES Student B Prior Score 3 years Prior Score 2 years Prior Score 1 year Current Score this year A student whose score drops from one year to the next could demonstrate moderate to high growth depending on the overall performance of the cohort.

  38. Can students who perform at low levels have a positive achievement result? 400 350 300 250 200 Student A Higher than expected growth YES Student B Prior Score 3 years Prior Score 2 years Prior Score 1 year Current Score this year A student whose score drops from one year to the next could demonstrate moderate to high growth depending on the overall performance of the cohort.

  39. Three Students with the Same SOL Scaled Scores on Grade 6 Reading

  40. Same Three Students - in Grade 7:SOL Scores Example only. Note that SGPs account for as much historical data as are available.

  41. Same Three Students - in Grade 7:SGP Calculations SGP = 18 SGP=48 SGP=61 Example only. Note that SGPs account for as much historical data as are available.

  42. What Do Percentiles Mean? 99th Percentile 99% of students with a similar achievement history scored lower Percentiles express the percentage of students that fall below a certain score 50th Percentile 50% of students with a similar achievement history scored lower 1% of students with a similar achievement history scored lower 1st Percentile

  43. What Do SGPs Compare? A Student Growth Percentile Compares the Student’s Current SOL Score with the Scores of Students throughout the State with Similar Score Histories.

  44. Student Growth Percentile Levels • To help interpret SGPs, VDOE established categorical growth levels of low, moderate, and high. These data are reported with the growth data for your division or school. • Low growth: students with SGPs of 1 - 34. • Moderate growth: students with SGPs of 35 - 65. • High growth: students with SGPs of 66 - 99. Reproduced from VDOE’s professional development on student growth percentiles, slide 6, http://www.doe.virginia.gov/testing/scoring/student_growth_percentiles/index.shtml#profdev.

  45. Steps for Using SGP Data in Performance Evaluation • Prepare and summarize data to show number and percent of students demonstrating low, moderate, and high growth, and students with missing data. • Determine whether you have sufficient data to use SGP in evaluation. • Determine information gained, including SGP contribution to annual performance rating, suggestions for professional development, and student learning needs.

  46. Prepare and Summarize SGP Data • Summarize annual data by content area and growth category. Include number (N) and percent of students taught who: • Demonstrated low, moderate, or high growth; and • N and percent with missing data • Include data for two or more years separately and into a single, aggregate group. • Disaggregate data into meaningful groups (e.g., by course/class or student groups) as appropriate. This step is particularly helpful for identifying educator strengths and areas for improvement.

  47. Determine Whether SGP Is Appropriate for Use in Teacher Performance Evaluation

  48. Determine Whether SGP Is Appropriate for Use in Teacher Performance Evaluation (1) *For assistance with Master Schedule Collection (MSC) or other data collections, please contact resultshelp@doe.virginia.gov. Handout Page 17

  49. Determine Whether SGP Is Appropriate for Use in Teacher Performance Evaluation (2) Handout Page 17

  50. Determine Whether SGP Is Appropriate for Use in Teacher Performance Evaluation (3) *Divisions interested in using a median growth percentile for performance evaluation must use caution when there are significant percentages of missing data. Median SGP is likely to misrepresent student progress when significant amounts of data are missing. VDOE guidance suggests median growth percentile be used ONLY when 90 percent or more of the students taught have SGP data. Handout Page 17

More Related