Review of Cut Scores and Conversion Tables ( Angoff Method)

1. Review of Cut Scores and Conversion Tables(Angoff Method)

2. Scoring GuidesReliable Scoring • Scoring guides should clearly indicate the level and point value of each item on the assessment. • Scoring guides should provide clear guidance on how to assign points to a student response on an assessment item. Scoring guides allow different teachers to assign the same score for the same level of performance on an assessment – Reliability

3. The Angoff Method to Create Conversion Tables • The Angoff Method is a research-based process used to establish cut scores corresponding to each level of proficiency • A cut-score is the lowest possible raw score that will result in a particular proficiency level • A cut-score is used to establish the range of raw scores at each proficiency level

4. Conversion TablesEstablish Cut-Scores Level 2 Problems – Level 2, 3 and 4 students should get these questions correct. 7 7 7

5. Conversion TablesEstablish Cut-Scores Level 3 Problems – Level 3 and 4 students should get these questions correct. 9 5 - 7 9

6. Conversion TablesEstablish Cut-Scores Level 4 Problems – Level 4 students should get these questions correct.

7. Conversion Tables: Establish Cut-Scores Add up the total number of points you would expect a Level 2, Level 3, and Level 4 student to receive. 7 16 0 7 17 19

8. Conversion TablesEstablish Cut-Scores for the Half Points • Cut scores represent the lowest score at a specific level • To achieve a score of 1.5, 2.5 or 3.5 students must demonstrate at least half of the learning of the next level • Cut scores for half points are the nearest whole number that is at least half way between the cut-scores for Levels 2, 3, and 4

9. The Angoff MethodDetermine Cut-Scores for Levels 1.5, 2.5 and 3.5 18 12 4 4 12 18 0 0 7 7 16 16 19 19

10. The Angoff MethodDetermine Cut-Scores for Levels 1.5, 2.5 and 3.5 Fill in the raw score range for each Proficiency Level. The conversion table is now complete. 4-6 12-15 18 4 12 18 19 0 7 7-11 16 16-17 19 0-3

11. Conversion TableYour Turn • Create the Conversion Table for the assessment you took at the beginning of the class. ANSWER: 1 5-6 9 10 2-4 7-8 0

12. Best Practices in Assessment • Stay focused on standards and proficiency scales to level assessments. Leveled assessments by design assess the standard. • When modifying an existing assessment, follow the SEA Method for developing a leveled assessment tied to a proficiency scale. • To assess student learning and achievement of the standard, make sure you have the bulk of the questions at Level 3 (the standard), with some questions at Level 2 and some questions at Level 4. Leveled assessments by design assess a full range of levels of proficiency on a standard. • To convert raw scores into cut scores on scoring guides, use the Angoff Method.

13. Resources This Excel spreadsheet that will help you create a conversion table using cut scores. If you enter the number of possible points for each level (2, 3, and 4) it will calculate the conversion table for you! ***This spreadsheet is on the RMS portal under Standards-Based Grading