1 / 20

G rade S core M arking 2013

G rade S core M arking 2013. Purpose. To improve discrimination between grade levels in NCEA external examinations. Research. From 2006-2009 research was carried out to compare grades awarded by the ‘old’ system with grades awarded using aggregated marking.

dixon
Download Presentation

G rade S core M arking 2013

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. GradeScore Marking2013

  2. Purpose To improve discrimination between grade levels in NCEA external examinations.

  3. Research • From 2006-2009 research was carried out to compare grades awarded by the ‘old’ system with grades awarded using aggregated marking. • In 2010 a live pilot was carried out to test the feasibility of using GSM (then called MEA) for 12 examination papers.

  4. Results of trials • Results showed improved correlation between ability (based on performance in other standards) and grades awarded. • Markers thought score-based marking was easier for them to use AND gave valid results for students.

  5. Grade Score Marking What’s new for markers?

  6. The Process • The schedule is written with grades and numbers (examiner). • Question benchmarking (panel leader). • Panel meeting and marker training. • Marking questions (N2, M5 etc). • Aggregation of question scores to give a total score. • Final cut scores for grades are determined in a judgement meeting with a focus on grade boundaries in the standard (panel leader and checkmarker).

  7. Schedules • For 2013, assessment schedules have been written for the marking round as grades AND scores. • Each grade for a question has been divided into high and low and the marking criteria established for the new scores that sit alongside the grades.

  8. Grades and matching scores

  9. Panel leader and checkmarker • Usual marking procedures (benchmarking, panel meeting and check marking) will be used. • There will be an additional meeting of the panel leader and check marker to determine cut scores for the final grades.

  10. Prior to marker meeting • Panel leaders and check markers will mark at least a days’ marking. • The resulting total scores will be checked to ensure the cut score for each boundary accurately reflects the grade appropriate for the standard. • Panel leaders will confirm that the large majority of scripts around each cut score satisfy the requirements of the standard.

  11. Marking the papers • The marking process is standards based with scores being used to aggregate the grades. • Scores from questions are added to give a total score for the paper. • Markers write only scores on the cover of the examination booklet. • The final standard checking (cut score setting) phase is the judgement of performance against the standard.

  12. Setting the Cut Score • Put all the papers in piles in total score order (not all scores need to be represented) • Independently (PL & CM) decide on cut scores for N/A, A/M and M/E boundaries using the standard • Compare and confirm recommended cut scores.

  13. Finalising cut score • The cut score will not be confirmed until marking is almost complete AND marking is consistent.

  14. Who decides? The cut score will be finally determined by: • the standard • the panel leader and checkmarker (or senior marker) • the NAF (National Assessment Facilitator) • NZQA measurement experts

  15. Re-marking • As always any major problem in marking could result in a re-mark. • This will only occur with approval of the Manager, Secondary Examinations. • A re-mark could occur if a problem arises in the result profile in November/December. • A re-mark could occur in January.

  16. Potential Misclassifications • We believe using score-based marking will result in increased accuracy of grade classification. • This means it should produce the best possible outcomes for standards based assessment by examination.

  17. Results • Markers will write only the total score on the front of the paper. • The cut-score will be entered into the results database by the NAF, after consultation with the Senior Markers and NZQA staff. • The correct grade will be computer generated for the online result notice.

  18. Results • The online result notice will show only the grade N, A, M, E. • The judgement statements on the web will show candidates the cut scores for each standard so they can check their grade is correct.

  19. Projected benefits • Greater accuracy in grade determination • Fairer to students • More transparency • Reduction in year-by-year variability leading to diminished need for PEPs in the longer term. (PEPs are profiles of expected performance; they are currently used to limit extreme and unfair variability in results) • Closer alignment of marking to the standard.

  20. Thank you!

More Related