1 / 36

Understanding NSC Standardisation: Processes, Principles, and Outcomes

This presentation discusses the standardisation decisions made for the release of the 2010 NSC results, providing insights into the context, principles, approaches, and processes adopted by Umalusi, the Council for Quality Assurance in General and Further Education and Training.

lelaf
Download Presentation

Understanding NSC Standardisation: Processes, Principles, and Outcomes

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Release of the 2010 Standardisation DecisionsPresentation to Portfolio Committee on Basic Education15 March 2011

  2. WHAT CAN WE LEARN FROM THE NSC RESULTS? Context, principles, approaches and processes Dr Sizwe Mabizela – Chair of Council

  3. Reasons for Disclosure • Unprecedented interest in the role of Umalusi • Uninformed comments • Credibility of the NSC • Credibility of Umalusi

  4. Legal Mandate • Chapter 2A of GENFETQA Act 58 of 2001 (as amended in 2008)

  5. Section17 of the GENFETQA Act • (1) The Council must assure the quality of assessment at exit points • (2)(a) The Council must develop policy for the accreditation of assessment bodies other than departments of education and must submit it to the Minister for approval • (b) The Minister must make regulations in which the policy for accreditation is set out • (c) The Council must accredit an assessment body in accordance with the regulations contemplated in paragraph (b) • (3) The Council must perform the external moderation of assessment of all assessment bodies and education institutions • (4) The Council may adjust raw marks during the standardisation process.

  6. Section17 of the GENFETQA Act • (5) The Council must, with the concurrence of the Director-General and • after consultation with the relevant assessment body or education • institution, approve the publication of the results of learners if the • Council is satisfied that the assessment body or education institution • has— • (i) conducted the assessment free from any irregularity that may • jeopardise the integrity of the assessment or its outcomes; • (ii) complied with the requirements prescribed by the Council for • conducting assessments; • (iii) applied the standards prescribed by the Council which a learner is • required to comply with in order to obtain a certificate; and • (iv) complied with every other condition determined by the Council. • (6) The Council must issue certificates to learners who have achieved qualifications or part qualifications

  7. Processes and procedures in quality assuring the NSC examinations • External Moderation and approval of question papers • Monitoring the “State of readiness” • Monitoring of the administration and conduct of examinations • Verification of marking • Monitoring the capture of examination marks • Standardisation

  8. Why Umalusi standardises results, and how • Provision of GENFETQA – Council may adjust raw marks. • International practice – large scale assessment systems • Standardisation – process used to mitigate the effect of factors other than learners knowledge and aptitude on the learners performance. • Sources of variability – difficulty in question paper, undetected errors, learner interpretation of questions

  9. Objectives for Standardisation • To ensure that a cohort of learners is not advantaged or disadvantaged by extraneous factors other than their knowledge of the subject, abilities and their aptitude. • To achieve comparability and consistency from one year to the next.

  10. Process for Standardisation • Continuation of JMB and SAFCERT model • Assessment Standards Committee • Qualitative Reports • Standardisation booklets (data) • Subjects are standardised individually, in a linear and non- iterative manner

  11. General principles applied in the standardisation of examination marks • 1. In general no adjustment should exceed 10% or the historical average. • 2. Adjustments in excess of 10% could be considered at the upper end to increase the number of distinctions in a subject. • 3. In the case of the individual candidate, the adjustment effected should not exceed 50%of the raw mark obtained by the candidate. • 4. If the distribution of the raw marks is below the historical average, the marks may be adjusted upwards subject to the limitations.

  12. General principles applied in the standardisation of examination marks (cont.) • 5. If the distribution of the raw marks is above the historical average, the marks may be adjusted downwards subject to the limitations. • 6. The computer adjusted mark is calculated based on these principles. • 7. For those subjects with a practical component of 50%, raw marks could be accepted. • 8. Umalusi however retains the right to amend these principles where and when deemed to be necessary based on sound educational principles.

  13. Specific issues / debates • Does Umalusi meet with government and look at the pass rates on raw exam marks? • Does Umalusi adjust marks to achieve a particular pass rate? • Is Umalusi subjected to political pressure to achieve a particular pass rate?

  14. WHAT CAN WE LEARN FROM THE NSC RESULTS? STANDARDISATION DECISIONS ERCO NSC 2010

  15. WHAT CAN WE LEARN FROM THE NSC RESULTS? STANDARDISATION DECISIONS IEB NSC 2010

  16. WHAT CAN WE LEARN FROM THE NSC RESULTS? STANDARDISATION DECISIONS DBE NSC 2010

More Related