1 / 6

8. Standardization

RELANG Relating language examinations to the common European reference levels of language proficiency: promoting quality assurance in education and facilitating mobility. 8. Standardization

clarke
Download Presentation

8. Standardization

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. RELANGRelating language examinations to the common European reference levels of language proficiency: promoting quality assurance in education and facilitating mobility 8. Standardization European Centre for Modern Languages and European Commission cooperation on INNOVATIVE METHODOLOGIES AND ASSESSMENT IN LANGUAGE LEARNING

  2. LinkingProcedures in the Manual • Familiarisation with the CEFR • Linking on the basis of specification of examination content • Standardization and Benchmarking • Standard setting • Validation: checking that exam results relate to CEFR levels as intended

  3. Claims through Specification and Standardization • If a claim of a link to the CEFR is based on specificationonly, we do not know what score a candidate needs to claim that the candidate’s ability is at the CEFR-level the test claims to be at. • Claims can be further substantiated through standardisation of judgements: item-difficulties are judged in relation to CEFR levels.

  4. Steps in the standardization phase • Assuring adequate familiarisation with the CEFR. • Training in rating productive skills using tables and scales in the CEFR or the Manual & scales or specific rating scales • Training in rating receptive tasks using tables in the Manual & specifications developed for the examinations or tests in question • Benchmarking performance samples • Standard setting of receptive tasks

  5. Group Decisions • Both benchmarking and standard setting are procedures which require group decisions, which in turn have to be carefully prepared by appropriate training.

  6. Benchmarking in Direct Tests • In holistically rated tests, the judgment on the CEFR level is direct, and therefore it is important to assist raters in giving valid judgments. The main tool used for this special type of standard setting is called benchmarking. • Benchmarking involves providing one (or more) typical sample(s) to illustrate performance at a given level both for standardisation training and to serve as a point of reference in making future decisions about performances of candidates.

More Related