320 likes | 438 Views
Aligning levels to the European Framework. The Origó Experience Budapest, February 2006. The number of ORIGÓ exams in 2005 (oral and written): 108 401. ITK ORIGÓ. The number of languages : 29 Arabic, Beás- Romani, Bulgarian, Chinese, Croatian, Czech, English, Danish,
E N D
Aligning levels to the European Framework The Origó Experience Budapest, February 2006
The number of ORIGÓ exams in 2005 (oral and written): 108 401
ITK ORIGÓ • The number of languages:29 • Arabic, Beás- Romani, Bulgarian, Chinese, Croatian, Czech, English, Danish, • Esperanto, Finnish, French, German, Hebrew, Hungarian, Italian, • Latin, Lovari-Romani, Modern-Greek, Old-Greek, Polish, Portugese, • Romanian, Russian, Serb, Spanish, Slovakian, Slovenian, Swedish, Turkish • 2 testing systems: • Hungarian as a Foreign Language -ALTE-membership
The number of exam centres: 70 - accredited/registered
69% 49% Oral Written Pass rate 2005
female male 36% 64% Population characteristics: age and sex 2005 8000 7000 férfi nő 6000 5000 4000 3000 2000 1000 0 14 21 28 35 42 49 56
Candidates • The oldest: 1935. 06. 23., female - Basic German, C, Pass • The youngest: 1991.12. 14., female - Basic German, A, Passed • Maximum performance (oral): 62 candidates 100%: English, Arabic, German, Esperanto, Latin, Hungarian, Russian, Italian, Rumanian, Spanish, Serb, Slovakian, Modern-Greek, Hebrew - Basic-, Intermediate-, Advanced levels • Maximum performance (written): 9 candidates 100%: Basic English- (5), Basic Hungarian-, Intermediate Italian-, Basic Spanish-, Basic Modern-Greek
The Hungarian context • the law 1st September, 2006 • the Accreditation Board July, 2006 • the Matura - one-way equivalence • international consensus? • levels?
Schedule • familiarization - scales • specification - documentation • standardization - scales, calibrated samples • empirical validation - calibrated samples, level setting
Origó - Previous experience • level setting - empirical alinging Rigó and international exams (ESU framework, Goethe) • quality control procedures • accreditation (1999)
Origó - work accomplished • schedule • familiarisation (exam developers) • specification - modifications in Origó scales suggestions for other modifications • familiarisation - all oral examiners
Origó - work to follow: • familiarisation - item writers, markers (written exams) • benchmarking - sample materials (exam developers) • standardisation - all examiners • empirical validation - major languages
Origó - benefits • positive working experience (CEFR) • useful guidelines (Manual) • useful discussions (awareness raising) • useful modifications
Origó - problem areas • terminology • translation problems • advanced (C1)/proficiency (C2) levels • availability of sample reference materials • mediation
Terminology„claims” • linking • relating • harmonizing • aligning • level setting
Translation problems • „claim” • „a degree of spontaneity and fluency”
Levels Proficiency (C2) Advanced (C1)
Difficulties with sample materials videos in English (Eurocentre, Cambridge) quality (copy of a copy) accents (international) levels
Jihun B2 / intermediate near pass at level good pass
Estelle B2- / intermediate good basic weak interm. interm.
Renate - / B1 B1 B2
Annemarie - / C1 B2 C1
Evgeny C1 / Proficiency good interm. weak prof. prof.
Interpretation of data IRT information - Eurocentre - Dialang, Cambridge, Finnish Matriculation not enough background info for reproduction no measuring instruments attached
Origó - Mediation • major difficulty: no CEFR scales • no Council of Europe sample materials • external validation? • accreditation?