70 likes | 157 Views
TIMSS 2007 Field Test Instruments Translation and Verification Summary. International Association for the Evaluation of Educational Achievement. Scope of verification. 56 Educational Systems 36 Languages Most popular: English (11) and Arabic (12).
E N D
TIMSS 2007Field Test Instruments Translation and VerificationSummary International Association for the Evaluation of Educational Achievement
Scope of verification 56 Educational Systems 36 Languages Most popular: English (11) and Arabic (12)
Completeness of materials for verification Majority of countries submitted completed materials 1 country didn’t submit questionnaires
Timeline • 17 countries submitted materials before the end of January • 32 countries submitted materials in February 7 countries submitted materials in March
Quality of translation/adaptations Overall very good quality! The best performance ( timing completeness of materials quality of translation): CHINESE TAIPEI, HUNGARY, IRAN
Evaluation of procedures • Separate verification of translation/cultural adaptations and layout Verification of the World/RTF materials: • SFTP server for the country’s up- and down-loaded procedures • Recommendation for the main study: format needs to be changed but (preferably) ‘track changes/insert comments’ options should be used!
Evaluation of translation to Arabic • Countries’ opinion: countries criticizedgeneric translation but 5 countries didn’t introduced any adaptations • Adaptations introduced by some countries: names, product labels, etc. terminology language convention(writing formulas, diglossia, influences) Verifiers’ opinion: some problems with terminology approx. 15% of adaptations were criticized by verifiers • Recommendation for the main study: More detailed instruction on necessary adaptations would be helpful!