80 likes | 90 Views
BILC STANAG 6001 Testing Workshop Kranjska Gora, 2018. Successful trialling : from trial and error to best practices. Roadmap to a validity argument. Test purpose :
E N D
BILC STANAG 6001 TestingWorkshop Kranjska Gora, 2018 Successfultrialling: fromtrialanderror to bestpractices
Roadmap to a validity argument Test purpose: To assess and communicate an individual’s unrehearsed, general language communication ability and proficiency level for the purpose of interoperability within NATO.
TRIALLING PILOTINGPRE-TESTING Trialling/ piloting / pre-testing
Trialling from test validation point of view The role of the language tester is to collect evidence to support test use and interpretation that a larger community – the stakeholders (students, testers, teachers and society) – accept. (Fulcher, Davidson, 18, 2007)
The language tester cannot point to facts and claim a test valid. There are many possible interpretations of facts. What he or she has to do is create an argument that best explains the facts available. (Fulcher, Davidson, 18, 2007) What is evidence?
Which facts can trialling help collectand which arguments can trialling help build? How do wecreate a validity argument?
Appropriate population Administration Test format Statistical (quantitative) analyses Qualitative analysis Challenges…