1 / 19

STANAG 6001 Testing Workshop 4-6 September 2018 Kranjska Gora, Slovenia

STANAG 6001 Testing Workshop 4-6 September 2018 Kranjska Gora, Slovenia. BILC Update Sept 2017 – Sept 2018. Bureau for International Language Co-ordination. NATO’s consultative and advisory body for language training and testing issues. Main responsibility: custodian of STANAG 6001

proe
Download Presentation

STANAG 6001 Testing Workshop 4-6 September 2018 Kranjska Gora, Slovenia

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. STANAG 6001 Testing Workshop4-6 September 2018Kranjska Gora, Slovenia BILC Update Sept 2017 – Sept 2018 by Emilija Nesheva,BILC Secretary

  2. Bureau for International Language Co-ordination • NATO’s consultative and advisory body for language training and testing issues. • Main responsibility: custodian of STANAG 6001 • Community of language teaching/testing professionals from MoDs and defense-sponsored organizations. • Mission: To promote and foster interoperability among NATO and Partner nations by furthering standardization of language training and testing. To support the Alliance's operations through the exchange of knowledge and best practices, IAW established procedures and agreements. • Vision: To achieve levels of excellence where progress made by one is shared by all. • Purpose: To foster cooperative professional support among BILC member nations and to extend support to NATO within the field of language training and education and language assessment. • Active participation in BILC activities from 26 NATO nations and 15 Partner nations.

  3. BILC Steering Committee Chair Col. (ret.) Trayko Stoykov GBR (1966-1981) DEU (1982-1996) USA (1997-2008) CAN (2008-2014) USA (2014-2016) BGR (2016-2019) Senior Advisor Dr. Ray Clifford Secretary Emilija Nesheva Secretary Col. Petko Petkov Associate Secretaries Jana Vasilj-Begovic Julie Dubeau Keith Wert Peggy Garza

  4. Major BILC Events • BILC Annual Conference in May; • BILC STANAG 6001 Testing Workshop in September; • BILC Professional Seminar in October.

  5. 2017 STANAG 6001 Testing WorkshopSkopje, 5-7 September, 2017 SETTING THE STAGE FOR TESTER SUCCESS Sub-themes: - Selecting and training new testers - Determining job qualifications for new testers - Norming and re-norming testers to limit “drift” - Integrating new testers into test development teams - Improving testing team dynamics - Designing training for speaking test interviewers and raters - Training proctors and invigilators for standardized test administration - Defining and observing best practices in testing - Improving inter/intra-reliability - Familiarizing teachers and students with the testing policy/directive/test format - Managing stakeholders’ expectations - Developing and documenting professional development plans for testers

  6. 2017 BILC Professional Seminar, Tbilisi, 02-05 October, 2017 PAVING THE ROAD TO THE STANDARDIZATION OF TRAINING AND TESTING: LESSONS-LEARNEDSub-themes: • Using STANAG 6001 as the blueprint for language training/testing • Making the leap from Level 2 to Level 3 • Effective strategies for teaching at L3 • Challenges of teaching the skill of writing • Designing national tests to correlate with the BAT • The benefits and challenges of standardization • Setting and meeting the standards • Is your Level 3 my Level 3? • NATO jobs and language proficiency requirements • Dealing with internal pressures to lower the standards

  7. 2018 BILC ConferenceLisbon, 20-24 May 2018 Theme: “Invigorating Training through Technological Tools” Sub-topics: - Measuring success rates before and after the use of technology - The science behind language learning - Using technology to modernize testing - Technology as a tool of teacher/student empowerment - Does technology provide us with shortcuts to language learning success? - Gaming as a learning tool - Enhancing teacher training to match current expectations - Effective language maintenance tools - Social media and project-oriented, computer assisted language learning - Incorporating translation technology in the classroom Study Groups Topics: - Familiarization with STANAG 6001 for Non-Specialists - STANAG 6001 Handbook for Curriculum Development - Revision of the Tri-Service Word and Terminology List - Enhancing Teaching of the Writing Skill for NATO Staff Officers - Distance Learning Enhanced by Technology

  8. BILC Cooperative Visits (September 2017 – August 2018) • Azerbaijan, September 2017 • Jordan, October 2017

  9. Cooperation between BILC and Defence Education Enhancement Programme (DEEP)

  10. BILC’s Professional Development Programme in Partnership Cooperation Menu (PCM. i. e. ACT-sponsoured BILC courses) • 1. Language Testing Seminars (conducted at PLTCE): • Language Testing Seminar, ACT.647, 2 weeks; • Advanced Language Testing Seminar, ACT.658, 3 weeks; • Language Standards and Assessment, ACT.648, 2 weeks. • 2. BILC Methodology Workshops • English Teaching Faculty Development Workshop “Teaching Speaking and Writing for Military Purposes”, ACT.659, 2 weeks. Conducted at 3 PTECs PLTCE, Bulgaria and Slovenia. Facilitators: BILC teaching & testing experts from 24 nations.

  11. PLTCE sponsored courses • IRT Workshop - introduction to IRT concepts and the advantages of using Rasch IRT analysis • Applied Consecutive Interpretation Techniques (ACIT) Workshop focuses on the development of skills essential to the task of effective interpreting including: event preparation, memory and comprehension, note taking, and handling linguistic and ethical challenges assertively.

  12. Recent BILC Working Groups’ activities Level 4 WG formed in 2010 WG Military Terminology and Translation formed in 2011 This list was compiled by the members of Study Group that met during the BILC annual conference in Tbilisi, Georgia in May 2013. Under the leadership of Austria their work was completed through online correspondence. • - Paper: “NATO STANAG 6001 Level 4 Language Proficiency – A Conceptual Model and Implications for Testing” (April 2013) • - Article “Defining and Assessing STANAG 6001 Level 4 Language Proficiency” (Chapter 10, Language in Uniform, Cambridge Scholars, 2015) • - Level 4 Reading Test Specifications • Tutorial (principles of text rating, differences • btw Level 3 and Level 4 texts, sample texts, • sample test development procedure, etc.) • Level 4 Test Prototype (Tester and • Examinee Booklets for speaking/writing • modality; administration and rating procedure) • - Test Familiarization Guide • Feedback Questionnaire • L4 Reading Familiarization Workshop

  13. Recent BILC Working Groups’ activities Portability and Recognition of STANAG 6001 Certificates WG formed in 2016 Familiarizationwith STANAG 6001 for Non-Specialists WG formed in 2018 Non-language specialists in NATO staff positions should be familiar with STANAG 6001 language proficiency levels in order to make informed decisions about SLPs and other matters relating to languages such as establishing policy on linguistic interoperability, determining capability targets for languages, and using English as an operational language within NATO, etc. While the STANAG 6001 Overview for Non-Specialists and the full STANAG 6001 descriptors can be used as in promoting a common understanding and interpretation of the descriptors, it has become evident that non-specialists making these decisions remain uninformed. The goals of the WG are to: propose a prototype e-learning module building on the existing BILC documents that will include samples of language at each proficiency level and explanations; explore ways to make the Familiarization with the STANAG 6001 for Non-Specialists module readily available as a practical resource for non-specialists. - Improving recognition of STANAG 6001 certificates both within the militaries as well as by civilian institutions - Exploring more standardization of STANAG 6001 certificates across nations - Rendering to non-specialists the complexities of comparing the STANAG 6001 criterion referenced tests to other types of language tests - Four BILC policy recommendation documents developed and published on the BILC website: • BILC Policy Recommendation on Essential Information for STANAG 6001 Test Certificates • BILC Policy Recommendation on the Acceptance of Commercial STANAG 6001 Certificates • BILC Policy Recommendation on the Longevity of STANAG 6001 Language Certificates • BILC Policy Recommendation on the Portability of STANAG 6001 Language Certifications

  14. Benchmark Advisory Test (BAT) Initiative History of BAT – started in 2003 at the BILC Conference in Harrogate. • Purpose: to provide an external measure against which nations can compare their national STANAG 6001 test results and to standardize testing across the nations. • 8 nations collaborated on the BAT development. • Contract awarded by NATO for the BAT delivery to ACTFL. • In 2009, 11 NATO nations participated, with up to 20 tests each . Proposed a possible resurrection of the BAT after the 2016 BILC Conference in Riga - Evidence for the Validity Roadmap (Brno, Sept 2016); - Discussed by the WG on Portability and Recognition of STANAG 6001 Certificates (Bled, Sept 2016); - Survey of interest by BILC Secretary (fall 2017) - 21 nations responded favorably. - This year two BAT Writing&Speaking Forums took place (9-13 July and 6-10 August 2018) at PLTCE, Garmisch Partenkirhen. Participants are encouraged to receive certification as BAT interlocutors/raters. - The certification process will begin a month after the forums. - BAT 2

  15. BILC SharP

  16. BILC site

  17. Questions? Contacts: • BILC site https://natobilc.org • Email chairman@natobilc.org • My office telephone +359 2 92 21035 • My service mobile phone +359 889 803 732

More Related