340 likes | 510 Views
National English Ability Test. Jin, Kyung-Ae (Korea Institute for Curriculum & Evaluation). 1. Backgrounds. A. Backgrounds. To enhance practical English education and improve students’ speaking and writing skills, various policies were adopted.
E N D
National English Ability Test Jin, Kyung-Ae (Korea Institute for Curriculum & Evaluation)
1. Backgrounds A. Backgrounds To enhance practical English education and improve students’ speaking and writing skills, various policies were adopted. National English Ability Test (NEAT) including speaking and writing as an substitute for the current College Scholastic Ability Test, which only measure reading and writing was proposed.
1. Backgrounds Establishment and announcement of innovative plans for English education: Nov., 2006 President’s election promise and a core governmental: Feb., 2008 Announce a new plan to develop a new national English ability test as an assessment reform effort to improve student English ability in speaking and writing for an “enhancement of practical English education.” Establishment and announcement of a basic plan to develop the NEAT : July, 2007 (For student user:Level 1) Provide national educational standards for English education aligned with the curriculum in elementary, middle, and high schools. (For general user:Level 2, 3) Substitute foreign tests being used for domestic purposes, assess four modalities in balance, and attempt to obtain international comparability. Introduce a new national English ability assessment emphasizing practical English skills as a substitute for the College Scholastic Ability Test.
1. Backgrounds B. Pre-tests ○NEAT pre-tests(’09.5~12) ※ 1st (33 schools, 4,300students) → 2nd(43schools, 5,300students) → 3rd(78schols, 10,600students) ○ Public Hearing for NEAT (’10.6) ○ NEAT pre-tests(’10.9~‘11.3) ※ 4th(34schools, 2,900 students) → 5th(169schools, 20,000students) → 66th (16schools, 1,900students) ○Final Public Hearing (‘11.5)
2. Goals and directions Students will acquire basic communicative skills through high school education Goals Students will select either NEAT Level 2 or Level based on their aptitude and future career Level 2: basic academic English Level 3: practical English ▪ To align the contents of NEAT with the National curriculum to reform school education Provide teacher training programs with regard to the new test Directions
3. Test Development A. Target System Target System Number of examinees and the tests: 120,000 and 24tests( two opportunities per students, 50,000 students simultaneous test Secure item writers and raters: 5,000 secondary teachers IBT system: Headquarter, 1,700 IBT test center( ‘11~’13) Organization: 75 personnel
3. Test Development B. Timetable
3. Test Development C. Development Policy Develop the test specifications for Level 2(Basic Academic English)and Level 3(Practical English) - New English Curriculum (2009 revision) is being developed aligned with NEAT ※ New curriculum : ’11,8 notification → ’11,9 textbook development →’13Applied inhigh school1st year → ’15 NEAT application for college entrance
3. Test Development <Key Characteristics> Level 2 Level 3 • Require the degree of English proficiency necessary for college or university classes. • Focus on basic and practical English ability. Objective ▪ No grammar items ▪Focus on communicative skills ▪ Topics on Practical English: everyday life, work ▪ No grammar items ▪Focus on communicative skills ▪ Topics on Basic Academic English Characteristics • 3000 words • 2000 words Vocabulary Alignment with curriculum • English I & II, English reading comprehension & writing, Advanced English conversation • General English, and • Practical English conversation
3. Test Development A. Format In listening and reading domains, anchor items for test equating are included Number of Items & Test period Level 2Level 3Test period 35min Listening Reading 60min Test Domains Speaking 15min Writing 35min 35 35 145min Total 35 35 4 4 2 4 76 78
3. Test Development B. Topics : Practical English
3. Test Development B. Topics : Basic Academic English
3. Test Development A. Test objectives: Reading
3. Test Development B. Behavioral Domain: Reading & Listening ◦ More inferential and comprehensive understanding items in Level 2 than Level 3 ◦ More literal understanding items in Level 3
3. Test Development C. Number of Words (Listening)
3. Test Development D. Number of Words (Reading)
3. Test Development E. Item Types ◦ Various charts, pictures, graphs and realia are adopted to enhance authenticity of the testand align with the curriculum and textbooks (1) Listening
3. Test Development (2) Reading
3. Test Development (3) Speaking (4) Writing
쓰기 Ⅰ. 국가영어능력평가시험 개발 방안
쓰기 Ⅰ. 국가영어능력평가시험 개발 방안
4. IBT System A. Cloud Computing IBT System • Setting up VDI(Virtual Desktop Infrastructure) at the Central Center • The students log in on their monitor and take the test at the test center • 3) The client in the test center down loads the test items and uploads the answers • 4) Minimize effect of PC environment for providing equivalent test environment
4. IBT System Ⅱ. 시험 시행 방식 B. Test Center
5. Score Report Score Report: Provide performance level for listening, reading, speaking and writing • 1)Criterion-referenced test • Excellent, Average, Basic and Below Basic • Standard Setting (Bookmark Method) • 2) Test equating • Students’ scores of different tests are equated • non-equivalentgroup design with external anchor items
2. Conclusions A. Survey (2009, Jin et al.) With 500 respondents, 62.1% said NEAT will enhance students’ speaking and writing ability 62.1% 75% 68% 61.4% 54% (English Education Specialists: 75%, Non-English Teachers: 68%, Parents: 61.4%, English Teachers: 54%)
2. Conclusions B. Evaluation of English Education Policy(2010, Kim, Jeon, Woo & Jin) 67.8% agree to adopt NEAT 72.5% of parents expect innovation of speaking and writing instruction at school 65.92% of parents expect that students will speak and write English better 72.5% 67.8% 65.92%
6. Conclusions Enhance students’ speaking and writing skills in addition to listening and reading through adopting NEAT Students can select different tests (Level 2 or Level 3) based on their future career and aptitude Through criterion-referenced test, the students can have clear performance objectives Positive wash back effect on school English education NEAT