1 / 24

The New SHAPE Listening & Reading Tests OR HOW DID THEY DO THAT?!

The New SHAPE Listening & Reading Tests OR HOW DID THEY DO THAT?!. Michael Adubato SHAPE Language Testing Centre Belgium. GERMANY 5 – 3 SWEDEN Friends Arena, Stockholm 16 October 2013. Designing tests for SHAPE – a true learning process. University of Westminster. Aim.

blaine-harrington
Download Presentation

The New SHAPE Listening & Reading Tests OR HOW DID THEY DO THAT?!

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. BILC Seminar – Stockholm, Sweden October 2013 The New SHAPE Listening & Reading Tests OR HOW DID THEY DO THAT?! Michael Adubato SHAPE Language Testing Centre Belgium

  2. GERMANY 5 – 3 SWEDENFriends Arena, Stockholm16 October 2013

  3. Designing tests for SHAPE – a true learning process University of Westminster

  4. Aim To explain the challenges we faced designing the Listening and Reading tests and how we overcame them.

  5. The Format – Listening and Reading SLP 2: 20 x passages 20 x MCQ SLP 3: ? x passages 20 x MCQ SLP 4: ? x passages 20 x MCQ/ SA SLP 3 – 4 Listening: 75 mins Reading: 120 mins SLP 2 – 3 Listening: 60 mins Reading: 90 mins

  6. Factors affecting Passage Length Listening: Speed per level Rubric Orientation message Time to complete MCQ Required test length Reading Reading speed per level Types of reading: skim/ scam/ read for detail Required test length

  7. Validity English Genres Contexts

  8. Sample from Examination Schematic

  9. Creating the texts………

  10. Which factors affect the complexity of a text? • Criteria eg STANAG or CEFR • Task focus • Grammar • Lexis • Sentence length • Density of text/passage • Speed (listening) • Interference (listening) • Level of inference

  11. Task Foci Answer who, what, when questions Distinguish fact from rumour or hearsay Recognise author's intentions Answer how and why questions Recognise attitudes and emotions of the writer Outline the development of an argument

  12. Order tasks Undertake TNA Produce Schematic Writing and Setting Process Train writers Select final writers Select writers Scrutinise in-office Allocate test items to writers Initial draft Allocate items to writers Scrutinise in-office Writer edits Internal Setting Internal Setting Board Writer edits Pilot and adjust In-house edits Pilot papers Produce paper

  13. Recording

  14. Why do people offer to sit a pilot examination? Joy For a reward To please others They have no reason to do so

  15. Piloting Exam Paper in the UK

  16. Piloting the paper overseas SLP 2/3/4??

  17. What did SPSS do for us? (Remember, items increase in difficulty throughout each level of the test.) Enabled us to see how many people answered a question with a, b, c or d.

  18. Pre-test questionnaires • Gender • Nationality • Language level (variation required) • Educational level

  19. Demonstration of Paper C Spreadsheet NOT shown!If you’re interested in this, I can provide you with a copy…

  20. Questions?

More Related