1 / 40

Briefing Session on the 2012 HKDSE English Language Assessment Framework

Briefing Session on the 2012 HKDSE English Language Assessment Framework. March 2008. Background. Third consultation conducted in late 2006 New public assessment of HKCEE English Language first implemented in 2007 Further consultation in the light of the 2007 HKCEE experience

jacob
Download Presentation

Briefing Session on the 2012 HKDSE English Language Assessment Framework

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Briefing Session on the 2012 HKDSE English LanguageAssessment Framework March 2008

  2. Background • Third consultation conducted in late 2006 • New public assessment of HKCEE English Language first implemented in 2007 • Further consultation in the light of the 2007 HKCEE experience • Questionnaire survey conducted in January 2008

  3. 2007 HKCEE Experience

  4. SBA Implementation Schedule

  5. Implementation of SBA in 2007

  6. Moderation Results of Option 1 Schools

  7. Moderation Results of Option 1 Schools

  8. Moderation Effect on Candidates

  9. Implication of Moderation Results • Mean and spread of the SBA marks submitted by the majority of schools fall within the expected range • Most teachers have a good understanding of the assessment criteria and can assess their students accurately • Reliability of SBA not an issue • Fairness ensured by statistical moderation

  10. Absentee Rate of School Candidates in 1996 CE English Language Speaking Exam

  11. Absentee Rate of School Candidates in 2007 CE English Language Speaking Exam

  12. Possible Explanations • Students in “Yes” and “Trial” schools had more speaking practice in school because of the SBA • They became more confident with the public exam format, which involves similar speaking tasks – group discussion and individual response • Positive backwash effect of the SBA on the ability to speak English and to interact with peers in different contexts.

  13. Effect of SBA on Speaking Exam

  14. Effect of SBA on Speaking Exam • Students in “Yes” schools got higher marks in the SBA than in the speaking exam • Students in “Yes” and “Trial” schools got higher marks in the public speaking exam than those in “No” schools • BUT “Yes” and “Trial” schools may just be better schools

  15. Effect of SBA on Speaking Exam

  16. Effect of SBA on Speaking Exam • Students in “Yes” schools did better than expected based on prediction from written papers (+0.25) • Students in “Trial” schools did slightly better than expected (+0.03) • Students in “No” schools did significantlyworse than expected in the speaking exam (-0.35)

  17. Congeneric Measures Model Analysis • Strong evidence that the various components are measuring a single underlying ability • Reliability of components .882 to .702 • R > L&IS > W > SBA > S • SBA (.753) more reliable than speaking exam (.702)

  18. Inter-paper correlationsCorrelation Matrix (by listwise case exclusion, N=28,253)

  19. Survey Results

  20. Main focus of questionnaire • Assessment of the modules in the Elective Part • Replacing the speaking exam with SBA • The need for strategic implementation of SBA in 2012 HKDSE • Teachers’ satisfaction with the level of support provided by the HKEAA and the EDB

  21. Results: Response Rate

  22. Results • Responses measured on 6-point scale • 3.5 adopted as minimum level of acceptability

  23. Assessment of the Modules in the Elective Part

  24. Assessment of the Modules in the Elective Part

  25. Replacing the Speaking Exam with SBA

  26. Teachers’ satisfaction with level of support provided by HKEAA and EDB (1)

  27. Teachers’ satisfaction with level of support provided by HKEAA and EDB (2)

  28. Teachers’ satisfaction with level of support provided by HKEAA and EDB (3)

  29. Need for Strategic Implementation of SBA in 2012 HKDSE

  30. Respondents’ comments (1)

  31. Respondents’ comments (2)

  32. Respondents’ comments (3)

  33. Respondents’ comments (4)

  34. Proposed/Revised Assessment Frameworks

  35. Proposed/Revised Assessment Frameworks

  36. Proposed/Revised Assessment Frameworks

  37. Rationale for the Revised Framework • Teachers need to deal with HKCEE, HKALE and HKDSE from 2009 to 2012 • Speaking exam retained for school candidates as the majority of teachers do not favour its replacement by SBA • Weighting of SBA component reduced from 20% to 15% and weighting of Part B of Writing paper reduced from 20% to 15% so that 10% can be allocated to the Speaking exam • The total number of SBA marks to be submitted reduced from 4 to 3 to address teachers’ concerns about workload. • Weighting of SBA component reduced to 15%, which is the same as the 2007 HKCEE

  38. Schedule for HKDSE Development Standards-referenced Reporting (SRR) • Production of sample papers and marking schemes • Pilot test of sample papers conducted • Draft of level descriptors and annotated examples completed • Briefing sessions conducted for schools & SRR requirements finalised by Dec 08 • SRR booklets with sample papers disseminated to schools by Mar 09

  39. Schedule for HKDSE Development School-based Assessment (SBA) • Assessment criteria, specifications and sample tasks developed • Briefing sessions conducted for schools; SBA requirements finalised by Dec 08 • SBA handbook disseminated to schools by May 09

  40. Thank You Questions?

More Related