Report to Central South University Medical School Administration April 2004

1. Report to Central South University Medical School AdministrationApril 2004 China Medical Board of New York Institute for International Medical Education

2. Examination Elements • Multiple Choice Questions • 150 items • Objective Structured Clinical Examination • 15 stations: 10 with patients • Faculty Observations • At least 3 observations of each student over 3 months

3. International Student Standards • Examination items reviewed by an international panel WITHOUT first looking at student performance. • International cut-score set. • Cut-score applied to student performance. • Cut-scores range from 41% to 78% correct.

4. Standard-Setting Panel

5. International School Standards • International Panel met to decide acceptable failure rate for each domain for each school. • Reviewed test materials and student-level cut-score, then independently chose an acceptable failure rate by domain. • Acceptable failure rates by domain range from 9 to 24%.

6. School Standard-Setting Panel

7. Examination Results • Results in Seven Domains • Some Domains measured by 1, 2, or 3 methods • Results are either: • Strength (>5% above standard) • Borderline (5% +/- standard) • Improvement (>5% below standard)

8. Example: OSCE Examination Domain

9. Areas of Strength • Scientific Foundations • Population Health • Information management • Clinical Skills • OSCE assessment suggests strength • MCQ assessment suggests borderline

10. Areas for Improvement • Professionalism • Communication Skills • Scientific Thinking

11. Summary – Central South

12. Your School Report Document • Section 1 • International Domains with Student and School-Level Standards • Section 2 • International Sub-Domains with Student-Level Standards • Section 3 • Disciplines With Student-Level Standards

13. Hand Out Report

14. Section 1: International Domains Example

15. Section 2: International Sub-domains Example

16. Section 3: Disciplines Example

17. Questions?