1 / 15

THE ASSESSMENT UNIT

Department of Medical Education College of Medicine King Saud bin Abdul Aziz University for Health Sciences. THE ASSESSMENT UNIT. The Assessment Unit is committed to working within the regulations and provisions of both of the following:

oke
Download Presentation

THE ASSESSMENT UNIT

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Department of Medical Education College of Medicine King Saud bin Abdul Aziz University for Health Sciences THE ASSESSMENT UNIT

  2. The Assessment Unit is committed to working within the regulations and provisions of both of the following: • Policies and Procedures of the College of Medicine Assessment Unit. • IDEAL Consortium Program. Unit GOAL:

  3. To be responsible for producing and editing MCQs, OSPE and OSCE stations for student examinations and for preserving them in the College of Medicine Bank (IDEAL). To ensure that student assessment is in accordance with the block (course) content and that examinations follow block blueprints. To analyze the psychometric properties of the examinations and to provide feedback on the examination results. To maintain a liaison with the IDEAL International Consortium for sharing medical student assessment banks. To implement Assessment Unit Policies and Procedures. To ensure complete confidentiality of the Assessment Unit. Unit OBJECTIVES:

  4. Forming Assessment Unit Committee. Setting up blueprints for course exams. Providing assessment and item-writing workshops. Soliciting, preparing, and editing items. Scheduling meetings for review and approval of items to ensure that the blueprint is adhered to and the items meet the IDEAL criteria. Typing and formatting examinations for the block mid block and final examinations. Unit Activities/assessment process:

  5. Collating, delivering, and retrieving written examinations. Marking exams using optical scanners and delivering results to Academic Affairs. Reviewing psychometric properties of the test/items. Securing and maintaining proper storage of examinations. Activities (Cont’d)

  6. Ideal consortium (International Database for Enhanced Assessment and Learning) • A group of medical schools organized to share their undergraduate student assessment items ( n = 25). • We are the first Saudi medical school to be accepted into the Consortium. • Services of the Consortium. • Provide access to a huge student data bank (20,000+ items). • Offer faculty development programs. • Workshops • Conferences • On-site training • Annual meetings • Contribute to quality assurance of our assessment system.

  7. Maintain the local bank on IDEAL system. Retrieve items from IDEAL shared bank for our examinations. Forward annual contribution of items to the IDEAL Consortium. (150 items minimum) Conduct IDEAL Consortium workshops for Assessment Unit staff and faculty. IDEAL CONSORTIUM - Local Responsibilities

  8. COLLEGE CONTRIBUTION IN IDEAL Meetings attended. Oman Indonesia Canada Participated as facilitator in IDEAL workshops. Sudan – Khartoom and Jazeera

  9. IDEAL is a Windows-based software application for conveniently: entering, storing, searching, retrieving, editing, printing or administering assessment items, as well as for updating, managing and sharing assessment banks in medical education. What is IDEAL?

  10. IDEAL supports the following item types: • X-Type (True/False, Multiple True/False), • A-Type (MCQs), • K-Type, • R-Type (Extended matching), • Multiple Response (Pick n of N for A-Type and R-Type), • Short Answer, • Modified Essays, • OSCE and OSPE. item types USED IN ideal:

  11. The IDEAL system includes two support item analysis programs for purposes of generating relevant item performance characteristics (based on students' responses to the items in an examination). The item analysis program generates an IDEAL readable file for purposes of uploading and storing with each banked item, its discrimination index, point biserial, difficulty level, and student response patterns by high, middle and low performance groups. Item analysis:

  12. Items are classified by and can be searched for: • using identification numbers or a modified version of USMLE's item classification scheme. • by MeSH terms (Medical Subject Headings). • or using any part of an item's text, i.e. words, phrases, or parts of words (i.e. wild cards). • search can be structured using a combination of classification criteria derived from a test blue print. Classification and search of items:

  13. Formulate more improvement in system for presentation of Block Mid year, Final, OSCE and OSPE examinations . Development of local bank on IDEAL system. Better utilization of IDEAL Consortium item bank. recommendations

  14. In sum, we are committed to Bringing our assessment goals in line with the College’s educational goals better to serve the college mission

  15. Thank you

More Related