1 / 49

Assessment Tools

Assessment Tools. وإذا حكمتم بين الناس فاحكموا بالعدل. Contents. Overview Objectives What makes for good assessment? Assessment methods/Tools Conclusions. Educational Triangle. Needs / Objectives/Outcomes & Contents. Curriculum. Strategies. Assessment. Assessment. Formative v/s

courtney
Download Presentation

Assessment Tools

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript


  1. AssessmentTools

  2. وإذا حكمتم بين الناس فاحكموا بالعدل

  3. Contents Overview Objectives What makes for good assessment? Assessment methods/Tools Conclusions

  4. Educational Triangle Needs / Objectives/Outcomes & Contents Curriculum Strategies Assessment

  5. Assessment Formative v/s Summative

  6. Formative vs Summative

  7. Assessment V/S Evaluation

  8. Evaluation: is more focused on making a judgment or determination concerning the quality of a performance, work product or use of skills against a set of standards. • Assessmentis more focused on  measuring a performance, work product, or skill in order to offer feedback to document strengths and growth and to provide directives for improving future performance. Assessments are nonjudgmental and are designed and intended to be helpful to produce improvement.

  9. Skills & Behaviour Cognition/ Knowledge Assessment Does Shows how Knows how Knows Miller GE. The assessment of clinical skills/competence/performance. Academic Medicine (Supplement) 1990; 65: S63-S7.

  10. Assessment Action Does Performance Shows how Competence Knows how Knowledge Knows Miller GE. The assessment of clinical skills/competence/performance. Academic Medicine (Supplement) 1990; 65: S63-S7.

  11. One method can’t do it all • One measure is no measure • We need a mixture of methods to cover the entire pyramid • We can choose different assessment tools

  12. Criteria for different assessment methods Validity: Reliability Educational impact Cost effectiveness Acceptability/ Practicability

  13. Criteria / Requirements Validity: Does it measure what it is supposed to measure? Reliability: Does it produce consistent results? Practicability: Is it practical in term of times & resources.

  14. Educational Impact Assessment may have facilitative or adversive effect on learning Emphasizes the important learning outcomes Provide feedback about the success of study methods

  15. What Should Be Tested? Important topics are weighted heavily The sample of items reflect the instructional goals and the process.

  16. Assessment Theory v/s Practice

  17. Written Exam

  18. Written Written tests can assess knowledge acquisition and reasoning ability, They cannot so easily measure skills

  19. Progress test …all students from (all classes) are submitted to the same test……

  20. Clinical Short cases Long cases OSCE Simulated Clinics Video consultation

  21. Clinical(cont’) 6. Slides Interpretation 7. Lab Data Interpretation 8. Portfolios SOE (simulated oral exam) Oral

  22. Computerized Case-based Testing • Computer is used to increase effectiveness in: • Cost • Test administration • Scoring • Authenticity (e.g. by multimedia) • Written, practical, clinical,…….

  23. “Long case" and “Short case" The basic requirementsfor reliability and validity have not always been achieved intraditional long & short cases

  24. Observing candidates' interaction with patients

  25. OSCEObjective structured clinical examination

  26. Observing Candidates' Interaction with Patients

  27. Oral

  28. Oral

  29. Work Place-Based Assessment • Direct observation: Clinical work sampling measures: • Mini-CEX, Mini-Clinical Evaluation Exercise • DOPS, Directly Observed Procedural Skills Directly Observed • P-MEX,  The Professionalism Mini-Evaluation Exercise • Global performance measures • Multi-Source Feedback (MSF or 360) • Aggregation and reflection measures • Logbook • Portfolio The oral examination is traditionally an unstructuredface to face session with the examiners

  30. PEER EVALUATION • Peer Assessment & Self Assessment The oral examination is traditionally an unstructuredface to face session with the examiners

  31. Assessment of professional behavior • Regular feedback of performance • For all the students • Helping students to grow as a professional • Starting from the beginning of the studies

  32. Dealing with work Dealingwithothers Dealingwithoneself Assessment of professional behavior Professional behaviour consists of three aspects

  33. Portfolio Criteria to meet the different aspects of competence are described by faculty • results of assessment • (longtudinal or tailored) • reports, video • projects • peer assessment • staff assessment • articles, presenting papers Student reflects on the different aspects of competence (written statements) Student gathers evidence about aspects of his competence

  34. Mentor = coach • Role as expert • results of assessment • reports • projects • peer assessment • staff assessment Student reflects on the different aspects of competence (written statements) On several aspects described by faculty Student proves his competence Student discusses his competence and reflection on it with the mentor Portfolio assessment

  35. What are the assessment toolsused in your college??

  36. Conclusion

  37. Conclusion • Comprehensive Assessment • Different methods to be applied • Standardized / structured • Not to depend only on few methods The oral examination is traditionally an unstructuredface to face session with the examiners

  38. MCQ, SAQ, Short essy, MEQs…. Simple recall questions Knows how Knows Does Shows how Knows how Knows

  39. Simulations requiring behaviouralperformance OSCE, OSPE, Simulated Clinics, Knows how Shows how Does Shows how Knows how Knows

  40. Assessing performance Work-based assessment: Clinical work-sampling, Mini-CEX, Portfolio, practice visits, case orals…. Does Shows how Does Shows how Knows how Knows

  41. Self-, peer, co-assessment, portfolio, multisource feedback, learning process evaluations…… Does Shows how Knows how Knows

  42. THANK YOU

More Related