270 likes | 443 Views
PPSK Assessment Workshop (2.15 – 3.15 pm): Tips on Constructions of Subjective Items - Essay and OSPE. An essay question is able to assess the entire spectrum of cognitive domains Essay question is able to measure variety of abilities
E N D
PPSK Assessment Workshop (2.15 – 3.15 pm): Tips on Constructions of Subjective Items - Essay and OSPE
An essay question is able to assess the entire spectrum of cognitive domains Essay question is able to measure variety of abilities They are excellent for promoting integrative and synthetic thinking It measures all levels of cognitive domains - L1 to L6
essay question…. • Students need practice in formulating arguments, expressing things clearly, and integrating ideas. • Essay tests tend to focus on a few large issues
Essay question are: Descriptive essay A descriptive assay explores the factual knowledge But, lacks argument, interpretation and evaluation
Essay question are: Critical essay judges higher level of thinking e.g. ability to comprehend analysis, synthesis, evaluation, etc.
Essay question ….. • Modified essay question – MEQ • Restricted response essay or Short essay questions • Open response or Long essay questions
What is MEQ? It contains a series of questions in several parts Each deals with a particular aspect of knowledge The questions are dependent or linked It may start with simple knowledge and may be extended to critical thinking It is appropriate in medicine
Question1 A 5-year old boy was admitted to HUSM because of high fever with rash. a. State 4 other relevant information you would obtain from this patient. (2 min) b. State 2 relevant physical findings you would elicit from this patient and give reasons (2 min)
Question 2 5-year old boy fever rash On examination, the child’s vital signs were stable with temperature of 40oC, no pallor or jaundice. Hess test was positive. a) State the principle of Hess test. (3 min) b) State two (2) differential diagnoses (2 min) So the scenario continues and the questions are based on the unfolding scenario ………………………….. Total marks 30 or 30 min
Short essay question Advantages of short essay Objective focused - it specifically test a particular aspect of knowledge only at a time Larger coverage Specific Easy marking
Short essay question Disadvantages Not always suitable for assessing higher level thinking Guessing is a possibility
Long essay question It is capable of assessing multiple aspects of cognitive domain Explores different sources, methods and approaches to solve problems Produce new idea
Disadvantages… Grades influenced by the length of the essay Essays test grades depend upon writing skills Grading is somewhat subjective Labor-intensive Feedback is delayed in continuous assessment
Construction of Essay 1. The question should clearly define the task 2. Indicate the scope and direction of the answer 4. Allow for "think time” Use more shorter-essay items rather than fewer longer ones
Construction of SEQ Develop a scoring key before administering the test Construct: Knowledge &Comprehension Topic: X Level of Difficulty: Low/Medium/High
Examples of SEQ List/Describe all virulence factors of V. cholerae Construct: Knowledge Topic: X Level of difficulty: Low OR Explain how the virulence factors of V. cholerae causes diarrhea in human being Construct: Synthesis Topic: X Level of difficulty: Medium to high
Examples of SEQ List the effects of fertilizer on fresh water algae OR Design an experiment to determine the effect of fertilizer on the growth of algae in fresh water.
Example of LEQ Discuss pathogenecity, laboratory diagnosis and prevention of shigellosis OR Every year about 12000 children suffer from shigellosis in Malaysia – Discuss
How to mark a essay question? Format of the essay – should have following section: Introduction Body or Content Conclusion Bibliography?
How OSPE evolved? Conventional clinical examinations were affected by: Patient variability and examiner variability The marks awarded only reflect the global performance of the candidate Problems in communication significantly affect the outcome .
The final score indicating his overall performance Gives no significant feedback to the candidate Attitudes are usually not tested OSPE was introduced to avoid problems associated with clinical examination .
Station 1 OSPE Example A microscope has been provided. Observe the labeled part (objective) and answer the following questions: Name the labeled part State two functions of the parts Define principle of dark ground microscopy
Station 2 Determine BMI of the person sitting in the station and complete the form below: a. Name of the person ___________ b. Age _________ Sex___________ c. Height _______ Weight ______________ d. BMI __________________ e. Give your Comment on observed BMI :