Tips on Constructions of Subjective Items: Essay J. Ashraful Haq MBBS, MPhil, PhD

1. Tips on Constructions of Subjective Items: Essay J. Ashraful Haq MBBS, MPhil, PhD

2. THREE PILLARS OF FORMAL LEARNING Acquisition of Knowledge & Skills Pedagogy Syllabus Assessment Formal Learning

3. Bloom 3 Domains of Educational Objectives Cognitive Domain (Knowledge & thinking or Intellectual Skills) Psychomotor Domain (Doing, Skill Coordination & Use of Motor-Skill Areas) Affective Domain (Emotional Quotient: Feelings, Attitudes, Values, Appreciation, Enthusiasm, Motivations )

5. Bloom’s Hierarchy Levels in Cognitive Domain Level 6: Evaluation Level 5: Synthesis Level 4: Analysis Level 3: Application Level 2: Comprehension Level 1: Knowledge

6. EVALUATION Judges the value of……. SYNTHESIS COGNITIVE DOMAIN(Thinking, Knowledge) Formulates new structure ANALYSIS Understands both content & structure APPLICATION Uses learning in new & concrete situation COMPREHENSION Grasps the meaning KNOWLEDGE Remembers previous material (Benjamin S. Bloom, 1956)

7. Assessment A systematic, on-going and repetitive process to determine the cognitive levels

8. Purpose of Assessment?

9. Purpose of Assessment • to grade individual students for certification • to grade groups, classes or institutions • to serve teaching & learning.

10. Purpose of Assessment…….contd • to examine the level of thinking of a learner. • to assess the different cognitive levels. • to select one category of students from others. Excellent --- good --- average ---- poor learners..

11. Method or tools of assessments • Written examination • Oral examination • Practical examination

12. Written examination Subjective Item : Essay Objective Item : MCQ Weightage in our MBBS course?

13. Written examination Subjective Item : Essay Objective Item : MCQ Weightage in MBBS our course? Essay : 77% MCQ : 23%

14. Why subjective items – Essay ?

15. Subjective Items – Essay An essay question is able to assess the entire spectrum of cognitive domains – L1 to L6 Essay question is able to measure variety of abilities They are excellent for promoting integrative and synthetic thinking Allow freedom in style and depth

16. Subjective Items: Essay Item • Open Response Essay Item (ORE) • Restricted Response Essay Item (RRE) • Descriptive essay Item • Critical essay Item • Modified Essay Question (MEQ)

17. Explain how insulin lowers the blood glucose level following a carbohydrate meal. What type of Essay item? Open Response Essay Item

18. Advantages: • Identify, organize and present an idea in a form of communication • Relate knowledge, idea and information from different sources • Produce a new idea • Evaluate idea and information

19. Disadvantages: • Scoring is subjective and can create a haloeffect • Scoring is more time consuming • Require trained examiner • Require legible handwritings

20. State two mechanisms of action of penicillin on bacteria. Restricted response essay item

21. RRE • Advantages: • Responses are limited to the scope of the questions • Marks can be specifically allocated – Increase • validity of scoring • Educator is able to focus question to a specific • objective • Candidate can easily interpret the requirement of • question

22. Disadvantages: • Not suitable for assessing higher level thinking skills • Can be assessed by other tools

23. Build a critical essay Item!!!

24. A question posed to student- Q. Penicillin kills gram positive bacteria. State two mechanisms of action of penicillin on bacteria.

25. Penicillin kills gram positive bacteria. State two mechanisms of action of penicillin on bacteria

26. Example of an essay item Explain how insulin lowers the blood glucose level following a carbohydrate meal.. (15 marks) Construct: Knowledge &Comprehension Topic: Carbohydrate metabolism Level of Difficulty: Medium Rubric

27. Rubric = an established and written-down set of criteria for scoring or rating student’s performance on tests, portfolios, writing samples, or other performance tasks.

28. Examples of Essay Items List/Describe all virulence factors of V. cholerae. Construct: Knowledge Topic: Vibrio Level of difficulty: Low

29. Examples of Essay Items Explain how V. cholerae causes watery diarrhea and excessive loss of potassium in human gut. Construct: Synthesis Topic: X Level of difficulty: Medium to high

30. Example of LEQ Discuss pathogenecity, laboratory diagnosis and prevention of shigellosis OR Every year about 12000 children suffer from shigellosis in Bangladesh – Discuss

31. Bloom’s Taxonomy: Verbs

32. Scheme for MBBS level – An example

33. Bloom’s Hierarchy Levels Constructs HIGHEST LOWEST

34. What is the distribution of Weightage of Items in 1st/2nd/Final Professional MBBS exam Knowledge Understanding Analytic ability Synthesis ability Affective & Psychomotor ???? %

35. Examine a 1st or 2nd or Final professional question paper and find - How many are RRE? How many are ORE?

36. SUMMARY It is about the right time for all of us to use the right word in constructing examination questions ........ Thank you