260 likes | 384 Views
Assessment of PBL. Prof.Marlar Than Dr.Wai Phyo Win. COGNITIVE RECALL APPLICATION REASONING. √. PSYCHOMOTOR COMMUNICATION SKILLS INTERPERSONAL SKILLS ATTITUDINAL PROFESSIONALISM TEAMWORK. X. RECEIVING RESPONDING INTERNALISING. X.
E N D
Assessment of PBL Prof.Marlar Than Dr.WaiPhyo Win Hands-on Workshop on PBL –DSMA
COGNITIVE • RECALL • APPLICATION • REASONING √ PSYCHOMOTOR COMMUNICATION SKILLS INTERPERSONAL SKILLS ATTITUDINAL PROFESSIONALISM TEAMWORK X RECEIVING RESPONDING INTERNALISING X Hands-on Workshop on PBL –DSMA
Cognitive outcomes- In written and clinical examinations- differences between PBL & traditional curriculum graduates are small; and do not favour PBL Non-cognitive domains (Attitudes, Interpersonal skills, Affective outcomes)- substantial advantages for PBL Self-directed learning, long-term outcomes- weak evidence in favour of PBL Traditional PBL Geoff Norman, McMaster University Medical School (AMEE Conference, Lisbon 2002) Hands-on Workshop on PBL –DSMA
Does PBL Work? YES!!!! Mac Master, Maastricht, NSW NO!!!-Many newcomers YES, BUT…. Hands-on Workshop on PBL –DSMA
CHANGING ROLES (passive – active) MOTIVATION TRIGGERS LEARNER EFFECTIVENESS OF PBLs APPROPRIATENESS [relevance,depth/ breadth, complexity] FACILITATOR Seldom assessed CHANGING ROLES [ from fact provider to facilitator] Hands-on Workshop on PBL –DSMA
WHY ASSESS THE PBL PROCESS? • The impact of this learning format (PBL) must be appraised/ reviewed • Monitor student growth • Adjust if and as necessary to fit needs / strengthen/ correct weaknesses • Some preliminary studies have shown that PBL process grades correlate well with academic performance (NBDE examinations) Hands-on Workshop on PBL –DSMA
WHAT SHOULD WE ASSESS? • OBJECTIVES OF PBL in most schools are:- • Capable of integrating topics/subjects • Able to perform self-directed learning • Capable of working in a group • Develop self-confidence • Able to retain knowledge • Capable of communicating effectively • Group learning, research and communication skills Hands-on Workshop on PBL –DSMA
WHAT SHOULD WE ASSESS? • LEARNERS - On preparation, organisation, overall contribution of each student to the group • ENSURING KNOWLEDGE OF A SPECIFIED DOMAIN, AND TRANSFERRING KNOWLEDGE TO NOVEL SITUATIONS • FACILITATOR ASSESSMENT- During the PBL process or end of block Hands-on Workshop on PBL –DSMA
LEARNERS TO SELF- ASSESS • ( i.e. REFLECT ) : It is important for students to identify gaps in their knowledge base It allows students to think more carefully of what they know/do not know and what they need to know to accomplish certain tasks Hands-on Workshop on PBL –DSMA
SOME QUESTIONS USEFUL IN SELF-ASSESSMENT HOW DID WE DO AS A GROUP? WHAT WENT PARTICULARLY WELL? WHAT COULD I HAVE DONE BETTER? WERE THERE DIFFICULT SITUATIONS? WAS ANYTHING PARTICULARLY HELPFUL? Hands-on Workshop on PBL –DSMA
ASSESS FACILITATOR- It is important that facilitators do not dominate the group, but facilitate learning and exploration PEER ASSESSMENT – Viable option to measure student growth because life outside the classroom requires working with others Hands-on Workshop on PBL –DSMA
SUMMATIVE Vs. FORMATIVE Hands-on Workshop on PBL –DSMA
MOST SCHOOLS FAVOUR FORMATIVE ASSESSMENT FORMATIVE ASSESSMENT Is used to monitor students’ progress through a course or period of training…feedback into the teaching/learning PROCESS (Gipps, 1994) • FEEDBACK SHOULD BE: • TIMELY • SPECIFIC • ACCURATE • NOT EMBARRASSING • SUFFICIENT • CONSTRUCTIVE • RELEVANT Hands-on Workshop on PBL –DSMA
FEEDBACK Should also encourage the students to explore different ideas. Hands-on Workshop on PBL –DSMA
PBL PROCESS ASSESSMENT WORKSHOP ( GET CONSENSUS ON WHAT, HOW, WHOM) ; TRY OUT ASSESSMENT FORMS Strategies STUDENT TRAINING BY FACILITATORS TRIAL RUN FOLLOWED BY AMENDMENTS IF NECESSARY Hands-on Workshop on PBL –DSMA
....So let's get to work!! ….start with assessing the IMU’s PBL process assessment forms and criteria Hands-on Workshop on PBL –DSMA
Can we adopt the IMU form to assess ? • Capability to integrate topics/subjects • Ability to perform self-directed learning • Capability to work in a group • Self-confidence • Retention of knowledge • Communication skills • Research capability (information seeking • & critical thinking) • Effectiveness of Facilitators Hands-on Workshop on PBL –DSMA
YOUR OPINIONS……???? Hands-on Workshop on PBL –DSMA
Thanks for your Attention! Hands-on Workshop on PBL –DSMA
REFERENCES: Formative and Summative Assessment by S.McAleer . Chapter 27 in In: A Practical Guide for Medical Teachers by J.A.Dent & R.M.Harden. Churchill Livingstone , 2002 A. Sefton (2002) : What is the Tutor’s role in Assessment? In: A Practical Guide for Medical Teachers by J.A.Dent & R.M.Harden. Churchill Livingstone , 2002, p 165- 167 NBDE (National Board Dental Examination) Scores and PBL Process Grades- iadr.comfex.com/iadr/2004/Hawaii/techprogram Assessment of PBL ; Evaluating curriculum; – http://edweb.sdsu.edu PBL – http://score.rims.K12.ca.us/problearn.html Hands-on Workshop on PBL –DSMA
Facilitator Performance Evaluation • Develops, maintains or is capable of recognizing a positive and productive learning environment - Hands-on Workshop on PBL –DSMA
Criteria of a good facilitator • Not dominating • Can guide students to achieve goal • Have experiences to guide students • Training? • Have knowledge regarding PBL process? • Can stimulate all learners to become active learners • Can encourage quiet learners Hands-on Workshop on PBL –DSMA
Criteria of a good facilitator • Flexibility • Eloquent • Critical thinking, open mind, • Constructive criticism – Feedback • Time management • Active, interest in PBL process • Motivated Hands-on Workshop on PBL –DSMA
Criteria of a good facilitator Role model Non pragmatic Good communication skill Non discriminatory Should have updated knowledge Can establish good rapport with students IT literate Hands-on Workshop on PBL –DSMA
PBL Assessment Guide 1. Communication Skills 2. Team work 3. Cognitive skills 4. Demonstration of knowledge 5. Presentation mode 6. Professionalism and attitude Hands-on Workshop on PBL –DSMA
PBL Assessment Guide 1. Communication Skills 2. Team work 3. Cognitive skills 4. Demonstration of knowledge 5. Presentation mode - effort and style of presentation 6. Professionalism and attitude Hands-on Workshop on PBL –DSMA