230 likes | 382 Views
Dynamic assessment and ‘Interactive Examination’. Anders Jönsson (LUT) & Nikos Mattheos (OD) Malmö University. How can professional-directed education foster reflecting and self-assessing practitioners?.
E N D
Dynamic assessment and ‘Interactive Examination’ Anders Jönsson (LUT) & Nikos Mattheos (OD) Malmö University
How can professional-directed education foster reflecting and self-assessing practitioners? The students must be given the opportunity to practice these skills, as well as be assessed on them. Jönsson, A. & Mattheos, N. Malmö University
The Interactive Examination - a structured assessment methodology- aims to evaluate students’ content specific skills in parallel to their metacognitive Jönsson, A. & Mattheos, N. Malmö University
This presentation will: 1.Describe the methodology,2. Present some results from last years cohorts,3. Highlight some interesting differences between the two education centres. Jönsson, A. & Mattheos, N. Malmö University
doctor teacher Autumn 2004: 34 3rd semester dental students 174 1st semester student teachers
Self-assessment Personal task Comparison task Feedback Assessment Evaluation Method 6 steps The Interactive Examination 6 steps Jönsson, A. & Mattheos, N. Malmö University
Self-assessment Personal task Comparison task Feedback Assessment Evaluation Method step 1 The Interactive Examination 1. Self-assessmentLikert-like questions from 1 (poor) to 6 (excellent) • - 11 competencies • match to instructors’ • judgement • 13 competencies • match to examination • results
Self-assessment Personal task Comparison task Feedback Assessment Evaluation Method step 2 The Interactive Examination 2. Personal taskAn authentic problem from professional life • A patient walks is • your clinic and... • Internet based • case presentations Actual Classroom scenarios A series of short Internet video films
Self-assessment Personal task Comparison task Feedback Assessment Evaluation Method step 3 The Interactive Examination 3. Comparison taska.identify differences between own and ‘expert’ answer, b. reflect on the reasons for these differences, c. define own needs for further learning.
Self-assessment Personal task Comparison task Feedback Assessment Evaluation Method step 4 The Interactive Examination 4. EvaluationAsking the students to evaluate the whole experience, through a standardised form Standardised form – 10 fields 8 identical – 2comparable
Self-assessment Personal task Comparison task Feedback Assessment Evaluation Method step 5 The Interactive Examination 5. Assessment of students- personal task, - comparison task.
Self-assessment Personal task Comparison task Feedback Assessment Evaluation Method step 6 The Interactive Examination 6. Personalized feedbackComments on: - students’ self-assessment-the personal task –the comparison document.
Results Evaluation Results Evaluation Results from the Likert-like questions that were identical in both centres:
Results Self-assessment Results Self-assessment Students as a group: Jönsson, A. & Mattheos, N. Malmö University
Results Self-assessment Results Self-assessment Individual students: Jönsson, A. & Mattheos, N. Malmö University
Results Self-assessment Results Self-assessment Regression analysis: Jönsson, A. & Mattheos, N. Malmö University
Results qualitative analysis Qualitative analysis:comparison document • differences • arguments • learning needs, • which and how? Jönsson, A. & Mattheos, N. Malmö University
Results qualitative analysis Qualitative analysis:comparison document • differences in: • form- content • attitudes • interpretation Jönsson, A. & Mattheos, N. Malmö University
Results qualitative analysis • differences..! • mainly content- few attitude • few form • hardly any interpretation • Learning objectives: • mainly content driven • ”need to know more...” • - similarities..! • mainly attitude • some content • some interpretation • few form • Learning objectives: • need more in-service • training
Results Comparison task Reflecting... • - differences in the nature of the assessed task? • differences in the institutional learning culture? • differences in student’s perception of the ”end product”? Jönsson, A. & Mattheos, N. Malmö University
Future research... • longitudinal observation of • self-assessment skills? • Evaluation of interventions? • investigate student’s perception of the ”end product”? Jönsson, A. & Mattheos, N. Malmö University
Thank You ! Jönsson, A. & Mattheos, N. Malmö University
Dynamic assessment and ‘Interactive Examination’ Contact: Anders Jönsson anders.jonsson@lut.mah.se Nikos Mattheos nikolaos.mattheos@od.mah.se