1 / 40

BVetMed Assessment

BVetMed Assessment. Christopher R. Lamb Chair, Finals Examination Board. RVC assessment policy. Use a variety of assessment methods Suited to learning outcomes Continual assessment, written, practical, project Examine at end of each teaching period Minimise assessment load

gotzon
Download Presentation

BVetMed Assessment

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. BVetMed Assessment Christopher R. Lamb Chair, Finals Examination Board

  2. RVC assessment policy • Use a variety of assessment methods • Suited to learning outcomes • Continual assessment, written, practical, project • Examine at end of each teaching period • Minimise assessment load • Prompt feedback • formative & summative

  3. Key Principle • The assessment objectives should match the educational objectives

  4. Miller’s pyramid

  5. Assessment formats • Knowledge • Multiple choice questions (MCQ) • Spot tests • Write-in formats • Short answer questions (SAQ) • Essays • Oral (viva)

  6. What is the chemical symbol for tin? • Sn • St • T • Tn • W

  7. Assessment formats • Application of knowledge • Multiple choice questions (MCQ) • Extended matching questions (EMQ) • Spot tests • Write-in formats • Short answer questions (SAQ) • Essays • Modified essay questions (MEQ) • Oral (viva)

  8. A previously healthy 18-month old male Cavalier King Charles spaniel has acute onset dyspnoea during a walk. No history of trauma. The dog appears depressed, has increased lung sounds and unilateral hyphaema. Thoracic radiographs show an alveolar pattern mainly in the peripheral parts of the caudal lobes. Which of the following ancillary tests is most likely to confirm the diagnosis? • Bronchoalveolar lavage • Echocardiography • Faecal examination • Haematology and serum biochemistry • Urinalysis

  9. Assessment formats • Practical skills • Objective structured clinical examination (OSCE)

  10. OSCE • Sterile collection of milk sample

  11. Assessment formats • Professional competence • the highest level of Miller’s pyramid • direct observation during IMR

  12. Professional competence • At post-graduate level • collect information about vets’ performance in their normal practice • mortality/morbidity • rating based on observation by managers, peers, nurses, owners (360 degree) • portfolios

  13. Joined-up thinking

  14. Essential properties of assessments • Validity • Reliability • Feasibility • Time • Resources

  15. Validity • An instrument is valid if it tests/measures what is intended (and not something else) • Criterion validity • does test predict outcome? • Content validity • does test mirror learning objectives? • Face validity • is the test acceptable to stakeholders?

  16. A course Learning outcomes Study activities Assessment

  17. An ideal curriculum

  18. The real curriculum

  19. Blueprinting • Blueprint links the LO to the assessment • Blueprint is a matrix • Test created by sampling widely across the matrix

  20. Knowledge

  21. Skills

  22. Communication skills blueprint

  23. 2007 Curriculum Increased emphasis on: • Understanding concepts and processes • Independent working and learning • Teamwork • Day-One practical skills • Student choice, i.e. tracking

  24. Assessment in 2007 Curriculum • More formative assessment • Weekly opportunities to test learning of material from earlier in the course • Improved feedback structures • Less assessment of fact retention, more of application of knowledge • Give the students information and assess how well they handle it • Clinical reasoning

  25. BVetMed • Year 1 & 2 • Underpinning science • Animal health & handling • Year 3-4 • Research project 1 (based on AHEMS) • Animal handling • Clinical sciences • Clinical skills • Year 4-5 • IMR • Research project 2 • Tracking

  26. How we assess Year 1 • In-course assessments • 1 Extended essay • 2 MCQ • 3 MCQ • Practical tests • Structured ISF orals • Spot tests

  27. How we assess Year 1 • Written Papers: • Paper 1: 1h MCQs • Paper 2: 2h “problem-solving” questions • Paper 3: 3h essay questions

  28. BVetMed Year 1 Essential knowledge Problem-solving

  29. To pass Year 1 • Candidates must • gain average mark of 50% for all components • at least 40% for the combined Essential knowledge elements, and • at least 40% for the combined Problem solving and interpretation elements, and • achieved a pass mark in In-course assessment 1, and • completed ICT Skills test

  30. How we assess Year 2 • In course assessment • MCQ • PMVPH Report • Integrated concepts presentations • Written papers same format as Y1 • Paper 1: 3h MCQs • Paper 2: 3h problem-solving questions • Paper 3: 3h essay questions

  31. How we assess Year 3 • In course assessment • Research Project 1 • Written Paper • MCQ and EMQ • Practical Tests • Animal Handling DOPS • Can complete earlier in course • 2 attempts before EMS starts

  32. Direct Observation of Procedural Skills • Less rigid format than OSCE, incorporates feedback, requires expert assessor • Students must demonstrate competence handling all 5 animal groups • Horse • Large artiodactyls (e.g. cattle) • Small artiodactyls (e.g. sheep, pigs) • Cat & Dog • Avians/exotics/small mammals

  33. How we assess Year 4 • Written Papers • MCQ/EMQ • Long answer • Practical Tests • Clinical OSCE (formative only)

  34. Year 4 Long answer paper • Open book format • Advised of subject of Q1 2w before exam • 4 questions • 1. Professional/ethics • 2. Data analysis • 3,4. Clinical problem scenarios • Initial scenario • Supplementary clinical information to consider over the weekend • Follow-up paper requires refined answers to 2 clinical scenarios

  35. Assessment of Year 5 - Finals • Pt.1 • IMR • qualifier for Pt. 2 • Pt.2 • Clinical Reasoning and Recognition • Skills • Pt.3 • Tracking • Tracking IMR • Taught tracking • Research project 2

  36. In-course assessment of IMR Students are assessed in the following categories • Professional Activity • Practical Skills • Clinical Reasoning and application of Knowledge Possible grades • Pass with distinction • Pass • Borderline • Clear fail Students receiving a “borderline” mark in two categories or a “clear fail” in any category fail the rotation

  37. Finals Pt.2 • Clinical Reasoning and Recognition • 3h Long Answer paper • MEQ • 3h EMQ paper • 2h Spot test • Clinical skills • OSCE

  38. Finals Pt.3 • In-course assessment of tracking IMR • 2.5h written exam • Q1 critique published research paper • Q2 & 3 long answer • Large choice of questions reflecting all tracking options • Research Project 2 • Report <5,000 words • Oral examination <30 min

  39. More information • Regulations • Assessment • intranet.rvc.ac.uk/StudentsAndTeaching/MarkingSchemes.cfm • General • intranet.rvc.ac.uk/StudentsAndTeaching/RegsAndProcs.cfm • Exam dates • intranet.rvc.ac.uk/StudentsAndTeaching/ExamTimetables_CT.cfm • intranet.rvc.ac.uk/StudentsAndTeaching/ExamTimetables_HH.cfm • Past papers • Blackboard>Past papers>BVetMed • www.rvc.ac.uk/Examiners

  40. clamb@rvc.ac.uk Any questions?

More Related