130 likes | 203 Views
From St George’s to GAME (Advanced Assessment Course). Bringing ideas and tools home ........ Josephine Boland 4 th December 2012. Reliability is a necessary but insufficient condition for validity (get the validity right first).
E N D
From St George’s to GAME (Advanced Assessment Course) Bringing ideas and tools home ........ Josephine Boland 4th December 2012
Reliability is a necessary but insufficient condition for validity (get the validity right first) 2. Embedding feedback in a programmatic approach to assessment
Reliability Assessment which provides a consistent, reliable measurement of the student’s performance. Same result would be obtained if it was carried out on the: - same student at a different time - same student by another assessor
Validity A test is valid if it measures what it purports to measure (Kelly 1927) Aligned to learning outcomes • Construct validity • Criterion validity • Content validity
Reliability is a necessary but insufficient condition for validity Striking the right balance? Getting the validity right first!
Reliability is a necessary but insufficient condition for validity Striking the right balance? Getting the validity right first! A plug for Curriculum Mapping!
2. Embedding feedback in a programmatic approach to assessment
A programmatic approachto assessment planning • Multiple methods • Assessment of learning + assessment for learning • Continuum of stakes (low/ high) • Explicit performance standards • Frequent formative, information-rich feedback • Student centred, longitudinal, holistic and self-directed • Planned programmatically....... Adapted from Dennefer, E (2012) Programmatic Assessment; Theory and Practice. Presentation to the Advanced Assessment Course, St Georges, London, November 2012
Student attitudes to formative assessment We’re so stressed about exams … I love writing case reports but if I’ve a choice between studying for my exam and writing a beautiful case report with no marks …. It’s unfortunate that I think like that but….. 5th year medical student (NUIG) Boland. J. (2012) Quality Issues in Assessment .Presentation to INMED, UL November 2012
Planning programmatically • See handout
Types of feedbackWays of giving feedback • Tutor feedback, peer feedback • Qualitative /quantitative • Written, oral, face-to face, electronic • Individualised, generic (whole group) • Solution/correct answer (reasons why) • Comments on performance • Numeric score per criterion • Others....?
Identifying the best opportunities for formative feedback • See handout
Reliability is a necessary but insufficient condition for validity (get the validity right first) 2. Embedding feedback in a programmatic approach to assessment