210 likes | 518 Views
Evaluation of the use of portfolios in the assessment of learning and competence in nursing, midwifery and health visiting Christine Webb Professor of Health Studies, University of Plymouth, UK. Issues in the literature. Authenticity and verification Validity Reliability
E N D
Evaluation of the use of portfolios in the assessment of learning and competence in nursing, midwifery and health visiting Christine WebbProfessor of Health Studies, University of Plymouth, UK
Issues in the literature • Authenticity and verification • Validity • Reliability • Usefulness in assessment of critical reflective development and competence • Role of academics in facilitation and guidance
Conflict between summative assessment function and learning value?
How did students use portfolios? • Deconstruction of learning outcomes • what do they mean? • overlap/repetition • Reconstruction to give teachers what they expected • re-writing history? • artificiality
Transforming the material? • Shopping trolley • Toast rack • Spinal column • Cake mix
Specialist practice programmes • One-to-one relationship with assessor • Continuity informed assessor judgements • Direct observation • Knowing the student
Pre-registration programmes • Multiple placements • Short duration • Nature of practice on wards
Midwifery – the exception? • Teachers had strong relationships with clinical staff • One-to-one supervision • Motivation • Not a ‘small cohort’ factor
Issues • Size/bulk of portfolios • Complexity of structure • Time needed for completion • The tail wags the dog • Process or outcome? • ‘Faking it’? • Being critical?
Clinical assessors assessed students’ practice NOT their portfolios. • The portfolio provided SUPPORTING evidence • Practice assessment tools need to be developed, in collaboration between teachers and assessors
Providing structure • Need to introduce students to incrementally more complex models of reflection as students progress through the programme • Otherwise, writing skills may determine the quality of what is written
Discrimination between students • Monitoring process were in place – double marking, internal moderation • Teachers and assessor could identify weak students • BUT failure/discontinuation on the basis of the portfolio was rare/non-existent
Feedback to students • Tripartite meetings • Personal tutor feedback
Preparation • Students • Teachers • Assessors
Role of External Examiners • Sampling portfolios • Examination Board
Assessing rigour? • Validity and reliability – quantitative research • Criteria for qualitative research
Recommendations: Policy • Sufficient time in each placement to build up student-assessor relationship • Recognition of implications of assessment in RN workloads • Greater investment in assessor training • Retain PTA/CPT role in specialist practice • Develop practice assessment tools
Recommendations: Portfolios • Balance evidence and workload • Appropriate structure • Include non-assessed ‘development’ section • Preparation of all parties • Tripartite meetings • Transformation of evidence
Use incrementally more complex models of reflection • Reconsider criteria used to assess portfolios • Make competency statements more realistic, user-friendly and valued