660 likes | 1.8k Views
Holistic Assessment of Social Work Students’ Professional Practice Marion Bogo. Joint Social Work Education Conference and Social Work Research Conference University of Hertfordshire 2010. Overview. Link between social work education and practice Conceptualization of professional practice
E N D
Holistic Assessment of Social Work Students’ Professional PracticeMarion Bogo Joint Social Work Education Conference and Social Work Research Conference University of Hertfordshire 2010
Overview • Link between social work education and practice • Conceptualization of professional practice • Assessment • Cognition • Interpersonal • Contextual
Social Work Education and Practice The purpose of social work education is to prepare social work practitioners
Professional Work:Dimensions • Thinking • Performing • Acting with integrity (Lee Shulman, 2005)
Signature Pedagogy “…pedagogical norms with which to connect and integrate theory and practice.” (Lee Shulman, 2005)
Social Work Education and Practice • United States: Council on Social Work Education, Educational Policy and Accreditation Standards 2008 • England: Social Work Task Force 2009 • Canada: Canadian Council of Social Work Regulators; Project - Social Worker Competency Profile 2010
Conceptualization of Professional Practice • Critique of competency as dimensions and skills – a checklist approach • How to capture holistic nature of practice and performance • not mechanistic • context • professionalism • knowledge competencies, internal cognitive processes for judgment, decision making
“In their own words…” Design a practice-based evaluation tool • Reflect practice teachers’ tacit or implicit conceptualization of student competence – dimensions they use • In practice teachers’ language
Meta-Competencies • Higher order overarching abilities and qualities - of a different order and nature than procedural or operational behaviors and skills. • Related to individuals’ ability to: • use discrete behaviors in a purposeful, integrated, and professional manner. • learn the specific role competencies of particular professions.
Behavior in the Organization Conceptualization of practice Collaborative relationship Meta-competencies Relational capacity/Intentional use of self Procedural competencies Conducts assessment and intervention Professional Communication Learning and growth as a professional DIRECT PRACTICE
Behavior in the Organization/ Relationships Critical Thinking and Analysis Planning Meta-competencies Leadership Procedural competencies Project management Professional Communication Learning and growth as a professional MACRO PRACTICE
Levels of Performance • High agreement on individual rankings of 20 vignettes- interclass correlation coefficient: 0.83 • Five categories generated • Exceptional - - - - - - - - - - - - - - - - - 5 • Ready for practice - - - - - - - - - - - - 4 • On the cusp - - - - - - - - - - - - - - - - - 3 • Needs more training - - - - - - - - - - -2 • Unsuitable for the profession - - - - 1
From Descriptions to a Tool • Dimensions of holistic competence • Learning and growth • Behavior in the organization • Conceptualizing practice • Collaborative relationships • Assessment and intervention • Professional Communication
From Descriptions to a Tool • For each dimension • Extracted descriptors from the ranked vignettes for each of 5 levels of performance • In practice teachers’ language.
Results New PBE tool was not more effective at discriminating students than older CBE tool.
Using all Tools • Recall most recent student • 20 vignettes ordered randomly • Select vignettes “similar” to their student. • Select from “similar vignettes” one or two vignettes that are “most similar” to their student. • Evaluate same student using • Practice-Based Evaluation (PBE) Tool • Competency-Based Evaluation (CBE) Tool
Scales • Holistic impression of students • Deconstruct • Relate to a skill • Convert to a point on a scale
Reflections on Assessment • When values collide • Student response and the inter-personal relationship • Negotiating • Where is ‘the school?’
Conclusion • In instructors’ own language – holistic, global, authentic -reflects their conceptualization of practice competence. • A tool without numbers. • Approaches that empower the practice assessor/field instructor and are not negotiated – exercise her expertise.
Dimensions of Practice • Six dimensions • Learning and growth • Behavior in the organization • Clinical relationships • Conceptualizing practice • Assessment and intervention • Professional Communication • For each dimension, descriptors provided for each of 5 levels of performance.
Levels of Performance Five categories • Exceptional - - - - - - - - - - - - - - - - - 5 • Ready for practice - - - - - - - - - - - - 4 • On the cusp - - - - - - - - - - - - - - - - - 3 • Needs more training - - - - - - - - - - -2 • Unsuitable for the profession - - - - 1
2008-9 Comparisons between CBE Tool (480) and PBE Tool (152)
OSCE: Objective Structured Clinical Examination • Developed in medicine and used in health professions (Harden et al., 1975) • Students interview series of standardized, simulated “clients” • “Clients” are trained actors • Students are given brief information – role, presenting issues, time frame and goal.
Adapted for Social Work • Holistic competence - in social work two components: • interview for 12-15 minutes for procedural competencies • followed by a structured reflective dialogue for 12-15 minutes to elicit meta-competencies • Both observed and rated by a trained rater.
Initial Study: Participants • 11 students completed Year 1 of the MSW Program • 7 recent graduates of the MSW Program • 5 experienced social workers with 5-7 years of experience