210 likes | 317 Views
CME Research: What does the evidence tell us?. Mentoring: What is the evidence that mentoring is an effective modality for learning? What are the pre-requisites for a successful mentoring program?. Luanne E. Thorndyke, MD
E N D
CME Research: What does the evidence tell us? Mentoring: • What is the evidence that mentoring is an effective modality for learning? • What are the pre-requisites for a successful mentoring program? Luanne E. Thorndyke, MD Associate Dean for Professional Development Penn State College of Medicine
Mentoring is a central component of professional development • A supportive relationship • A teaching-learning process • Involves coaching, role-modeling, motivating, assessing, feedback • Often involves sponsoring, promoting
Individual Professional socialization Career development Faculty advancement Career satisfaction Institutional Enhanced productivity Retention Engagement of faculty Sustained institutional vitality Effective mentoring enhances both individuals & institutions
Traditional mentoring focuses on the relationship between mentor and protégé • Great variability in mentoring programs • Outcomes usually focus on establishment of a “successful” relationship • Evaluation usually ‘short term’ and descriptive of pairing process and logistical components of the program • Level 1 outcomes: participation/satisfaction
“GAPS” in the literature • “Success” in mentoring programs not usually defined • Evaluation often limited, short-term • Method for measuring success not standardized • Data lacking on longitudinal impact and influence on career success of participants in structured mentoring programs
Functional Mentoring* is an alternative paradigm for mentoring programs * Thorndyke, Gusic, Milner. Functional Mentoring: A Practical Approach with Multilevel Outcomes. JCEHP, 28(3):157-164, 2008.
Junior Faculty Development Program Luanne E. Thorndyke, MD Maryellen Gusic, MD Robert Milner, PhD
There are three goals for the JFDP: • to promote the development and advancement of faculty of the PSUCOM through a program tailored to the specific needs of junior faculty. • to nurture and cultivate junior faculty to become the next generation of academic leaders. • to support the retention of native faculty talent through opportunities to continuously build and expand professional skills.
The JFDP consists of two components: a curriculum in professional development and a mentored project Curriculum: topics in education, research, clinical practice and career development Mentored project: completed with the guidance of a senior faculty mentor • project appropriate to faculty assignment • a new mentoring relationship
The projects provide an important opportunity for scholarship • Mentor guides mentee on project through regular interactions • junior faculty report how the results of their projects will be disseminated (scholarship) • scholarly product is particularly important for clinical faculty • projects represent the outcome of a successful mentoring relationship Mentor-mentee expectations are defined in the description of the Mentoring Program
Junior Faculty* 78 MD, 31 PhD, 8 MD/PhD, 1 DVM 47 female, 71 male 18/23 departments 11 did not graduate Mentors* 44 MD, 33 PhD or other degree 11 female, 66 male 21/23 departments+ other PSU campuses 28 mentors served more than once 129 junior faculty have participated; 77 mentors helped since 2003 *Participation mirrors institution-wide faculty demographics
JFDP Projects: 2003-2008 Research — 66/118 (56%) • submitting grant application (21) • developing & pursuing research projects (43) • research administration, outreach (2) Education — 41/118 (35%) • creating new courses or curricula (34) • developing new educational techniques (7) Clinical — 11/118 (9%) • establishing new clinical service lines
Functional Mentoring* enables assessment at multiple levels * Thorndyke, Gusic, Milner. Functional mentoring: a practical approach with multilevel outcomes. JCEHP, 28(3):157-164, 2008.
Change in Behavior Modification of Attitudes Acquisition of Knowledge/Skills Learner’s Reactions Participation Kirkpatrick’s model for multi-level evaluation of training programs Change in Organizational Practice Morrison, J. ABC of learning and teaching in medicine: Evaluation. BMJ 326: 385 (2003)
Levels of an Outcomes-based CME Evaluation Model* • Participation • Satisfaction • Learning • Performance • Patient health • Population health *Moore DE. A framework for outcomes evaluation in the continuing professional development of physicians.
Functional mentoring evaluation: Outcomes at multiple levels • Participation • Reaction and Satisfaction • Impact of the mentoring relationship • Skill development • Individual Project (evidence of transfer/performance in practice) • Impact of the project on the individual (career advancement) and beyond (institution, profession, patients)
Results of short- and intermediate-term evaluation (5 year follow-up)* • High satisfaction • Mentors had significant impact on projects • Some impact beyond projects • Mentoring led to skill development • Mentoring program enhanced ability to make new mentoring relationships • Projects established new ventures • Projects impacted individual careers *Thorndyke, Gusic, Milner. Functional Mentoring: A Practical Approach with Multilevel Outcomes. JCEHP, 28(3):157-164, 2008.
In summary . . . • The JFDP and the mentoring program is perceived as a valuable educational experience by participants and mentors • Participants perceive mentoring to be valuable • About 50% of mentees surveyed have a continuing relationship with their mentors • Functional mentoring provides an effective framework for institutional mentoring programs.
Still more to come… • Longitudinal data, obtained up to 18 months after program completion, are “preliminary” in that data will be collected for 5 years post completion of the program. • Long-term effects of the program on career advancement cannot be assessed within the time frame of this study. • We are currently investigating the long term outcomes of the projects and their impact on individual career success and on the institution.
What are the pre-requisites for successful mentoring programs? • Structure and flexibility • Defined expectations • Tangible outcomes • Tacit and explicit institutional support • Reward and recognition • Administrative commitment • A scholarly approach to the evaluation process
Acknowledgements • Maryellen Gusic, MD • Associate Dean for Clinical Education Professor of Pediatrics • Co-Director, Jr. Faculty Development Program • Robert Milner, PhD • Director, Office of Post-Doctoral Affairs Professor of Neural & Behavioral Sciences • Co-Director, Jr. Faculty Development Program