180 likes | 195 Views
Learn about FAIMER's methods for assessing teaching excellence, including competencies, challenges, and supportive strategies in educational settings. Discover the importance of recognizing and rewarding faculty development in promoting quality education.
E N D
FAIMER Assessing Teaching Excellence John Norcini, Ph.D.
FAIMER Overview • Purposes • Competencies • Methods • Challenges • Good system of teacher evaluation • Supporting teaching excellence Education: That which discloses to the wise and disguises from the foolish their lack of understanding Ambrose Bierce
FAIMER Purposes • Assess individual teachers • Help faculty improve • Establish accountability and make decisions • Assess educational programs • Improve curriculum and courses • Generate reform “Good teaching is one-fourth preparation and three-fourths pure theatre.” Gail Godwin
FAIMER Competencies • Competency framework is essential but often missing (Hardin) • Competencies • Information provider, Role model, Facilitator, Assessor, Planner, Learning resource developer • Approach • Scientific principles, Attitudes and ethics, Decision making, Teamwork • Professional development
Alumni ratings Employer ratings Administrator ratings Teaching scholarship Teaching awards Learning outcomes Teaching portfolio FAIMER Methods • Teaching activity • Student ratings • Peer ratings • External expert ratings • Self-evaluation • Video • Student interviews Berk, 2005
FAIMER Student Ratings • Students rate teaching skills • Most popular measure of attributes like clarity, interpersonal rapport, concern for students... • Useful for formative, summative, and program evaluation • Thousands of studies with good evidence of reliability and validity • Challenges include the quality of the rating forms, assortment of biases...
FAIMER Learning Outcomes • Using student performance to judge teaching skill • Assessment of outcomes rather than process • Establishes accountability • Best for formative and program assessment • Challenges include whether there are differences in ability of students to start and whether there are influences on students beyond the teachers...
FAIMER Teaching Portfolio • Systematic collection of a variety of measures • Includes teaching effort, ratings, advising/mentoring, educational leadership-administration, learner assessment... • Judged by quantity, quality, scholarship • Good for both formative and summative assessment • Challenges include comparability, scoring standards, assessors...
FAIMER Methods • Substantial number of methods • All add something • All have limitations • Important to rely on a system of assessment rather than individual measures • Incorporate several sources of information • Capitalizes on the strengths of several methods and balances out deficiencies
FAIMER Challenges in Teacher Assessment • System of assessment • Nonexistent • Unfocused • For example, it relies on general satisfaction and does not include student achievement… • Undifferentiated • Satisfactory versus unsatisfactory • Unhelpful • Feedback does not inform improvement • Inconsequential
FAIMER Challenges in Teacher Assessment • Faculty are threatened • Faculty do not believe it is needed • No culture of teaching • Not enough faculty development • Feasibility • Community-based preceptors
FAIMER Characteristics of a Good System of Teacher Assessment • Annual process • Clear rigorous expectations • Multiple measures • Multiple ratings • Regular feedback • Significance
FAIMER Supporting Teaching Excellence • Assessment of teaching excellence is most effective in the context of a continuous quality improvement program • Faculty development • Provides appropriate recognition
Faculty Development • Faculty are trained to be health care providers but not teachers • Faculty development programs are intended to prepare faculty for their various roles • Help address faculty shortages • Empower faculty members to excel as educators • Create a community that values teaching and learning
FAIMER Faculty Development • Effectiveness evidence (Steinert et al, 2006) • Faculty development participants found the programs acceptable, useful, and relevant • Tests showed significant knowledge gains • Changes in teaching behavior were reported by participants and detected by students • Changes included greater educational involvement and establishment of networks
Recognition • Significance of teaching assessment requires some form of recognition • Faculty are often not rewarded for teaching and educational activities • Many cannot afford to devote much time to clinical education • Develop a system that recognizes, rewards, and promotes faculty, in part, based on their teaching activities
Recognition • Recognition can take a variety of different forms • Inclusion in the tenure and promotions process has been used successfully • Academy of Medical Educators in the UK • Recognizes commitment to medical education • Standards for membership that include active engagement, course work, CPD… • Acts as a credential that exceeds the minimum standards of the GMC for clinical trainers
Summary • Goal of measuring teaching excellence is to improve the quality of care • Formative, summative, programmatic • Variety of methods • System and competencies are needed • It is important to support teaching excellence • Faculty development and recognition "Some cause happiness wherever they go; others, whenever they go." Oscar Wilde