130 likes | 255 Views
Measuring Principal Performance: How Rigorous Are Publicly Available Assessment Instruments?. Matthew Clifford Learning Point Associates matthew.clifford@learningpt.org Presentation for PEAC July 2010. Learning Point Associates Overview. www.learningpt.org.
E N D
Measuring Principal Performance: How Rigorous Are Publicly Available Assessment Instruments? Matthew Clifford Learning Point Associates matthew.clifford@learningpt.org Presentation for PEAC July 2010
Learning Point Associates Overview www.learningpt.org www.learningpt.org/expertise/educatorquality/METworks.php
What is Your Perspective onPrincipal Performance Assessment? • What instruments are you or others currently using? • How systematically are the instruments being administered? • How are results being used? • How confident are you in the assessment instruments and process?
What Research Tells Us about Principal Performance Assessment • School districts’ principal performance assessments appear to be inconsistently administered and measured (Goldring et al, 2009; Thomas et al, 2000; Murphy et al, 2007). • Principal performance assessments are not always aligned with existing state or national professional standards for practice, and lack justification or documentation of psychometric research (Heck & Marcoulides, 1996).
Learning Point Associates: Managing Educator Talent Performance Management Coherent Systematic www.learningpt.org/expertise/educatorquality/METworks.php
Principal Performance Assessment: Recommended Attributes • Transparent • Trusted • Consequential • Systematic and consistent • Involving multiple measures • Validate and reliable (Brown-Sims, 2010)
Our Study: Question & Method Question: How valid and reliable are publicly available principal performance assessment instruments?
Our Study: Review Criteria and Results Criteria for inclusion: • Claim of use as a principal performance assessment • Recent (within past 15 years or so) • Publicly available technical information Results of scan: • 2000 articles identified by keyword search & snowball sampling • Approx. 400 examined • 20 articles reviewed on 8 assessment instruments
Our Study: What did we learn? • If there are many principal performance assessment being used in the field, then evidence of their reliability and validity is not publicly available. • Of those reviewed, 5 of 8 were developed in tested in the mid-to-late1980s. • Survey-based assessment gather self, and others (3), perceptions of principal performance. One used a trained rater. • No information on consequential validity, and two examples of concurrent validity.
Matt Clifford E-Mail:matthew.clifford@learningpt.org Phone: 630-689-8017 1120 East Diehl Road, Suite 200 Naperville, IL 60563-1486 General Information:800-356-2735