340 likes | 478 Views
When Evaluation Gets Personal: Implications for Policy and Practice. CREATE 22 nd Annual Conference Atlanta, GA October 12, 2013 Very early on a Saturday morning. Andy Baxter SREB. In the end, it will all depend on the ability of adults in the schoolhouse to challenge and
E N D
When Evaluation Gets Personal: Implications for Policy and Practice CREATE 22nd Annual Conference Atlanta, GA October 12, 2013 Very early on a Saturday morning Andy Baxter SREB
In the end, it will all depend on the ability of adults in the schoolhouse to challenge and learn from one another. When Evaluation Gets Personal | Baxter
Section 1 The Good Ol’ Days When Evaluation Gets Personal | Baxter
A pearl of professional development in here somewhere.
98% You are doing fine. When Evaluation Gets Personal | Baxter
Section 2 And then we learned… When Evaluation Gets Personal | Baxter
Teachers are not all the same. When Evaluation Gets Personal | Baxter
Section 3 So much valuable new data. So many ways to screw it up. When Evaluation Gets Personal | Baxter
Categories can complicate. Ineffective? Developing? Accomplished? Exemplary? When Evaluation Gets Personal | Baxter
Tenure Compensation Barrier #1 Emphasizing policies that create high levels of anxiety. Setting Goals Accountable to Team Give and Receive Feedback Monitor Results Reward & Recognition When Evaluation Gets Personal | Baxter
Barrier #2 Our uncanny ability to deceive ourselves. When Evaluation Gets Personal | Baxter
Reflective Controlled Effort Deductive Slow Self-aware Rule-following
Automatic Uncontrolled Effortless Associative Fast Unconscious Skilled
Which middle circle is larger? When Evaluation Gets Personal | Baxter
“The target question is the assessment you intend to produce. The heuristic is the simpler question that you answer instead. The technical definition of heuristic is a simple procedure that helps find adequate, though often imperfect, answers to difficult questions. The word comes from the same root as eureka.” Substituting easy questions for hard ones When Evaluation Gets Personal | Baxter
How well is this teacher instructing her students? She is a good person. She hasn’t had a raise in years. I don’t trust those value-added measures. Whom else could I get? She tries hard. But I see her every Sunday at church. Bless her heart.
Section 4 Human judgment and evaluation When Evaluation Gets Personal | Baxter
Decision Fatigue When Evaluation Gets Personal | Baxter
Confirmation Bias: A tendency of people to favor information that confirms their beliefs or hypotheses. When Evaluation Gets Personal | Baxter
Availability bias: A tendency to make judgments about the probability of events by how easy it is to think of examples. Group A Group B Please list 7 ways this presentation could be improved: 1. Shorter 2. More interactive 3. Different presenter 4. More relevant 5. Better snacks 6. ? 7. ? Please list 2 ways this presentation could be improved: 1. Shorter 2. More interactive Which group will give the highest overall rating for the presentation on a scale of 1 ->5 (highest)? When Evaluation Gets Personal | Baxter
Compensatingbias: distorting the things you can control to correct for the things you cannot When Evaluation Gets Personal | Baxter
The halo effect: tendency to like/dislike everything about a person, including things you have not observed (Kahneman).
Negativity bias: The tendency to pay more attention and give more weight to negative than positive experiences or other kinds of information.
Anchoring effect: tendency to rely too heavily on the first piece of information offered Group A Group B How often do you make love? How happy are you? • How happy are you? • How often do you make love? Correlation = 0.11 Correlation = 0.62 When Evaluation Gets Personal | Baxter
Section #5 Five strategies to protect others from your human judgment When Evaluation Gets Personal | Baxter
Watch yourself. When Evaluation Gets Personal | Baxter
Monitor your cognitive load. When Evaluation Gets Personal | Baxter
Compare notes. When Evaluation Gets Personal | Baxter
Learn. When Evaluation Gets Personal | Baxter