Evaluation Plan for Wisconsin’s Educator Effectiveness System

1. Evaluation Plan for Wisconsin’s Educator Effectiveness System Prepared for the Wisconsin Department of Public Instruction By: ● Josef Dvorak ● Daniel Marlin ● Christa Pugh ●Nels Rude ●Mai ChouaThao Source: http://mashable.com/2012/07/23/technology-in-the-classroom/

2. Background on Educator Evaluation Systems • ● Emerging evaluation systems • ● Multidimensional evaluation • measures • ● Value-added modeling (VAM) • and other evidence-based • metrics • ● Professional development • ● Summative & formative feedback Source: http://twiniversity.com/2013/12/what-teachers-really-want-for-christmas/

3. Wisconsin’s Educator Effectiveness System ●Statewide implementation in 2014 ● System goal: “Provide a performance based evaluation that leads to improved student learning by supporting continuous improvement of educator practice.” ●Project goals: ● Identify recommendations for evaluating the Wisconsin Educator Effectiveness (EE) System ● Inform creation of Request for Proposal (RFP)

4. Logic Model

5. Methodology • ● State selection criteria • ● Contacted all states with a statewide evaluation system • ● Found documentation from 15 states • ● Highlighted common • and novel practices • ● Four broad topics • of research

6. Recommendations: Research Questions ● Implementation: How was the evaluation system enacted in each site? ● Educator perceptions: What were teachers’ and administrators’ perceptions of teacher evaluation and the classroom observation rubrics being implemented? ● Burdens of reform: What is being done in your school and/or school district to ensure the optimal implementation of the new teacher evaluation system? Source: http://www.c2mclean.com/smarter-students/elementary-school-students/

7. Recommendations: Research Questions ● Changes to educator behavior: To what extent did participants perceive that initial implementation of the new teacher effectiveness measures resulted in teachers increasingly reflecting about their practice? ● Metric and process fidelity: Do the evaluations produce ratings that are appropriate, valid, and reliable? ● Student outcomes: What is the impact on student outcomes?

8. Recommendations: Metrics • ● Implementation • ● Perceptions • The number of formal classroom observations was adequate to assess my performance. • ● Resources • I am confident that my district will provide me with the opportunities and resources to achieve system goals. • ● Quantitative measures • Number of teachers evaluated, median number of • observations per teacher • ● Educator outcomes • Whether teachers changed their educational • practices or increased collaboration • ● Student outcomes • Value-added modeling Source: http://3forward.com/sales-leaders-blog/tips-for-sales-managers-raising-sales-effectiveness/

9. Recommendations: Data Collection • ● Qualitative • ● Surveys • ● Focus groups • ● Interviews • ● Quantitative • ● Stratified sampling Source: http://www.employeesurveys.com/

10. Recommendations: Data Analysis ● Aggregate and publish survey, focus group, and interview data ● Statistical methods ● VAM ● Interrupted time-series model Source: http:/Moksony_Ferenc_Statistical_Methods_for_Program_Evaluation/ch07.html /www.tankonyvtar.hu/en/tartalom/tamop425/0010_2A_04_

11. For further information: Contact the La Follette School’s publications office at 608-263-7657 or publications@lafollette.wisc.edu Or see www.lafollette.wisc.edu/publications/workshops.html Thank you!