PDE Phase II Principal Effectiveness

1. PDE Phase II Principal Effectiveness Region 9 Cristine Wagner-Deitch Dr. Eric Rosendale

2. Learning Intentions Participants will… Understand that principal evaluation is an informative process – not an isolated event. Become familiar with the process and tools associated with Phase II. Utilize the Principal Effectiveness Rubric to create methods and practices that align to district/school efforts toward increased teacher effectiveness and student achievement. Begin to develop a district/school plan which builds capacity around the Principal Effectiveness Rubric. Region 9

3. Today’s Agenda… Overview and Rationale for the Project Establishing a Common Definition of Principal Effectiveness Focus on an Evidence-Based System Differentiation of Evaluative Processes The Role of Principal Growth The Importance of Transparency Systems Planning and Reflection Region 9

4. What to Expect This training will be: This training will not be: simply about compliance. a session focused only on how to “fill out the forms.” about providing the “right” answers. • a chance to reflect on principal effectiveness. • a way to make connections between teacher & principal effectiveness frameworks. • an opportunity to examine current system based on “best practice.” Region 9

5. Setting Norms for Our Group Please… • Participate and ask questions. • Understand that there are unknowns. Region 9

6. Training Materials Section 1:Powerpoint Slides Section 2:Training Materials Section 3:Research Documents Section 4:Rubrics Region 9

7. Project Goal To develop an educator effectiveness model that will reform the way we evaluate school professionals as well as examine the critical components of training and professional growth. The term “educator” includes teachers, education specialists, and principals. Region 9 “The term “principal” shall include a building principal, an assistant principal, a vice principal or a director of vocational education.” ~HB 1901

8. Definition of Terms Effectiveness: “Effective principals are those who boost academic achievement for all students, increase the effectiveness of their teaching staffs, and consistently take leadership actions shown to improve outcomes for students” (Reeves, 2010). Supervision: Collegial, focused on growth, ongoing, formative Evaluation: Requires summative judgment, based on evidence Region 9

9. Opening Activity: What’s Your System? TM pg. 2 • What is your current principal evaluation process? • Use the worksheet to • list the steps in your system. • organize your list using your school calendar. • Reflect: • How does your current system advance your district goals and promote principal growth? Region 9

10. Principal Effectiveness: Setting the Stage Region 9

11. Educator Effectiveness Overview Where we are in 2012-2013 • Teacher Effectiveness – Phase III • Principal Effectiveness – Phase II • Specialist Effectiveness – Phase I Region 9 • Anticipated Statewide Implementation • Teacher Effectiveness – 2013-2014 • Principal Effectiveness – 2014-2015 • Specialist Effectiveness – 2014-2015

12. Principal EffectivenessWhy Important and Why Now? • Effective school leadership has an impact on developing a culture focused on student achievement. However as stated by Douglas Reeves from the Leadership and Learning Center: “Most leadership assessments are infrequent, late, unhelpful and largely a source of administrative bother.” • Given the efforts taking place with teacher effectiveness, this becomes an opportune time for Pennsylvania to also develop its first universal instrument for principal effectiveness. Region 9

13. Principal Effectiveness Why Important and Why Now? (continued) As the Commonwealth continues its work with the establishment of universal effectivenessinstruments, it is essential that building and system leaders have initial and on-going training to guarantee sustainability and reliability. http://www.wallacefoundation.org/principal-story/executive-video/Pages/default.aspx Region 9

14. Our Approach Review of Previous Work • Reviewed existing state models from North Carolina, Delaware, Washington, Tennessee, and Colorado • Analyzed elements of the various models from the following perspectives: • The nine PA School Leadership Standards; Specifically the Core & Corollary Leadership Standards as mandated by Act 45 of 2007 • The leader’s role in improving student achievement • The desire for measureable and constructive feedback to staff • Conducted an extensive review of research linked to principal effectiveness. • MET Project • RAND • Wallace • Calder Region 9

15. Our Approach Review of Research • Highlights from the Measures of Effective Teaching (MET) Report: • Principals have the greatest indirect impact on student learning. • An emphasis is needed for evaluators to be accredited and reaccredited after a set period of time to prevent rater drift. • Having multiple observers helps to validate the growth, improvement, and evaluation process. Resource: http://www.metproject.org/reports.php Region 9

16. Our Approach Review of Research (continued) • Highlights from the April 2010 Policy Brief, Center for Analysis of Longitudinal Data in Education Research (CALDER): • More effective principals are able to staff schools with more effective teachers • Experience is a predictor of principal effectiveness • The principal's job is complex; Effectiveness depends on sense of efficacy on tasks and how time is allocated for tasks • Principal evaluations of teachers can offer valuable feedback on teacher performance, as opposed to student test scores alone Resource: http://www.caldercenter.org/publications/calder-policy-brief-8.cfm Region 9

17. Our Approach Engaging Stakeholders and Expertise • Educational experts from national, state, and locals levels provided reviews of various work throughout the process. • On June 18, 2012 Pennsylvania conducted its first statewide stakeholder meeting, which included representation from LEAs of various sizes and locations. Region 9

18. Our Approach Incorporating Act 82 of 2012 • Within Act 82, new requirements for Educator Effectiveness have been defined for teachers, principals, and education specialists. • Within the Act, it defines various categories that need to be addressed within principal evaluation systems: • Planning and Preparation • School Environment • Delivery of Service • Professional Development Region 9

19. Principal Effectiveness System • Observation/ Evidence • Domains • Strategic/ Cultural Leadership • Systems Leadership • Leadership for Learning • Professional and Community Leadership Building Level Data PSSA Achievement PVAAS Growth Graduation Rate Promotion Rate AP Course Participation SAT/PSAT Correlation PVAAS Region 9 Elective Data/SLOs District Designed National Tests District Rubrics IEP Growth Projects Portfolios Surveys PDE Standards for Review And Approval

20. Principal Effectiveness InstrumentCreation of a Framework • Combing all the background previously identified, a draft framework was developed that establishes a set of four leadership domains: • Domain 1: Strategic/Cultural Leadership • Domain 2: Systems Leadership • Domain 3: Leadership for Learning • Domain 4: Professional and Community Leadership • The framework contains specific components (with corresponding descriptors) to be included in each of the four domains. Region 9

21. Principal Effectiveness Instrument:Alignment with Act 82 and PIL Program Forms pg. 14 Draft – For Reference Only Region 9

22. PA CORE Standards The leader … • has the knowledge and skills to think and plan strategically, creating an organizational visionaround personalized student success. • is grounded in standards-based systems theory and design and is able to transfer that knowledge to his/her job as the architect of standards-based reform in the school. • knows how to accessand use appropriate datato inform decision-makingat all levels of the system. Region 9

23. Corollary Standards The Leader… • creates a culture of teaching and learningwith an emphasis on learning. • manages resourcesfor effective results. • collaborates, communicates, engages, and empowers othersinside and outside of the organization to pursue excellence in learning. • operates in a fair and equitable mannerwith personal and professional dignity. • advocates for children and public educationin the larger political, social, economic, legal, and cultural context. • supports professional growthof self and others through practice and inquiry. Region 9

24. Principal Effectiveness Why Important and Why Now? (continued) As the Commonwealth continues its work with the establishment of universal effectivenessinstruments, it is essential that building and system leaders have initial and on-going training to guarantee sustainability and reliability. Region 9

25. Phase II Requirements • Both the central office supervisor AND the principal(s) collect and share evidence for 3-5 components on the rubric. • One must fall under “Leadership for Learning.” • Supervisor submits results of collaborative assessment(s) using levels of performance for the 3-5 components chosen. • Supervisor and principal(s) provide feedback on the rubric and the process. Region 9

26. Why Evaluate Principals? Quality Assurance Professional Learning Region 9

27. 5 “Best Practices” forPrincipal Evaluation Common definition Focus on evidence Differentiation of evaluative processes Role of principal in their own growth Transparency Region 9

28. 5 “Best Practices” forPrincipal Evaluation Common definition Focus on evidence Differentiation of evaluative processes Role of principal in their own growth Transparency Region 9

29. Best Practice #1: Common Definition Start with a common definition of principal effectiveness that is studied, and understood, by all stakeholders. Region 9

30. Best Practice #2: Evidence Let evidence, not opinion, anchor the process. Region 9

31. Characteristics of Principal Effectiveness TM pg. 3 What do you view as the five most important characteristics/behaviors of effective principals? Region 9

32. Group Consensus Compile a list of characteristics and behaviors and indicate top three with most impact on student learning. Region 9

33. State of the Research: Article Review and Discussion Research • Guiding Question: How do OUR perceptions of principal effectiveness match with the research literature? • State of the Research (Choose One) • The Principal as Leader: Guiding Schools to Better Teaching and Learning (Wallace Foundation) • First Year Principals in Urban Districts: How Actions and Working Conditions Relate to Outcomes, Summary Document (Rand Corp) Region 9

34. State of the Research: Article Review and Discussion TM Pg. 4 • Highlight at least three key ideas that you’d like to discuss at your tables as you read. • When everyone is finished, discuss the key points everyone highlighted. • Bring your discussion to closure by examining the characteristics on chart paper and discussing the following question: How do OUR perceptions of principal effectiveness compare with the research literature? Region 9

35. Principal Effectiveness Review of Research (continued) • Highlights from the Wallace Foundation Report: “The School Principal as Leader” include the following competencies for effective school leaders: • Share a vision of academic success for all students • Create a climate hospitable to education • Cultivate leadership in others • Improve instruction • Manage people, data, and processes to foster school improvement Resource:http://www.wallacefoundation.org/knowledge-center/school-leadership/effective-principal-leadership/Documents/The-School-Principal-as-Leader-Guiding-Schools-to-Better-Teaching-and-Learning.pdf Region 9

36. Principal Effectiveness Review of Research (continued) • Highlights from the RAND Corporation Report: “First Year Principals in Urban School Districts”: • The report provided an analysis of the relationship between first year principals and achievementwithin urban school districts. • Results showed that when a principal leaves, student achievement suffers 2-3 years. Resource: http://www.rand.org/content/dam/rand/pubs/technical_reports/2012/RAND_TR1191.pdf Region 9

37. The Domains Strategic/Cultural Leadership Systems Leadership Leadership for Learning Professional and Community Leadership Region 9

38. Review: Evidence or Opinion? Principal Jones’ teachers all seem to feel positive about the direction that he is taking them to improve student academic outcomes. Faculty meeting agendas and handouts list safety policies and procedures. Building data teams held regularly scheduled meetings to develop proficiency plans for at-risk students, using specific protocols. Principal Rogers has difficulty with completing evaluation reports within the required timeline. Principal Sally states, “I have involved teachers in planning professional development.” Region 9

39. Exploring the Domains TM pg. 5 Forms T & P Rubric Region 9

40. PA’s Principal Effectiveness Framework Region 9

41. How to Make the ProcessFormative and Informative TM pg. 2 • Refer back to your district evaluation system & discuss: • Where does the principal rubric “fit”? • How might you enhance your process through evidence collection? • What barriers exist, and how might you address them? • How can you be sure that your principal has met a goal? Region 9

42. Connecting the Frameworks, Domains, and Components Framework for Teaching PA Principal Effectiveness Framework 4 Domains 19 Components Levels of Performance Design incorporates current research Focused on professional growth Promotes positive impact on student learning Distinguished extends beyond “self” • 4 Domains • 22 Components • Levels of Performance • Research-based • Focused on professional growth • Promotes positive impact on student learning • Distinguished extends beyond “self” Region 9

43. 5 “Best Practices” forPrincipal Evaluation Common definition Focus on evidence Differentiation of evaluative processes Role of principal growth Transparency Region 9

44. Best Practice #3: Differentiation of process • How do you differentiate the principal evaluation process? • by building goals? • based on principal’s level of experience? Region 9

45. 5 “Best Practices” forPrincipal Evaluation Common definition Focus on evidence Differentiation of evaluative processes Role of principal in their own growth Transparency Region 9

46. Best Practice #4: Role of the Principal in Their Own Growth Who does the thinking? Who does the learning? Region 9

47. Remember the teachereffectiveness process… TM pg. 6-8 What would the principaleffectiveness process look like? Region 9

48. PDE Phase II Process Principal’s self-assessment Together, supervisor and principal choose 3-5 components on the rubric for Phase II Review and embed principal effectiveness framework in current district evaluation process Beginning of Phase II meeting with supervisor and principal to set goals (January 2013) and map out evidence that will be collected and used throughout Phase II to measure effectiveness. Supervisor and principal meet midway to provide feedback, grounding conversation in the principal framework and the evidence collected so far (March 2013). Adjust goals and/or evidence list, if needed. Supervisor and principal meet at EOY (June 2013) to discuss evidence collected and determine levels of performance for selected components. Data submission to PDE (Deadline: June 30, 2013) Region 9

49. Principal Growth • Use Danielson’s Framework for Teaching process to create a similar process for principals. • Suggestions include: • Principals use rubrics and highlighters to self-assess their effectiveness. • Principals use data to set priorities based on component in the rubric. • Both supervisor and principal gather and share supporting evidence. (On-going) • Supervisors use highlighted rubrics to identify areas of agreement (based on evidence). • Supervisor and principal collaboratively assess the principal’s effectiveness for individual components Region 9

50. Systems Approach to Principal Effectiveness: Training Pg. 8 How do you link individual principal’s building goals to district goals? What’s the timing of the principal evaluation process given that data should be a valuable part of the goal-setting process? How frequently do you meet with the principal throughout the year to discuss and provide feedback on components of the rubric? Region 9