Continual Improvement Process

1. Continual Improvement Process Oregon Department of Education April, 2012

2. GOAL: This informational session will review requirements for the evaluation of the 2011-12 improvement plans and some principles of Effective Planning for Continual District/School Program Improvement. Review Rubric for evaluation of implementation of Title III Improvement Plans. Lessons Learned Section A– Planning, Section B Implementing, Section C Monitoring. AGENDA

3. SY 2010-11 • Parent Notification • After four years: Modify Curriculum/ Instruction or • Funding? • Replacement of Personnel 3 yrs. • SY 2009-10 • Parent Notification • After Two years: Improvement Plan; TA SY 2007-08 Parent Notification • SY 2008-09 • Parent Notification • After Two years: Improvement Plan; TA Timeline of Accountability for LEAs 1 yr 2 yrs. 4 yrs.

4. Example of a timeline for Implementing Plans/Provisions

6. EVALUATION OF IP PLANS 2011-12 PROCESS: • Follow Guidelines in Evaluation Rubric • Evaluation will be the first item on the submission of 2012-13 IP Plans • Missing items from the evaluation will result in returning the 2012-13 IP Plans for review. • Why? The 2012-13 plans are a follow-up of the 2011-12 IPs • All plans should be sent to Leslie Casebeer by June 29, 2012.

7. Procedures (A series of actions or steps taken to achieve an end) are provided to monitor to assess the implementation for all activities set forth in the master plan; The formative (short-term) evaluation procedures should seek to determine if the strategy had the expected effect on student achievement; The summative (long-term) evaluation procedures should seek to determine if the goals and objectives (activities) have been attained. Adapted from the Louisiana Department of Education Evaluation Rubric – 3 Guidelines

8. Guideline I. The evaluation procedures to monitor and assess the indicators of implementation for all activities should include at least three of the four of the following criteria: 1. What data instrument(s) was used to collect information and what kind of feedback was obtained as a result of the data analysis (inquiry)? 2. What was measured or assessed, and how was this information used? 3. Who conducted theevaluation? Please include the position title, i.e. Curriculum Director, Principal, etc. 4. How often were the goals/activities monitored (frequency)? Evaluation Rubric

9. Guideline II. The formative (short-term) evaluation procedures should seek to determine if the strategy had the expected effect on student achievement. • Did the evaluation procedures provide sufficient evidence to evaluate the short-term effects for each strategy on student achievement? • Short-term effects may have included student portfolios, comparison of student’s work throughout the year, teacher-made tests, or other similar type evidence. EVALUATION RUBRIC

10. Guideline III. The summative (long-term) evaluation procedures should seek to determine if the goals and objectives have been attained. Did the summative evaluation adequately convey if the school/district is improving? The summative evaluation should include the applicable testing instruments with descriptions of how they were used to determine if the goals and objectives were attained. This evaluation should include a comparison and/or analysis of test data but may also include other types of assessment and/or qualitative data. EVALUATION RUBRIC

11. QUESTIONS

12. Comprehensive Needs Assessment: Planning, Inquiry, SMART Goals • Implementation: Research-based strategies, design of master plan, professional learning, parental engagement School/District Improvement: The Leadership and Learning Center • Monitoring: Master Plan, Frequency, Measuring Progress, Evaluation

13. Assessment Results Gather and reflect on school/district data: external and internal. Comprehensive Needs Assessment Planning

19. Comprehensive Needs AssessmentPlanning Teacher Practices • Focuses conversation on research-based best practices • Educators talk about their practices, share their knowledge and skills and support one another in the specific contexts in which they work.

21. Leadership Performance: Implementing Innovations: Develops, articulates, and communicates a shared vision of the intended change. Investing in professional learning. Monitoring— Checking on progress. Providing continual assistance. Creating a context supportive of change. School Improvement Planning forthe Success of English Language Learners

22. STOP

23. QUESTIONS?

24. Reflect and celebrate program strengths; Determine what is currently working well and why; Assist in building program capacity in identifying strengths, areas which require attention to sustain strengths; Foster introspection, reflection and analysis; Lead to better planning with precision and intentionality; Act as a catalyst for collaborative and collegial conversations about sustainability from within. STRENGTHS: The Leadership Team

25. Identify areas in need of improvement; Identify a “vital few” key areas upon which to focus improvement efforts ; Acts as a catalyst for collaborative and collegial conversations about improvement from within; Provides a forum for consensus building around program improvement; Develops a deeper understanding of the unique improvement needs of schools and facilitates the communication of the improvement goals; Identify possible cause and effect scenarios. AREAS OF IMPROVEMENT: The Leadership Team

26. SMART Goals Specific and Strategic – Have you articulated precisely what you want to achieve and have priorities been strategically selected based on a comprehensive needs assessment? Measurable- Are you able to assess/ measure your progress? Achievable- Is the goal within your reach and within your control? Are targets ambitious yet attainable? Results-Based – Have established base-line data and targets of where you want to end up? Time-bound- What is the dead-line for completing your goal?

27. Specific and Strategic Ask questions such as: • In what area are a significant number of students experiencing difficulty? • What specific aspect of this area of concern would make the biggest impact for students if improvement occurred? • If students could change and do “X” in this area, would they benefit greatly – would it positively impact other areas of their learning? • If our goal was achieved and the specific area identified was significantly improved, what would students be doing? In other words, what would be the indicators?

28. Measurable Ask questions such as..... • What tool(s) will best measure if targets have been achieved? • Can the tool(s) be used to establish a baseline? • What is the achievement target for your students?

29. Attainable Ask questions such as..... • Is what we are expecting reasonable? • Do we have the capacity to make the desired change? If “yes”, how do we most effectively use our capacity to make the changes? If “no”, how do we prepare ourselves so we have the capacity to make the changes?

30. Setting Attainable Targets According to The Leadership and Learning Centre: If student performance is in the: 1st quartile the percentage increase should be at least 20% 2nd quartile at least 12% 3rd quartile – around 7% Top quartile – around 4% (Dr. Douglas Reeves, 2007)

31. Results -Oriented Ask these questions... • Why is it important for staff to achieve this goal? • Have ambitious yet attainable targets been set?

32. Time Bound Ask questions such as.... • What is the timeframe for achieving this goal? • What strategies are in place to keep us on track (monitoring strategies and time)

35. PARENT PARTICIPATION

36. . .

37. . .

40. Monitoring and Adjusting Evaluation

41. QUESTIONS?

43. Title III Contacts Kim A. Miller Education Specialist Education Improvement and Innovation kim.a.miller@state.or.us(503) 947-5712 Leslie Casebeer Leslie.Casebeer@state.or.us Phone:  (503) 947-5648 Fax:  (503) 378-5156

44. Title III Contacts Carmen West Program Specialist for Title III, ESL, Bilingual Programs Education Improvement and Innovation carmen.west@state.or.us 503-947-5669 44