Unified Improvement Planning: Preparing to Plan Webinar (School Level)

1. Unified Improvement Planning: Preparing to Plan Webinar (School Level) Developed by : The Center for Transforming Learning and Teaching www.ctlt.org

2. Work Session Purpose Ensure school planning teams will have access to the performance data they need to engage in unified improvement planning

3. Materials • UIP Template (School-Level) • UIP Handbook • Inventory of Performance Data • Configuring IE8 for the Data lab (Internet Explorer) • Organizing Data for Continuous Improvement • UIP Fall Training Schedule

4. How this will work • Sharing information • Collecting your questions • Specific times identified (mid-webinar) to respond to questions that have come up so far • Recommended follow-up

5. Session Outcomes Participate in webinar.Access additional resources.Complete follow-up activities. • Describe the student performance data needed to engage in unified improvement planning (state and locally available). • Describe the performance data needed to identify trends in each performance indicator area. • Identify local options for accessing required state data views/ reports. • Inventory locally available student assessment results (and when they are available during the year). • Identify which views/reports to bring to data analysis work sessions.

6. Agenda Overview of UIP data needs Identifying Trends Accessing Performance Data

7. Purposes of Unified Improvement Planning • Align federal and state accountability systems. • Provide a framework for performance management. • Support school and district use of performance data to improve system effectiveness and student learning. • Shift from planning as an event to continuous improvement. • Give external stakeholders a way to learn about how schools and districts are making improvements.

8. How will engaging in unified improvementplanning result inimprovements in performance?

9. Theory of Action: Continuous Improvement Evaluate Evaluate FOCUS Implement Plan Monitor Progress at least quarterly

10. State Performance Indicators

11. Colorado Unified Planning Template Major Sections: • Summary Information about the school or District • Improvement Plan Information • Narrative on Data Analysis and Root Cause Identification • Action Plan(s)

12. Unified Improvement Planning Processes Gather and Organize Data Review Performance Summary Describe Significant Trends Prioritize Performance Challenges Identify Root Causes Data Analysis (Data Narrative) Set Performance Targets Identify Major Improvement Strategies Progress Monitoring Identify Interim Measures Identify Implementation Benchmarks Target Setting Action Planning

13. Gathering and Organizing Data • To support local efforts to • Develop Unified Improvement Plans • Monitor progress continuously (at least quarterly) • What data? • Required State Data Reports/Views • Local Data Sources • UIP Handbook, p. 5-6: Gathering and Organizing Relevant Data

14. Multiple measures must be considered and used to understand the multifaceted world of learning from the perspective of everyone involved.-Victoria Bernhardt

15. Demographics School Processes Provides information that allows for the prediction of actions, processes, programs that best meet the needs of all students. Perceptions Student Learning Victoria Bernhardt

16. For what are multiple measures used in UIP? • Review current performance and prior year’s targets • Analyze data to identify trends • Prioritize performance challenges • Identify root causes • Identify interim measures (and monitor changes in student performance during the year) • Identify implementation benchmarks (and monitor implementation of action steps)

17. Looking Backward LOOKING FORWARD

18. Inventory Local Performance Data • Inventory of Performance Data Sources (spread sheet included in the materials for this webinar). • Components (see Legend) • Content Area • Assessment • Grade Levels • Which Students • Content Focus • Metrics • Questions • Follow-Up: Complete an inventory of performance data available to your school.

19. Your questions?

20. Agenda Overview of UIP data needs Identifying Trends Accessing Performance Data

21. Trends • Include all performance indicator areas. • Include at least three years of data. • Consider data beyond that included in the school performance framework (grade-level data). • Include positive and negative performance patterns. • Identify where the school did not at least meet state and federal expectations.

22. Trends Could be:

23. Trend Statements • Include: • Measure/Metric • Content Area • Which students (grade-levels, disaggregated groups) • Direction • Amount • Time period • Examples • The percent of 4th grade students who scored proficient or advanced on math CSAP declined from 70% to 55% to 48% between 2009 and 2011. • The median growth percentile of English Language learners in writing increased from 28 to 35 to 45 between 2009 and 2011. • Our dropout rate has been stable (15, 14, 16) and much higher than the state average between 2009 and 2011.

25. Your questions?

26. Agenda Overview of UIP data needs Identifying Trends Accessing Performance Data

27. Performance Data Sources CDE • www.schoolview.org • Data Center (graphs and charts) – 2011 data available August 3rd • Data Lab (charts) – 2011 data available August 3rd • requires changes in IE8 security settings • Math, reading, writing (no science) • The Colorado Growth Model (public and student-level data access) • PDF files • School Growth Summary Report • CEDAR (export into Excel) • Flat-files provided directly to district District data reporting tools

28. Data Lab • Requires changes in Internet Explorer security settings • On-line Tutorial on how to use it • On-line FAQ helps address issues that may arise • To download files to excel you may need to hold ctrl down while clicking on download

29. Poll • How do you access performance data for your school?

30. Small N? • What if summary reports have little or no data? • CDE does not report data for small N to protect student privacy. • Options? • Student-Level Data • Summary statistics for smaller N • Accessed through • District data reporting tool • Downloading student-level records from CEDAR • The Colorado Growth Model web-based application (student-level)

31. Accessing State Data • Username and password required to: • Download data files from CEDAR • Access student-level data through the Colorado Growth Model web-based application • Who provides/changes usernames and passwords? • District assigned Local Access Manager (LAM) • State does not provide or change school-level usernames and passwords. • Poll: Who has a username and password?

32. Notes for Alpine Users • Users can select the N for summary statistics (as low as 1) • Users identify the “groups” of students for whom they want to run reports. • Training Videos include – how to create groups.

33. Your questions?

34. What performance data views/reports do we need? • How do we analyze data with action in mind? • Would action steps target growth separate from achievement? • In what categories do we take action? • Content areas (math, reading, writing, science) • Disaggregated groups of students (low performing, low growth, race/ethnicity, ELL, IEP. . .)

35. Levels of data/levels of challenges System Program (Tier I) Program (Tier II/ Tier III) Individual

36. A path through the data. . . Review the SPF Report to identify where performance did not at least meet expectations (federal/state/local) Select one content area on which to focus Consider performance (achievement/growth) by grade level for 3+ years Consider performance by disaggregated group by grade level for 3+ years Look for and describe positive and negative trends Disaggregate groups further Within grade-levels consider achievement by standard/sub-content area Look across groups Consider cross-content area performance (3 + years) Consider PWR metrics over 3+ years

37. Your questions?

38. Academic Achievement • CSAP performance by grade level • % proficient and advanced • % and number scoring at each performance level • Available from CDE: • Data Center (http://www.schoolview.org/performance.asp ) • Data Lab (http://www.schoolview.org/performance.asp ) • Download files from CEDAR • Flat-files provided to districts • District data tool

39. Data Center

40. From the Data Lab

42. Academic Growth • The Colorado Growth Model by grade level • Median Student Growth Percentile • % Catch-up, %Keep-up, %Move-up • Available from CDE: • The Colorado Growth Model (web-version) • Data Center • Data Lab • School Growth Summary Report (pdf) • Download from CEDAR • Flat files provided to district • District data tool

43. Schools within a District

44. Students in a Grade in a School

47. Standard/ Sub-Content Area • CSAP Achievement by Standard or Sub-Content Area by grade-level • % proficient and above • Available from CDE: • Flat files provided to district • Download from CEDAR • District Data Tools

49. Disaggregated Groups • More detailed than the SPF/DPF • SPF/DPF Disaggregated Groups: • Minority • Free/Reduced • ELL • IEP • Below Proficient

50. Disaggregated Group Performance • CSAP and Colorado Growth Model by grade-level • Achievement: %proficient and advanced, % performing at each level • Growth: median student growth percentile, %catch-up/keep-up/move-up • Available from CDE: • School Growth Summary Report • The Colorado Growth Model (web-version) • Data Center • Data Lab • Download from CEDAR • Flat File provided to district • District data tool