Using Multiple Data Tools to Evaluate Our School's Effectiveness in Meeting the Needs of Different Groups of Student

1. Using Multiple Data Tools to Evaluate Our School's Effectiveness in Meeting the Needs of Different Groups of Students PVAAS Statewide Core Team Fall 2011

2. Alternative Entry Points Session: Needs of INDIVIDUAL STUDENTS Session: Evaluating Effectiveness with GROUPS This session Assessing Our Capacity to Meet the Needs of Groups of Students

3. The PVAAS Fall 2011 Sessions Session: Session: Using Multiple Tools to Evaluate Our School's Effectiveness in Meeting the Needs of Different Groups of Students What is our current grade level data process? How do we analyze our success in supporting Subgroups? At risk students? High achieving students? What do we do with these data? Using Multiple Tools to Identify the Needs of Individual Students • What is our current student level data process? • What are our performance risks? • How do we identify students at risk? • What data should we gather on students to determine their needs? • What do we do with these data? This session Assessing Our Capacity to Meet the Needs of Groups of Students

4. Meeting the Needs of Groups of StudentsSession Agenda Assessing Our Capacity to Meet the Needs of Groups of Students

5. Session Materials • Copy of PowerPoint • For notes • Full Electronic version on flash drive • Participant Workbook • Navigation Guide • Hunt for Evidence Worksheet with Screen Shots of Reports • Guiding Questions • Grade/Course Profile Template Assessing Our Capacity to Meet the Needs of Groups of Students

6. Flash Drive per District: Contents • All Fall 2011 Professional Development Materials • PVAAS Face-to-Face Overview, 3 hour session • PVAAS Overview webinar session • PVAAS 90 Minute 1:1 Consultations • ½ Day Individual Student Data Analyses • ½ Day Grade Level/Course Data Analyses • PVAAS NEW Features • Video Clips: • Student Level Meetings; Grade Level Meetings • Slips used in Sessions + Others • Other PVAAS SY11-12 Professional Development Materials • All materials are also available on PDE PVAAS webpage Assessing Our Capacity to Meet the Needs of Groups of Students

7. Session Approach • Use multiple data tools to evaluate the effectiveness of your district/school in meeting the needs of different groups of students • High/Low achieving students • Students in subgroups • Other groups of interest to you? • Discussion of strategies for building the capacity of staff in your district/school(s) to conduct these types of data-informed processes Assessing Our Capacity to Meet the Needs of Groups of Students

8. Using Multiple Tools to Identify the Needs of Individual Students Grade/course Level Data Analyses and Planning Assessing Our Capacity to Meet the Needs of Groups of Students

9. School Structures for Data-Informed Decision Making District-Level Support (Budgetary Support, Professional Development, Resources and Time) Assessing Our Capacity to Meet the Needs of Groups of Students

10. Differences Across District and Schools • There is variation in HOW districts/schools will approach grade/course level planning. • Who, what, when, how often, and to what degree • BUT there are some shared practices among these approaches • There is variation in the technology/tools available to manage all of the data for grade/course level meetings • Access to websites of PDE data tools (eMetric and PVAAS) • Data warehouse • Excel, local databases • Paper reporting • BUT there are some shared practices among these different technology solutions/tools Assessing Our Capacity to Meet the Needs of Groups of Students

11. Shared Practices Continuous improvement for grade/course level planning (mitigating risk) means: Having the right people, focusing on the right groups of students, using the right data and asking the right questions which results in the most effective plan for the “system” Today’s focus is on these key areas with an emphasis on USING the data to further understand the effectiveness of your school in meeting the needs of different groups of students. Assessing Our Capacity to Meet the Needs of Groups of Students

12. Assessing Our Capacity to Meet the Needs of Groups of Students Grade/Course Level Data AnalysEs Assessing Our Capacity to Meet the Needs of Groups of Students

13. Purpose of Analysis: The Grade/Course • Plan to Improve Student Achievement and At Least Meet AYP Targets by Grade Level • Analyze Grade/Course Level Results • Grade/Course Level Goal Setting • Ensure Instructional Program Coherence/Alignment • Curriculum – Instruction – Assessment • Supports (infrastructure including scheduling, staffing, etc.) • Monitoring Implementation and Effectiveness of Grade or Course-Specific Program Assessing Our Capacity to Meet the Needs of Groups of Students

14. Grade Level Teams in Action • 5th and 6th grade teams from each elementary school • Team includes: • Regular Ed • Special Ed • Principal • Assistant Supt of Elementary • View Video Clip: #1 Process • Key Points? Assessing Our Capacity to Meet the Needs of Groups of Students

15. Using Multiple Tools to Identify the Needs of Individual Students Engaging The Team Assessing Our Capacity to Meet the Needs of Groups of Students

16. Workbook Engaging the Team: Using Data Do 2 quick “whip-arounds” at your table to answer: Describe the engagement of TEACHERS and BUILDING LEADERS in your school(s) in GRADE/COURSE level data analyses and planning. What structures are in place to create an ownership of the student results by TEACHERS and ADMINISTRATORS - ownership of the positive results and the results that indicate a need for improvement? Be prepared to share with the whole group. Assessing Our Capacity to Meet the Needs of Groups of Students

17. Workbook Engaging the Team • Let’s look at more grade/course level team meetings • Note: Team process may look different at E, M, HS • Questions to ask during video clip • Are the teachers engaged? • Is the building leader engaged? • What is your evidence of engagement? • 3 Video Clips: Grade Level Meetings • Note: Team process may look different at E, M, HS • Video Clips: #2, #3, #4 • Key Observations? Assessing Our Capacity to Meet the Needs of Groups of Students

18. Team Ownership • All team members have a chance to participate. • No one is presenting results to the teachers. • Teachers AND principal(s)are discussingthe results of individual student performance together. • This may look different at the elementary, middle , and high school levels. Video Clip: #5, #6 Assessing Our Capacity to Meet the Needs of Groups of Students

19. Workbook Team Ownership – An Evolution • Engagement of a team in a data-informed process takes time and support! • Grade Level Video Clip: #7 What structures contributed to team’s ability/capacity to evaluate their success in meeting the needs of different groups of students? Assessing Our Capacity to Meet the Needs of Groups of Students

20. What does YOUR Grade/Course-level planning look like now?Complete the table. Workbook Assessing Our Capacity to Meet the Needs of Groups of Students

21. Using Multiple Tools to Identify the Needs of Groups of Students HunT For Evidence: Data Tools Assessing Our Capacity to Meet the Needs of Groups of Students

22. Hunt for Evidence Assessing Our Capacity to Meet the Needs of Groups of Students

23. Do You Know Where to Look for Evidence? • On the Hunt for Evidence worksheet found in your workbook, match each question with the report(s) that yields evidence to answer the question. • You can work individually or in pairs. • We will share the possible answers after a few minutes. Hunt for Evidence!!!! Assessing Our Capacity to Meet the Needs of Groups of Students

24. Workbook Hunt for Evidence! Assessing Our Capacity to Meet the Needs of Groups of Students

25. Workbook Hunt for Evidence! Assessing Our Capacity to Meet the Needs of Groups of Students

26. Workbook Hunt for Evidence! Assessing Our Capacity to Meet the Needs of Groups of Students

27. Hunt for Evidence Assessing Our Capacity to Meet the Needs of Groups of Students

28. Using Multiple Tools to Identify the Needs of Groups of Students Group Performance Assessing Our Capacity to Meet the Needs of Groups of Students

29. Evaluating Group Performance Purpose: • Determination of the system’s effectiveness and our capacity to meet the needs of groups of students • Using multiple data tools • Develop plan(s) of action • Goal: Reduce the number of individual students with performance risks • Goal: Increase or maintain achievement levels? Assessing Our Capacity to Meet the Needs of Groups of Students

30. Some Possible Groups in Your District/School? Which groups of students are of interest/in need? • Low achieving students? • High achieving students? • Subgroups? • Whole grade level/course? Assessing Our Capacity to Meet the Needs of Groups of Students

31. Group PerformanceDiscuss with Your Team Assessing Our Capacity to Meet the Needs of Groups of Students

32. Possible Sources of Evidence of Group Performance Assessing Our Capacity to Meet the Needs of Groups of Students

33. Assessing Our Capacity to Meet the Needs of Groups of Students A PROCESS for Assessing our capacity to meet the needs of groups of students Assessing Our Capacity to Meet the Needs of Groups of Students

34. Which groups are in need of evaluation? • Which group(s) of students in your school warrant a data analyses process? • Specific grade levels? Or, all grade levels? • Specific subject areas or courses? • Specific populations of students? • Low achieving students? High achieving students? Assessing Our Capacity to Meet the Needs of Groups of Students

35. Which groups are in need of evaluation? • For purposes of this training you can select a group, grade level and subject area for focus during the data analyses part of this session • Or, you can do the same group(s) and subject that facilitator is analyzing • Suggest 1 grade/subject for review during this session • Divide grades/subject if attending as a team • We will use multiple years of achievement and growth data to evaluate the system’s effectiveness to address the needs of a group of students Assessing Our Capacity to Meet the Needs of Groups of Students

36. Step 1 and Step 2 • Step 1: Longitudinal View of Achievement Data and Growth Data • Whole grade level • Subgroups • Is there an issue of concern? • Where is there an issue of concern? • Step 2: Longitudinal View of Student Needs • Are there additional issues of concern? • Identify areas of need • Are additional data needed? Other questions to ask? Assessing Our Capacity to Meet the Needs of Groups of Students

37. Where are we headed today? Assessing Our Capacity to Meet the Needs of Groups of Students

38. I do, You do! • Facilitator will walk through/model step 1 • Then you do step 1 • Facilitator will walk through/model step 2 • Then you do step 2 for ONE group of students Assessing Our Capacity to Meet the Needs of Groups of Students

39. Access to Grade/Course Level Data • Websites • eMetric: https://solutions1.emetric.net/pssa/ • PVAAS: https://pvaas.sas.com • Login information • Secure usernames and passwords are assigned by your district/school administrator(s) • Demo sites can be used as back-up option • Let’s get started! Assessing Our Capacity to Meet the Needs of Groups of Students

40. Step 1: Analyze Longitudinal Achievement and Growth Data Group: Reading, Grade 8, Economically Disadvantaged & Special Ed Subgroups • eMetric • Performance Levels Summary (Totals and Proportions) • Group Summary: Scale Scores • For past three years • PVAAS • School Value-Added Report • School Performance Diagnostic Reports- Whole grade and Subgroups • Current year and previous years Assessing Our Capacity to Meet the Needs of Groups of Students

41. 8th Grade Reading – Performance Levels Assessing Our Capacity to Meet the Needs of Groups of Students

42. Why look at Average Scaled Score? • Analyzing just the percentage of Proficient/Advanced students does NOT provide a full picture of achievement Assessing Our Capacity to Meet the Needs of Groups of Students

43. 8th Grade Reading – Average Scale Score Assessing Our Capacity to Meet the Needs of Groups of Students

44. Value Added Report Assessing Our Capacity to Meet the Needs of Groups of Students

45. Performance Diagnostic for Entire Grade Assessing Our Capacity to Meet the Needs of Groups of Students

46. PVAAS Performance Diagnostic Growth Descriptors - Interpretation What the whiskers tell us… Exceeded the standard for PA Academic Growth Blue Met the standard for PA Academic Growth Green Zero (0) Line Growth Did not meet the standard for PA Academic Growth Pink

47. Patterns of Growth • Questions for Educators: • What patterns of growth do we see at the various grade levels? • What implications does this have for future achievement levels of students? • What implications does this have for closing he achievement gap? A C B

48. School Performance Diagnostic Summary Assessing Our Capacity to Meet the Needs of Groups of Students

49. Performance Diagnostic for ED Subgroups Assessing Our Capacity to Meet the Needs of Groups of Students

50. Performance Diagnostic for IEP Subgroups Assessing Our Capacity to Meet the Needs of Groups of Students