280 likes | 294 Views
This session will explore diagnostic assessments and formative data to broaden the conversation on school improvement. Learn how to integrate non-traditional data and analyze case studies on effective data usage.
E N D
Do Now: Please open “Title 1 Conference Handout” in the folder with materials for this session
Expanding the Data Conversation for Districts and Schools • Andrew Schmitz, Assistant Director of Professional Learning • Ben Magras, School Leadership Coach
Session Objectives • By the end of the session, participants will be able to… • Describe diagnostic assessments and formative data that broaden the school improvement conversation beyond student outcome metrics • Identify ways to integrate and align non-traditional data into existing school/district/state systems and structures • Analyze case studies and examples of how school leaders have effectively used this data to drive school improvement
Trains exemplary teachers and school leaders Provides empirically based tools and training nationwide Conducts rigorous applied research Operates a multi-campus Pre-K to 12 school Reliably Excellent Schooling
Pitfalls & Benefits • Schools can get a better picture of how to improve learning for all students by gathering, intersecting, and organizing different categories of data more effectively. (V. Bernhadt)
The 5Essentials: Organizational & Culture Conditions Framework Items Measures The teacher asks difficult questions in class. This class challenges me. This class requires me to work hard to do well. The teacher expects us to become better thinkers, not just memorize things. The teacher expects me to do my best all the time. The teacher expects everyone to work hard. • English Instruction • Math Instruction • Academic Press • Quality of Student • Discussion
Becoming Effective Learners: Noncognitive Factors Survey Students answer questions on concepts such as Belonging (I fit in at school), Grit (I finish whatever I begin), Growth Mindset (My intelligence is something that I can’t change much), and others
Other Tools • AdvancED (eProve) • National School Climate Center (Comprehensive School Climate Inventory) • TNTP (Instructional Culture Insights Survey) • Department of Education School Climate Survey (EDSCLS) • Tripod Student Survey
Research on Student & Staff Surveys • Measure of Effective Teaching (MET) & the Gates Foundation • Found that teachers’ student survey results are predictive of student achievement gains • Results also suggest that surveys may provide outcome related results in grades and subjects for which no standardized assessments of student learning are available
Our Research 20+ years of research, 15 years of data • Framework built from research on organizational factors that matter most in improving schools • Validated through longitudinal study • Continuously assessed for reliability, validity, and relevance • Analyzed at scale in Illinois
Ongoing Progress Monitoring • Open-ended survey questions and focus groups • Walk-through indicators • Student and teacher interviews • How have you used strategies like those described above to help gather formative data on organizational and cultural conditions?
Organizing Data Around a Coherent Framework • 5Essentials & Florida DoESchool Improvement Plan and District Improvement and Assistance Plan • Indicator options in Step 1b of Problem Solving • Essential Conditions tags in Step 4 of Problem Solving • Five Domains Guiding Questions in Step Zero Toolkit, which provides guiding questions for problem analysis by Essential • Organizational framework of the Turnaround Monitoring Toolkit, which includes conversation prompts for each Essential • Embedded throughout the SIG 1003(g) Cohort 4 proposal
5Essentials & Florida: Problem Solving Module • Indicator options in Step 1b of Problem Solving include Essential and Measure scores
5Essentials & Florida: Problem Solving Module Essential Conditions tags in Step 4 of Problem Solving • Selections populate visual organizer
Key Ingredients for Successful Alignment • Recognize the similarities between the measures and common areas of school improvement • Include specific teacher/student survey framework goals in your school improvement plans • Leverage survey categories as the root causes underneath student achievement challenges
Key Ingredients for Successful Alignment • Common school improvement goal: We will increase 5th grade math proficiency by 15%. We will add an intervention teacher in 5th grade and adopt Math Thematics and a blended learning math program. • Expanded school improvement goal: We will increase 5th grade math proficiency by 15%. • Action Steps: • We will add an intervention teacher in 5th grade and adopt Math Thematics and a blended learning math program. • We will improve our math collaboration and math PD by developing our PLC around DuFour principles of a focus on learning, results, and collaborative culture and the “four questions”. • We will regularly get feedback on our PLCs and ask teachers to rotate presenting • We will adopt adult learning principles and ensure teachers have time to practice and evaluate new strategies
Nettelhorst Elementary & Lake View High School • Measures of focus • Student-teacher trust & Academic personalism • Monthly grade level meetings centered around different areas of student-teacher trust • Teacher feedback on meeting design and content • Reflective discourse • Enrichment/remediation block (WIN) • Administration-led walkthroughs • Teacher-led vision-setting • Restorative practice support for teachers • Structures and trainings for peace circles, conflict resolution, etc. • Support for administrators on how to build a non-punitive mindset with teachers
Technical Core (e.g. Teaching and Learning) Social Base (e.g. Trust and Commitment)
Key Ingredients to Successful Data Utilization • Organize sources of data to think and act coherently. • Connect sources of data to your school improvement plan. • Involve staff from the entire building • Be vulnerable in how you talk about the data • Help staff establish a productive mindset
Questions & Contact Information • Andrew Schmitz • amschmitz@uchicago.edu • Ben Magras • bmagras@uchicago.edu