1 / 89

Workshop Objectives

Southwest Ohio 2014 Data Workshops Using the HSTW Assessment and MMGW Survey Data to Take Action High Schools & Middle Schools Mike Ross HSTW/MMGW Ohio Data Consultant Susanne Davis HSTW/MMGW Ohio Assessment Coordinator. Workshop Objectives.

illana-leach
Download Presentation

Workshop Objectives

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Southwest Ohio2014 Data WorkshopsUsing the HSTW Assessment and MMGW Survey Data to Take ActionHigh Schools & Middle SchoolsMike Ross HSTW/MMGW Ohio Data ConsultantSusanne DavisHSTW/MMGW Ohio Assessment Coordinator

  2. Workshop Objectives • Understand components of the HSTW and MMGW Assessment Reports • Identify gaps in student achievement and instructional practices • Identify new challenges • Link key Assessment data to the Site Review Process (SRP) • Explore how Assessment data may provide critical baseline or “readiness” levels for implementing common core state standards

  3. HSTW HSTW Key Practices • High Expectations • Program of Study • Academic Studies • Career/Technical Studies • Work-Based Learning • Teachers Working Together • Students Actively Engaged • Guidance • Extra Help • Culture of Continuous Improvement

  4. Aligned academic core All students matter High expectations and extra help Engaging students Teachers working together Support from parents Qualified teachers Use of data Use of technology for learning Strong leadership MMGW Key Practices

  5. Why Are Data Important? • Replace hunches with facts • Enable us to tackle root causes instead of symptoms • Enable us to determine if we are accurately tracking effects • Assist in understanding how school and classroom practices impact achievement

  6. Data Can’t Help When… • The data are not valid or reliable • The appropriate questions are not asked after reviewing the data • Data analysis is not used for making wise decisions • There is no commitment by teachers and administrators to change school and classroom practices when data indicate the need for change Make conscious efforts to develop a data-rich culture at your school!

  7. Multiple Measures Based on Victoria Bernhardt’s Multiple Measures Model

  8. Categories of Data “Measures of student learning help us understand how students are performing and what students know as a result of instruction. Student Achievement Based on Victoria Bernhardt’s Multiple Measures Model

  9. Categories of Data School Processes “…programs, practices, and instructional strategies…that produce school and classroom results.” Based on Victoria Bernhardt’s Multiple Measures Model

  10. Categories of Data Perceptions “A particular view, judgment, or appraisal formed in the mind about a particular matter...a belief stronger than impression and less strong than positive knowledge.” Based on Victoria Bernhardt’s Multiple Measures Model

  11. Categories of Data “Statistical characteristics of human populations…builds the context of the school …for which change is planned and takes place.” Demographics Based on Victoria Bernhardt’s Multiple Measures Model

  12. A Complete Picture

  13. HSTW Comparisonsof Assessments to OAA/OGT HSTW Assessment • Based on NAEP Standards • 3 areas • Administered to 12th graders • Content through grade 12 • Multiple choice OGT/OAA • Based on Ohio standards • 2 to 5 areas • Administered (initially) to 3rd through 10th graders • OGT – through gr. 10 • Multiple choice & constructed response

  14. HSTW Comparisonsof Assessments to OAA/OGT HSTW Assessment • Reports Readiness Standards - Generalize to high school and college success • Scale scores • Cut scores/ Proficiency Levels • Random Sample • Others? OGT/OAA • Not predictive of college success • OGT tied to graduation • Scale scores • Cut scores/ Proficiency Levels • All students • Others?

  15. 2014 Assessment & SurveysOhio Participation 2014 HSTW Assessment 125 Ohio sites (41 SWO) 6,314 Ohio 12th grade students (2,286 SWO) 4,580 Ohio teachers (1,754 SWO) 2014 MMGW Surveys 95 Ohio sites (31 SWO) 12,118 Ohio 8th grade students (5,518 SWO) 1,789 Ohio teachers (653 SWO)

  16. Approaching the Report • Before analyzing data, ask yourself “who participated in this assessment?” • Random sample or all students? • Career/technical or all students? • Who completed the assessment? • Pages 62, 71, 86, 97 of High School assessment report • What is your H.S. category? – A, B, C, D Refer to top left of each page and descriptions on page iv.

  17. High School Standard Setting – Readiness Standards Students performing at this level or above are able to enter postsecondary studies without needing additional preparation and/or are able to pass most employer exams for entry-level jobs.

  18. 2014 HSTW Assessment Results -All Ohio Sites HSTW Goal = 85% Source: 2014 HSTW Assessment – Ohio Composite, pg.1 18

  19. 2014 HSTW Assessment Results -All Ohio Sites 60% 63% 60% Source: 2014 HSTW Assessment – Ohio Composite, pg.1 19

  20. 2014 Ohio Achievement Assessment 8th Grade Preliminary Results State Standard = 75% Source: ODE website

  21. 2014 Ohio Achievement Assessment 8th Grade Preliminary Results Source: Ohio Department of Education

  22. Main Summary Reports • Now that we know who participated and how Ohio students performed, how did yourschool do overall? • H.S. - Executive Summary, pp. 1-2 • M.S. – refer to your OAA data

  23. 2014 All Ohio HSTW Sites Composite, p. 1

  24. 2014 All Ohio Career Centers Composite, p. 1

  25. Key Indicators of Student Achievementor Power Indicators (report page 2) 12 Student and 6 Teacher Indicators Associated with very high mean scores ETS has found these indicators to be statisticallypredictiveof student achievement

  26. 2014 All Ohio HSTW Sites Composite, p. 2

  27. HSTW Activity Time High School - Utilizing the Executive Summary & Analyzing Differences • Report pp. 1-12 • HS Handout #1 Middle School – Reviewing State Achievement Data • State Report/Data • MS Handout #1

  28. Activity Processing • What value do these data provide? • How can you use this executive summary and other features in the reports in planning at your school?

  29. Utilizing the High School Overview andMiddle School Indices

  30. More Information • Now that we’ve gotten a picture of overall performance, where can I get some more details? • H.S. - Executive Summary – pp. 1-2 • H.S. - Overview – pp. 3-24 • M.S. - Indices – pp. 6-8

  31. Semantics Indicator Index or indices (pl.) Common meanings and distinctions 32

  32. “Our Definition” Indicator – a student experience(s) and/or improvement strategy(ies) that are associated with higher levels of student achievement 33

  33. Definition Examples of Indicators Used a graphing calculator in math assignments at least weekly. Prepared a written report of science lab results at least monthly. Used computer skills to complete an assignment or project in C/T classes at least weekly. 34

  34. Definition Index – A scale that combines multiple items into a single value. Each index is built around a common theme which HSTWor MMGW believes is a key element of student achievement. 35

  35. …be mindful “Although we cannot prove a causal connection between the indices and student test performance, it can be said that faithful adherence to the Key Practices is associatedwith better student achievement.” 36

  36. Understanding the Indices • Based on the HSTW Key Practices • Example – Literacy Across the Curriculum • A series of indicators (and frequency) are identified for each practice • Example – Students often revised their essays or other written work several times to improve their quality • The number of indicators experienced determines the level of emphasis • Example – Intensive = 8-10 indicators

  37. Source: 2014 HSTW Assessment – Ohio Composite, pg.13

  38. High School Indicator Data (source: 2014 All Ohio HSTW Sites Composite, p. 26)

  39. The MMGW Indices2014 MMGWStudent Survey Ohio Composite, p. 7

  40. 2014 MMGW Student Survey Ohio Composite, p.17

  41. 2014 MMGW Student Survey Ohio Composite, p.18

  42. 2014 MMGW Student Survey Ohio Composite, p.19

  43. HSTW Activity TimeA More Detailed Picture of Your School’s Performance High School – Utilizing the Overview & the HSTW Indices • Report pp. 1 & 13-23 • HS Handout #2 Middle School – The MMGW Indices • Report pp. 6-7 • MS Handout #2

  44. Share • On what three categories of indicators did most of your students report an intensive emphasis? • What actions did you take that may account for these results? • What challenges did you identify by looking at these data?

  45. The Importance of Leadership and School Improvement

  46. HSTW Key Practice:Continuous Improvement Use student achievement and program evaluation data to continuously improve school culture, organization, management, curriculum and instruction to advance student learning.

  47. Improvement Cycle

  48. Teachers’ Perception on Continuous School ImprovementPercentage Who StronglyAgree Source: 2014 HSTW Assessment – Ohio Composite, p.57

  49. Teachers’ Perception on Continuous School ImprovementPercentage Who StronglyAgree Source: 2014 HSTW Assessment – Ohio Composite, p.57 50

More Related