1 / 38

Using Assessment Data to Monitor Teaching Effectiveness to Encourage School Improvement

Using Assessment Data to Monitor Teaching Effectiveness to Encourage School Improvement. Margaret Heritage CRESST/UCLA CBSE & ACER International Educational Conference on Assessment 25 th January, 2011 Delhi, India. Overview. Recent U. S. Developments A System of Quality Assessments

rachel
Download Presentation

Using Assessment Data to Monitor Teaching Effectiveness to Encourage School Improvement

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Using Assessment Data to Monitor Teaching Effectiveness to Encourage School Improvement Margaret Heritage CRESST/UCLA CBSE & ACER International Educational Conference on Assessment 25thJanuary, 2011 Delhi, India

  2. Overview Recent U. S. Developments A System of Quality Assessments Quality Process of Data Use Data Tools Data Use Skills and Culture

  3. Recent Developments • Spotlight on data use in the U.S. for the past decade (e.g., Ikemoto & Marsh & 2007; Hamilton, Stecher & Klein, 2002) • Research suggests that data use is a characteristic of effective schools and districts (e.g., Casserly, 2006; Cawelti & Protheroe, 2001; Consortium for School Networking, 2003; Laird, 2006; Supovitz & Klein, 2003; Teddlie & Reynolds, 2000; Tognieri & Anderson, 2003)

  4. Key Issues • Use of assessment data in the service of teaching and learning requires: • Quality assessments • Quality in the process of using data derived from assessments (Herman & Heritage, 2007)

  5. QUALITY ASSESSMENTS

  6. One size does NOT fit all

  7. Three Features of an Assessment System • Comprehensiveness • Coherence • Continuity A comprehensive assessment system “provides a variety of evidence to support educational decision making" (p. 259) A coherent assessment system is built on a well-structured conceptual base – an expected learning progression, which serves as the foundation of all assessments A continuous assessment system provides “indications of student growth over time.” (p. 259). • (NCR, 2001)

  8. Assessments in the System Standards Student Minute -by-minute Daily Weekly Unit Quarterly Annually Adapted from Herman & Heritage, 2007

  9. Assessment Quality • Validity • Reliability • Freedom from Bias

  10. QUALITY PROCESS OF DATA USE

  11. Data Use Process yes Targeted data collection no OK ANALYSIS OF PRESENT STATE Anal Data analysis & interpretation PRESENT STATE TRANSFORMATION PLANNING Identify available data TRANSITION TO NEW STATE Identify what we want to know

  12. State Assessments

  13. INTERIM ASSESSMENTS – First Administration

  14. INTERIM ASSESSMENTS – First Administration

  15. INTERIM ASSESSMENT - Second Administration

  16. INTERIM ASSESSMENT - Second Administration

  17. Multiple Data Sources • What have my students learned? • What are the strengths and weaknesses student learning?

  18. Multiple Data Sources • Aggregated data from annual assessments • Subscales for more specific information • Quarterly assessments to review rate of progress and patterns

  19. Data Use Process yes Communication Targeted data collection no OK ANALYSIS OF PRESENT STATE Anal Data analysis & interpretation Prioritize needs & options Build consensus & make decisions Identify desired results PRESENT STATE TRANSFORMATION PLANNING Develop targeted plan Identify available data Identify resources Communication Identify evidence-based interventions TRANSITION TO NEW STATE Identify what we want to know Create monitoring & evaluation plan Implement Plans Analyze & rework Collect data for monitoring & evaluation Communication

  20. Going Beyond Assessment Data(Berhardt, 1998) • Achievement • Demographics • Opportunities to Learn • Perceptions

  21. DATA TOOLS

  22. The Problem

  23. Data Tools • Store • Access • Analyze • Integrate multiple sources • Relational database

  24. Quality School Portfolio (CRESST) 23 different graphic reporting options

  25. Digital Portfolio Store student work with rubric and exemplars

  26. Digital Portfolio Store video samples of student performance

  27. ARKANSAS LONGITUDINAL DATA SYSTEM

  28. Revised Data Analysis Framework Specific analysis instructions Focus on growth/progress Increased emphasis on student cohorts

  29. Revised Data Analysis Framework Emphasizes patterns/trends Prompts identification of next steps Addresses possibility of needing more data

  30. Online PD—Tool Tutorial

  31. hive Visualization

  32. DATA USE SKILLS AND CULTURE

  33. Skills (Heritage and Chen, 2005) • Ask questions to start the investigation • Frame drill-down questions to deepen the inquiry • Interpretive questions

  34. Skills (Heritage and Chen, 2005) • Select appropriate analysis (e.g., comparative, correlation, cross-sectional, longitudinal analysis) • Interpretive skills • Set priorities and goals

  35. Data Culture • Expectation that judicious use of evidence drives the educational practices of leaders and teachers to improve student learning • Leaders and teachers engage in using data for systematic reflection and planning • “Using data is the way we do things around here.”

  36. To Summarize • Well-aligned system of high-quality assessments • Tools that support analysis and interpretation • Skills to analyze and interpret data effectively • Attitude that data are a valuable resource for guiding improvement

  37. mheritag@ucla.edu

More Related