1 / 24

Module 2: Exploration

This module focuses on the district evaluation of Multi-Tiered System of Supports (MTSS). Stakeholders explore the benefits and risks, determine lead roles, build awareness, describe risks, and build consensus. It delves into the need for MTSS evaluation, stakeholder beliefs, perception surveys, consensus development, alignment with local context, and policy considerations impacting districts. It also covers capacity requirements, evidence for replication, critical components, and unknowns around MTSS evaluation for student outcomes. The module guides in assessing assessments, data sources, fidelity implications, problem-solving steps, and methods for evaluating the impact of MTSS on student outcomes.

joshdodson
Download Presentation

Module 2: Exploration

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Module 2: Exploration RtI Innovations: Evaluation Anna Harms & Jose Castillo

  2. Agenda & Objectives

  3. Stages of Change/Implementation “It” is the district evaluation of MTSS.

  4. Exploration and Consensus for Adoption After fully exploring the benefits and risks, stakeholders decide how to move forward at this time. • Examine need, evidence, fit, necessary resources, and capacity • Determine who will play lead roles in developing consensus • Build awareness and garner support among stakeholders • Describe risk and help partners manage risk (What will be different for us?) • Build consensus and commitment

  5. Reflection: What are the risks of moving forward with evaluation of MTSS if there is not consensus for it?

  6. Consensus and Readiness • In order to have consensus, we must gather information and strategically communicate that information. • “Willingness” and “readiness” are not one and the same • Excellent Resource: Scaling Up Brief on Readiness for Change • (State Implementation and Scaling-up of Evidence-based Practices, 2013) • http://sisep.fpg.unc.edu/sites/sisep.fpg.unc.edu/files/resources/SISEP-Brief3-ReadinessForChange-09-2013.pdf

  7. A Structure for Exploring Readiness and Gaining Consensus

  8. Need What is the need for evaluating MTSS in our district? • What data/information suggest there is a need for evaluation of MTSS and that it is a priority? • What is the scope of the need? Evaluation just for MTSS? Implementation of evaluation practices across the board? • From which stakeholder groups are our indicators of need coming?

  9. Beliefs Survey • Assesses educator beliefs related to RtI/MTSS • 27 items, Likert Scale format • Strongly Agree to Strongly Disagree • 3 Factors: • SWD Academic Abilities and Performance • Data-Based Decision Making • Functions of Core & Supplemental Instruction

  10. Perception of Practices Survey • Assesses educator perceptions of data-based problem-solving practices across tiers • 18 items, Likert Scale format • Never Occurred to Always Occurred • 2 Factors: • Academic Practices • Behavior Practices

  11. Consensus Development:Guiding Questions cont. Perception of Practices: • What practices occurring in our school do we think are most consistent with MTSS? • Least consistent? • Which ones do we think may be a threat to the successful implementation of the model?

  12. Consensus Development:Guiding Questions cont. Beliefs & Practices: • How consistent are the overall beliefs of our school with our overall perceptions of the practices occurring? • What does this level of consistency/inconsistency mean in terms of implementing an MTSS in our school?

  13. Fit How does evaluation of MTSS fit within our local context? • Alignment with district priorities? • Alignment with our MTSS framework? • Other ways of evaluating programs and practices? • Alignment between school, district, regional, and state systems and requirements?

  14. How do the following policy considerations impact districts in your state? Student Performance & Growth • State-determined school-performance measures • ESSA allows states more flexibility • Measures and outcome criteria vary from state to state • Other state-mandated performance indicators • State Performance Plans (SPED) • School and District Improvement Plans • Local performance indicators • Academic measures and performance criteria • Behavioral measures and performance criteria

  15. What capacity and/or requirements exist to support evaluation efforts? Statewide and Local: • Data sources and measures • Data management and reporting systems • Professional development and evaluation plans • Instruction and intervention plans & protocols • Technical assistance personnel and supports

  16. Evidence & Readiness for Replication What evidence suggests that district evaluation of MTSS will help you to meet your desired goals? • What have other districts achieved through the evaluation of MTSS? • What is the status of empirical research? Number of studies? Quality of the research? • How well is the practice of evaluating MTSS defined? • Has the process been replicated? • Are model sites and experts available to provide TA? • What are the characteristics of other districts that have evaluated MTSS? How diverse? Similar to my district?

  17. Evidence for Critical Components of MTSS What We Know What We Don’t Know Which assessments and data sources “should” be used How much drift in implementation fidelity can occur without reducing effectiveness Which steps of problem-solving relate most to student outcomes • Assessments and data sources available that predict student outcomes • Research supported instruction and intervention methods and strategies exist • Problem-solving process relates to student outcomes

  18. Evaluation of MTSS What We Know What We Don’t Know How to determine “how much” MTSS is contributing to student outcomes Which models and data sources for evaluating MTSS implementation work best What levels of implementation fidelity are needed for student outcomes to improve Which systemic issues will need to be addressed in a given district • Implementation related to improved academic, behavior, and SPED outcomes • Implementation has looked different (e.g., # of tiers, assessments used, approaches to intervention) • Evaluations have occurred at school, district, intermediate agency, and state (pilot) levels • Methods and tools for evaluating implementation available

  19. Necessary Resources If we want to evaluate MTSS well within our district, what resources will be necessary? • Information about. . . • Tools and materials for. . . • Time for. . . • People to do . . . • Money for. . .

  20. Capacity • Given the resources that will be necessary and your currently available resources, do you have the capacity to evaluate MTSS? What could you do to increase your capacity? • Information • Tools and Materials • Time • People • Money

  21. Reflection: Consider your district’s readiness to implement and evaluate MTSS. What aspects of the hexagon need to be addressed to move forward?

  22. Contact Us Anna Harms Jose Castillo University of South Florida, Florida Problem Solving/Response to Intervention Project jmcastil@usf.edu • Michigan’s Integrated Behavior and Learning Support Initiative • aharms@miblsimtss.org

More Related