370 likes | 574 Views
Is PBIS Evidence-based?. George Sugai OSEP Center on PBIS University of Oregon Center for Behavioral Education & Research University of Connecticut August 5, 2008 www.cber.org www.pbis.org George.sugai@uconn.edu. Purpose. Is PBIS Evidence-based Practice? What is PBIS ?
E N D
Is PBIS Evidence-based? George Sugai OSEP Center on PBIS University of Oregon Center for Behavioral Education & Research University of Connecticut August 5, 2008 www.cber.org www.pbis.org George.sugai@uconn.edu
Purpose Is PBIS Evidence-based Practice? • What is PBIS? • How is evidence-based determined? • What is PBIS evidence?
www.pbis.org Horner, R., & Sugai, G. (2008). Is school-wide positive behavior support an evidence-based practice? OSEP Technical Assistance Center on Positive Behavioral Interventions and Support. http://www.pbis.org/files/101007evidencebase4pbs.pdf.
Why evidence-based? • Maximize outcomes • Minimize harm • Increased accountability • Increase efficiency • Improve decision making • Improve resource use
Basic Approach • Start w/ what has greatest likelihood of addressing (evidence-based) confirmed problem/question • Explained/supported conceptually/empirically • Adapt to local context/culture/need • Monitor regularly & adjust based on data • Adapt for efficient & durable implementation
4 Evaluation Criteria • Effectiveness • Has/will practice produced desired outcome? • Efficiency • What are costs (time, resources, $) to implement practice? • Relevance • Is practice & outcomes appropriate for situation? • Conceptually soundness • Is practice based on theory?
Basic Practices Evaluation
Design Questions • Has functional or cause-effect relationship been demonstrated & replicated? • Have alternative explanations been accounted & controlled for? • Have threats or weaknesses of methodology been controlled for? • Was study implemented w/ fidelity/accuracy?
Research Designs • Experimental - RCT & SSR • Evaluation - Descriptive w/ baseline • Case Study - Descriptive w/o baseline • Testimonial - No/Limited data
Results Questions • Who were subjects? • How much like my participants? • Where was study conducted? • How much like where I work? • What measures were used? • Do I have similar data? • What outcomes were achieved? • Are expected outcomes similar
Effectiveness Logic • Significance (“believe”) • Likelihood of same effect by chance • Effect Size (“strength”) • Size of effect relative to business as usual • Consequential Validity (“meaning”) • Contextually meaningful
Tertiary Prevention: Specialized Individualized Systems for Students with High-Risk Behavior CONTINUUM OF SCHOOL-WIDE INSTRUCTIONAL & POSITIVE BEHAVIOR SUPPORT ~5% Secondary Prevention: Specialized Group Systems for Students with At-Risk Behavior ~15% Primary Prevention: School-/Classroom- Wide Systems for All Students, Staff, & Settings ~80% of Students
Basics: 4 PBS Elements Supporting Social Competence & Academic Achievement OUTCOMES Supporting Decision Making Supporting Staff Behavior DATA SYSTEMS PRACTICES Supporting Student Behavior
GENERAL IMPLEMENTATION PROCESS Team Agreements Data-based Action Plan Evaluation Implementation
SWPBS Subsystems School-wide Classroom Family Non-classroom Student
School-wide 1. Common purpose & approach to discipline 2. Clear set of positive expectations & behaviors 3. Procedures for teaching expected behavior 4. Continuum of procedures for encouraging expected behavior 5. Continuum of procedures for discouraging inappropriate behavior 6. Procedures for on-going monitoring & evaluation
Non-classroom • Positive expectations & routines taught & encouraged • Active supervision by all staff • Scan, move, interact • Precorrections & reminders • Positive reinforcement
Classroom • Classroom-wide positive expectations taught & encouraged • Teaching classroom routines & cuestaught & encouraged • Ratio of 6-8 positive to 1 negative adult-student interaction • Active supervision • Redirections for minor, infrequent behavior errors • Frequent precorrections for chronic errors • Effective academic instruction & curriculum
Individual Student • Behavioral competence at school & district levels • Function-based behavior support planning • Team- & data-based decision making • Comprehensive person-centered planning & wraparound processes • Targeted social skills & self-management instruction • Individualized instructional & curricular accommodations
Family • Continuum of positive behavior support for all families • Frequent, regular positive contacts, communications, & acknowledgements • Formal & active participation & involvement as equal partner • Access to system of integrated school & community resources
PBS Systems Implementation Logic Visibility Funding Political Support Leadership Team Active & Integrated Coordination Training Evaluation Coaching Local School Teams/Demonstrations
VIOLENCE PREVENTION? • Surgeon General’s Report on Youth Violence (2001) • Coordinated Social Emotional & Learning (Greenberg et al., 2003) • Center for Study & Prevention of Violence (2006) • White House Conference on School Violence (2006) • Positive, predictable school-wide climate • High rates of academic & social success • Formal social skills instruction • Positive active supervision & reinforcement • Positive adult role models • Multi-component, multi-year school-family-community effort
90-School RCT StudyHorner et al., in press • Schools that receive technical assistance from typical support personnel implement SWPBS with fidelity • Fidelity SWPBS is associated with • Low levels of ODR • .29/100/day v. national mean .34 • Improved perception of safety of the school • reduced risk factor • Increased proportion of 3rd graders who meet state reading standard.
RCT Project TargetBradshaw & Leaf, in press • PBIS (21 v. 16) schools reached & sustained high fidelity • PBIS increased all aspects of organizational health • Positive effects/trends for student outcomes • Fewer ODRs (majors + minors) • Fewer ODRs for truancy • Fewer suspensions • Increasing trend in % of students scoring in advanced & proficient range of state achievement test
4J School District Eugene, Oregon Change in the percentage of students meeting the state standard in reading at grade 3 from 97-98 to 01-02 for schools using PBIS all four years and those that did not.
05% 20% 11% 22% 84% 58% SWPBS schools are more preventive
July 2, 2008 ODR rates vary by level
July 2, 2008 A few kids get many ODRs
SWIS summary 07-08 July 2, 20082,717 sch, 1,377,989 stds; 1,232,826 Maj ODRs