CEC’s Evidence Based Practice Effort

1. CEC’s Evidence Based Practice Effort Rachelle Bruno Northern Kentucky University

2. Professional Standards and Practice Committee • Standing Committee • Knowledge and Skill Subcommittee • Evidence Based Practice Workteam

3. CEC Member Involvement • CEC Staff • Richard Mainzer, Associate Executive Director, Professional Services • Discussions with RA - 2005, 2006 • Discussions with IDC - 2006 • Discussions with Division Boards - 2004, 2005, 2006 • Presentations at TED • Open Forum - CEC Convention 2006

4. Member Involvement (con’t). • Selected Conference Call Participants- • David Bateman, Ellen Brantlinger, Bryan Cook, Diane Browder, Lynn Ahlgrim-Delzell, Marilyn Friend, Russell Gersten; Diane Haager, Janie Hodge, Janette Klingner, Tim Landrum,Robin McWilliam, Sam Odom, Diane Paul, Hugh Reid, Kathlene Shank, Gary Siperstein, Melody Tankersley • Pilot Team Members • Bryan Cook; Diane Browder/Lynn Algrim-Delzell; David Test; Tim Landrum; Robin McWilliam; Sam Odom; Janette Klingner

5. CEC Special EducationEvidence-Base Practice Family Values Professional Wisdom Evidence-Based Practices

6. Current Timeline & Activities Jan 2006 Board asks PSPC to engage in further discussion of EBP Spring 2006 PSPC engages CEC in discussion - convention, conference calls Oct 2006 PSPC requests Pilot January 2007 Board approves Pilot January 2008 Report to Board

7. Tasks of the Pilot Project • Determine decision criteria and coding rubrics • Determine review guidelines • Develop guidelines for practice reports • Review extant studies • Evaluate process

8. What is a practice? • Specific strategy or intervention designed for use by special educators intended to support the education of individuals with exceptional learning needs • Could include programs that are a combination of interventions

9. Pilot Criteria/Classification Based largely on the work by the CEC Division for Research task force’s articles in the winter 2005 issue of EC Examines: • Number, type, and quality of studies • Direction and significance of the effects

10. How does this fit with the What Works Clearinghouse? Coordinating efforts in this area as much as possible.

11. Positive Evidence-Base Potentially Positive Evidence Base Insufficient Evidence-Base Mixed Effects Evidence Base No Discernible Effects Evidence Base Negative Evidence-Base Describing the Evidence Base

12. Potential Study Rubric Dimensions • Design • Dependent and Independent Variables • Design Quality • Implementation Quality • Effects

13. Proposed Process

14. Proposed Evidence-Based Practice Study Reports • A clear and complete description of the practice with its essential components, • A description of each research study that the team included in the synthesis study, • A scored rubric for each included study along with a completed rubric across the studies to determine the category of the practice. • A brief description of the results of each included study, including the direction, magnitude, and statistical significance of the empirical effect estimate. This could be characterized as a statistically significant positive, substantively important positive, indeterminate, or negative effect. • The study team’s recommendation along with the basis of the recommendation.

15. Technical Review Panels • Supporting the PSPC, a new CEC Scientific Advisory Sub-committee (SASC) in collaboration with CEC affiliates will establish a pool of expert reviewers from which the SASC can select TR panels to conduct the reviews of the EBP Studies. Each TR panel will analyze an EBP Study to ensure the criteria were appropriately applied to the body of literature and the recommendation(s) are appropriate. • TR panels selected from the pool based on their backgrounds • Division input

16. Who will do the Studies? • Workteams sponsored by CEC Divisions and research teams • Small number of expert colleagues (3 to 5) • Who can harvest relevant studies • And efficiently synthesize the results

17. What Studies will come first? CEC together with its affiliate Divisions will identify practice areas for study and schedules as time and resources permit.

18. Dissemination The Bridge Between Knowledge and Effective Practice • Utilize existing methods that CEC with its affiliates have for dissemination in ways that ensure professionals have the information to select and implement practices with fidelity. • CEC must also ensure that practices are disseminated to those who influence the context in which professional practice occurs.

19. CEC Special EducationEvidence-Base Practice Family Values Professional Wisdom Evidence-Based Practices

20. Information Richard Mainzer Associate Executive Director Professional Services Richardm@cec.sped.org 703-264-9408 Rachelle Bruno Pilot Workteam Chair bruno@nku.edu 859-572-5167