1 / 36

Developmental Disabilities Program Independent Evaluation (DDPIE) Project

Developmental Disabilities Program Independent Evaluation (DDPIE) Project. Technical Assistance Institute UCEDDs June 12, 2008 Westat Lynn Elinson, Ph.D. Developmental Disabilities Program Independent Evaluation (DDPIE) Project. Also known as “ADD Independent Evaluation” .

sarila
Download Presentation

Developmental Disabilities Program Independent Evaluation (DDPIE) Project

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Developmental Disabilities Program Independent Evaluation (DDPIE) Project Technical Assistance Institute UCEDDs June 12, 2008 Westat Lynn Elinson, Ph.D.

  2. Developmental Disabilities Program Independent Evaluation (DDPIE) Project Also known as “ADD Independent Evaluation”

  3. Purpose of Presentation • To provide update on progress since last national UCEDD technical assistance meeting (May, 2007) • To present next steps • To provide feedback on pilot study • To answer questions, obtain comments

  4. Presentation Outline • Background • Update on progress • Further Validation • Timing • Feedback on pilot study • Comments/questions

  5. 1. Background

  6. Purpose of the DDPIE Project • Demonstrate impact of DD Network programs on: • Individuals • Families • Service providers • State systems • Provide feedback to ADD to help improve the effectiveness of its programs and policies • Promote positive achievements of DD Network programs by “storytelling” • Promote accountability to the public

  7. Purpose of Phase I • Develop tools for independent evaluation • Test the tools • Report and make recommendations to ADD

  8. Content of Measurement Matrices Benchmarks Key Functions Indicators PerformanceStandards

  9. Reporting at National Level Data will be collected on individual programs and rolled up to national level. Independent evaluation will NOT be comparing programs to one another Independent evaluation will NOT replace MTARS, which is specific to individual programs.

  10. 2. Update on Progress

  11. Issues Raised by All Programs • Transparency • Efficiency - use of existing data • Simplicity

  12. Transparency • Working Groups • All programs - ERoom - Telephone calls - Written comments - National TA meetings • Advisory Panel • ADD website • Validation Meeting

  13. Efficiency • Testing use of existing data (5-year plan, annual report, MTARS background information) in pilot study

  14. Simplicity • One of the purposes of the pilot study was to inform the revision or elimination of benchmarks/indicators • Advisory Panel recommended not reducing number of benchmarks/indicators until after the pilot study.

  15. 3. Further Validation

  16. Opportunities for validation • Working Group process* • Advisory Panel meetings* • Opportunities for feedback from DD Network programs (at national meetings, by telephone, E-Room, in writing)* • Pilot study* • Validation Meeting* • OMB process* – new contract *DD Network programs represented

  17. Purpose of Validation Meeting • To review benchmarks, indicators, and performance standards • To rate the indicators on importance or value to ADD independent evaluation goals • To make recommendations on process for further development of performance standards

  18. Validation Meeting Representation • Self-advocates • Family members • DD Council members • Members of Boards of Directors (P&A) • DD Network program staff • Policy analysts • Researchers

  19. 4. Timing

  20. DDPIE Project Milestones

  21. 5. Feedback on the Pilot Study

  22. Purpose of Pilot Study • To inform the revision or elimination of some benchmarks/indicators • To test data collection instruments • To inform the further development of performance standards • To determine the usefulness of existing data in reports to ADD • To test the logistics for a full-scale independent evaluation

  23. Programs Participating in Pilot Study

  24. Criteria for DD Council Inclusion in Pilot Study • Geographic diversity (e.g., rural/urban); • Geographic region of the United States (west, midwest, and east); • Participation in MTARS in 2005 – 2007 (at least 1) • Organizational structure (is and is not in a medical school); and • Is and is not a LEND program.

  25. Pilot Study Activities • Development of data collection instruments • Training • Review of program materials (policies, procedures, forms, reports) • Program visits • In-person and telephone interviews • Review and analysis of reports to ADD – 5-year plan, annual report, MTARS materials (for some) • Transcriptions, write-ups, analysis, synthesis

  26. Interviews

  27. Pilot Study Experiences • Organizing program visit • Developing agenda with Executive Director • Logistics • Some observations to date

  28. Pilot Study Participants – Feedback from Executive Directors

  29. 6. Comments and questions

  30. Contacts: • Lynn Elinson, 412 421-8610, lynnelinson@westat.com • Cynthia Thomas, 1-800-937-8281, ext. 4364, cynthiathomas@westat.com

More Related