1 / 9

Project Assessment using the DIO Cycle

Project Assessment using the DIO Cycle. Engineering Education NSF Attendees Conference September 27-28, 2007 Barbara M. Olds, Colorado School of Mines. The Design-Implementation-Outcome (DIO) Cycle. Evidence: An Essential Tool

myra-carver
Download Presentation

Project Assessment using the DIO Cycle

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Project Assessment using the DIO Cycle Engineering Education NSF Attendees Conference September 27-28, 2007 Barbara M. Olds, Colorado School of Mines

  2. The Design-Implementation-Outcome (DIO) Cycle Evidence: An Essential Tool Planning for and Gathering Evidence Using the Design-Implementation-Outcomes (DIO) Cycle of Evidence The Consortium for Building Evaluation Capacity Utah State University 2005

  3. Four Main Assessment Purposes • Oversight and accountability • Program improvement involving mid-course corrections • Overall assessment of merit and worth • Generating knowledge • Mark, Henry, & Julnes, 2000; Weiss, 1998, quoted in Evidence: An Essential Tool, 2005

  4. The Design-Implementation-Outcomes (DIO) Cycle Design What changes need to be made? How are we going to Intervene? Outcomes Implementation What are the results?

  5. DESIGN • What problem(s) need to be solved? • How are we going to intervene? • What evidence is needed to show the design is valid? (research, theory, etc.) • What evidence is needed to document the context(s) within which the project will operate? • What evidence is needed to show the design is feasible?

  6. IMPLEMENTATIONWhat evidence is needed… • To determine if project activities are carried out as planned? • To document successes, challenges, and lessons learned? To document decisions that were made to change implementation or make mid-course corrections? • To document characteristics of the context?

  7. OUTCOMESWhat evidence is needed… • To determine if anticipated outcomes were achieved? • To demonstrate project/activity goals were reached on time and within budget? • To demonstrate the extent to which project outcomes can be attributed to specific project activities? • To support replication to achieve similar outcomes in other contexts?

  8. OUTCOMES • What aspects of a) project design, b) implementation of activities, or c) evaluation need to be redesigned based on the outcomes, and what evidence is needed to support these changes?

  9. Some online resources • American Evaluation Association (AEA) http://www.eval.org • AEA Links to Online Texts: http://www.eval.org/evaluationlinks/onlinehbtxt.htm • The Evaluation Center: http://www.wmich.edu/evalctr/ • SRI’s On-line Evaluation Resource Library (OERL): http://oerl.sri.com/ • NSF’s User-Friendly Handbook: http://www.nsf.gov/pubs/2002/nsf02057/start.htm

More Related