1 / 6

Evaluation Design Handbook: Methods, Techniques, and Phases

Learn about evaluation design principles, techniques, and phases for formative and summative evaluations, including setting boundaries, selecting methods, and reporting findings. Understand the importance of sharing information and objective program descriptions over time.

bbohannon
Download Presentation

Evaluation Design Handbook: Methods, Techniques, and Phases

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. October 11, 2005 (1)POLS 4300.06/PUBL 6800.03 • Fitzgibbon and Morris, pp. 1-54 • What is a design? Definition, p. 9 • Design failures in summative evaluations: reasons, pp. 12-13 • Design in formative evaluations, pp. 16-20 • Techniques for special cases, pp. 20-23 • The control group, ‘true’ control group and non-equivalent control group, pp. 25-32

  2. October 11, 2005 (2)POLS 4300.06/PUBL 6800.03 • Programs for both groups, pp 32-35 • Pre and post tests and limits, pp 37-45 • Other tests: time series (N.B.), pp. 45-48 • Selecting a design: rigor, relevance, time and resources (N.B.), pp. 48-54 • Stecher and Davis, the evaluation plan: priorities, approaches and techniques, pp. 63-90, including Appendix, pp. 89-90

  3. October 11, 2005 (3)POLS 4300.06/PUBL 6800.03 • Chapter 3, EVALUATOR’S HANDBOOK • For FORMATIVE Evaluations • Phase A: Set the Boundaries (6 steps) • Phase B: Select Appropriate Evaluation Methods (8 steps) • Phase C: Collect and Analyze Information (5 steps) • Phase D: Report Findings (3 steps)

  4. October 11, 2005 (4)POLS 4300.06/PUBL 6800.03 • Chapter 4, EVALUATOR’S HANDBOOK • For SUMMATIVE Evaluations • Phase A: Set the Boundaries (5 steps) • Phase B: Select Appropriate Evaluation Methods (8 steps) • Phase C: Collect and Analyze Information (4 steps) • Phase D: Report Findings (3 steps)

  5. October 11, 2005 (5)POLS 4300.06/PUBL 6800.03 • Internal differences reflect distinct but overlapping functions of 2 types • This in turn underscores timing of each • Key for Formative Evaluation is sharing of information between evaluator and client • Key for Summative Evaluation is objective description of program over time periods • Note different purposes (5), p. 87

  6. October 11, 2005 (6)POLS 4300.06/PUBL 6800.03 • Also note description of participants (6), pp. 87-88 • Be aware of fact your evaluation normally will COMBINE Formative and Summative • It will also merge approaches and methods, but toward the qualitative end • Also that there will be a liaison person • You’re on your own after the E.A. sign-off

More Related