60 likes | 78 Views
October 11, 2005 (1) POLS 4300.06/PUBL 6800.03. Fitzgibbon and Morris, pp. 1-54 What is a design? Definition, p. 9 Design failures in summative evaluations: reasons, pp. 12-13 Design in formative evaluations, pp. 16-20 Techniques for special cases, pp. 20-23
E N D
October 11, 2005 (1)POLS 4300.06/PUBL 6800.03 • Fitzgibbon and Morris, pp. 1-54 • What is a design? Definition, p. 9 • Design failures in summative evaluations: reasons, pp. 12-13 • Design in formative evaluations, pp. 16-20 • Techniques for special cases, pp. 20-23 • The control group, ‘true’ control group and non-equivalent control group, pp. 25-32
October 11, 2005 (2)POLS 4300.06/PUBL 6800.03 • Programs for both groups, pp 32-35 • Pre and post tests and limits, pp 37-45 • Other tests: time series (N.B.), pp. 45-48 • Selecting a design: rigor, relevance, time and resources (N.B.), pp. 48-54 • Stecher and Davis, the evaluation plan: priorities, approaches and techniques, pp. 63-90, including Appendix, pp. 89-90
October 11, 2005 (3)POLS 4300.06/PUBL 6800.03 • Chapter 3, EVALUATOR’S HANDBOOK • For FORMATIVE Evaluations • Phase A: Set the Boundaries (6 steps) • Phase B: Select Appropriate Evaluation Methods (8 steps) • Phase C: Collect and Analyze Information (5 steps) • Phase D: Report Findings (3 steps)
October 11, 2005 (4)POLS 4300.06/PUBL 6800.03 • Chapter 4, EVALUATOR’S HANDBOOK • For SUMMATIVE Evaluations • Phase A: Set the Boundaries (5 steps) • Phase B: Select Appropriate Evaluation Methods (8 steps) • Phase C: Collect and Analyze Information (4 steps) • Phase D: Report Findings (3 steps)
October 11, 2005 (5)POLS 4300.06/PUBL 6800.03 • Internal differences reflect distinct but overlapping functions of 2 types • This in turn underscores timing of each • Key for Formative Evaluation is sharing of information between evaluator and client • Key for Summative Evaluation is objective description of program over time periods • Note different purposes (5), p. 87
October 11, 2005 (6)POLS 4300.06/PUBL 6800.03 • Also note description of participants (6), pp. 87-88 • Be aware of fact your evaluation normally will COMBINE Formative and Summative • It will also merge approaches and methods, but toward the qualitative end • Also that there will be a liaison person • You’re on your own after the E.A. sign-off