Instructional Development (EDER675) Evaluating Instruction

1. Instructional Development (EDER675)Evaluating Instruction

2. Agenda for tonight Review of • Instructional Strategies • Instructional Materials New: • Evaluation of Instruction • Program Evaluation Case: Sam Gonzales (Jeremy)

3. Instructional Strategies • http://www.ucalgary.ca/%7Eekowch/675/mar24/instructionalstrategy.htm

4. Instructional Materials • http://www.ucalgary.ca/%7Eekowch/675/mar24/materials.htm

5. Evaluating Instruction • http://www.ucalgary.ca/%7Eekowch/673/mar20/formsum.html

6. Evaluating Instruction Formative Product Evaluation The process of appraising instructional materials during preparation. To judge descriptive info (instruction components) and how much learning results from the instructional materials - valuing those results/ Formative Process Evaluation The appraisal of instructional methods, that is, how well planned learning experiences are delivered or facilitated.

7. Evaluating Instruction: Developing a Formative Evaluation Plan • Format of the plan • Statement of purpose • Description of data collection plans • Description of procedures for analyzing data that are appropriate for them • Outline the constraints imposed by the situation • Decision rules that will guide revisions of the data • A desciption of the expected results consistent with the data collection techniques chosen & specific analysis plans • Time estimates for implementation of the evaluation plan • Plans for communicating results to appropriate decision makers. • Roles and responsibilities of a team • Team leadership

8. Developing a Formative Evaluation Plan • Step 1: Determining purpose, objectives, audience and subjects • How much will targeted trainees enjoy the instructional materials, content or methods? • How much will the participants learn? • How much impact will the learning experience have on the participants’ job performance? • How much impact will the planned learning experience have on the organization?

9. Developing a Formative Evaluation Plan • Step 2: Assessing Information Needs • (of the targeted audiences.. What do we need from these people?) • Instructional Designers: want to know how to revise instructional materials • Key decision makers • Immediate supervisors or learners on board? • Union reps on board?

10. Developing a Formative Evaluation Plan • Step 3 Protocol • Freq. Of audience contact in evaluation • Permissions in order • Which permissions needed? • What formal/informal steps assure • Decision makers experience is ok • Labels • Timing • Participation • Method of evaluation

11. Developing a Formative Evaluation Plan • Step 5. • Setting • Program issues • How much testing • Positive outcomes • Negative outcomes • Cost estimates • Accuracy of prerequisites ok?

12. Developing a Formative Evaluation Plan • Evaluation design (for client and team) • Define key terms • Clarify purpose and objectives • Provide logical series of activities • Identify populations to be studied • Summarize standards by which instruct. Matls will be judged

13. Adieu for this week, EDER 675Readings for The Next Two Weeks:Effective Communication: Chapter 16 - 19 Rothwell & Kazanas.Case: Project Management: Haley Lawrence p. 129 by Diane ErlichEugene G. KowchAssistant Professor of Educational Technology This person is reading….. ;-)