Program Planning and Evaluation

Program Planning and Evaluation EAD 877 - April 2

Formulating Evaluation Plans Making Recom- mendations and Communicating Results Evaluation Reports - Eun-Young & Jamie Case Study - Ann Systematic Program Evaluation Internship Experience A G E N D A 4/2

Let’s review: T of Learning is Linked to 5 Components - • 1. CONTEXT • 2. NEEDS and IDEAS • 3. OBJECTIVES • 4. INSTRUCTIONAL PLANS • 5. EVALUATION

Evaluation of Programs • Formulating an Evaluation Plan - part of Cafarrella’s Interactive Model • “Introducing a Framework for Evaluation” - Mark’s book - the goal of evaluating programs and policies - for social betterment

Programs Policies Products Examples? Personnel Performance Proposals Examples? According to Scriven (a well-known expert on evaluation, we evaluate:

A process used to determine whether DESIGN & DELIVERY of a program were effective and whether the proposed OUT- COMES were met. Used for ACCOUNTABILITY and DECISION MAKING What is Program Evaluation?

Judging the Value and Worth of a Program is not easy because: • Difficult to demonstrate that outcomes are tied to what happened in the program • Difficult to develop clear criteria upon which judgments are made • Some Planners don’t want to know - purely political/personal

Planning Systematic Program Evaluation - (see handout) • How will you find out what you need to know? • What approach will you use to find out what you need to know? • What will you do with the data when you find out what you need to know?

Making Recommendations and Communicating Results • The case of Barbara - director for continuing education • Did she use all the components of systematic evaluation? • What did she want to accomplish in her evaluation?

Barbara wanted to: • Let participants know they were being listened to - and use their ideas • Make sure the results were delivered to “powers that be” • Present results that “grabbed” people’s attention

Communicating Results “Even when reports are lively and interesting, often no real thought is given to getting key decision-makers to review and use the info”

Questions to ask when communicating the results of your evaluation: • What constitutes program success? • What are some suggestions for making recommendations about current and future programs? • What factors do program planners need to consider when communicating results?

More questions??? • Who is your audience? • How do you time your reports? • Will you followup? Ask your key stakeholders if they need any clarification? • What is the dollar value of personnel time for this activity?

Go back to case of Barbara Learn from our mistakes, according to Sork What led to this success/failure? Do you believe what you are doing is right? Did you compare before and after? Success? Failure?

Do you have a framework? Are you going to Revise Eliminate or Plan new program Focal points: Content Instructional design Transfer Outcomes or Impact Suggestions for current or future programs?

Function - how will the data be used? Scope/Audience - how comprehensive? Content - tailor results to issues and concerns Structure/Style - short reports or long Format - formal, short reports, product display, case study, brochure, e-mail 5 factors to consider:

Who is your Audience? • Individuals and groups intimately involved in the program • Current participants, future participants, senior management, advisory group, the public, instructors, staff

How do you time your report? • WHEN to SEND? • Immediately after program; after a holiday; a year later; when new volunteers are needed? • Timing is everything…..

Do you follow-up? • Informal? Formal? • Hallway? Coffee breaks? • Planned session; planned lunch? • Make sure info is HEARD, READ, TALKED ABOUT, CLARIFIED

Internship Program • Next Steps……… • Room Reserved for April 30 Erickson Hall, Room 250 from 4 p.m. to 6 p.m.

Program Planning and Evaluation