1 / 16

Evaluate Strategic P rogram S uccess

Evaluate Strategic P rogram S uccess. Changing Mindsets Conference August 2010 – TAFE Development Centre. Michelle Harrex Senior Teaching and Learning Co-ordinator Professional Learning and Development. Objectives of this session.

shawna
Download Presentation

Evaluate Strategic P rogram S uccess

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Evaluate Strategic Program Success Changing Mindsets Conference August 2010 – TAFE Development Centre

  2. Michelle Harrex Senior Teaching and Learning Co-ordinator Professional Learning and Development

  3. Objectives of this session • Knowledge of issues to consider when evaluating teaching/ course/ program • Abilities to plan evaluation of your practices in a course/ program

  4. Your current practice

  5. Will the information add value? Objective: A path to value

  6. Why evaluate? (Purposes of evaluation)

  7. Two examples of evaluation approaches • Action Research for ongoing improvement of quality (Formative Evaluation) • Pre-Post Test for measuring change, adapted from experimental/scientific approaches that use Treatment and Control groups (Summative evaluation)

  8. Action Research (formative evaluation)

  9. Is the information valuable? Evaluate to meet stakeholder needs! In the current climate what is considered valuable evaluation data? Learner engagement vs business imperative (the tug of war) Where do you stand, where does your organisation stand, where do your clients stand?

  10. Define what is valuable then develop a sound evaluation framework? How to evaluate? (Key considerations) • The evaluation model depends on the purpose of evaluation (fitness for purpose). • Data/information can be qualitative and/or quantitative. • Ideally, data should be from many sources to reduce biases (increase validity and reliability). • Data analysis and conclusions should be appropriate.

  11. The structure of a Training Evaluation Problem – a model 1 2 3 4 5 TRAINING WORKPLACE Reactions Results Learning Behaviour

  12. Task : Consider a course/ program you are teaching/developing. For each purpose of evaluation, identify the following: • Major focus of the evaluation • Typical issues that should be explored, i.e. the types of questions to ask • Types of evidence that should/can be collected

  13. Emphasis on results…see handout • Kirkpatrick says we need to progress through the layers…do you agree?

  14. Kirkpatrick Model for evaluating effectiveness of training programs What organisational benefits resulted from the training? To what extent did participants change their behaviour back in the workplace as a result of the training? To what extent did participants improve knowledge and skills and change attitudes as a result of the training? How did participants react to the program?

  15. The benefits of valuable evaluation • Program viability • Customer satisfaction • Competitive edge • Compelling evaluation

  16. Resources Online resources for Teaching/Program Evaluation LTDI, Heriot Watt University (n.d.). Evaluation Cookbook -A practical guide to evaluation methods for lecturers. Retrieved from http://www.icbl.hw.ac.uk/ltdi/cookbook/contents.html McNamara, C. (n.d.). Basic Guide to Program Evaluation. Retrieved from http://www.managementhelp.org/evaluatn/fnl_eval.htm Penn State University (n.d.). Program Evaluation. Retrieved from http://extension.psu.edu/evaluation/ TDA (2007). Impact Evaluation of Continuing Professional Development. Retrieved from http://www.tda.gov.uk/upload/resources/pdf/i/impact_evaluation.pdf The University of Sheffield (2008). LeTSEvaluation Resources –Impact Evaluation. Retrieved from http://www.sheffield.ac.uk/lets-evaluate/impact

More Related