PLANNING CONFERENCE 2 – 4 MARCH 2012 Slieve Donard Resort and Spa Newcastle Project Evaluation

1. PLANNING CONFERENCE 2 – 4 MARCH 2012 Slieve Donard Resort and Spa Newcastle Project Evaluation European Studies SENIOR PROGRAMME

2. Ray Kirtley (R.Kirtley@hull.ac.uk) International Resource Centre for Schools and Colleges, University of Hull, (part of the Faculty of Education) - Support for schools and colleges in international and global education- Management of teacher inservice training programmes - Assessment of funding applications for the British Council and EU - External evaluation of EU education projects

3. Why is evaluation important? To improve the quality of the project To provide a context for open discussion on project performance To reveal strengths as well as weaknesses and identify obstacles to progress

4. Monitoring v Evaluation Monitoring The continuous process of collecting and assessing data A tool for efficient project management A means of assessing progress towards objectives Checking of activities, deadlines, and resources Main tools: periodic reports, reviews, partner agreements Evaluation An assessment of the most relevant quality aspects of the whole project Provides evidence to support decisions Main tools: quantitative and qualitative evaluation methods Formative and summative Internal/external/peer Continuous processes during the lifetime of the project Thanks: die Berater

5. “My father is on the broad side and on the tall side. My father was a hardworking man and he had a lot of money. He was not fat or thin. His age was about 30 years when he died, he had a good reputation, he is a married man. When he was in hospital, I went to see him every Sunday afternoon. I asked him how he was going on, he told me he was a lot better. My father was very kind to me, and gave me and my cousins cigarette cards. He likes doing woodwork, my father, for me, and he likes a little game of cards now and then; or a game of darts. He chops the wood and saws the planks and he is a handsome man, but he is dead.” The teacher’s comment was, “Tenses. You keep mixing past and present.” John Blackie, formerly Chief Inspector of Primary Schools, used to tell a poignant little tale of a ten year olds essay, written in the day of the 11 plus examination. The child had written the following:

6. Evaluation is a process which should: Begin before the application is submitted and continue throughout the project (formative) Involve the whole partnership, students and others Predict how the project will develop Help in the process of quantifying results Build a culture of evaluation Reduce the work of the report!

7. Stages in evaluation Planning for evaluation: Agree the priorities for evaluation. It is impossible to evaluate everything! Check that everyone shares a common vocabulary Agree how responsibility for evaluation will be shared across the partnership Discuss timing, create an evaluation workplan

8. Collecting and interpreting evidence: ‘How do we know?’ What are we going to evaluate? The processes of the project(classroom activities, meetings, communications) The outputs of the project(materials, website, DVDs) The outcomes of the project - more difficult! Do we know the original situation?(Benchmarking of skills, knowledge, attitudes) What will be our indicators of change?

9. What shall we evaluate?

10. Collecting and interpreting evidence: ‘How do we know?’ What evaluation tools should we use? Use evaluation tools which are carefully structured and make indicators clear: Self evaluation is often highly effective

11. EVALUATION DIARY: Activity (including dates) Target Groups Brief rationale and description of activity Impact Future modifications NAME SCHOOL/ORGANISATION

12. EVALUATION DIARY: Activity (including dates)Theme or title Target GroupsWho with? Brief rationale and description of activityWhy did I do it? What did I do? ImpactHow did it go? Future modificationsIf I was to do this activity again what would I change and why. NAMESCHOOL/ORGANISATION

13. Evaluation of a project meeting INDICATORS: Sufficient information was sent before the meeting and communication was efficient Partners were given time for introductions (or re-introductions) and had time to update each other on their backgrounds and what they can bring to the project The agenda has been respected and any changes negotiated Partners have all contributed to the meeting The goals of the meeting were met The working environment was adequate for the proposed tasks Planned activities have taken place The partners have a clear idea of their next steps The accommodation, food and social element were adequate

14. ‘What are we going to do next?’ Analyse results - if possible at a team meeting Draw attention to the positives as well as the challenges Adapt: workplan, activities, communications, management styles, budgets Inform everyone involved - try not to impose! Record all the reasons for the changes Implementing change:

15. Survival Kit for Multilateral Project Management www.european-project-management.eu Where to go for help: