European Commission IDEAS - New Delhi 14 April 2005

1. European Commission DG Budget – Evaluation Unit European Commission IDEAS - New Delhi 14 April 2005

2. European Commission DG Budget – Evaluation Unit • Commission Communication on evaluation standards and good practise • Entry into force July 2003 Organisational context • Main evaluation responsability on individual Directorates General (evaluation functions) • Centralised support and coordination

3. European Commission DG Budget – Evaluation Unit • Regulatory context • Previous good practise guidelines • Commission Communications: - on evaluation (2000) - on Activity Based Management (2001) • Financial regulation with rules on evaluation • Internal Control Standards (evaluation is one of 24)

4. European Commission DG Budget – Evaluation Unit • Purpose and scope Purpose: • Assist services in organising and managing their evaluation activities • Ensure quality of evaluation • Achieve usefulness and use of evaluation • Recognition of the importance of evaluation across management levels and decision-making

5. European Commission DG Budget – Evaluation Unit Scope: • "Evaluation principles", resources, processes • Evaluation function in all Commission departments and the preparation, management and use of results of evaluation activities • Type of evaluation: • evaluations of policies, programmes, activities, • ... (except individual projects) • ex ante, interim and ex post • - internal and external

6. European Commission DG Budget – Evaluation Unit Structure • 39 standards (binding) and 20 good practice (recommended). Main sections: • Evaluation function: profile, role, tasks, • resources • Evaluation activities: planning, feedback, • external communication • Evaluation process: evaluation project, steering • groups, conduct of evaluations • Quality of evaluation reports

7. European Commission DG Budget – Evaluation Unit Contents (1) – The evaluation function • Profile, role, tasks and resources of the evaluation function • - Evaluation function with clear role and visible in • the DG structure • - Support in the formulation of policies, • programmes and management processes • - Adequate human & financial resources

8. European Commission DG Budget – Evaluation Unit Contents (2) – Evaluation activities • Management of Evaluation Activities • Annual and multi-annual planning • Feedback to decision-making process • Action on conclusions and recommendations • - Dissemination of evaluation results

9. European Commission DG Budget – Evaluation Unit Contents (3) – The evaluation process • Design of an evaluation project - terms of • reference • Steering Group • - Managing evaluations: responsibilities, independence

10. European Commission DG Budget – Evaluation Unit Contents (4) – Quality of Report • Quality of the reports. • Substance of the report • Conclusions and recommendations: non-interference • and unbiased • - Recommendations: clear, useful, applicable

11. European Commission DG Budget – Evaluation Unit Regulation vs. persuasion • Binding minimum standards & auditable • Combined with good practices • Guidance on how to apply the standards • Training & exchange of good practices

12. European Commission DG Budget – Evaluation Unit Acceptance and utilisation • In the establishment phase • Drafted with the involvement of an interservice working group • Formal Interservice consultation (integration of comments)

13. European Commission DG Budget – Evaluation Unit Acceptance and utilisation In the application phase • Self assessment by services - Compliance with Internal Control Standards (89% claim compliance) • - Annual reporting cycle • Questionnaire by DG Budget  -open-ended with 2 questions: • - Useful? • - Changes needed? • European Court of Auditors: auditing questionnaire covering many standards