1 / 7

Introduction

NZAID Experiences with DAC Evaluation Quality Standards (EQS) Andrew Kibblewhite & Miranda Cahn NZAID Evaluation Advisors. Introduction. Outline of presentation How NZAID has been using the EQS Case study: annual analysis of quality of NZAID evaluations EQS: conclusions and opportunities

dore
Download Presentation

Introduction

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. NZAID Experiences with DAC Evaluation Quality Standards (EQS)Andrew Kibblewhite & Miranda CahnNZAID Evaluation Advisors

  2. Introduction Outline of presentation • How NZAID has been using the EQS • Case study: annual analysis of quality of NZAID evaluations • EQS: conclusions and opportunities • NZAID and EQS: where to from here?

  3. Using the EQS in NZAID • Benchmark for standards of evaluations and reviews. • Developing NZAID evaluation guidelines • Advice to NZAID programme managers • Peer reviewing and appraising evaluations/reviews • Joint evaluations – sets common standards • Annual analysis of quality of NZAID-commissioned evaluations (case study follows)

  4. Case study: Using EQS for analysis of quality of NZAID evaluations Annual review of quality of NZAID evaluations • For NZAID learning, and improvement • In 2008 - eighteen 2007 evaluations • EQS informed • ‘matrix’ of criteria against which reports assessed • standards expected • Aspects of evaluations and reviews needing improvement were identified

  5. Case study: … continued Found: • Most NZAID evaluations could be improved • EQS useful in guiding the analysis • NZAID has additional specific evaluative criteria • EQS – allowed flexibility • Analysis grounded in international expectations However: • Some specific standards/content we required were not covered in the EQS • Aspects in the EQS could be more logically arranged • Evaluation/review methodology standards – developed our own criteria

  6. EQS: conclusions and opportunities Conclusions: • Overall – EQS very useful • EQS language - clear for a broad audience • EQS - shared understanding of evaluation standards • EQS - allows for flexibility and innovation Opportunities: • Improve methodology section in EQS • Enhance and re-arrange the information about evidence • Include guidance on appropriate management structures • Arrange EQS document more logically • Clarify purpose and use of EQS • Increase awareness amongst stakeholders

  7. NZAID – where to from here? • More awareness and promotion of use: • NZAID staff: • Guidelines • Advice • Contractors • Training • Specified in TOR. • Encourage the EQS to be applied more at the design stage, incl. informing M&E frameworks

More Related