Public sector evaluation benchmarking exercise

1. Public sector evaluationbenchmarking exercise Prepared for ECG Meeting by K Chomitz for IEG October 25 2013

2. Submissions received from CEDs at: • African Development Bank • Asian Development Bank • Council of Europe Bank • European Investment Bank • Interamerican Development Bank (note: practices currently under revision) • IFAD • Islamic Development Bank • World Bank

3. Distribution of responses Note: excludes IADB – system under revision

4. Elements most frequently implemented(7 CEDs fully consistent) • The CED has a strategy for its mix of evaluation products that balances the two evaluation functions of accountability and learning. • Review: Draft evaluations are reviewed to ensure quality and usefulness.

5. Elements frequently implemented(6 CEDs fully consistent) • Performance Evaluation Reports (PERs): PERs are scheduled to ensure that sufficient time has elapsed for outcomes to be realized and for the sustainability of the operation to be apparent. • Stakeholders’ Consultation: Stakeholders are consulted in the preparation of evaluations. • Scope of Evaluation: Evaluations encompass all performance attributes and dimensions that bear on the operation’s success. • The assessment of Relevance covers both the relevance of objectives and the relevance of project design • The assessment of IFI Performance covers the quality of services provided by the IFI during all project phases. • Borrower Performance assesses the adequacy of the Borrower’s assumption of ownership and responsibility during all project phases. • Rules for assigning criteria ratings are clearly spelled out.

6. Elements infrequently implemented(two CEDs fully consistent) • The evaluation includes consideration of unanticipated outcomes. • If project objectives were revised during implementation, the project is assessed against both the original and the revised objectives. • The CED prepares a periodic synthesis report • The CED follows up on IFI Management’s implementation of recommendationsmade by the CED

7. Elements least implemented(only one CED fully consistent) • Sampling Methodology: The sampling methodology and significance of trends are reported. (IFAD) • Efficiency: : (i) Did the benefits of the project exceed project costs; and (ii) Were the benefits of the project achieved at least cost? (ADB)

8. Questions for discussion • Do these results align with expectations? • Are there OPs or EEs which need to be revisited? • Do you agree that the next step is validation to ensure consistency with GPs? • Is there scope for sharing approaches to GPs?