EVALUATION AND SUSTAINABLE DEVELOPMENT GOALS

1. Sri Lanka Parliamentarians Forum for Evaluation EVALUATION AND SUSTAINABLE DEVELOPMENT GOALS Introduction to evaluation and importance of evaluation for development process in the district

2. Project Cycle -Traditional Needs Assessments Scope Time Objective Budgeting Resources Resources planning Project Assessment with monthly and final progress report. Monitoring Initiating-concept building with objective Planning Close up Implementation Author Isha Miranda (M&E Consultant) ishamiranda@yahoo.ca Project Development Stage

3. What do you know about evaluation? courtesy by Dorothy Lucks and adapted for the workshop

4. Project Cycle -Traditional Needs Assessments Scope Time Objectives Budgeting Resources Resources planning Assumption Risk Initiating-concept building with objective End Evaluation Planning Close up Implementation Mid Term Evaluation Mid Term findings and filling the gap Author Isha Miranda (M&E Consultant) ishamiranda@yahoo.ca Project Development Stage

5. Definition of Evaluation An evaluation is an assessment, conducted as systematically and impartially as possible, of an activity, project, programme, strategy, policy, topic, theme, sector, operational area or institutional performance. Author Soma De Silva

6. An evaluation analyses the level of achievement of both expected and unexpected results by examining the results chain, processes, contextual factors and causality using appropriate criteria such as relevance, effectiveness, efficiency, impact and sustainability. Author Soma De Silva

7. An evaluation should provide credible, useful evidence-based information that enables the timely incorporation of its findings, recommendations and lessons into the decision-making processes of organizations and stakeholders Author Soma De Silva

8. OECD/DAC Definition An assessment, as systematic as possible of the on-going or completed projects ….. It’s design, implementation and results. The aim is to determine the relevance and fulfillment of objectives, development efficiency, effectiveness, impact and sustainability. An Evaluation should provide information that is credible and useful enabling the incorporation of lessons learned into the decision – making process. Author V. Sivagnanasothy

9. Evaluation purpose Author Dorothy Lucks

10. Programming Evaluation Implementation • Evaluation can inform • planning • programming • budgeting • implementation • and reporting • Evaluation can contribute to evidence-based policymaking Evaluation Author Soma De Silva

11. Why evaluation so important ? • Improves Accountability, Transparency, Results orientation and Good Governance • Feedback helps Lessons learning and access to best practices-Improves Project quality • Helps to avoid repetition of past mistakes • Mid- course corrections during implementation • Early warning signals – Alerts, feedback on Design, implementation and results • Establish performance Management Culture and Facilitates Public Sector Reforms • Improve the process of decision making • Empowerment of beneficiaries. Author V. Sivagnanasothy

12. Why Evaluate To help us see where we are going and if we need to change direction To see what had been achieved To help us to make better plans for the future To make our work more effective and Empower Stakeholders To take corrective actions To collect more information Why Evaluate To see if our work is costing too much and achieving too little To identify the issues, problems and constraints (early warning - alerts) To improve accountability, transparency and good governance To be able to share our experiences and learn lessons To compare the program with others like it To see where our strengths and weaknesses lie Author V. Sivagnanasothy

13. Monitoring , Evaluations and Learning Cycle southern Hemisphere's

14. 4.Improve Use findings and understandings Evaluation 3.Learn Data analysis reporting • Purpose: to assist decision makers to • improve policies, programs and projects FINAL/POST EVALUATION Were targets met? What lessons were learned? What are the recommendations for the future? INTERIM EVALUATION Checks progress Reviews test/pilot activities Helps adaptability Avoids wasted resources 1.Define Program designing and Planning 2.Measures Data collection management DESIGN EVALUABILITY Program Logic Monitoring design Author Dorothy Lucks and adapted for the workshop

15. How do you think evaluation helps for programmes in your district? DCC identifies needs of the district DCC reviews progress DCC decides programmes DCC allocates financial resources DCC finds disparities in the district Would evaluation findings help for DCC for above?

16. What do you want to achieve in programmes? • Activities (Building a school, building a community hall) or • Results? • Impact (educated youth ready for the job market) • Outcome (higher enrollment at schools, low drop out rate) • Output (education facilities available) • Use of resources timely manner • Effective decision making

17. Evaluation criteria OECD-DAC criteria courtesy by Natalia Kosheleva

18. Key steps in evaluation process courtesy by Natalia Kosheleva

19. How to read evaluation report • Executive Summary • Background • Purpose (Evaluation Questions) • Methodology • Findings • Lessons learned • Conclusions • Recommendations courtesy by Natalia Kosheleva

20. Evaluation policies, norms and standards http://www.unevaluation.org/document/detail/1914 courtesy by Natalia Kosheleva

21. courtesy by Natalia Kosheleva

22. courtesy by Natalia Kosheleva

23. courtesy by Natalia Kosheleva

24. courtesy by Natalia Kosheleva

25. Discussion about ethics courtesy by Natalia Kosheleva

26. Case 1 You’ve done the summative final evaluation of a project. Evaluation was commissioned by an organization that implemented the project. According to organization policy evaluation report has to be made public. Client thinks that some of the evaluation findings reflect badly on the organization. Client asks you to remove these findings from the report. What would you do? courtesy by Natalia Kosheleva

27. Case 2 You asked for individual interviews with members of a local women committee who participated in the project activities and you have a schedule for these interviews. You come for the first meeting and find out that all women are already there and would prefer to have a group conversation. What would you do? courtesy by Natalia Kosheleva

28. How evaluations can be used in our district? • Present 1-2 one page evaluation reports in DCC meetings with clear recommendations for decision making. • Advocate decision makers to take decisions based on evidence. • When progress is reviewed at DCC, request evaluation findings to encourage use of evaluation. • Design projects based on needs so that deprived/ most disadvantaged people are served. • When approving new programmes/ interventions, check whether it defines clear results and includes M&E in the design. • When approving new programmes/ interventions, allocating financial resources, check whether they are priorities. • Try to identify disparities in the district through disaggregated data and evaluation findings.