240 likes | 521 Views
Monitoring & Evaluation System: the Experience of the Millennium Challenge Account (MCA) Armenia . Shushan Kurkchiyan , MCA-Armenia Yerevan, Armenia June 20, 2011. MCC’s Core Principles. Poverty Reduction through Economic Growth Good Policies Matter Country Ownership Focus on Results.
E N D
Monitoring & Evaluation System: the Experience of the Millennium Challenge Account (MCA) Armenia. ShushanKurkchiyan, MCA-Armenia Yerevan, Armenia June 20, 2011
MCC’s Core Principles • Poverty Reduction through Economic Growth • Good Policies Matter • Country Ownership • Focus on Results
“Focus on Results” means… • Integrating monitoring and evaluation into project design and implementation • Holding implementers accountable for achieving results • Using analysis and lessons learned for decision-making
Monitoring and Evaluation: A Partnership between MCC and MCA How much will farmer income increase over time? Did farmer income increase relative to comparison group? Economic and beneficiary analysis Irrigation Infra: How many kilometers of tertiary canals are being rehabilitated? WtM: How many farmers are being trained? Monitoring Evaluation 4
Economic Analysis: What is an ERR? • Comparison of the costs and benefits of a public investment • People often focus on the benefits, but forget about costs • Way to utilize scarce resources cost effectively to improve peoples’ economic well-being (i.e. design and select projects)
With a higher than 12.5% ERR, benefits outweigh costs: Total Benefit = 170 Total Cost = 100
Beneficiary Analysis • MCC’s Definition of a Beneficiary • Anyone who receives assistance • Anyone who realizes increased income • Anyone who lives in Armenia
Indicators in M&E Plan Goals Outcomes Results Level of Indicator Outputs Process Milestones Implementation (early in implementation) (later or after end) Time
Monitoring • In MCA-A M&E Plan has 2 types of monitoring indicators: Process Milestones and Outputs • Process looks at progress in terms of contract signing, disbursements and important deadlines, i.e. milestones • Output looks at direct results such as number of farmers trained, number of pump stations renovated, kilometers of canals rehabilitated, etc.
Evaluation • Outcome and Goal indicators look at what happens after the program or program component is implemented. • Through evaluations we try to understand whether the program had the intended impacts on its intended beneficiaries. • Did farmer income increase? Did farmers move from growing lower value crops to growing higher value crops?
Changing Indicators • New indicators may be added • Indicator information (definition, data source, etc) may be revised as necessary • Indicators may be deleted if: • The cost to collect the data is greater than the benefit • The Project design changes such that the indicator does not measure the intended outcome
Changing Targets • MCC’s preference is to not change targets • Interim targets may be changed as long as end of Compact targets does not change • For end of Compact targets,the modified targets will be analyzed to assess whether they maintain the integrity of the original ERR
Revising the M&E Plan • Any changes should be documented with appropriate justification • All revisions must be approved by MCC • Revision of the M&E Plan of the MCA-Armenia.