210 likes | 303 Views
THE BIG PICTURE. L-MEP. Liberia - Monitoring & Evaluation Program. Can the Agency tell the truth about results? Can the participants tell the truth about results?. BIG PICTURE: OBJECTIVES. Understand legal mandate Understand USAID/State responses Identify participant responses. L-MEP.
E N D
THE BIG PICTURE L-MEP Liberia - Monitoring & Evaluation Program Can the Agency tell the truth about results? Can the participants tell the truth about results?
BIG PICTURE: OBJECTIVES Understand legal mandate Understand USAID/State responses Identify participant responses L-MEP Liberia - Monitoring & Evaluation Program 2
USAID and the GPRA Government Performance Results Act: Who is your customer? What service/product do you provide? How much do you provide? What does it cost? USAID Performance Report: (Def. p 68) Pre-selected indicators must report data against targets to demonstrate results. The data are produced by implementation of a PMP based on a Development Hypothesis expressed by a Results Framework L-MEP Liberia - Monitoring & Evaluation Program 3
What is Performance Management? L-MEP Liberia - Monitoring & Evaluation Program • It is the systematic process of: • monitoring the achievements of program operations; • collecting and analyzing performance information to track progress toward planned results; • using performance information and evaluations to influence decision making and resource allocation; and • communicating results achieved, or not attained, to advance organizational learning….” (Def. p 67) 4 4
“Domino effect” in Performance Management context L-MEP Liberia - Monitoring & Evaluation Program Objective Specific Objective Specific Objective Activities 5 5
“Domino effect” in Performance Management context L-MEP Liberia - Monitoring & Evaluation Program Objective Specific Objective Specific Objective Activities 6 6
“Domino effect” in Performance Management context L-MEP Liberia - Monitoring & Evaluation Program Specific Objective Specific Objective Objective Activities 7 7
“Domino effect” in Performance Management context L-MEP Liberia - Monitoring & Evaluation Program ? Objective Specific Objective Specific Objective Activities 8 8
Performance Management Means we learn from the real world to improve effectiveness L-MEP Liberia - Monitoring & Evaluation Program 9 9
What is a Result? A significant, intended, and measurable change in the condition of a customer, or a change in the host country, institutions, or other entities that will affect the customer directly or indirectly (Def. p. 69) L-MEP Liberia - Monitoring & Evaluation Program 10
USAID Response: Development Hypothesis Ultimate customer or customer’s environment impact 1-20 years Do not always succeed but produce learning from experience Produce data on the road of causality traveled to benefiting customers: new knowledge & impact L-MEP Liberia - Monitoring & Evaluation Program 11 11
WHAT IS A RESULTS FRAMEWORK?(Def. P 69) Graphic representation of a strategy for achieving a specific objective Includes the objective, necessary intermediate results, and any critical assumptions that must hold Conveys the implicit development hypothesis (cause-and-effect linkages) Used as a planning, communications, and management tool L-MEP Liberia - Monitoring & Evaluation Program Critical Assumptions National policy supports watershed basin regional planning Obj.: Water resources management in 2 watershed basins improved IR1: Models for restoration/ conservation validated IR2: Water Management decision making restructured IR3: Investment in improved Water resources management increased IR4: Stakeholder conference generates consensus to restructure decision making 12
State Department Response: Standard Indicators Foreign Assistance Standardized Program Structures and Definitions (with Standard “F” indicators) Lets take a look at them. L-MEP Liberia - Monitoring & Evaluation Program 13
What are “F” indicators? Foreign Assistance Framework standardized indicators world wide (+/- 3,000 – See FAF Standardized Program Structure and Definitions – program element indicators and flash drive total list) Response to the GPRA and Office of Management and Budget Selected by the Mission (with or without consultation with Partners) L-MEP Liberia - Monitoring & Evaluation Program 14
TheForeign Assistance Framework L-MEP Liberia - Monitoring & Evaluation Program 15
How to treat “F” indicators ADS 203.3.8.3 p 36 2nd paragraph: custom indicators at AO or outcome level. Standard indicators often suitable for management purposes at lower levels of RF 3rd paragraph: custom indicators in joint Performance Report/Operational Plan for impact/outcome only L-MEP Liberia - Monitoring & Evaluation Program 16
CUSTOM INDICATORS A Results Framework can include results at several levels in the causal chain: inputs outputs, outcomes, and impact Very few “F” indicators measure results at the outcome or impact levels Missions are accountable for impact as defined in response to GPRA L-MEP Liberia - Monitoring & Evaluation Program 17
Task I (by Organization) If you have a Results Framework: write each Result on a separate A4 paperand tape them up in Results Framework format. Write your major Activities on A4 papersand tape them across the bottom or the Framework. If you do not have a Results Framework: write your Objective and major Activities on A4 papersand tape them up with the Objective up high and the Activities across the bottom (down low,) with space in between. At your table, discuss the questions: Who is your customer? What do you do for them? How much do you do? What does it cost? L-MEP Liberia - Monitoring & Evaluation Program 18
Discussion Review What did you use to address the GPRA Questions? Results Framework indicators and data? State Department “F” standard indicators and data? Annual expenditures? Quarterly Report data or narrative? Other? Can you tell the truth about your results? Can the Agency tell the truth about results if you can’t? L-MEP Liberia - Monitoring & Evaluation Program 19
So, What is a Performance Management Plan (PMP)? L-MEP Liberia - Monitoring & Evaluation Program • ADS 200 definition: • A tool used by USAID Mission/Office and assistance objective team to plan and manage the process of assessing and reporting progress toward achieving an Assistance Objective (ADS p. 67) • Let’s Look at two: Mountain Conservation Society & Liberia Case 20 20
Session 1. Summary GPRA Questions Agency Development Hypothesis: Results/Learning Standard Indicators: “F” Truth about Results = Quality of Performance Management of IPs Reality doesn’t lie; we do. L-MEP Liberia - Monitoring & Evaluation Program 21