1 / 41

E-101 Thursday Section

E-101 Thursday Section. Thursday, 1 st nov. , 2012 11 – 12.30 p.m. Roadmap for today. Housekeeping Where are we? What are the goals? Application Feedback – sticky notes. Housekeeping. Paper II is coming up

kerry-johnson
Download Presentation

E-101 Thursday Section

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. E-101 Thursday Section Thursday, 1stnov. , 2012 11 – 12.30 p.m.

  2. Roadmap for today • Housekeeping • Where are we? • What are the goals? • Application • Feedback – sticky notes

  3. Housekeeping • Paper II is coming up • Paper III – Dec. 20th – we will start looking at this more closely once Paper II is back

  4. Where are we-

  5. M&E - • One of the most impt. aspects of this course - make sure you walk away with it • Resources – • International Initiative for Impact Evaluation • J-PAL • UNESCO IIEP • UNICEF Innocenti Research Center • UNICEF Evaluation Database • World Bank Evaluation Database • Other classes – • HaiyanHua’s M & E class • Tom Kahne - Program Evaluation

  6. Weiss Reading • What does she have to say? Summary? • What are the tensions that might arise in the evaluation process?

  7. Monitoring & Evaluation There is a difference between M and E! Monitoring: The gathering of evidence to show what progress has been made in the implementation of programs. Focuses on inputs and outputs. Evaluation: Measuring changes in outcomes and evaluating the impact of specific interventions on those outcomes.

  8. Monitoring & Evaluation

  9. Reflections - • What are the tensions b/w an insider & outsider role as an evaluator? • If time is money, how does one implement process? • What are the ways in which impact might be considered? How might cultural differences impact these? • Creating local capacity for communities to monitor their own programs & hold states accountable for the delivery of basic services? • Dissemination to the beneficiaries?!

  10. Implementation Issues? • Political Economy • Policy Context • Methods

  11. Political Economy • What is the policy purpose? • Test innovations & defend budget • Allocate budget to certain programs • Pressure to demonstrate aid effectiveness and scale up • Answer electorate • Reaching Targets

  12. Policy Context • What questions need answering? • Who are the stakeholders who want answers? Do they also have the same amount of clout? • What policy questions need answers? • How much of a change would determine success? • What does the government really need, and what will it use?

  13. Methods • Operationalizing the outcome • Process/outcome indicators • Channels of impact – theory of change • Underlying assumptions [log frame] • Who has access to the program? Are they the same as the intended beneficiaries? • Data collection – time vs. cost • Analysis • Dissemination

  14. Things to think about • What ? • Type of information and data to be consolidated • How? • Procedures and approaches for data collections and analysis • Why? • Why are we doing this – does it support the program/policy • When? • Freq. of data collection, reporting • Who? • Responsibilities and capacities of focal points and resource persons

  15. Sector Analysis: What is it? • Sector Review: summary of the state of the sector • Sector Assessment: success of the sector in meetings certain goals • Sector Analysis: (most comprehensive) includes review and assessment (above), and also describes sector needs, constraints, and opportunities for improvement. • (Kremmerer, 1994)

  16. Sector Analysis: What is it? Tries to answer questions relating to: • External efficiency • Internal efficiency • Access & equity • Administration & supervision • Costs & financing (Pigozzi & Cieutat, 1998)

  17. Sector Analysis: What is it? The contents of a sector analysis may include: • Synthesis • Economic & Financial Analysis • History, Structure & Management Capacity • Analysis by Sub-Sectors: • Special Studies • A list of background documents (Pigozzi & Cieutat,1988)

  18. Sector Analysis: Steps • Initiation • Formation of the National Steering Committee • Determination of the scope of the analysis • Formation of the subsector teams • Formation of the technical analysis team • Instrumentation and collection of data • Preliminary analysis of data • Discussion of preliminary findings • Collection of any additional data • Formulation of draft recommendations • Discussion of draft recommendations • Revision and prioritization of recommendations. (Kremmerer, 1994)

  19. Political Mapping: An Example

  20. Political Mapping: An Example

  21. Stakeholder Map: An Example

  22. Program Theory “Program theory…refers to the mechanisms that mediate between the delivery (and receipt) of the program and the emergence of the outcome of interest. The operative mechanism of change isn’t the program activities per se but the response that the activities generate.” - Carol Weiss, Evaluation, p. 57 You will be reading a section of this book for next week.

  23. Activity: Program Theory For each program, there may be multiple pathways to the intended outcome. Source: Weiss, C. (1997). Theory-based evaluation: Past, present, and future. New Directions for Evaluation, (76), 41-55, p. 42.

  24. From Program Theory to Implementation to Evaluation • Logical Frameworks • can help you to organize: • Design • Implementation • Evaluation • Developed by USAID in the 1960s • Vary slightly, but always include: 4 x 4 • Narrative Summary, Indicators, Means of Verification, and Assumptions

  25. Log Frames • “In terms of relevance, practice could be the development of common understandings gained via an examination of assumptions and creation of a common language for evaluation” - Garaway p.p. 718 • Log frame as tool to do examine • Relevance: what, where, who • Effectiveness: Process & implementation • Efficiency: Making the best use of resources • Impact: Support the program purpose

  26. How do you develop a logic model? • Linear process from beginning to end • Move around (iterative) • Backwards (identify results then determine the resources/inputs and activities that are required) Can be described as If ___________ then ____________. If we have X resources and do Y activities, then we will have Z Outputs, W Outcomes and T Impact.

  27. ? ? ? ? Impact ? Outcome Outcome Outcome ? Output Output Output Output Output Output ? ? ? ? ? ? Putting It All Together Impact ? Outcome Output ? Output Output ? ? ?

  28. How to annoy your family with what you learned at HGSE… Your Planned Work Logic Model of a Family Trip Your Intended Results Impact Resources/ Inputs Activities Outputs Outcomes Tickets for all family members Frequent flyer miles used Money saved Ground transport Holiday flight schedules Family schedules Holiday weather Your exam/ paper due dates Create family schedule Get holiday flight info Get tickets Arrange ground transport Family members enjoy vacation Continued good family relations

  29. Logical Frameworks

  30. Logical Frameworks THEN IF AND THEN IF AND THEN IF AND

  31. Logical Frameworks

  32. Logical Frameworks

  33. Logical Frameworks

  34. Logical Frameworks

  35. Logical Frameworks

  36. Logical Frameworks

  37. Logical Frameworks

More Related