1 / 21

Mawadda Damon May 2, 2011 TAP 3 Launch Workshop

Mawadda Damon May 2, 2011 TAP 3 Launch Workshop. TAP Monitoring and Evaluation. Overview. Introduction Context and purpose of the evaluation Indicators Data Collection Timeline. Introduction. NORC at the University of Chicago. Independent research organization Established in 1941

menora
Download Presentation

Mawadda Damon May 2, 2011 TAP 3 Launch Workshop

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Mawadda Damon May 2, 2011 TAP 3 Launch Workshop TAP Monitoring and Evaluation

  2. Overview Introduction Context and purpose of the evaluation Indicators Data Collection Timeline

  3. Introduction NORC at the University of Chicago Independent research organization Established in 1941 Develop knowledge to support evidence-based decisions Collect data Provide analysis Work in international development, health, education, economics, crime, justice, energy, security, and the environment

  4. Evaluation Team Ghana: Yazeed Abdul Mumin Rwanda: Norbert Sangano NORC US office: Ray Struyk Mawadda Damon Sam Haddaway BurkinaFaso: Venceslas Nikiema Uganda: Linda Lilian

  5. TAP Purpose • To strengthen the capacity of civil society organizations to hold their governments accountable for public spending and service delivery in the social sectors. • Barriers to Independent Monitoring Organizations’ success: • Weak institutional capacity and skills • Lack of positive relationships with government and donors • Lack of access to information

  6. TAP Concept Activities • Training in research tools and effective communication • Work with government champion • Promotion of partnerships • Support information exchange Short-Term Outcome • Improved IMO performance Long-Term Outcome • Improved efficiency of government spending • Improved service delivery

  7. Impact Evaluation Design A B C D • Purpose: effectiveness of program concept • Change between pre and post-project

  8. Indicators and Data Collection

  9. Monitoring Data Collection • IMO Survey • Outputs and size • Procedures • Changes in operations • IMO effort • Follow-up by Local Associate • Timeline • Baseline: April 2011 • Follow-up: December 2013

  10. Impact Evaluation

  11. Short-Term Outcome Indicators Measuring Improved IMO performance Analytic capabilities • View on quality of analysis • Value as source of research Collaborations • With whom and how often • Added-value of partnerships • Effectiveness Sustainability • Number transparency and accountability of projects • Reputation

  12. Long-Term Outcome Indicators Measuring improved efficiency of government spending and service delivery Impact of TAP-related work • Policy changes • Monitoring tools • Improved public expenditure/service delivery Perceived improvement in IMO effectiveness • Influencing policies and procedures • Quality of research and communications • Effective partnerships

  13. Data Collection • Policy Community Survey • Respondents • 50 policymakers, opinion leaders, civil society organizations • List developed by Local Associates and shared with IMO • Content • General • Sources of information • Use of analysis in decision making • Receptivity of policymakers to information from NGOs • Organization specific • Usefulness and impact of its activities • Quality and relevance of work • How effective are communications

  14. Data Collection Policy Community Survey • IMO effort • Timing • May - June 2011 • Dec 2013 - Jan 2014

  15. Data Collection • IMO Project Case Studies • Respondents • Staff at IMO • Collaborators • Content • Five in-depth case studies • Role of each collaborator • Research and communications activities • Challenges and results

  16. Data Collection • IMO Project Case Studies • IMO effort • Timing • May 2011, March 2012, December 2013

  17. Data Collection Schedule

  18. Analysis Notes • Data Analysis • Statistical testing • Qualitative data analysis • Attributing Causality • Control for other factors/changes

  19. Summary of IMO Tasks

  20. How Can We Meet Your Needs? • Provide de-identified PCS survey database • Provide baseline and final evaluation report • What else would you like?

  21. Email: damon-mawadda@norc.org

More Related