1 / 94

M&E for Accountability & Global Progress Tracking

M&E for Accountability & Global Progress Tracking. Monitoring, Operations Research and Evaluation Team UNAIDS/Geneva April 2007. ORIENTATION 2008 UNGASS Country Progress Report. Benefits of UNGASS for M&E strengthening UNGASS Guidelines Purpose and use Core indicators

osanna
Download Presentation

M&E for Accountability & Global Progress Tracking

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. M&E for Accountability & Global Progress Tracking Monitoring, Operations Research and Evaluation Team UNAIDS/Geneva April 2007

  2. ORIENTATION2008 UNGASS Country Progress Report Benefits of UNGASS for M&E strengthening UNGASS Guidelines Purpose and use Core indicators Data sources & data vetting Reporting process

  3. INTRODUCTION Where does UNGASS fit in M&E system? UNGASS Reporting Timetable Use of 2006 UNGASS data Global use Country use

  4. WHERE DOES UNGASS FIT IN A COMPREHENSIVE M&E SYSTEM? Benefits of UNGASS reporting for M&E strengthening: • Brings partners together around a core set of indicators • Helps identify data gaps & data quality issues • Stimulates the establishment of a centralised database of HIV indicator data • Provides a de facto bi-annual report on the epidemic and the response

  5. WHERE DOES UNGASS FIT IN A COMPREHENSIVE M&E SYSTEM? Program Improvement Share Data with Partners Reporting/ Accountability [UNGASS, other]

  6. UNGASS REPORTING TIMETABLE

  7. GLOBAL USE OF 2006 UNGASS DATA • Global Progress Report • Report to the Secretary General (as required in the Declaration of Commitment) • Used for tracking the Millennium Development Goals

  8. COUNTRY USE OF 2006 UNGASS DATA 1. National report on the epidemic and response • informs programmatic decisions • guides reviews of the National Strategic Plan • informs resource mobilisation efforts (e.g. GFATM proposal development) • is used as an advocacy tool • is used to report progress on Declaration of Commitment to Senior Government Officials

  9. COUNTRY USE OF 2006 UNGASS DATA 2. M&E system strengthening • convenes relevant partners to address a particular M&E need • identifies data gaps • assists in planning data collection efforts • identifies data weaknesses • helps mobilise resources for system strengthening • stimulates evaluation questions

  10. LESSONS LEARNED FROM 2006 UNGASS REPORTING • Challenges in 2006 reporting • 2006 reporting from MENA • Lessons learned from 2006 reporting • UNAIDS/Geneva-level • Country-level

  11. CHALLENGES IN 2006 REPORTING 137 countries submitted a Country Progress Report • 10% reported on all indicators relevant to epidemic • 51% used CRIS to report indicator data Some basic data quality issues including • incorrect indicator or incorrect indicator calculation • incomplete data (e.g. only 20% of indicators reported included the required disaggregation) • illogical values • discrepancies between data in CRIS and Report

  12. Percent Range and Median of Indicators Reported by Countries by Region - UNGASS 2006 Report

  13. IMPORTANCE OF DISAGGREGATED DATA

  14. LESSONS LEARNED FROM 2006 REPORTINGUNAIDS/Geneva-level The following inputs are paramount for improving the quality of the data obtained from countries: • Revise UNGASS indicators, where necessary • Provide clear and specific Guidelines • Provide user-friendly, flexible CRIS software • Provide training on UNGASS indicators & reporting process • Provide technical support, where needed

  15. LESSONS LEARNED FROM 2006 REPORTINGCountry-level • Ensure correct understanding of indicator definition/operands • Report all required indicators • Identify and document data sources • Provide all data and information needed for each indicator • Cross-validate data (comparison with previous years, comparison with alternate sources, etc.) • Use CRIS for indicator reporting • Double-check for data entry errors • Submit timely

  16. LESSONS LEARNED FROM 2006 REPORTINGCountry-level LESSONS LEARNED FROM 2006 REPORTING • Address data gaps early • Seek to enhance data quality • Follow all the steps in the reporting process • Double-check accuracy and obtain consensus on all indicator values at country level before submission

  17. ORIENTATION ONTHE UNGASS GUIDELINES Purpose Target audience Contents Principles and process of Guidelines revision Use of Guidelines

  18. PURPOSE • Provide essential information on construction of core indicators for reporting • Ensure transparency of the reporting process in-country • Ensure consistency of information across countries for global progress analysis

  19. TARGET AUDIENCES • Government sector • including the National AIDS Committee, Ministries (e.g. Ministry of Health, Ministry of Finance, Ministry of Education) • Nongovernmental sector • including nongovernmental organizations, faith-based organizations, people living with HIV, private sector • UN co-sponsors and donor agencies

  20. CONTENTS OVERVIEW • Introduction p. 9-13 • Implementation at National Level p. 14- 20 • Core Indicators p. 21-82 • Appendices 1 - 9 p. 83-139

  21. APPENDICES 1 - 9 Changes to Core Indicators Country Progress Report template Methodology used for the coverage survey Consultation/preparation process for the Country Progress Report Reporting schedule for Core Indicators National Funding Matrix 2007 National Composite Policy Index (NCPI) 2007 Sample check-list for Country Progress Report Selected bibliography

  22. PRINCIPLES OF GUIDELINES REVISION Consensus-driven process Transparency Consistency Comprehensiveness Quality Integration within the National M&E system Feasibility

  23. PROCESS OF GUIDELINES REVISION Process of Guidelines Revision • Debriefing process • 2006 Indicator performance • M&E Reference Group review • Technical working groups for each indicator

  24. HOW TO USE THE GUIDELINES Familiarize yourself with the current Guidelines & the changes since the previous round Disseminate the Guidelines and use them to develop a collaborative in-country process Ensure that the correct definitions are used for construction of the indicators & refer to Further Information, as needed Use all Appendices Ask for clarification / assistance, as needed

  25. CORE INDICATORS Overview of Core UNGASS Indicators Which UNGASS indicators to report Changes since the 2005 UNGASS Guidelines Core UNGASS Indicators

  26. WHAT ARE CORE UNGASS INDICATORS? Quantitative variables whichprovide simple and reliable ways of measuring progress towards achieving the Declaration of Commitment on HIV/AIDS

  27. CORE UNGASS INDICATORS National Indicators (N=25) Four categories: 1. National commitment and action 2. National programmes 3. Knowledge and behaviour 4. Impact Global Indicators (N=4)

  28. CORE UNGASS INDICATORS:NATIONAL INDICATORS Four categories: 1. National commitment and action 2. National programmes 3. Knowledge and behaviour 4. Impact

  29. CORE UNGASS INDICATORS:NATIONAL INDICATORS National indicators are important for two reasons: • They are used to evaluate the effectiveness of the national response 2. They are used to provide information on regional and global trends

  30. MILLENIUM DEVELOPMENT GOALS (MDGs) Millennium Development Goals (MDG) There are 8 MDGs: • Goal 6: Combat HIV/AIDS, Malaria and other diseases • Target: Have halted by 2015 and begun to reverse the spread of HIV/AIDS • UNGASS indicators are used to monitor progress

  31. UNGASS Indicators to monitor MDG-6 12) Current school attendance among orphans and among non-orphans aged 10-14 17) Percentage of women and men aged 15–49 who had more than one sexual partner in the past 12 months who report the use of a condom during their last sexual intercourse • Four of the national indicators are also 13) Percentage of young women and men aged 15-24 who both correctly identify ways of preventing the sexual transmission of HIV and who reject major misconceptions about HIV transmission 22) Percentage of young women and men aged 15–24 who are HIV infected

  32. Global Indicators • Amount of bilateral and • multilateral financial flows • (commitments and disbursements) • for the benefit of low- and • middle-income countries • Amount of public funds for • research and development of • preventive HIV vaccines • and microbicides • Percentage of transnational • companies that are present • in developing countries and • that have workplace HIV • policies and programmes 4) Percentage of international organizations which have workplace HIV policies and programmes

  33. Which UNGASS indicators should countries report? Which UNGASS indicators should countries report? • No distinction between Generalized Epidemic Indicator Set & Concentrated /Low-prevalence Epidemic Indicator Set • Most national indicators are applicable for all countries • Countries are expected to "know their epidemic"

  34. Which UNGASS indicators should countries report?(continued) Which UNGASS indicators should countries report? When countries choose not to report on a particular indicator, an explanation needs to be provided: Either, • The indicator is not applicable to the epidemic • The indicator is applicable, but no data is available

  35. Which UNGASS indicators should countries report? (continued) The indicators have to be constructed including the required disaggregations, as outlined in the current UNGASS guidelines

  36. Changes since the 2005 UNGASS Guidelines Why changes? • To improve the comprehensiveness and quality of data What changes? • See Appendix 1

  37. Changes since the 2005 UNGASS Guidelines (continued) Principles used in revisions • changes are based on • input received from partners • an analysis of indicator performance in the 2005 reporting round • new programmatic developments • every effort was taken to minimize changes • every effort was taken to ensure that most countries would be able to collect the data or obtain it from already existing data sources

  38. Changes since the 2005 UNGASS Guidelines (continued) Indicators added: 6) Percentage estimated HIV-positive incident TB cases that received treatment for TB and HIV 7) Percentage of women and men aged 15-49 who received an HIV test in the last 12 months and who know their results

  39. Changes since the 2005 UNGASS Guidelines (continued) Indicators removed: • Percentage of large enterprises/companies which have HIV/AIDS workplace policies and programmes • Percentage of women and men with sexually transmitted infections at health care facilities who are appropriately diagnosed, treated and counselled

  40. Changes since the 2005 UNGASS Guidelines (continued) Indicator definition changed 1) AIDS spending 3) Blood Safety 5) Prevention of Mother-to-Child Transmission • Most-at-risk Populations: Prevention Programmes 11) Life Skills-based HIV Education in Schools 16) Higher-risk Sex 17) Condom Use During Higher-risk Sex

  41. Changes since the 2005 UNGASS Guidelines(continued) Age range expanded 4) HIV Treatment: Antiretroviral Therapy Composite indicator divided into its components 20) Injecting Drug Users: Condom Use 21) Injecting Drug Users: Safe Injecting Practices Added questions 2) National Composite Policy Index

  42. CORE UNGASS INDICATORS:NATIONAL INDICATORS National Commitment and Action • Domestic and International AIDS spending • by categories and financing sources 2) National Composite Policy Index (NCPI) Questionnaire divided into two sections: Part A (Government) Strategic plan; Political support; Prevention; Treatment, care & support; Monitoring & Evaluation Part B (Non-government) Human rights; Civil society involvement; Prevention; Treatment, care & support

  43. CORE UNGASS INDICATORS:NATIONAL INDICATORS National Programmes 3) Percentage of donated blood units screened for HIV in a quality-assured manner • Percentage of adults and children with advanced • HIV infection receiving antiretroviral therapy 5) Percentage of HIV-positive pregnant women who received antiretrovirals to reduce the risk of mother-to-child transmission • Percentage estimated HIV-positive incident • TB cases that received treatment for TB and HIV

  44. CORE UNGASS INDICATORS:NATIONAL INDICATORS National Programmes(continued) • Percentage of women and men aged 15-49 who received • an HIV test in the last 12 months and who know their results • Percentage of most-at-risk populations who received an • HIV test in the last 12 months and who know their results • Percentage of most-at-risk populations reached • with HIV prevention programmes

  45. CORE UNGASS INDICATORS:NATIONAL INDICATORS National Programmes(continued) 10) Percentage of orphaned and vulnerable children aged 0-17 whose households received free basic external support in caring for the child 11) Percentage of schools that provided life-skills based HIV education within the last academic year

  46. CORE UNGASS INDICATORS:NATIONAL INDICATORS Knowledge and Behaviour 12) Current school attendance among orphans and non-orphans aged 10–14* 13) Percentage of young women and men aged 15–24 who both correctly identify ways of preventing the sexual transmission of HIV and who reject major misconceptions about HIV transmission* 14) Percentage of most-at-risk populations who both correctly identify ways of preventing the sexual transmission of HIV and who reject major misconceptions about HIV transmission *Millennium Development Goals indicator

  47. CORE UNGASS INDICATORS:NATIONAL INDICATORS Knowledge and Behaviour (continued) 15) Percentage of young women and men aged 15-24 who have had sexual intercourse before the age of 15 16) Percentage of women and men aged 15–49 who have had sexual intercourse with more than one partner in the last 12 months 17) Percentage of women and men aged 15–49 who had more than one sexual partner in the past 12 months reporting the use of a condom during their last sexual intercourse* *Millennium Development Goals indicator

  48. CORE UNGASS INDICATORS:NATIONAL INDICATORS Knowledge and Behaviour (continued) 18) Percentage of female and male sex workers reporting the use of a condom with their most recent client 19) Percentage of men reporting the use of a condom the last time they had anal sex with a male partner 20) Percentage of injecting drug users reporting the use of a condom the last time they had sexual intercourse 21) Percentage of injecting drug users reporting the use of sterile injecting equipment the last time they injected

  49. CORE UNGASS INDICATORS:NATIONAL INDICATORS Impact 22) Percentage of young women and men aged 15–24 who are HIV infected* 23) Percentage of most-at-risk populations who are HIV infected 24) Percentage of adults and children with HIV known to be on treatment 12 months after initiation of antiretroviral therapy 25) Percentage of infants born to HIV-infected mothers who are infected *Millennium Development Goals indicator

More Related