Chinelo Odiakosa-Mmakwe Co-authors: Liman.A , Onoh.O ,

1. Results from Systematic Monitoring and Evaluation of Community-based OVC Programs in Nigeria: The CUBS experience ChineloOdiakosa-Mmakwe Co-authors: Liman.A, Onoh.O, Community Based Support for OVC Project (CUBS) December, 2011 @ The ICASA Conference, Addis Ababa, Ethiopia

2. What is Monitoring? The routine tracking of key parts of a programme using record keeping and regular reporting

3. What is Evaluation? Periodic assessment of a project’s relevance, performance, effectiveness and impact in relation to stated objectives It Involves: measuring outcomes and impacts systematic assessment of the project achievements

4. Background/National challenges • With the escalating impact of TB/HIV/AIDS, Orphans and Vulnerable Children (OVC) in Nigeria was estimated at 17.5m in 2008 (FMWASD) • Ascertaining vulnerability priority amongst children – difficult • Increasingly difficult to monitor the health of the child and link them to services • Inadequate statistical data and OVC directory in Nigeria • High documentation requirements by donor agencies

5. Background/State challenges (Before the Project) • CSOs had little or no concrete documentation on OVC activities • The few available reports of CSOs were saddled with errors • OVC service delivery was quantitatively-based • The MSWR had no database or directory on OVC • Absence of monthly reports from CBOs to the MSWR • Monitoring of OVC wellbeing at the community level was almost absent.

6. Methods • USAID-funded CUBS – a project of Management Sciences for Health (MSH), provides community based (CB) support to OVC in 11 states of Nigeria. • CUBS trained 16 CB-Organization staff, 6 OVC desk officers of Federal Ministry of Women Affairs (FMWASD) and a SACA representative on M&E tools • 2 CBOs working in Rivers and 4 CBOs in Akwa Ibom States • 2 more CBOs added in Rivers and 1 in AKS • Each CBO enrolled and rendered services to OVC from different LGAs guided by the approved National M&E tools on OVC

7. Tools order OVC Service Form OVC Service Register CSO Monthly Summary Form LGA Monthly Summary Form Referral Form Training Register State Monthly Summary Form National OVC Summary Form

8. CUBS bottom-up M&E approach • Community Volunteers administers the Child Status Index periodically which measures the child’s well being • CSOs/Volunteers routinely provide services especially psychosocial support to OVC based on CSI findings • CSO M&E officers gathers the data and document in all available tools • The CUBS M&E Specialist conducts a first level verification on reports as well as routine mentoring, monitoring and supervision to CSOs

9. Cont’d • The M&E Specialist conducts a second level verification monthly as well as periodic field visits in company of the MSWR OVC desk officer/M&E officer when appropriate • Final verified copies of reports are thereafter sent by the CSO to CUBS and the MSWR • The MSWR is the coordinating body responsible for disseminating reports to other State actors (like SACA, etc) • Monthly CSO/CUBS meeting at the Ministry • Through these processes, capacity of CSOs and MSWR are strengthened • A pool of verified data derived and data storage enhanced

10. Services rendered covers 6+1 areas Health Education Food and Nutrition Shelter and Care Protection Psychosocial Support Household Economic Strengthening OVC with CSI scores 1 & 2 in each domain are first served Results

11. Results Cont’d

12. Results (Aug – Dec. 2010 for two states)

13. Results cont’d • Close monitoring on the health of the child is now achieved using community volunteers • Linking them to services need-oriented (OVC scoring 1 & 2 in each CSI domain are first served before those scoring 3&4) • Qualitative service provision now possible • Tracking the well being of the child now possible with the CSI reapplication • Referrals now made easy (early detection of illnesses and appropriate referral using the National OVC referral form) • Proper documentation of all OVC now in place (Each child has a folder with all M&E tools filled) • Comprehensive OVC directory per CSO now available

14. CSOs Data Storage before and After Intervention After Before Data storage at the start of the CUBS-OVC project at Hope and Care Foundation- CUBS Supported CSO Hope and Care Foundation, Client folders Storage 3 months into the CUBS Project

15. A database of OVC in Nigeria is now being developed by the FMWA with the systems strengthening support of the CUBS project Strengthened OVC coordinating structures Enhanced capacities of State OVC Desk Officers, caregivers of OVC and representatives of OVC CSOs Review of OVC working documents (NPA & SOP) Development of training Manual for OVC service provision (6+1 service areas) Development and pilot testing of national M&E Plan for OVC response in Nigeria Capacity building for OVC service providers in the country Provision of direct services to OVC Achievements

16. Orphans and Vulnerable Children National Plan of Action (NPA) 2006-2010 National Guidelines and Standards of Practice (SOP) on Orphans and Vulnerable children Training Manuals for OVC service provision in Nigeria OVC Advocacy Kits Directory of OVC NGOs in Nigeria M&E Plan for OVC Response in Nigeria Working Documents

17. Reiterating documentation processes using a bottom-up approach enhances the quality of services rendered by CBOs and public health workers to the Vulnerable child at the community level. The wellbeing of most vulnerable children can be enhanced if HIV programs consistently align with National tools as adapted by the CUBS project. Conclusion

18. Remember If you do not measure results, you can not tell success from failureIf you can not see success, you cannot reward itIf you can not reward success, you are probably rewarding failureIf you can not see success, you can not learn from itIf you can not recognize failure, you can not correct itIf you can demonstrate results, you can win public support Adapted by Kusek and Rist (2004) from Osborne & Gaebler, 1992

19. OVCsupport.net www.msh.org Aknowledgement Dr. Audu Liman – Chief of Party – MSH/CUBS Obialunamma Onoh – M&E Advisor – MSH/CUBS Africare Nigeria – Rivers/AKS Team Resources

20. Thank you!! Merci!!