240 likes | 429 Views
PEPFAR OVC Survey Toolkit. Janet Shriberg, EdD Senior Evaluation Advisor Office of HIV/AIDS USAID **please note that slides were created with work done by MEASURE Evaluation. PEPFAR Mission & Goal (OVC).
E N D
PEPFAR OVC Survey Toolkit Janet Shriberg, EdD Senior Evaluation Advisor Office of HIV/AIDS USAID **please note that slides were created with work done by MEASURE Evaluation
PEPFAR Mission & Goal (OVC) • Mission: To mitigate the social, emotional and economic impacts of HIV/AIDS on children and to reduce their risk and vulnerability while increasing their resilience • A goal: To care for 5 million orphans and vulnerable children • 10% funding earmark for OVC
The problem • High investment in OVC programs BUT impact is unclear & questions regarding “what works” in improving household well-being • Part of the challenge: lack of standardized measures and tools for child and household outcomes (well-being)
A proposed solution Standardized questionnaires for use in a survey of children ages 0-17 years and their adult caregivers
Who are these tools for? • Local and international research institutions and other implementing organizations with evaluation agenda • USAID Forward – supporting local researchers
The purpose • Standardize population-level child and caregiver well-being data beyond what is available from routine surveys • Produce actionable data to inform programs and enable mid-course corrections • Enable comparative assessments of child and caregiver well-being and household economic status across a diverse set of interventions and regions
Focus on PEPFAR OVC programs • Indicators need to reflect & be amenable to change by PEPFAR program intervention • HH interventions led by home visitors • Community interventions • Low direct funding per target, focus on linkages • Often inadequate services in vicinity
How did we start… • Two step, participatory process: • Build consensus around core impact indicators for PEPFAR-funded OVC programs • Develop OVC program evaluation (survey) tools
Distilling the core indicators • Our starting point: 6+1 domains of PEPFAR OVC programming • Step 1: Extensive literature search • Step 2: Gaps (HES, PSS) filled through targeted research Result: >600 child/HH wellbeing questions/indicators • Step 3:Analysis against 8 criteria Result: shorter list of questions for discussion
Finalizing the core indicators • External working group: solicited review from 49 stakeholders • Finalized core set of 12 child and 3 household measures
Developing the tools • Tools drafted with strong stakeholder input • Draft tools piloted in Zambia and Nigeria • Cognitive interviews to test key concepts (e.g. social support) • Household pre-test of full tools, procedures
Structure and content • Caregiver questionnaire (including questions on household) • Child questionnaire (ages 0-9 years), administered to caregiver • Child questionnaire (ages 10-17), administered to child with parental consent & child assent
Caregiver questionnaire *DHS, bold=core indicator
Child questionnaire (ages 0-9) *DHS, bold=core indicator
Using the Tools • There is no single data collection tool that can meet all OVC program M&E requirements.
What’s in the toolkit? • Tools & Manual • Template protocol with consent/assent forms • Methodological guidance • Data analysis guide • Data collector training manual and materials • French translations
Global Monitoring, Evaluation and Reporting (“ the MER”) • PEPFAR shift towards outcomes and impact • All technical areas participating (CARE, PREVENTION, TREATMENT) • Specific Changes for OVC Programs • 2 indicators at Level 1 (required, reported to HQ) • Outcomes Package at Level 2 (required, reported at country level; indicators elevated from survey toolkit) • 2 Education indicators: attendance and progression • Systems Strengthening and Social Protection at Level 3 (recommended)
Where can I find out more? Go to MEASURE Evaluation website: http://www.cpc.unc.edu/measure/our-work/ovc Email: Janet Shriberg jshriberg@usaid.gov
Special Thanks to… • Dr. Jenifer Chapman, MEASURE Evaluation* (*Technical Lead for Toolkit, slideset creator) • Dr. Lisa Parker, MEASURE Evalution • OVC TWG Working Group, HQ and Missions • Stakeholders globally working on OVC programming • IATT Education for Guidance on education questions