490 likes | 964 Views
Using PIIRS data for planning, learning, improving programing CI MEL Community of Practice Session 2 March 20, 2018. Quick recap: Where to find PIIRS data Staff – Reach – Impact. http:// careglobalmel.care2share.wikispaces.net/FY17%20data. Quick poll.
E N D
Using PIIRS data for planning, learning, improving programingCI MEL Community of PracticeSession 2March 20, 2018
Quick recap: Where to find PIIRS dataStaff – Reach – Impact http://careglobalmel.care2share.wikispaces.net/FY17%20data
Quick poll • Go to www.menti.com and use the code 46 27 20 • Have you used PIIRS data in your role?
Case Examples for Using PIIRS Data • Mali Modibo Bamadio – National Coordinator for MEL • Bangladesh Sazidur Rahman - Program Monitoring, Evaluation and Evidence Coordinator • Southern Africa Gideon Cohen – Evidence and Knowledge Management Specialist • Latin America and the Caribbean Claudia Sanchez – Regional Coordinator Program Quality and Impact
Mali • PIIRS data used • Staff, Reach and Impact linked to CI 2020 program strategy and TOC geographic coverage. • The data is often translated into Infographics, developed by the MEAL coordinator • Purposes: • Reflection on the PIIRS cycle and how the yearly PIIRS data collection can help us measure progressively our impact, from the project start. • Discussions on whether we are going to achieve impact in the long term. • Dialogue on alignment with the Program Strategy. • Dialogue on PQ
Mali • MEL: Inclusion of CARE’s others projects/Programs Results Indicators, beyond the Impact/Outcomes indicators or CARE’s global ones) • Writing proposals (e.g. inclusion of CARE’s global outcomes indicators) • Communicating our work to various actors • Internally, for example, with implementing partners during Country Office Coordinating Meeting (CCM) session (a space at CO level for Management decision making) • Externally, during CO annual reporting, etc.
CARE Mali 2025 ProgrammaticStrategy, TOC and MEL CARE Mali 2025 Theory of Change of ProgrammaticStrategy • 1. If the financial situation of women and girls is improved through more diversified livelihoods and equal access and control of productive resources. • Fight against gender inequality and strengthen women's voices • 2. And women and girls living in chronically vulnerable areas have the capacity (information, skills, knowledge and means) to adapt their livelihoods to climate change and manage the consequences of conflict. • Increase resilience, reduce risk and respond to the humanitarian crisis 3. And governance at all levels is more effective and transparent, ensuring that women have better civic participation and better access to basic social services. • Supporting inclusive and improved governance capacities By 2025, women and girls in the 15-49 age group (and their children under 5) are empowered to adapt to recurrent crises and their voices are strengthened.
Level of CO’s projects alignment/integration of CARE’s Approach in 2017
Bangladesh FY-17 48 Projects 40 Long-Term 4 Humanitarian 340 Staff 182 Staff 4 Both Monitoring and Evaluation Team 31
Bangladesh PIIRS data used
Bangladesh Purposes
Bangladesh: formats in which FY17 data was used Latest measurement 85% Baseline 66% Indicator 6: Demand satisfied for modern contraceptive among women aged 15-49
Bangladesh: formats in which FY10-FY15 data was used CARE Bangladesh Canteen Field Office Gazipur
The limitations • Incorporating IMPACT indicators (approved LFAs) • Impact data project specific • Adjusting reporting timeline (PIIRS vs Donors) • Resilience Marker (Rural focused on food security and nutrition; mismatched in WE context – progress misrepresented) • Lengthy Timing limits usage (review and approval process)_______________________________________________________ • Sharing information with partners and communities (Internal struggle)
Has using the PIIRS data led to any type of actions or commitments in your CO/region?
Southern Africa • PIIRS data has been used to aggregate our collective results, under six broad outcome areas, for the Impact Growth Strategy HER HARVEST OUR FUTURE. These results have been used as the means of measuring progress towards the 10 million IGS impact target, and are featured in the annual Impact Report (used to leverage resources for Southern Africa). We have also summarized these in an infographic (bottom left) to quickly share overall results. • PIIRS comparative graphics (e.g. on advocacy & scale up – bottom right) are used during the annual MEAL training, and participants from COs engage with the forms in detail, and see how they can use the data for reflection, analysis and action planning. Participants’ call for summary visualizations of PIIRS data led to the development of the global PIIRS FY17 summaries
CARE Malawi: Use of Project and Country Profiles • Summaries of CO PIIRS FY17 results were produced and circulated to COs. CARE Malawi used this as an opportunity to include staff in a reflection exercise about the results that the CO is achieving. This exercise helped to develop a national level picture in comparison to peer COs in the region, and allowed staff to think about CO strengths and where some gaps remain.
Latin America and the Caribbean LAC isone of thethe more UNEQUAL region of theworld, wheretherichestconcentratealmost 50% of theincome of theregion, whenthepoorestbenefitonly 5% of it. • Social Dynamics in LAC • MICs • Migration: Urban–rural dynamics • Youth (urban and rural) • Governance (national level) • Climate change • Insecurity and Corruption • Private Sector Engagement Inequalities of income between countries, measured by the Gini coefficient, where 0 corresponds to perfect equality, and 1 to total inequality. Countries in red are more unequal than countries in green.
Gender Based Violence and Violence against women • Economic opportunities • Food Nutrition and Security - Resilence • Climate Change and DRR • Social inclusion: Rights, Leadership Multiplyingimpact LAC Strategy - 2014
A diverseregion : • LAC countrieswithpresence of CARE (6) • Central America: Honduras, Guatemala • Andes: Ecuador and Peru • Caribbean: Cuba and Haiti • Other LAC countrieswhereweworkthroughpartners (5): • Colombia • Mexico • Costa Rica • Nicaragua • DominicanRepublic
For what purpose have you used the PIIRS data? Dialogue on alignment with the Program Strategy, dialogue on PQ or MEL at the regional level and CO levelDoes using the PIIRS data lead to any type of actions or commitments in your CO/region? Yes! Year 2016 • Workshop February - Create the CARE LAC programleadershipteam(PQ and ACD of 6 countries) We have a regional strategy….now, we need to development a system to measure the implementation and impact of the strategy and our programs!! – we can use PIIRS for that , and add other components if is necessary. Compromise to work together, have a plan and also meetings for analysis and learning every 6 months. • March – june: • Revision of LAC Theories of Change (working women, indigenous peoples, women rural smallholders – & populations affected by disasters), and the alignment with the CI indicators…. • Aggregation & analysis of LAC region PIIRS FY14 & FY15 data, the base line of the strategy (where we are?) • Workshop September: Analysis of the PIIRS FY14 and FY15 results with the team, analysis of CI indicators…..first reflections • Direct and indirect participants….it is not clear, we need better definitions • Advocacy, are we reporting all? • Unpacking and understanding the CI indicators – is that clear? • Develop a Pilot in Honduras for the alignment of CI indicators to the current programs, create a system for that and a visual
Data collection Project M&E systems – data collection tools Reports to donors Data storing, aggregation & analysis Reports to Government & other stakeholders Transparent information for Impact Groups PIIRS formats (CI) FNS sub-indicator format (CI) Use and dissemination of data PIIRS on line Revision of regional, thematic & global theories of change Revision of Theories of Change in programs – and revision of application of CARE approach & roles PIIRS data exported to Excel Regional M&E tools (contribution analysis, outcome harvesting, most significant change, etc.) Aggregation and analysis of data – in Excel, SPSS, Access etc. At country level At global level - CI/Outcome Areas At regional level Country level impact reports Global impact and reach reports (CI) Thematic impact and reach reports Influencing for multiplying impact (country or regional) Regional impact reports
CARE LAC programleadershipteam - Peru, Cuba, Guatemala, Haiti, Ecuador, Honduras (February 2016)
5. Global indicators relevant for LAC ToCs Highly relevant for 3 ToCs: • 19. # and % of people of all genders who have meaningfully participated in formal (government-led) and informal (civil society-led, private sector-led) decision-making spaces • 20. # of new or amended policies, legislation, public programs, and/or budgets responsive to the rights, needs and demands of people of all genders • SE 3. # of policies, norms and practices changes for more inclusive and sustainable economies (e.g. of private sector) Highly relevant for 2 ToCs: • 17. % of women who (report they) are able to equally participate in household financial decision-making • 18. # and % of women with union, women’s group or cooperative membership through which they can voice their labor rights • SE 5. # of new employment created for impact population (women, youth) • LAC 1. % of time dedicated to unpaid domestic and care work, by sex, age and geographical area (SDG Indicator 5.4.1)
Does using the PIIRS data lead to any type of actions or commitments in your CO/region? Yes! Year 2017 • Workshop June: Analysis of the AF16 PIIRS results… this results really represent our work in LAC?.... The PIIRS forms are completed correctly by project teams or is necessary to put more effort in training?. Commitment to improvement for next PIIRS AF17! – 6 countries. • July – September: Every CO prepare a plan to have a good campaign of PIIRS. They place unrestricted resources, LAC Region coordinate Support of CI MEL and MI CARE USA. Training and monitoring in the quality of the data and the Support and evidence behind any results….more in the calculate of indirect participants (for generate evidence in the multiplying impact strategy) • September – sent PIIRS formats to CI • Workshop November – seeing our first results of AF17….yeiiiii!!, now we can see the LAC multipliyng impact strategy in action! /direct vs indirect and identify our best initiatives for learning....it is Working!
5 7 35 19 8 15
What has been the outcome of using the PIIRS data? - How is the PIIRS data useful/valuable for the purposes you have defined? • Allows to analyze areas of programmatic strength or weakness year by year, and work improvement plans (regional level, CO level) to overcome areas of weakness • Allows to measure the direct and indirect reach, which is a measure of Multiplying impact and a proxi is that so much advocacy can be done • It allows us to know the scope and application of our approaches • allows you to map which are the initiatives that work best with partners What are its limitations? • Cualitive data to understand the changes – link with other tools like most significant change to capture this changes • Advocacy results are not totally represented – need to use other tools for MEL in advocacy • More figures and graphics to combine data by countries (Power BI?) • effectiveness/eficience of the iniciatives – cross PIIRS with new report of Pamotzi by program, in term of budget and impact or reach
Reflections on today’s session • Go to www.menti.com and use the code 46 27 20 • How do you plan on using PIIRS data with your team? • Q&A
Upcoming sessions • Contact us if you have something you would like to share: