140 likes | 164 Views
This report presents the results of a meta-evaluation of various programs for local governance. It explores the diversity of these programs, the executing organizations, modalities, and exchange of experiences. The report also highlights limitations and provides recommendations for improving the relevance, efficiency, effectiveness, impact, and sustainability of these programs.
E N D
CIB: results of meta-evaluation programmes for local governance Stockholm, June 19th 2018 ACE Europe (Corina Dhaene)
Diversity of programmes • Who is executing? • Modalities • Exchange of experiences • Integratingmunicipal expertise in programmes for localdemocracy • One2One relations (MIC, city links) • Types of partnerships • Topics (LED, women)
Limitations of the analysis • Access to full reports • No analysis of methodologicalquality • Weak focus on cost-efficiency/cost-awareness andsustainability • Weakdefinition of and attention tospecific features of localgovernance • Risk of beingevaluated as an NGO programme (Norway) • Where are the politics? (VVSG)
Overall objectives Specific objectives (outcomes) Results (outputs) Activities Inputs/means The 5 evaluation criteria (under pressure) Impact sustainability Effectiveness Efficiency Relevance The situation to address
Relevance • Relevance of programmes is substantiated: by context, tailoredtoneeds of localgovernments, coherent withgovernmentpolicies • Questions: • Who’sneeds? Toachievewhat? • Is transfer of knowledge relevant/possible? • Relevance for sector development? (VNG-LGCP, FCM-CISAL) • Missing: • (comments on) power analysis • Analysis of addedvalueandcontribution of variousmodalities (VNG-LGCP, Catalonia)
Interesting finding and practice • Ensuring cross-cutting of expertise (ICLD, FCM, Connectivecities) • Analysis of transferability of practice (ConnectiveCities) + using research (Universidades) • Answeringneed of support ‘byproximity’ to support muchneededcontextualisation • Integrate gender in programmes (ICLD, FCM)
Efficiency • Efficient, quality of interventions, usingmunicipal expertise addstocost-efficiency, improved project management • Challenging: • WorkingwithLGAs (there is no way aroundthem, or is there?) • Integration of ad hoc (municipal) expertise in capacity building plans
Efficiency • M&E: resultsframeworks do exist • Challenges: • upward accountability, • focus on output, weakdefinition of outcomes, • little expertise in qualitativemethods for data collection • Weaker post-intervention follow-up (trainings) • Systematic analysis anddocumentation of lessonslearned (for whom? For what? Effectivedissemination?) – AL-Las, ConnectiveCities
Efficiency • Interestingpracticeandfindings • ICLD result chain: link, share, transfer, act • attention for experiment and co-creation (seealso PDIA)? • No successful transfer without deconstruction + reconstruction in a different context (beforeexperimentation) • Investing in continuousinternalevaluationandreflection (FCM, ICLD, VNG) • Updates on context andrisks (FCM)
Effectiveness and impact • Assessment depends on theToC/anticipated change • Substantiated changes: • Capacity for project management • Beinginspired, understandingneed for/possibility of change • New knowledgeand awareness • Advancing in (technical) aspects of definedprojects) • Lessconclusive (only in generalterms or anecdoticalevidence): • Changes at the level of broadermunicipality • Increased trust of citizens • Better information flowstocitizens • Involvement of citizens in decision making • Challengesto move beyond project level • Limited access tofinance • Weakercapacity of LGAs • Coherencewithgovernment policy is nottranslatedintoappropriateoperationalarrangements/mechanisms for interaction
Effectiveness and impact • Interestingpracticeandfindings • ICLD ITP trainings: linkingwithlocal training institutions (integrate modules on gender, localdemocracyandinternational cooperation for councillors at this level) • Using SDG as a vector tomobiliseandorientthepolicies of municipalities (Universidadesand VVSG) • Process approach to MIC (connectivecities): first exploringthe domain, then making a match • Workingwithlocal ‘mentors’ (ICLD ITP, FCM, VVSG))
Sustainability • Role for localgovernmentassociations • Embedment in municipalplansand budgets canbeattained (VVSG, ICLD ITP) • Establishing new structures • Major role of individuals (andpersonalities)
Recommendations • (Identify more explicitelywhat is localgovernanceandinstitutionalstrengthening) • Access tofinance: attention for revenu collectionandpotential revenu • Guide the ‘transfer’ and co-creation of knowledge • Stimulatenetworkingbetweenmunicipalities in one country (open up for external expertise andstimulateinstitutional links) • Combine bottom-up approach withpro-active steering • Evolvetowards a learningoriented M&E system (introduce new methods, stimulate joint analysis andreflection, introduce peer learning) • (Documentation of practice/experience/lessonlearned: for whomandtowhat end?)
Statements • Make surethatevaluatorsevaluatetheprogramme as a localgovernanceprogramme (usingandvalorisingmunicipal expertise) • Deconstruction of practice is essentialtoensureexperimentation in a different context • There is a strong wish for concentration of efforts (topics, countries) topromoteeffectivelearning: but thisdepends on the type of learning