160 likes | 242 Views
In search of the chimera. Measuring the impact of information on development. In search of the chimera. Maartje op de Coul New media evaluation, Oneworld International maartje.opdecoul@oneworld.org Sarah Cummings
E N D
In search of the chimera Measuring the impact of information on development
In search of the chimera Maartje op de Coul New media evaluation, Oneworld Internationalmaartje.opdecoul@oneworld.org Sarah Cummings Information manager, Information and Library Services, Royal Tropical Institute (KIT)s.cummings@kit.nl
Content • Chimera = impact • Oneworld case studies (impact assessment) • Smart tools (performance evaluation) • Some conclusions • And a question….
Why ‘chimera’ = impact • Mythical creature with three heads... but also unachievable illusion • Child of Typhon, a dynamic force like the Internet • Impact: socioeconomic development or long-term behavioural change • Performance evaluation • ICT4D: wireless, mobile phones, telecentres • Information services: QAS, newsletter, SDI, libraries etc
Oneworld case studies: overview • 2003 • 20+ ICT4D projects visited • Three continents • Link between ICT4D and poverty • Building Digital Opportunities (DFID, SDC and DGIS) plus implementing agencies
Oneworld case studies:methodology • Impact = • socio-economic development • long-term behavioural changes • ‘any change at the level of organizations’ Indicators: opportunity, empowerment and security
Oneworld case studies: findings 1 • OpportunitiesSkill building, access to markets and e-business • Empowerment- Individual level: self-confidence, self-esteem, emancipation, changing power relations, visibility- Organizational level: efficiency, networking, effective lobbying, access to public services, transparency and accountability of governments • SecurityLife saver, warning fires, empowerment
Oneworld case studies: findings 2 • SustainabilityFinancial, human resources • Regional differencesSouth Asia: varied infrastructure, involvement of private sector, rural areas, little M&E, technical creativitySouthern Africa: low commitment of government and private sector, infrastructure limited, early stageCentral America: high commitment government and private sector, sophisticated content, Spanish, good M&E
Oneworld case studies: conclusions • Cautious optimism • Compatible technologies • Combination with traditional technologies • Financial base
LEAP IMPACT 1 • Dgroup on evaluation of ICTs and information services • Smart tools: CTA, IICD and KIT plus 40-50 individual partners: writers, testers, thinkers, coordinators, reviewers • Self-help, resource poor environment • 4 modules of ‘Smart tools’- Preparatory work- Process tools- Data collection and analysis- Activity tools
LEAP IMPACT 2 • Testing of the activity tools: 18 testers in the South, and some in the North • Testing to be completed October • Revision based on testing • Handbook end 2004 • Publication: medio-2005 • End of a three year project........what next?
Conclusions • In different ways, either self-motivated or donor motivated trying to understand the impact of ICT4D and performance of information services • How do you show that your newsletter or website has ‘impact’? • Is impact assessment a three-headed monster...? • Impact assessment essential if investments in ‘information’ are to be compared with other development interventions.... • Sustainability of the ‘information hype’
A question….. • How to evaluate communities? • KIT has 3 new communities, one on iManagement • Standards and approaches?