90 likes | 104 Views
VERITE – evaluation process. Alasdair Reid, alasdair.reid@ade.be Berlin, 22 February 2002. Points addressed. Role and scope of the evaluation Logical framework Coherence of the objectives Expectations of members; Gauging network effects Indicators (targets and process) Next steps.
E N D
VERITE – evaluation process Alasdair Reid, alasdair.reid@ade.be Berlin, 22 February 2002
Points addressed • Role and scope of the evaluation • Logical framework • Coherence of the objectives • Expectations of members; • Gauging network effects • Indicators (targets and process) • Next steps VERITE - Evaluation process
Role and scope of the evaluation • Examine and analyse progress and the qualitative results: • Articles on database, level and quality of discussion, etc. • Informed opinion on level of networking • Should facilitate adjustments to work programme & orientation of networking • Management tool, "resource light" and process oriented. VERITE - Evaluation process
VERITE – simplified logical framework Workshops Increased awareness New IMT schemes Portal Access to providers Network effects Project management Sustainability of networking Discussion group Exchange know-how Database Access to knowledge Activities / Outputs Results / Impacts VERITE - Evaluation process
Coherence of the objectives • Attaining the objectives implies a number of assumptions: • That there is a complementarity of know-how and experience; • That the tools and activities are pertinent to members; • Unless the incentives are there to maximise "networking effects", achieving "results" will not lead to a sustainable impact. • Project assumes members of the network are active beyond the time allocated to specific tasks. VERITE - Evaluation process
Typology of members:Co-ordinators, Disseminators* & Learners VERITE - Evaluation process
How to gauge network performance ? • Pertinence of networking activities: • Satisfaction of participants : IT tools, workshops… • Level of networking activity (quantitative indicators); • Efficiency of network management: • Process assessment – views on barriers and drivers to networking; • Quality of organisation of events, effective operation of IT tools as networking interface; • Network effects • Valued added with respect to baseline knowledge & activities in field of IMT; • Extension and sustainability of network. VERITE - Evaluation process
Indicators targets & process • Network members interaction (inter-regional): • Quantitative (n° of messages, articles, etc.) • Qualitative (types of interaction generated); • Take-up at regional level (intra-regional): • Quantitative (n° of users of DB per region, etc.) • Qualitative (Feedback from dissemination) • Networking effects (impact): • Quantitative (n° of new IMT schemes implemented at regional level, enlarged participation, etc.) • Qualitative : Types of new co-operation between members, sustainability (new projects, etc.) VERITE - Evaluation process
Next steps • Preparation of a short "baseline situation" questionnaire and distribution to partners (before Easter); • First evaluation report (September 02); • Support to WS organisers for a satisfaction/quality participants survey; • Participation at 2-3 network events (workshops); • Second "evolution of knowledge" questionnaire (June 03) • Second evaluation report (September 03) VERITE - Evaluation process