The COVOSECO Empowerment Evaluation Tool

COVOSECO From Co-operation between to Co-evolution of Science and Economy The COVOSECO Empowerment Evaluation Tool Covoseco Research Group ITB, IAGO, ISEOR, SBE, SIC and FEB Open seminar Brussels 11.06.03

COVOSECO From Co-operation between to Co-evolution of Science and Economy Presentation outline • Project Introduction • Why the tool is needed • Tool Overview • Evaluation Process • Our experiences in five countries

COVOSECO From Co-operation between to Co-evolution of Science and Economy Introduction to project • Investigation of the functioning of innovation led Public Private Partnerships • Role and success of PPPs relies on a good working partnership • Evaluation of the state of the partnership achieved through the COVOSECO Empowerment Evaluation tool (EE-tool)

COVOSECO From Co-operation between to Co-evolution of Science and Economy Why are we here? • EU expenditure on public private partnerships (PPPs) in research and innovation is Euro 7 535 million. • EU budget is Euro 97 815 million • PPPs absorb 7.7 per cent of the EU budget

COVOSECO From Co-operation between to Co-evolution of Science and Economy Programmes mainly delivered through public private partnerships in research and innovation

COVOSECO From Co-operation between to Co-evolution of Science and Economy Programmes are evaluated • This is done on the basis of input /output • Impacts are looked for • It is essentially a ‘macro’ approach • Case studies do provide some ‘micro’ underpinnings - They are observational and summative interpretations

COVOSECO From Co-operation between to Co-evolution of Science and Economy Foci of evaluations Evaluations focus on different aspects • 1. Economic or social impact • 2. Processes and systems • 3. Learning & development The EE-tool adds a fourth to these: • 4. Perspectives assessment And assists processes & learning

COVOSECO From Co-operation between to Co-evolution of Science and Economy The nature of Public Private Partnerships • Partners pursue different aims • Without making these clear • Power is unevently distributed • Conflicts are unrecognised

COVOSECO From Co-operation between to Co-evolution of Science and Economy Gaps in technique • A tool to analyse the functioning of the PPP at management level • objectives, communication, trust, resources • A tool to clarify differences • A tool to help resolve divergences in the partnership

COVOSECO From Co-operation between to Co-evolution of Science and Economy Overview of tool • EE-tool provides “snapshot” of current state of the PPP • Therefore enables PPPs to be concurrently evaluated and improved • Achieves this through reviewing and group activities

COVOSECO From Co-operation between to Co-evolution of Science and Economy Approach • A structured dialogue among partners • The evaluation is based on individual and collective weighting with questionnaire criteria • The external “evaluator” moderates the discussion, trying to make the participants express themselves in an exhaustive way • The things said are as important as the figures (weighting and scores) • The evaluator delivers his comments with an analysis of strengths and weaknesses in a second phase of the meeting or in a so-called feed-back session

COVOSECO From Co-operation between to Co-evolution of Science and Economy Applications & examples Framework Programmes Shared cost research projects Innovation Relay Centres Regional Development Programmes Innovation centres and networks Product development projects Programmes themselves Determination of priorities & management Plus: applications to many partnership activities

UK exp. ROME PPP: Average Weightings and Scores

S/ FK Nätverk; Average Scores and Weightings

COVOSECO From Co-operation between to Co-evolution of Science and Economy D/ REBIZ Local VET Network; Average Scores and Weightings

COVOSECO From Co-operation between to Co-evolution of Science and Economy Software tool by Covoseco • EE Tool in the Internet • Versions in English, French, German, Greek, Italian, Slovenian, Swedish…….

COVOSECO From Co-operation between to Co-evolution of Science and Economy Main contributions of the tool • developing a common perception of goals and a cooperative, communicative, project-oriented culture • enabling strengths and weaknesses to be highlighted and thoroughly discussed • solving problems such as communication, pluri-disciplinarity or geographical distance • identification of strengths by an external observer produces self-confidence among the network members • creation of a common “performance appraisal culture” for network members • foundation for common awareness of efficiency (costs) and effectiveness (results)

COVOSECO From Co-operation between to Co-evolution of Science and Economy Opportunities for using the tool • Complementary method in evaluating programmes • Facilitator for multicultural project teams • Assisting PPP programme formulation • Producing knowledge about networks

The COVOSECO Empowerment Evaluation Tool