EUREKA Initiative: Assessment & Evaluation Procedures for Technological Innovation and Market Competitiveness

1. INNOVATION 2004Prague, Nov. 30/Dec.1-3, 2004 The EUREKA Initiative: Assessment and Evaluation Procedures Svatopluk Halada EUREKA Secretariat, Brussels svatopluk.halada@es.eureka.be

2. vHanover Declaration (1985) vAssessment and Evaluation Procedures Competitiveness matrix  Criteria and Indicators Project Assessment Methodology  Criteria and Indicators vInnovation and Competitiveness through R&D projects How to measure competitiveness Technological Innovation Market Impact vSummarizing points of attention Agenda

3. EUREKA Initiative’s primary objective is “to raise, through closer co-operation among enterprises and research institutes in the field of advanced technologies, the productivity and competitiveness of Europe’s industries and national economies on the world market” Hanover Declaration - 1985

4. vA European Programme and Network for market- oriented R&D and innovation activities vIntegral component of the European Research Area v Strengthening European competitiveness v Promoting innovation in market-oriented collaborative projects EUREKA Mission

5. ASSESSMENT AND EVALUATION PROCEDURES • OBJECTIVES • Assess added value: Trans-national R&D • Contribution to European competitivity • Identify success stories • Monitor project implementation • Input to strategic reviews • Raise visibility of the EUREKA INITIATIVE • ContinualENHANCEMENT OF EUREKA LABEL

6. PHASES vEx-ANTE (Project selection /assessment)  MONITORING (Project progress during implementation)  vEx-POST (Project results)   EXPLOITATION (Economic, technological, social impacts) EUREKA PROJECT ASSESSMENT ANDEVALUATION PROCEDURES

7. Ex-ante vProject selection procedure (EUREKA´s criteria ) vCompetitiveness Matrix (C-matrix) vProject Assessment Methodology (PAM) vMonitoring vEarly progress check Ex-post v Final report of newly finnished projects vReport on Withdrawn Projects Exploitation v Market Impact Report vContinuous & Systematic Evaluation (CSE) Assessment and Evaluation

8. The project must: vInclude partners from at least two EUREKA Members vThe R&D content must concern development or application of innovative technologies within the EUREKA scope v Result in a marketable product, process or service v Be aimed at the civilian sector The criteria for a EUREKA project

9. Technological Innovation Output (max. 4 points) product, process, service, etc. Consortium (max. 3 points) quality, capability, capacity Costs (max. 2 points) Market Impact Market potential/perspective (max. 5 points) Market(ing) power of consortium (max. 4 points) Competitiveness matrix: 5 criteria

10. Competitiveness matrix TWO CRITERIA: TECHNOLOGICAL INNOVATION IMPACT ON THE MARKET

11. Combination of:WeightPoints vPartner and consortium capabilities 5 max. 100 financial managerial vProject management aspects 1,25 max. 100 organisation task distribution planning, milestones, etc. vTechnology and innovation 2,5 max. 100 vMarket impact and competitiveness 2 max. 100 Project Assessment Methodology: 19 criteria

12. Project Assessment Methodology • PAM is obligatory since January 1st 2004 for 2 years pilot (implemenation) period • The first result is opening new ways of strengthening procedures especially for project assessment and monitoring • vThe second result is opening a new perspective in making European procedures for innovation projects like EUREKA projects more homogeneous in the future. This kind of “harmonisation” will really pave the way for a European innovation policy (not to assess several times the same project) Towards cohesion and innovation policy

13. Project Assessment Methodology Role and responsibility of forthcoming Czech EUREKA Chairmanship v Active involving in the present Working Group on  Project Assessment Methodology (PAM) Continuous & Systematic Evaluation (CSE) • Preparation of the Evaluation report on results and output of PAM in implementation period 2004-2005

14. vProduct or service vApplication vNew vImproved vExisting vTechnological vNon-technological vVaries per market, region and culture Innovation: views and cross-links

15. vDescription of deliverables vConsortium composition R&D intensive companies (large/small) Involvement of universities/institutes vPartners’ commitment vCosts related to project activities Indicators for innovation assessment

16. vUsage value vApplication spread / market size generic (many sectors) specific sector niche application own use (in case of process improvement) vGeographic spread / market size own country Europe worldwide vTransferability and spin-offs Market impact: views and cross-links

17. v Description of deliverables v Existing or new market application/sector, geographically market access business plan/model v Consortium composition users involved from how many countries industry or academia driven v Sales network of participants multinational companies vs. SMEs vTime to market Indicators for market impact assessment

18. The Hanover Declaration should be considered as the leading principle. A good understanding of the project outcome is essential. Inter-linkages/relations between assessment criteria should be taken into account. The quality of the consortium composition is a measure for the innovative/technological content of the project as well as for the market impact of the final project results. Time-to-market is an important element of the EUREKA Initiative; project duration in combination with total costs, project deliverables and marketing capacity of the consortium should be taken into account. Making good assessments is a matter of experience. It cannot be learned overnight. ‘Real world’ case discussions seem to be a good training tool. Summarizing points of attention