1 / 23

EVALUATION 2009 Orlando, Florida, USA 2 November 2009 Neville Reeve European Commission DG RTD

Multi-actor, multi-component evaluation of the EU Framework Programmes. EVALUATION 2009 Orlando, Florida, USA 2 November 2009 Neville Reeve European Commission DG RTD. Council of the European Union. European Commission. European Parliament. European Commission.

iden
Download Presentation

EVALUATION 2009 Orlando, Florida, USA 2 November 2009 Neville Reeve European Commission DG RTD

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. EUROPEAN COMMISSION – DG Research – 12 November 2009 Multi-actor, multi-component evaluation of the EU Framework Programmes EVALUATION 2009 Orlando, Florida, USA 2 November 2009Neville Reeve European Commission DG RTD

  2. Council of the European Union European Commission European Parliament European Commission Managing the Framework Programme DG External Relations Secretariat General DG Budget European Court of Auditors DG Research DG Information Society and Media DG Energy & Transport Joint Research Centre DG Enterprise Court of Justice DG External Relations DG Agriculture & Rural dev’t DG Regional Policy DG Competition European Commission and Directorates General European Union Institutions

  3. EU research • Framework Programme (FP) is a multi-annual research funding programme implemented at EU level • 7th Framework Programme (2006-2013) - €50 billion – 27 Member States – more than 100 participating countries – tens of thousands of transnational co-funded projects

  4. EU Research Framework ProgrammesAnnual Budgets between 1984 and 2013 NB: budgets in current prices. Source: Annual Report 2003, plus FP7 revised proposal

  5. Budgets of the EU Framework Programmes

  6. INCO Energy SMEs EU research: changing priorities

  7. FP7 – Indicative breakdown (€ million)

  8. FP 5 FP 6 FP 7 Annualmonitoring FP6 ex post 5 yearassessment FP7 Ex ante Impact Assessment Thematic level evaluations National Impact studies 2002 1998 2000 2004 2006 2008 Multi component evaluation system FP8 Ex ante Impact Assessment FP7 interim evaluation

  9. Evaluation Actors, Networks & Standards • Actors • Political level – Council, European Parliament • Commission level – Secretariat General • DG level – central units, operational level • Member States evaluation • Networks • DG Research Evaluation Network • European RTD Evaluation Network • Commissions internal Evaluation Network • European Commission evaluation standards

  10. Indicators for FP Monitoring (1)

  11. Indicators for FP Monitoring (2)

  12. Evaluation Roadmap • FP6 Ex-post evaluation in 2008 • FP7 Progress report in 2009 • ERC review 2009 • FP7 interim evaluation in 2010 • Ex ante Impact Assessment (FP8) in 2011/12 • Ex evaluation FP7 in 2015

  13. Evaluation of the 6th FP - Evidence and Analysis EXPERT GROUP Supporting Experts analyses Studies at FP level Self-assessments; interviews; consultations Impact studies by Member States Studies at Thematic level Statistical analysis of FP implementation and annual Monitoring Reports

  14. Evaluation study of FP structuring – (1) FP6 networks are characterised by a core periphery structure dominated by a small number of closely-knit organisations. Industry plays less of a coordinating role and is weakly embedded in the FP6 networks with the exception of IST FP6 has resulted in more upstream than downstream outputs Performance decreases as project size increases New Member State participation is dominated by a few actors in Poland, Hungary and the Czech Republic.

  15. Evaluation study of FP structuring (2) - Network structure of the FP6 thematic areas

  16. Evaluation study of FP structuring (3) - Who coordinates whom in FP6 (Universities, Industry, Institutes)

  17. Evaluation study of FP structuring (4) - Who coordinates whom in FP6 (New Member States)

  18. 1_LIFE_SCIENCE_HEALTH 2_IST 3_NMP 4_AERO_SPACE 5_FOOD 6_ENERGY 6_GLOBAL 7_CITIZENS EURATOM INCO 2006 POLICY_SUPPORT 2004 2002 Total 0.5 1.5 0 1 2 Using bibliometrics to assess participation (1) - Relative citation rate of lead scientists, by FP priority – year 2002, 2004, 2006

  19. Using bibliometrics to assess participation (2) - Lead scientists’ 2–year Relative Citation Rate (RCR), all priorities taken together

  20. http://ec.europa.eu/research/evaluations/

  21. EUROPEAN COMMISSION – DG Research – 2 November 2009 Dr Neville Reeve Directorate-General for Research Unit for Evaluation and Monitoring of Programmes Phone +32-2-298 93 29 Fax +32-2-295 40 82 neville.reeve@ec.europa.eu http://ec.europa.eu/research/evaluations

More Related