250 likes | 345 Views
Evaluating funding modes towards a concept of funding ecologies. Ulf Sandström KTH Stockholm. Peter van den Besselaar VU University Amsterdam Org Science & Network Institute. Proliferation of funding modes. New policy aims -> new funding modes Strengthening c ompetition (councils)
E N D
Evaluating funding modestowards a concept of funding ecologies Ulf Sandström KTH Stockholm Peter van den Besselaar VU University Amsterdam Org Science & Network Institute
Proliferation of funding modes • New policy aims -> new funding modes • Strengthening competition (councils) • Career grant schemes • Excellence programs • Strategic knowledge: large scale programs • Useful knowledge: thematic programs • International funding in various ways van den Besselaar FTEval 2013
From evaluating funding institutions and programs … • Evaluating of funding institutions and individual funding instruments • Does the evaluated funding institution/instruments work well? • But what is “well”? Frame of reference? • Comparison? But how and with what? • Different funders/instruments fulfill different and complementary roles van den Besselaar FTEval 2013
… to evaluating the funding ecology van den Besselaar FTEval 2013
Funding ecology • Complex landscape of funders and funding instruments with partly different and partly overlapping agenda’s • Overlapping: this leads to competition between funders, opening up the system for variety • Different: specializing, niche seeking, searching for the promising fields, application domains, procedures and instruments -> variety van den Besselaar FTEval 2013
Competition & complementarity • What is the optimal funding ecology? • Avoiding duplication of instruments? • Variety versus size? van den Besselaar FTEval 2013
Three tasks in analyzing the funding ecology • Describe • Distinguish modes and instruments • Measure the output and impact by funding mode • At field level • Compare the funding institutions/instruments • Understand the dynamics of funding ecologies • Optimal varietyand size and under what conditions van den Besselaar FTEval 2013
Ongoing research • Impact of large thematic programs • Knowledge for Climate program • Searchingfor excellence and the effects of funding • Bank of Sweden Tercentenary Foundation • WithUlfSandstromand Agnes Wold • Ongoing work -> scattered results up to now van den Besselaar FTEval 2013
Description: comparison and complementarity of funders • Do different funding modes differ in terms of: • Organizational forms, procedures, criteria • Topical focus • Productivity, impact, innovativeness,societal relevance van den Besselaar FTEval 2013
Methods and data • WoS data; delineation of fields • Topical structure • Field normalized impact • Publ: 2009/2010; Cit. window 2010-12 • Clean/disambiguate funders • Classify funders: funder type van den Besselaar FTEval 2013
Empirical examples • Two dimensions • Impact by funding mode • Topical coverage by funding mode • Two fields • climate change research • immunology • Two countries • Sweden • the Netherlands van den Besselaar FTEval 2013
Funding modes / organizations • Universities • Public research Institutes • Fundamental • Applied • Councils • Basic • Applied • Organizations • Private foundations • NGO’s • Societies • Thematic • Large national programs • Thematic councils • EC: • FW program • ERC, Marie Curie • Foreign funders • Companies • No funders mentioned van den Besselaar FTEval 2013
Delineation • Climate change research: search terms (TS) • Immunology: journals (WoS research area) • More fields/countries in next phase van den Besselaar FTEval 2013
New funders: climate change research 1988-2012 van den Besselaar FTEval 2013
Impact by funder (NL-climate) van den Besselaar FTEval 2013
Impact by funder (NL-climate) van den Besselaar FTEval 2013
Topical diifferences (NL-climate) van den Besselaar FTEval 2013
Impact by funder (Sw-climate) van den Besselaar FTEval 2013
Int. co-auth. papers (Sw-climate) van den Besselaar FTEval 2013
Nat auth papers (Sw-climate) van den Besselaar FTEval 2013
Summary of findings up to now • Impact: • International funding > national funding • Partly but not fully international collaboration effect • Funding conditions are important • Topics: differences & overlap van den Besselaar FTEval 2013
Current work • Extending the analysis to other fields and countries: • Patterns (1): relation between output/impact variables and number of funders / funder types • Patterns (2): relation between output/impact variables and sizeof funders / instruments van den Besselaar FTEval 2013
Extending the evidence • Similar results for Immunology • International funders > national funders • Effect remains (but smaller) when controlling for international co-authorship • Funding conditions matter • Size of instrument matters: • Size/selection trade off van den Besselaar FTEval 2013
Predictive validity by competition level Peter van den Besselaar / predictive validity
Conclusions and further work • Comparing funding modes and instruments seems promising • Technical improvements (classification funding modes, organizational differences, statistics) • More fields, more countries • More performance indicators (e.g., societal impact) • Empirical regularities? And then explanations. • Lessons about individual funding modes / instruments • Lessons about funding ecologies van den Besselaar FTEval 2013