150 likes | 164 Views
This article explores how research charities can effectively meet their missions and assess excellence in the field. It discusses the challenges in picking winners, assessing outputs, and the future of biomedical research in the UK.
E N D
Charities, excellence & assessment Dr Mark Walport Director The Wellcome Trust
Outline • how can research charities meet their mission? • how do we pick winners? • how do we assess outputs? • the future
What do universities look like? the RAE has: • driven excellence • focussed attention on outputs but has had unintended consequence: • increased volume of research at expense of physical infrastructure • lecturers appointed rather than support staff • pressure for short term research results • damaged clinical research capacity • the work of teams devalued • teaching devalued RAE2001 RAE1996 RAE1992
UK StrengthPlurality of funding for biomedical research *Cancer Research UK was formed in 2002, following the merger of ICRF and Cancer Research Campaign (CRC). Figures before 2002 show the combined spending of ICRF and CRC (Source: Cancer Research, Science and Technology Committee) The AMRC line shows the total spend on UK medical and health research by AMRC members charities. The figure for 2005 is an estimate based on AMRC subscription data. Trust funding includes international spend.The Gates Foundation figure only includes grants to institutions in the UK.
Charities can meet their missions if… • universities ‘fit for purpose’ • a funding model to promote this we hope to be able to… • fund the best researchers • fund the best ideas • fund in the best research environments • get value for money
Picking winnersIdentifying excellence • are you a good scientist? • what has been discovered? • who has been trained? • how have outputs been communicated? • what is your question? • why is it important? • how will you approach the question? • what resources do you need?
Peer review of inputs • robust and rigorous • more thorough than RAE methods • international • but can be risk averse
Charity Research Support Fund • a metric based award mechanism in relation to quality charitable income • an explicit volume of QR ring-fenced as partnership fund • included in block grant to VCs • merits: • directly rewards success • rigorous peer review • responsive to change between RAEs • enables universities to support infrastructure for research in manner that best suits university
Assessing outputs The issues • adoption of true/realistic measures/indicators: - recognition of the incremental & unpredictability of research - challenge of identifying ‘impact’ from basic research • avoiding perverse incentives - weighing papers - citation/impact factors • managerial vs professional targets - quantitative vs qualitative indicators • focus on national indicators for an increasingly global pursuit • attribution - multiple funding partners, international collaboration
Witness Seminars – obstetric ultrasound • leadership of Professor Ian Donald 1950-60s • remarkable collaboration between engineers and clinicians • resistance from doctors who had spent years ‘training their hands to see’ • demonstration, refinement and results led to huge change in clinical practice
Funds awarded vs. papers produced for the top 15 institutions & trend line
Importance rating by nature of research base = 573 original research papers
Importance assessments of original research papers vs JIFs (log scale)
Biomedical research in the UK: The future • very strong biomedical research base in UK • reward excellence • drive innovation • build on successful work of UK CRC • get the Health Research Fund right • ensure post-RAE metrics reward national strength in biomedical research