620 likes | 678 Views
Archived File. The file below has been archived for historical reference purposes only. The content and links are no longer maintained and may be outdated. See the OER Public Archive Home Page for more details about archived files. Update on NIH Peer Review Enhancements.
E N D
Archived File The file below has been archived for historical reference purposes only. The content and links are no longer maintained and may be outdated. See the OER Public Archive Home Page for more details about archived files.
Update on NIH Peer Review Enhancements Elias Zerhouni, MD Director, National Institutes of Health Peer Review Advisory Committee Meeting April 30, 2008
Reality: First-rate peer review is a cornerstone of NIH Emerging Reality: Increasing breadth, complexity, interdisciplinary nature of biomedical science are creating new challenges for peer review Funding trends aggravate the stress on peer-review NIH Response: Reviewing – and enhancing – peer review Reviewing Peer Review The Continuing Charge: “Fund the best science, by the best scientists, with the least administrative burden…” And the Added Challenge:… but recognize that “best” is dependent on many factors, including scientific quality; public health impact; mission of Institute or Center; existing NIH portfolio
Design Implementation Plan Evaluate Actions DevelopNew NIHPolicies Diagnostic Begin Phased Implementation of Selected Actions Jul 07 - Feb 08 Mar 08 - April 08 June 08 Reviewing Peer Review:Project Phases
DRAFT Report of Challenges & Recommended Actions • Reducing Administrative Burden of Applicants, Reviewers and NIH Staff • Enhancing the Rating System • Enhancing Review & Reviewer Quality • Optimizing Support at Different Career Stages • Optimizing Support for Different Types and Approaches of Science • Reducing Stress on the Support System of Science • Meeting the Need for Continuous Review of Peer Review • http://enhancing-peer-review.nih.gov/ 5
Reviewing Peer Review:Project Phases Design Implementation Plan Evaluate Actions DevelopNew NIHPolicies Diagnostic Begin Phased Implementation of Selected Actions Jul 07 - Feb 08 Mar 08 - April 08 June 08
Develop Draft Implementation Plan • Release Draft Report • Formal public comment period • Outreach to professional organizations and other stakeholders • SCWG SC Peer Review Implementation Groups • 3 Working Groups • Cluster 1: Applications, review and ratings • Cluster 2: Quality of peer reviews • Cluster 3: Support of different career stages • Position papers from EPMC, RPC, GMAC, PLC, TAC and eRA • Broad input from NIH staff • Town meeting with Scientific Review Officers and Program Staff • Cross-cutting committee: provide integrated recommendations to NIH Director 7
Granularity of the Discussion:We need to tackle the big challenges Sand Rocks Pebbles Guided by several principles: Do no harm Continue to maximize the freedom of scientists to explore Focus on the changes that are most likely to add significant value at a reasonable cost/benefit ratio
Core Theme: Excellence of Reviewers • The excellence of peer review is directly correlated to our ability to recruit, retain and motivate the most accomplished, broad minded and creative scientists to serve on study section • Reduce burden of review • Flexibility • Training strategy • Recognize and Reward distinguished service 9
Core Theme: The Fairness and Clarity of Peer Review • Consistently identify application’s relative merit, potential for scientific and/or public health impact, and feasibility • Applicants and NIH program officers deserve clear and purposeful review feedback, including informative summary statements and a rating system comparable across study sections and fields of science • Summary statement structure aligned with specific criteria • Pilot ranking strategies • Pilot and implement shorter applications 10
Core Theme: Support Scientists at Different Stages of Their Careers • Peer review should fairly evaluate proposals from all scientists, regardless of their career stage or discipline, and avoid bias towards more conservative and proven approaches at the expense of innovation and originality • Early stage investigators – reduce bias (number of fully discussed proposals, cluster discussion of ESI within panel, percentile separately) • Reduce need for multiple applications • Established investigators retrospective and prospective
Comparison of the Age of NIH PIs and Medical School Faculty 1980 Sources: IMPAC II Current and History Files and AAMC Faculty Roster System Age Distribution of NIH RPG Investigators and Medical School Faculty
Comparison of the Age of NIH PIs and Medical School Faculty 1981 Sources: IMPAC II Current and History Files and AAMC Faculty Roster System Age Distribution of NIH RPG Investigators and Medical School Faculty
Comparison of the Age of NIH PIs and Medical School Faculty 1982 Sources: IMPAC II Current and History Files and AAMC Faculty Roster System Age Distribution of NIH RPG Investigators and Medical School Faculty
Comparison of the Age of NIH PIs and Medical School Faculty 1983 Sources: IMPAC II Current and History Files and AAMC Faculty Roster System Age Distribution of NIH RPG Investigators and Medical School Faculty
Comparison of the Age of NIH PIs and Medical School Faculty 1984 Sources: IMPAC II Current and History Files and AAMC Faculty Roster System Age Distribution of NIH RPG Investigators and Medical School Faculty
Comparison of the Age of NIH PIs and Medical School Faculty 1985 Sources: IMPAC II Current and History Files and AAMC Faculty Roster System Age Distribution of NIH RPG Investigators and Medical School Faculty
Comparison of the Age of NIH PIs and Medical School Faculty 1986 Sources: IMPAC II Current and History Files and AAMC Faculty Roster System Age Distribution of NIH RPG Investigators and Medical School Faculty
Comparison of the Age of NIH PIs and Medical School Faculty 1987 Sources: IMPAC II Current and History Files and AAMC Faculty Roster System Age Distribution of NIH RPG Investigators and Medical School Faculty
Comparison of the Age of NIH PIs and Medical School Faculty 1988 Sources: IMPAC II Current and History Files and AAMC Faculty Roster System Age Distribution of NIH RPG Investigators and Medical School Faculty
Comparison of the Age of NIH PIs and Medical School Faculty 1989 Sources: IMPAC II Current and History Files and AAMC Faculty Roster System Age Distribution of NIH RPG Investigators and Medical School Faculty
Comparison of the Age of NIH PIs and Medical School Faculty 1990 Sources: IMPAC II Current and History Files and AAMC Faculty Roster System Age Distribution of NIH RPG Investigators and Medical School Faculty
Comparison of the Age of NIH PIs and Medical School Faculty 1991 Sources: IMPAC II Current and History Files and AAMC Faculty Roster System Age Distribution of NIH RPG Investigators and Medical School Faculty
Comparison of the Age of NIH PIs and Medical School Faculty 1992 Sources: IMPAC II Current and History Files and AAMC Faculty Roster System Age Distribution of NIH RPG Investigators and Medical School Faculty
Comparison of the Age of NIH PIs and Medical School Faculty 1993 Sources: IMPAC II Current and History Files and AAMC Faculty Roster System Age Distribution of NIH RPG Investigators and Medical School Faculty
Comparison of the Age of NIH PIs and Medical School Faculty 1994 Sources: IMPAC II Current and History Files and AAMC Faculty Roster System Age Distribution of NIH RPG Investigators and Medical School Faculty
Comparison of the Age of NIH PIs and Medical School Faculty 1995 Sources: IMPAC II Current and History Files and AAMC Faculty Roster System Age Distribution of NIH RPG Investigators and Medical School Faculty
Comparison of the Age of NIH PIs and Medical School Faculty 1996 Sources: IMPAC II Current and History Files and AAMC Faculty Roster System Age Distribution of NIH RPG Investigators and Medical School Faculty
Comparison of the Age of NIH PIs and Medical School Faculty 1997 Sources: IMPAC II Current and History Files and AAMC Faculty Roster System Age Distribution of NIH RPG Investigators and Medical School Faculty
Comparison of the Age of NIH PIs and Medical School Faculty 1998 Sources: IMPAC II Current and History Files and AAMC Faculty Roster System Age Distribution of NIH RPG Investigators and Medical School Faculty
Comparison of the Age of NIH PIs and Medical School Faculty 1999 Sources: IMPAC II Current and History Files and AAMC Faculty Roster System Age Distribution of NIH RPG Investigators and Medical School Faculty
Comparison of the Age of NIH PIs and Medical School Faculty 2000 Sources: IMPAC II Current and History Files and AAMC Faculty Roster System Age Distribution of NIH RPG Investigators and Medical School Faculty
Comparison of the Age of NIH PIs and Medical School Faculty 2001 Sources: IMPAC II Current and History Files and AAMC Faculty Roster System Age Distribution of NIH RPG Investigators and Medical School Faculty
Comparison of the Age of NIH PIs and Medical School Faculty 2002 Sources: IMPAC II Current and History Files and AAMC Faculty Roster System Age Distribution of NIH RPG Investigators and Medical School Faculty
Comparison of the Age of NIH PIs and Medical School Faculty 2003 Sources: IMPAC II Current and History Files and AAMC Faculty Roster System Age Distribution of NIH RPG Investigators and Medical School Faculty
Comparison of the Age of NIH PIs and Medical School Faculty 2004 Sources: IMPAC II Current and History Files and AAMC Faculty Roster System Age Distribution of NIH RPG Investigators and Medical School Faculty
Comparison of the Age of NIH PIs and Medical School Faculty 2005 Sources: IMPAC II Current and History Files and AAMC Faculty Roster System Age Distribution of NIH RPG Investigators and Medical School Faculty
Comparison of the Age of NIH PIs and Medical School Faculty 2006 Sources: IMPAC II Current and History Files and AAMC Faculty Roster System Age Distribution of NIH RPG Investigators and Medical School Faculty
Aging of Both NIH Grantees and Medical School Faculty Cohorts Since 1980 2006 1980 Sources: IMPAC II Current and History Files and AAMC Faculty Roster System Age Distribution of NIH RPG Investigators and Medical School Faculty