340 likes | 530 Views
Archived File. The file below has been archived for historical reference purposes only. The content and links are no longer maintained and may be outdated. See the OER Public Archive Home Page for more details about archived files.
E N D
Archived File The file below has been archived for historical reference purposes only. The content and links are no longer maintained and may be outdated. See the OER Public Archive Home Page for more details about archived files.
Updates American Recovery Act (ARRA) & Enhancing Peer Review ProjectPeer Review Advisory CommitteeJune 8th, 2009 Lawrence A. Tabak, DDS, PhD
American Recovery and Reinvestment Act (ARRA) NIH is grateful to the Congress and the President for the opportunity contribute to improving the Nation’s health and economy
NIH and Comparative Effectiveness Research • NIH received $400M of the $1.1B appropriated for CER under the American Recovery and Reinvestment Act of 2009 • NIH’sinvolvement has included: • Participation on the Federal Coordinating Committee (NIH is represented by Dr. Betsy Nabel, Director, NHLBI) • Participation in the March 2009 Stakeholder meeting of the IOM CER Priority Setting Committee (the priority list is to be issued by June 2009) • NIH CER Coordinating Committee, Co-chaired by Drs. Richard Hodes Betsy Nabel, wascreated to provide advice to the NIH Director on the best use of the CER stimulus funds, implementation of CER rules and definitions, et cetera. • NIH-AHRQ CER Subcommittee created to coordinate the CER dialogue with AHRQ • NIH Fingerprinting Subcommittee
NIH and Comparative Effectiveness Research • NIH CER Opportunities Using ARRA Funds • Fund existing applications • Revisions • Administrative supplements • Challenge Grants in Health and Science Research • 69 CER-specific submissions in the March 2009 Challenge Grant RFA • Research and Research Infrastructure “Grand Opportunities” (GO Grants) • Examples • NCI: “Centers for Planning and Evaluation for CER in Genomic and Personalized Medicine” • NHLBI: Projects that target heart, lung and blood diseases • More to Come!
Challenge Grant Program Review Applications reviewed by Editorial Board members (electronic review) Editors provide final scores and rankings (Study Section) ICs rank applications in each Broad Challenge Area Ad hoc committee of ICD bin applications across all Broad Challenge Areas IC National Advisory Councils Perform Secondary Review NIH Director makes final decision on allocation of OD ARRA funds Remaining applications released to ICs for additional funding consideration
Challenge Grants Program: Interim Observations • The extraordinary response clearly indicates that the biomedical research community has enormous untapped capacity • The short-term effects of the program align well with the goals of American Recovery Act • The program will also have long-term effects as well • Scientific progress will add to future advances • Additional demand will continue to stress system infrastructure
Summer Program for Students/Teachers • Participants in all 50 States • Over 300 institutions (including small businesses) • Over 1000 mentors • ~3900 positions FY09/010 • HS ~ 630 • College ~ 2700 • Teachers ~ 540 • Total expenditure ~ $35.4M • OD ~$26.4M • ICs ~$9M
Key ARRA Data Tracking/Monitoring Channels NIH reports ARRA (and non ARRA) spending through HHS – includes name of awardee and source of funding Central repository for ARRA spending; granularity not yet decided (currently not at level of individual grants)
Key ARRA Data Tracking/Monitoring Channels (cont.) Lists notices of proposed government procurement actions, contract awards, sales of government property, and other procurement information over $25,000 - all updated daily Grantees will report on the number of jobs created, % project completed, expenditures Will provide award information at the grant level
Reporting Outputs and Outcomes In addition to Outputs (qualitative measures in each area) we must also track scientific/public health outcomes Administration added GPRA to ARRA reporting requirement to track performance Basis of agency level performance assessments Scientific Research Outcome-SRO Matrix (time to achieve by difficulty) Details in FY 2011 with representative measures from ICs for 1-3 year ARRA funded science 7-10% of NIH ARRA funds
Enhancing Peer Review: Background Peer Review Oversight Committee (PROC) Established Working Groups: 1.Engage the Best Reviewers 2.Improve the Quality and Transparency of Review 3.Ensure Balanced and Fair Reviews Across Scientific Fields and Career Stages 4.Continuous Review of Peer Review • Year-long Deliberative Effort Gathering Feedback & Input: • Request for Information • NIH Staff survey • IC White Papers • Internal Town Hall Meetings • External Consultation Meetings • Data Analysis • Internal and External Working • Groups September 2008 March 2008 – June 2008 June 2007 – Feb. 2008 Identified Key Recommendations
Implementation Timeline Changes SO FAR Changes NOW Changes LATER (except ARRA) January 2009 May/June 2009 January 2010 Submissions • Phase out of • A2 applications • Identification of • New and Early Stage • Investigator (ESI) R01 applications • Enhanced review criteria • New scoring system • Criterion scoring • Structured critiques • Clustering of New Inv. R01 Applications • Score order review • Alignment of applications & review criteria • Shorter Research Plans
Implementation Overview Priority Area 1 – Engage the Best Reviewers • Improve Reviewer Retention - New review committee members now have the option of attending 2 meetings per year for 6 years (rather than 3 meetings/year for 4 years. • Recruit the Best Reviewers - A compilation of tips and best practices for recruiting reviewers is now available to the review staff of all NIH Institutes and Centers. • Enhance Reviewer Training - During the winter and spring of 2009, Dr. Scarpa held a series of regional training sessions for study section chairs. This was available to chairs of CSR and IC review committees. • Allow Flexibility through Virtual Reviews - Pilots are being conducted on high-bandwidth support for review meetings to provide reviewers greater flexibility and alternatives for in-person meetings.
Implementation Overview Priority Area 2 – Improve the Quality and Transparency of Review • Improve Scoring Transparency and Scale - Reviewers use critique templates that prompt them to identify major strengths and weaknesses for each review criterion. The templates contain links to full descriptions of the newly enhanced review criteria, which place more emphasis on impact and less on technical details. Applications are now scored on a 9 point scale. • Provide Criterion Scores for All Applications - Review criterion-based scoring commenced in late April 2009. Applications that are not discussed by the full review committee now receive the assigned reviewers’ critiques. In 2009, streamlined applications will receive scores on each criterion in addition to the reviewers’ critiques to help applicants assess whether or not they should resubmit an amended application. • Shorten and Restructure Applications - Shorter (12 page research plan) R01 applications (with other activity codes scaled appropriately) will be restructured to align with review criteria for January 2010 receipt dates.
Implementation Overview Priority Area 3 – Ensure Balanced and Fair Reviews across Scientific Fields and Career Stages, and Reduce Administrative Burden • New NIH Policy to Fund Meritorious Science Earlier - To ensure that the largest number of high quality and meritorious applications receive funding earlier, NIH has decreased the number of permissible grant application resubmissions (amendments) from two to one. • Review Like Applications Together - NIH now identifies Early Stage Investigators (ESIs), and has set a goal of funding ESI R01 applications at rates similar to those of new R01 applications from established investigators (see NOT-OD-08-121 and NOT-OD-09-013). Where possible, R01 applications from new and ESI investigator applications (including ESIs) are discussed together at review meetings. When appropriate and feasible, the same approach is used for clinical research applications.
Communications & Training The Enhancing Peer Review at NIH Web Site provides: Background Information Timelines and Implementation Information of each Priority Area Frequently Asked Questions and Answers All NIH Guide Notices Relating to Peer Review Changes Training and Communication Resources for NIH staff, including Videos, slide sets and handouts Email box for questions http://enhancing-peer-review.nih.gov
THANK YOU! Peer Review Oversight Committee (PROC) • Raynard Kington, Chair, Acting Director, NIH • Larry Tabak, Co-Chair, Acting Deputy Director, NIH • Sally Rockey, Co-Chair (OER) • Toni Scarpa, Co-Chair (CSR) • Jeremy Berg (NIGMS) • Story Landis (NINDS) • Alan Willard (NINDS), Integrator
THANK YOU! Subgroup 1 • Craig Jordan (NIDCD), Chair • Alan Willard (NINDS), Integrator • David Armstrong (NIMH) • Sheryl Brining (NCRR) • George Gardner (OER) • Pam Gilden (OER) • Gwynne Jenkins (OER) • Stacy Kocher (OER) • Sherry Mills (OER) • Mona Rowe (NICHD) • Don Schneider (CSR) • Phil Smith (NIDDK) • Barbara Spalholz (NCI) • Janelle Jobe (Ripple Effect Communications, Contractor) • Lubna Sher (Ripple Effect Communications, Contractor) • Amy Bielski (Ripple Effect Communications, Contractor)
THANK YOU! Subgroup 2 • Jane Steinberg (NIMH), Chair • Alan Willard (NINDS), Integrator • Sally Amero (OER) • Sheryl Brining (NCRR) • Megan Columbus (OER) • Suzanne Fisher (CSR) • JoAnne Goodnight (OER) • Marcia Hahn (OER) • Marvin Kalt (NIAID) • Glen Nuckolls (NIAMS) • Valerie Prenger (NHLBI) • Bill Riley (NIMH) • Denise Russo (OER) • Anne Scanley (OSP) • Sara Silver (OER) • Tracy Waldeck (NIMH) • Carol Wigglesworth (OER) • Jennifer Pohlhaus (Ripple Effect Communications, Contractor) • Janelle Jobe (Ripple Effect Communications, Contractor)
THANK YOU! Subgroup 3 • Stephen Mockrin (NHLBI), Chair • Alan Willard (NINDS), Integrator • Sally Amero (OER) • Melissa Antman (NHLBI) • Andy Bredemeyer (NHLBI) • Noni Byrnes (CSR) • Bob Finkelstein (NINDS) • David George (NIBIB) • Mary Ann Guadagno (CSR) • Ann Hagan (NIGMS) • Cheryl Kitt (CSR) • Marilyn Miller (NIA) • Sherry Mills (OER) • Carl Roth (NHLBI) • Mark Siegert (OER) • Janelle Jobe (Ripple Effect Communications, Contractor) • Amy Bielski (Ripple Effect Communications, Contractor)
THANK YOU! Communications & Training Group • Megan Columbus (OER), Co-Chair • Sherry Mills (OER), Co-Chair • Alan Willard (NINDS), Integrator • Sally Amero (OER) • David Armstrong (NIMH) • Kerry Brink (OCPL) • Suzanne Fisher (CSR) • Robert Freund (CSR) • Don Luckett (CSR) • Chuck Selden (OER) • Sara Silver (OD) • Jean Sipe (CSR) • Jennifer Pohlhaus (Ripple Effect Communications, Contractor) • Lubna Sher (Ripple Effect Communications, Contractor) • Kerry Gorelick (Ripple Effect Communications, Contractor) • Amy Bielski (Ripple Effect Communications, Contractor)