National Science Foundation CAREER Program Workshop Florida State University April 18, 2012

1. National Science Foundation CAREER Program Workshop Florida State University April 18, 2012 W. Ross Ellington, AVP for Research & Professor

2. Agenda • Introduction • Overview of program • Identifying the correct NSF program to target your proposal to • Required elements of the proposal • Crafting the proposal • The NSF peer review process • Common problems with noncompetitive proposals and “near misses” • Resources available at FSU • Panel of current FSU CAREER awardees • Wrap up

3. Overview: Faculty Early Career Development (CAREER) Program New NSF CAREER Program Solicitation http://www.nsf.gov/pubs/2011/nsf11690/nsf11690.pdf NSF CAREER Workshop

4. CAREER: The Faculty Early Career Development (CAREER) Program is a Foundation-wide activity that offers the National Science Foundation's most prestigious awards in support of junior faculty who exemplify the role of teacher-scholars through outstanding research, excellent education and the integration of education and research within the context of the mission of their organizations. Such activities should build a firm foundation for a lifetime of leadership in integrating education and research.

5. Full proposal deadlines (due by 5 PM proposer’s local time) • NOTE: FSU’s 3 day rule (http://www.research.fsu.edu/contractsgrants/documents/submissionpolicy.pdf) • July 23, 2012 • Directorate: Biological Sciences (BIO) http://www.nsf.gov/dir/index.jsp?org=BIO • Directorate: Computer & Information Science & Engineering (CISE) http://www.nsf.gov/dir/index.jsp?org=CISE • Directorate: Education & Human Resources (EHR) http://www.nsf.gov/dir/index.jsp?org=EHR • Office of Cyberinfrastructure(OCI) http://www.nsf.gov/dir/index.jsp?org=OCI • July 24, 2012 • Directorate: Engineering (ENG) http://www.nsf.gov/dir/index.jsp?org=ENG

6. Full proposal deadlines (due by 5 PM proposer’s local time) • NOTE: FSU’s 3 day rule (http://www.research.fsu.edu/contractsgrants/documents/submissionpolicy.pdf) • July 25, 2012 • Directorate: Geosciences (GEO) http://www.nsf.gov/dir/index.jsp?org=GEO • Directorate: Mathematical & Physical Sciences http://www.nsf.gov/dir/index.jsp?org=MPS • Directorate: Social, Behavioral & Economic Sciences (SBE) http://www.nsf.gov/dir/index.jsp?org=SBE • Office of Polar Programs (OPP) http://www.nsf.gov/dir/index.jsp?org=OPP

7. By the Directorate's deadline for submission of CAREER proposals, proposers must meet all of the following eligibility requirements: Hold a doctoral degree by the deadline date in a field supported by NSF; Be untenured until October 1 following the deadline; and Have not previously received a CAREER award (prior or concurrent Federal support for other types of awards or for non-duplicative research does not preclude eligibility); AND By October 1st following the deadline for submission of CAREER proposals: Be employed in a tenure-track (or tenure-track-equivalent) position as an assistant professor (or equivalent title) at an accredited institution located in the U.S., its territories, or possessions, or the Commonwealth of Puerto Rico, that awards degrees in a field supported by NSF; OR Be employed in a tenure-track position (or tenure-track-equivalent position) as an assistant professor (or equivalent title) at an organization located in the U.S., its territories or possessions, or the Commonwealth of Puerto Rico, that is a non-profit, non-degree-granting organization such as a museum, observatory, or research lab.

8. The minimum CAREER award size is $400,000 for a five-year period for all directorates except for the Directorate of Biological Sciences (BIO) and the Office of Polar Programs (OPP). For proposals submitted to BIO and OPP, the minimum award size is $500,000 over five years. [FSU awards have ranged from $400,000 to ~$600,000; there are currently 12 CAREER awardees at the University]. Proposers should also review the list of recent CAREER awards made in their discipline for guidance on average award size. A list of CAREER Division/Directorate Contacts can be found on the CAREER web page at http://www.nsf.gov/home/crssprgm/career/contacts.htm.

9. Identifying the Correct NSF Program to Target Your Proposal to NSF CAREER Workshop

10. NSF has a hierarchical organizational structure Directorate Division Program Biological Sciences Molecular & Cellular Biosciences Biomolecular Dynamics, Structure & Function Cellular Processes Genetic Mechanisms Networks and Regulation Biological Infrastructure Integrative Organismal Systems Environmental Biology Emerging Frontiers

11. Depending on your discipline, there may be several NSF divisions that your proposal could be peer reviewed. Within a division there may be multiple programs. How do you choose the most appropriate ? ?

12. NSF award search engine http://www.nsf.gov/awardsearch/ • String search by • CAREER • Disciplinary program • Key words/phrases • PI • Institution • Will provide details about award size and project summary

13. Contact program officers at NSF and pitch ideas; visits to the Ballston, VA headquarters are welcome. FSU has a CRC program for faculty which supports trips to Federal agencies (Funding Agency Travel [FAT] Program http://www.research.fsu.edu/crc/fat.html ; provides up to $1,000 for trips)

14. Before contacting Program Officer • Prepare a brief ¼ page research summary • Read the CAREER guideline • Questions to ask • Does idea fit the program in technical focus? • What are the common shortcomings/problems the program officer has seen in proposals? • Are there things PI should include or address in a proposal to help get it funded? • Questions not to ask • Do you like my idea? • Recommendations for Co-PI? • Will you review my proposal before submission? • (from L.S. Garton, TAMU)

15. Find out from the literature where workers in your area are obtaining funding. The ACKNOWLEDGMENTS sections of research papers will carry the grant/award number(s). Ask your colleagues and mentors for advice. Many have served on NSF panels.

16. After the deadline date, program officers within a division meet. • Typically, a proposal will be assigned to a single program for review. • Sometimes proposals will be co-reviewed by two programs within the same division. • Rarely, a proposal will be co-reviewed by two programs in different divisions. • Co-reviewed proposals are mixed blessings. • You have to please and convince two panels • Costs can be split between two programs

17. Required elements of your proposal NSF CAREER Workshop

18. Must conform to the NSF Grant Proposal Guide (GPG) http://www.nsf.gov/publications/pub_summ.jsp?ods_key=gpg • Coversheet • Indicate target program • Title of project must begin with “CAREER:” • Project Summary • Summarize the research and education objectives, and plans for the integration of education and research activities. • The Project Summary must clearly address in separate statements how the proposal meets both the Intellectual Merit and Broader Impact review criteria. • Project Summary (Probably the single most critical part of the proposal!)

19. Project Description • The Project Description section should contain a well-argued and specific proposal for activities that will, over a 5-year period, build a firm foundation for a lifetime of contributions to research and education in the context of the PI's organization. The Project Description may not exceed 15 pages. Should contain the following: • Description of the proposed research project, including preliminary supporting data where appropriate, specific objectives, methods and procedures to be used, and expected significance of the results; • Description of the proposed educational activities, including plans to evaluate their impact on students and other participants; • Description of how the research and educational activities are integrated with one another • Results of prior NSF support, if applicable. • More when we talk about crafting the proposal.

20. References Cited • Biographical Sketch of Principal Investigator • Supplementary Documentation • Departmental Letter* • Letters of Collaboration • Postdoctoral Researcher Mentoring Plan (relatively new)* • Data Management Plan (new 2011)*

21. *The Departmental Letter should be no more than 2 pages in length, and include the department head's name and title, below the signature. The letter should contain the following elements: • An indication that the PI's proposed CAREER research and education activities are supported by and integrated into the educational and research goals of the department and the organization, and that the department is committed to the support and professional development of the PI; • A description of a) the relationship between the CAREER project, the PI's career goals and job responsibilities, and the goals of his/her department/organization, and b) the ways in which the department head (or equivalent) will ensure the appropriate mentoring of the PI, in the context of the PI's career development and his/her efforts to integrate research and education throughout the period of the award and beyond; and • A statement to the effect that the PI is eligible for the CAREER program.

22. Postdoctoral Researcher Mentoring Plan • • Proposals that include funding to support postdoctoral researchers must include a description of the mentoring activities that will be provided for such individuals (one page). • • Proposed mentoring activities will be evaluated as part of the merit review process, under NSF’s broader impacts merit review criterion. • • Mentoring activities may include: • - Providing career counseling, training in the preparation of grant proposals, or training in responsible professional practices • - Developing publications and presentations • - Offering guidance on techniques to improve teaching and mentoring skills • Providing counseling on how to effectively collaborate with researchers from diverse backgrounds and disciplinary areas • (from http://www.nsf.gov/bfa/dias/policy/nsfday/propprepmr.pdf)

23. Data Management Plan • Policy requires awardees to share their data within a reasonable length of time, so long as the cost is modest. • Proposal preparation requirements stipulate that the project description should provide: “…a clear description of experimental methods and procedures and plans for preservation, documentation, and sharing of data, samples, physical collections, curriculum materials and other related research and education products” (from http://www.nsf.gov/bfa/dias/policy/nsfday/propprepmr.pdf)

24. Data Management Plan • NSF will require that all proposals include a data management plan in the form of a supplemental document (maximum of 2-pages) – This supplement should describe how the proposal will conform to NSF policy on the dissemination and sharing of research results. – A valid Data Management Plan may include only the statement that no detailed plan is needed, as long as the statement is accompanied by a clear justification. – The Data Management Plan will be reviewed under the Intellectual Merit or Broader Impacts criterion or both, as appropriate for the scientific community of relevance. • Data management requirements and plans specific to the Directorate, Office, Division, Program, or other NSF unit, as well as a set of FAQs will be consolidated and available on a single NSF website at: http://www.nsf.gov/bfa/dias/policy/dmp.jsp.

25. Budget Issues • GPG dictates allowable costs; some unique characteristics of CAREER • Inclusion of voluntary committed cost-sharing is not allowed • Support of OTHER SENIOR PERSONNEL is prohibited • Budget justification (no more than 3 pages)

26. Crafting the proposal NSF CAREER Workshop

27. First principles • Do not put this off to the last minute! Your department, college and Sponsored Research Services will have to process the proposal (re: FSU’s 3 working day rule). • Have your colleagues vet the proposal. • Pay particular attention to NSF’s review criteria as well as to the unique features of the CAREER program. • Adhere to guidelines- page length, font size/density, margins etc. • I generally finish my proposals 4-5 weeks in advance and then return to them 2 weeks before the target date.

28. Defining the problem • Most CAREER proposals are derived from doctoral or postdoctoral research effort. Some postdoctoral mentors forbid transfer of projects. • It is essential to define a problem that provides the foundation for a longer term effort (that is, your CAREER). • Confirmatory efforts that break little new ground should be avoided. • “Transformative Research” is the buzz phrase- "Transformative research is ... research driven by ideas that stand a reasonable chance of radically changing our understanding of an important existing scientific concept or leading to the creation of a new paradigm or field of science. Such research also is characterized by its challenge to current understanding or its pathway to new frontiers (National Science Board)."

29. Defining the problem cont. • The problem should be hypothesis driven- What is the question? What is the rationale for asking this question? (Obviously, not appropriate in many disciplinary areas) • Proposed research should be “novel, innovative, bold, transformative vs. incremental”. (MJ Pazzani, VPR, Rutgers)

30. NSF Criterion 1- What is the intellectual merit of the proposed activity? • How important is the proposed activity to advancing knowledge and understanding within its own field or across different fields? • How well qualified is the proposer (individual or team) to conduct the project? (If appropriate, the reviewer will comment on the quality of prior work.) • To what extent does the proposed activity suggest and explore creative, original, or potentially transformative concepts? • How well conceived and organized is the proposed activity? • Is there sufficient access to resources?

31. NSF Criterion 2- What are the broader impacts of the proposed activity? • How well does the activity advance discovery and understanding while promoting teaching, training, and learning? • How well does the proposed activity broaden the participation of underrepresented groups (e.g., gender, ethnicity, disability, geographic, etc.)? • To what extent will it enhance the infrastructure for research and education, such as facilities, instrumentation, networks, and partnerships?

32. NSF Criterion 2- cont • Will the results be disseminated broadly to enhance scientific and technological understanding? • What may be the benefits of the proposed activity to society? • Mentoring activities provided to postdoctoral researchers supported on the project will be evaluated under the Broader Impacts criterion. • There are special considerations in evaluating NSF CAREER proposals (to be discussed later).

33. Project Summary • Single page which tilts the mindset of the reader. It must address the following issues: • What is the research problem? • Why is this problem important? • How will you investigate the problem? • What will be the impact of your research? • How does the research address the intellectual merit and broader impact criteria (must be specifically mentioned) • How will research and educational plans be integrated into the unique micro-context of your university? • How does the proposed effort fit into your long term career plans?

34. Project Description (Ellington’s tried and proven structure) Results from Prior NSF Support Comments and Responses to Reviewers Research Plan General Introduction List of (Experimental) Objectives Objective 1: ---------------------------- I. Hypothesis II. Background & Rationale (include preliminary data) III. Methods & Procedures IV. Anticipated Outcomes V. Potential Pitfalls and Problems

35. Objective 2, Objective 3……. Summary of overall experimental plan, anticipated outcomes, how the effort will move the field forward and how this work fits into your future research plans; should emphasize Intellectual Merit issues Your narrative should provide short snappy summary statements that might be paraphrased in a proposal review. Use of boldface in places is useful (but not in excess!).

36. Education Plan For CAREER proposals you can attempt to interleaf your educational plan into the Research Plan narrative. However, there is a danger that you might muddy the waters. Mission: “The Florida State University preserves, expands, and disseminates knowledge in the sciences, technology, arts, humanities, and professions, while embracing a philosophy of learning strongly rooted in the traditions of the liberal arts. The University is dedicated to excellence in teaching, research, creative endeavors, and service. The University strives to instill the strength, skill, and character essential for lifelong learning, personal responsibility, and sustained achievement within a community that fosters free inquiry and embraces diversity.”

37. The plan: • Your teaching philosophy • Components • Learning goals • Assessment • Innovative, novel and impactful • Integration of the research and teaching plans • Section that specifically addresses criterion 2 issues; examples • Undergraduate, graduate and postdoctoral training • Creation of research resources • Establishment of unique collaborations • Public outreach • Include a realistic timeline

38. A few thoughts on “teaching philosophy” • (from Rutgers CAREER Workshop) • Teaching “Credo”- your beliefs about teaching and learning • Why do you teach the way you do? • What methods do you use to integrate research and teaching? • How do you know you are being effective?

39. A final point…. • Proof of concept is critical • Can be in the form of prior published work or preliminary data • Demonstrates that the project is feasible and that you have the capability to do the work or at least are on the right track • Avoid presentation of copious amounts of preliminary data………

40. The NSF peer review process NSF CAREER Workshop

41. Seehttp://www.nsf.gov/bfa/dias/policy/meritreview/detailsof the overall process The program officer identifies 5-8 ad hoc reviewers. The program officer develops a panel of reviewers who will attend a panel meeting at NSF; each proposal is assigned a primary panelist, secondary panelist and “reader” panelist. Reviews for ad hoc reviewers and panelists are electronic (on FASTLANE); typically each panelist will receive 10-15 proposals to review (half as primary) as well as another group of 5-8 to read only Reviewers are asked to rate each proposal (Ex, VG, G, Fair, Poor) and then provide a justification based on both criteria

42. 5) After panelists have uploaded their reviews, they will have access to the reviews of the ad hoc reviewers and those of the other panelist • 6) The panel usually meets ~3 months after the target date; each proposal is treated as follows: • Primary gives his/her evaluation and rating • Secondary gives his/her evaluation rating and then summarizes the ad hoc reviews • There is general discussion about the proposal and a rating is arrived at • Ratings- High Priority, Medium Priority, Low Priority, Not Competitive (done on a PowerPoint slide; relative position within a rating category is important)

43. The “reader” takes notes and then drafts a “Panel Summary” which describes the strengths and weaknesses of the proposal; this is designed to be a very constructive document • The primary and secondary must approve the panel summary • All of this is done electronically; each panel member has a PC • At the end of the panel there is a general discussion about repositioning proposals in the rating categories as well as shifting of some to different categories • 7) The program officer is not required to follow all the recommendations of the panel. He/she can take into account existing funding of the PI, geographic issues, stage of career of the PI, thematic imperatives of the Foundation etc • 8) The program officer then will make recommendations up the chain of command for awarding or declining a proposal • 9) Notification is electronic, usually within 2 months of the panel

44. Final considerations about the peer review process • Primary and secondary panelists are rarely experts in yourspecific area (depends on program) • This means that your narrative must provide sufficient background detail to set the stage for description of the project and the integration of the educational component • Ad hoc reviewers may be experts in yourspecific area • However, return of ad hoc reviews and the quality of such reviews is highly variable • Often, the most detailed and careful reviews are from the primary and secondary panelists

45. Common problems with noncompetitive proposals and “near misses” (derived, in part, from a presentation by Dr. M. J. Pazzani, VP for Research and Graduate and Professional Education, Rutgers University) NSF CAREER Workshop

46. Common problems with noncompetitive proposals • Problem not clearly articulated • Failure to identify goals and plan of attack • Many unrelated tasks • Failure to differentiate the proposed work from that of others • Emphasizing the lack of information about the research problem you are addressing (when, in fact, the reason why there is a lack of information is because the problem itself is not particularly important) • Poor page space planning (Pazzani says at least 60% of the project description should be devoted to the research plan)

47. Common problems with “near misses” • Solid but incremental work without a truly fresh perspective • Lack of innovation; proposed effort is similar to your prior published work • Lack of compelling evidence that the research plan will succeed • Important within a narrow subfield, but does not make a convincing case that the work is important in a broader context • Education plan is uninspiring and lacks assessment mechanism(s) • Missing timeline.

48. Resources Available at FSU • Your colleagues • Current and Past FSU CAREER awardees • NSF person at Sponsored Research Services (Dale Langevin dlangevin@admin.fsu.edu) • Ross Ellington (wellington@admin.fsu.edu) NSF CAREER Workshop

49. Questions?