Integrating Broader Impacts into your Research Proposal

1. Integrating Broader Impacts into your Research Proposal Delta Program in Research, Teaching, and Learning Trina McMahon Associate Professor of Civil and Environmental Engineering co-faculty director, Delta Program tmcmahon@engr.wisc.edu

2. Recommendation for Change ‘Research directorates should expand resources for educational activities that integrate education and research.’ -Shaping the Future, NSF, 1996

3. Demand for Change ‘Effective October 1, 2002, NSF will return without review proposals that do not separately address both merit review criteria within the Project Summary. We believe that these changes to NSF proposal preparation and processing guidelines will more clearly articulate the importance of broader impacts to NSF funded projects.’ - Important Notice 127

4. Broader Impact 2.0 – NEW in 2013 • October 2012, NSF released a new version of the Grant Proposal Guide that included significant changes in the review elements for Merit Review (Intellectual Merit and Broader Impacts) based on input from the National Science Board Task Force on Merit Review • As of January 14, 2013, greater “equivalency” of importance of Intellectual Merit and Broader Impacts

5. Broader Impact 2.0 continued • “BI may be accomplished through the research itself, through activities that are directly related to specific research projects, or through activities that are supported by, yet are complementary to the project.” • “The quality of the BI activities is more important that the quantity.” • “Any proposed BI activities includes a mechanism to assess success.”

6. Broader Impact 2.0 cont. • “If you lack experience with conducting activities described in your proposal or if the activities require resources that are not readily available to you or your team, you should consider collaborating with experts who can provide the necessary expertise, assistance, and resources.”

7. Broader Impact 2.0 cont. • No one knows how these new guidelines for Broader Impact activities will affect review of Graduate Research Fellowship applications • Kind of hard to find out when NSF is shut down

8. Evolution of NSF’s Vision 1995: “Enabling the nation’s future through discovery, learning, and innovation.” 2006: “Advancing discovery, innovation and education beyond the frontiers of current knowledge, and empowering future generations in science and engineering.” 2011: “Empowering the nation through discovery and innovation” From National Science Foundation Strategic Plans

9. Defining ‘Broader Impact’ How well does the proposed activity: • Advance discovery and understanding while promoting teaching, training, and learning? • Broaden the participation of underrepresented groups (e.g. gender, ethnicity, disability, etc.)? • Enhance the infrastructure for research and education, such as facilities, instrumentation, networks, and partnerships? • What are the benefits of the proposed activity to society in general? from NSF Review Criteria, 2011

10. Elements of your broader impact plan A good broader impact plan will have: • Explicit objectives • Stated relationship to scientific research • Understanding of intended audience • Specific and feasible implementation plans • Connectivity to existing networks • Evaluation plan - did you accomplish objectives

11. Advancing discovery while promoting teaching and learning Examples of activities: • Integrate research activities into STEM teaching at all educational levels • Participate in the recruitment, training, and/or professional development of K-12 science and math teachers • Partner with researchers and educators to develop effective means of incorporating research into learning and education • Establish special mentoring programs for high school students, undergraduates, graduate students, and technicians conducting research • Develop, adopt, adapt or disseminate effective models and pedagogic approaches to STEM teaching

12. Broaden participation Examples of activities: • Include students from underrepresented groups as participants in the proposed research and education activities • Establish research and education collaborations with faculty and students at community colleges, colleges for women, undergraduate institutions • Participate in developing new approaches (e.g., use of information technology and connectivity) to engage underserved individuals, groups, and communities in science and engineering • Participate in conferences, workshops and field activities where diversity is a priority

13. Broad dissemination Examples of activities: • Partner with museums, nature centers, science centers, and similar institutions to develop exhibits in science, math, and engineering • Involve the public or industry, where possible, in research and education activities • Give science and engineering presentations to the broader community (e.g., at museums and libraries, on radio shows, and in other such venues.) • Make data available in a timely manner by means of databases, digital libraries, or other venues such as DVDs • Publish in diverse media (e.g., non-technical literature, websites, press kits) to reach broad audiences* • Participate in multi- and interdisciplinary conferences, workshops, and research activities *check with your advisor about the feasibility of doing this

14. Broader Impact of Your Research • While it is important to describe the significance and impact of your research… • talking about the impact of your research alone is NOT sufficient to satisfy NSF’s broader impact criteria • “...both criteria are important and should be given full consideration during the review and decision-making processes, each criterion is necessary but neither is sufficient.” NSF’s Merit Review Criteria, Review and Revisions, December 2011, National Science Board

15. Insights from Review Panels • Applicants reviewed in blocks based upon stage in education • expectation of research experience and accomplishments is commensurate with stage of education • all senior undergraduates reviewed first • first-year graduate students • second-year graduate students

16. Insights from Review Panels • General review guidelines: • Intellectual Merit (not really the focus of this workshop!) • high standards for academic performance • research expectations dependent upon both education stage and availability of research opportunities • you MUST be able to clearly communicate the motivation, purpose, and general plan for your research • do NOT assume that the reviewer has any background knowledge in your specific research area • make sure you do not have any conspicuously absent reference letters (i.e., from your past or present research advisors) • for later-stage applicants, evidence of research productivity is crucial

17. Insights from Review Panels • General review guidelines: • Broader Impact • integration of broader impacts throughout? • demonstration of knowledge of what constitutes broader impact activities? • evidence that you will follow through with your proposed activities? • past participation in broader impact activities? leadership or initiative in these activities? • does not need to be astonishingly novel – but should be meaningful, feasible, and have the potential to impact broad and/or diverse audiences • Overall: How well has the applicant done given the hand they have been dealt? • not everyone has the same opportunities – has the applicant taken advantage of the opportunities available to them?

18. What do YOU get out of this? • If you receive the funding: • a pretty nice stipend • prestigious award • ability to choose amongst a greater number of labs/advisors • advisor happiness • supported plan for engaging in broader impact activities • Even if you do not receive the funding: • experience in grant-writing and forming a research plan • generation of broader impact ideas that perhaps you and your advisor can still explore

19. A few more additional resources • UW Writing Center (http://writing.wisc.edu) • Will review early drafts for you (but contact them ASAP!) • UW Madison Graduate School Resources • http://www.grad.wisc.edu/admin/outreach/externalfellows.html • http://uwmadisonoffr.wordpress.com/ • University of Missouri list of resources • https://research.missouri.edu/about/broader_impact Of course also see the workshop packet PDF for many more resources