Evaluation and assessment 3 rd Party External Evaluation

1. North Gulf Coastal Hazards Collaboratory Track II Evaluation and assessment 3rd Party External Evaluation Presenter: Cindi Dunn, Principal Evaluator Office of Educational Innovation & Evaluation College of Education, Kansas State University June 13, 2013

2. “Areas of Success” Metrics • CyberinfrastructureImprovement (Cyberinfrastructure Development; Simulation Experiments) • Research Production • Research Collaboration • Human Resource Development (Outreach and Education Activities; Diversity) • Sustainability for Future Cyber-Enabled Research and Innovation

3. Data sources • DRAFT Third Annual Report to NSF • Project Documents on Portal • NG-CHC Retreat held October 2012 • NG-CHC Annual Conference June 2013 • Collaboration Survey Spring 2014 • Portal Analysis Spring 2014 • Reports and other documentation

4. “Areas of Success” Metrics • CyberinfrastructureImprovement (Cyberinfrastructure Development; Simulation Experiments) • Research Production • Research Collaboration • Human Resource Development (Outreach and Education Activities; Diversity) • Sustainability for Future Cyber-Enabled Research and Innovation

5. 1. Cyberinfrastructure and Experiments Number of Researchers and Students Supported by NG-CHC

6. 1. Cyberinfrastructure and Experiments

7. 1. Cyberinfrastructure and Experiments Need to define and develop measures

8. 1. Cyberinfrastructure and Experiments Need to define and develop measures

9. “Areas of Success” Metrics • CyberinfrastructureImprovement (Cyberinfrastructure Development; Simulation Experiments) • Research Production • Research Collaboration • Human Resource Development (Outreach and Education Activities; Diversity) • Sustainability for Future Cyber-Enabled Research and Innovation

10. 2. Research Production Number of Publications in Major Scientific Journals 30 25 14 9 8 1 Published or accepted

11. 2. Research Production Number of Presentations at Major Peer-reviewed Conferences 44 43 20 12 10 9 2 Need to identify peer-reviewed

12. 2. Research Production Number of Products and Other Types of Intellectual Property Tools applicable?

13. 2. Research Production Number and Types of Media Exposure 8

14. 2. Research Production Number and Types of Awards and Honors 17 Advisory Boards Editorial Boards Fellowships 12 9 7 5 5

15. “Areas of Success” Metrics • CyberinfrastructureImprovement (Cyberinfrastructure Development; Simulation Experiments) • Research Production • Research Collaboration • Human Resource Development (Outreach and Education Activities; Diversity) • Sustainability for Future Cyber-Enabled Research and Innovation

16. 3. Collaboration Number of Multi-State/Institution Research Projects (per year and total) 186 67 61 58

17. 3. Collaboration Number of Researchers from Multi-State/Institutions (per strategy* and total) 86 66 38 3 5 *Faculty could be in more than one strategy

18. 3. Collaboration Quality of Collaboration (per strategy* and total Year 1 = 3.8; Year 2 = 4.1) Governance , Administration, Mutuality (Y2H), Norms (Y1H)

19. 3. Collaboration Overall Quality of Collaboration (per strategy* and total)

20. 3. Collaboration Number of Publications Produced by Collaborative Efforts (NSF acknowledged) Year 1 = 67%; Year 2 = 73%; Year 3 = 89%

21. 3. Collaboration Number of Collaborative Research Proposals Developed by NG-CHC Need to define and develop measures

22. “Areas of Success” Metrics • CyberinfrastructureImprovement (Cyberinfrastructure Development; Simulation Experiments) • Research Production • Research Collaboration • Human Resource Development (Outreach and Education Activities; Diversity) • Sustainability for Future Cyber-Enabled Research and Innovation

23. 4. Human Resources *Graduate Students in NG-CHC Research Program *Number of Students Recruited for Project that Persist in STEM

24. 4. Human Resources Numbers of Minorities in Outreach and Education Activities Need values from Outreach Activities

25. 4. Human Resources *Number of Summer Workshops for Junior/Senior High Schools # of participants and satisfactory levels not reported or limited.

26. 4. Human Resources *Number of Summer Workshops for Undergraduate/Graduate Students # of participants and satisfactory levels not reported or limited.

27. 4. Human Resources *Number of faculty and staff trained in NG-CHC. *Number of students trained in NC-CHC. *Number of new courses. Define and obtain existent data.

28. “Areas of Success” Metrics • CyberinfrastructureImprovement (Cyberinfrastructure Development; Simulation Experiments) • Research Production • Research Collaboration • Human Resource Development (Outreach and Education Activities; Diversity) • Sustainability for Future Cyber-Enabled Research and Innovation

29. 5. Sustainability *Number of funded research clusters & other organizations established. *Number of researchers and graduate students in each established center. Define and obtain existent data.

30. 5. Sustainability Number of Successful Awards from NSF and Other Agencies EPA FESD Industry NASA NSF NOAA $2,604,374 $1,083,000 $210,000

31. “Areas of Success” Metrics • CyberinfrastructureImprovement (Cyberinfrastructure Development; Simulation Experiments) • Research Production • Research Collaboration • Human Resource Development (Outreach and Education Activities; Diversity) • Sustainability for Future Cyber-Enabled Research and Innovation