1 / 23

Dr. Julia Melkers , Associate Professor of Public Policy Georgia Institute of Technology

Evaluating the Alaska EPSCoR Phase III: Resilience and Vulnerability in a Rapidly Changing North: The Integration of Physical, Biological and Social Processes. Dr. Julia Melkers , Associate Professor of Public Policy Georgia Institute of Technology

marnie
Download Presentation

Dr. Julia Melkers , Associate Professor of Public Policy Georgia Institute of Technology

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Evaluating the Alaska EPSCoR Phase III:Resilience and Vulnerability in a Rapidly Changing North: The Integration of Physical, Biological and Social Processes Dr. Julia Melkers, Associate Professor of Public Policy Georgia Institute of Technology Dr. Eric Welch, Associate Professor of Public Administration University of Illinois at Chicago Year 4 Evaluation Presentation Alaska EPSCoR All Hands Meeting May 2011 Fairbanks, Alaska

  2. Year 4 Evaluation • Extends prior years formative evaluations to not only collaborative development, but also academic production. • Summative Knowledge-Based Impacts • Research Capacity • New research ideas and related activities • Research Outcomes • Publications and knowledge-based impacts • Looking forward: • Lessons learned and possible future directions

  3. Today • Data sources and focus • Co-authorship connections • Shared knowledge • Disciplinary placement • Research impacts • Conclusions

  4. Evaluation Design & Data • Faculty survey • Brief online survey re: newest developments and emerging plans • Articles/papers • Grant proposals • Research ideas • Bibliometric analysis • Analysis of publication-related outputs • Alaska EPSCoR Phase III Annual Reports • ISI Web of Science:

  5. Bibliometric Data • Bibliometric Measures: • Publication counts • Co-authorship patterns • Citation counts and disciplines (Moed, 2005) • Integration Score: Degree of interdisciplinarity based on cited works (Porter and Rafols, 2009) • Bibliographic coupling: “Coalescence” based on knowledge sharing (shared citations) • SOURCES: • SCI-EXPANDED- Science Citation Index • SSCI- Social Sciences Citation Index • A&HCI - Arts & Humanities Citation Index • CPCI-S - Conference Proceedings Citation Index– Science • CPCI-SSH - Conference Proceedings Citation Index- Social Science & Humanities

  6. Survey Focus • Respondents: 99 faculty (67% response rate) • Higher response among those involved for multiple years and supported by EPSCoR Content: • New activities & outputs • Qualitative: • Details on new research • Most important outcomes • Student impacts • Outreach and stakeholder interaction/impacts

  7. Results of Alaska EPSCoR Involvement & Support • 77% reported new ideas or plans for research • 44% reported submission of grant proposals in 2010/2011 • (range = $4500 to $3M) • (average = $636,000) • 32% reported submission of a journal article in 2010/2011 • Mean of ~ 1 articles per person • Detailed qualitative results provided in final report.

  8. Bibliometric Analysis

  9. Findings: Publication Counts: 2007-2010 • 54 AK EPSCoR faculty produced 122 peer reviewed journal publications • Additional publications include 45 books/one time pubs • Other (non-EPSCoR) journal publications (pre/non) = 680

  10. Finding: Co-Authorship on Alaska EPSCoR Publications -- Alaska EPSCoR faculty have broadco-authorship ties, within and outside of Alaska 443 authors 54 EPSCoR affiliated authors 122 EPSCoR publications

  11. Finding:Co-authorship ties within AK EPSCoR reflect fewer broad relationships, but clear cross- component ties Other Co-authorships 54 EPSCoR authors E-I index (component) = -0.073 E-Index (institution) = -0.707

  12. Finding: Knowledge sharing/coalescenceMost central faculty showed some common knowledge base of AK EPSCoR 36 core network authors • Percentage of references shared by at least one EPSCoR author • EPSCoR publications show higher % of shared reference than pre or non-EPSCoR publications

  13. Global Map of Science, 2007 221 SCI-SSCI Subject Categories Rafols, Porter and Leydesdorff (2009) Env Sci & Tech Ecol Sci Agri Sci Infectious Diseases Geosciences Clinical Med Chemistry Matls Sci Engineering Biomed Sci Cognitive Sci. Health & Social Issues Psychology Physics Computer Sci. Business & MGT Social Studies Econ. Polit. & Geography

  14. Disciplinary placement of AK EPSCoR Pubs Env Sci & Tech EPSCoR Publications in the Map of Science Geosciences AgriSci Infectious Diseases Ecol Sci Clinical Med Engineering Chemistry MatlsSci Biomed Sci Cognitive Sci. Health & Social Issues Physics Psychology Computer Sci. Business & MGT Social Studies Econ. Polit. & Geography Integration Score = 0.523

  15. Finding: EPSCoR publications overall demonstrate higher interdisciplinarity than non-EPSCoR pubs

  16. FINDING: AK EPSCoR show early signs of having a multiplicative effects: Results: 122 EPSCoR publications are cited 596 times in the WoS • (686 timeswithself citation (9%) • 2267 Total Authors, 836 Institutions • 282 Journals, 96 SubjectCategories • Articles citing AK EPSCoR publication are in turn cited by another 1687 articles • Caveats • Lag times • Partial 2011 data • Faculty reporting accuracy

  17. AK EPSCoR Early Impacts:Work cited by authors across the U.S. (all 50 states) Created using addresses of authors listed on the publication citing AK EPSCoR

  18. Finding:Global impact of Alaska EPSCoR Publications: cited by authors in 71 countries

  19. Finding: Citation Impacts based on broad set of articles.

  20. Finding: Citation Impacts based on broad set of articles. • Some “Chapin Effect” exists. • Yet, citations of EPSCoR work are more broadly based

  21. Env Sci & Tech EPSCoR Publications in the Map of Science Disciplinary placement of AK EPSCoR Pubs Geosciences AgriSci Infectious Diseases Ecol Sci Clinical Med Engineering Chemistry MatlsSci Biomed Sci Cognitive Sci. Health & Social Issues Physics Psychology Computer Sci. Business & MGT Social Studies Econ. Polit. & Geography N= 122 Integration Score = 0.523

  22. Env Sci & Tech Knowledge Impacts:Articles citing EPSCoR Pubs Geosciences AgriSci Infectious Diseases Ecol Sci Clinical Med Engineering Chemistry MatlsSci Biomed Sci Cognitive Sci. Health & Social Issues Physics Psychology Computer Sci. Business & MGT Social Studies Citing Pieces: EPSCoR Cited- Publications in the Map of Science Econ. Polit. & Geography N=596 articles

  23. Overall Findings • Alaska EPSCoR Phase III research has: • generated new research ideas and related collaborative relationships; • generated work that has been recognized nationally and internationally; • generated or leveraged global research ties, expanding the knowledge resources of Alaskan researchers and institutions; and • produced work that has been based on interdisciplinary knowledge resources • been visible in a cross disciplinary international research community.

More Related