1 / 21

Connecting Research American Evaluation Association - Anaheim, CA November 2011

This session discusses the challenges faced in tracking impact in the research community and presents options and the CASRAI approach to overcome these challenges. It highlights the importance of a common data dictionary and how it can improve efficiency, multiplicity, and clarity in research evaluation.

mwinnie
Download Presentation

Connecting Research American Evaluation Association - Anaheim, CA November 2011

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Connecting Research • American Evaluation Association - Anaheim, CA • November 2011

  2. Agenda • show how a common data dictionary can address the challenges of tracking impact in the research community • Challenges • Options • CASRAI approach

  3. Challenges

  4. Challenges • efficiency • multiplicity • clarity

  5. Efficiency challenges • doing vs measuring • capturing vs remembering

  6. Multiplicity challenges • multiple participants • multiple disciplines • multiple institutions • multiple funders • ...all on multiple projects

  7. Clarity challenges • terminology • comparability • identifiability • ... all across multiple independent players

  8. Options

  9. Options • standardize the hosting • standardize the software • standardize the storage format • standardize the data dictionary

  10. CASRAI approach

  11. Modular dictionary • Terms, definitions, relationships, thesauri • Core, discipline, jurisdictional layers • Simple and compound elements

  12. Exchange format • any concept representable as data • any data representable as documents • any exchange processable • a common ‘currency’ for information

  13. Evaluation: what • Multiple frameworks of research measurement can share common source data • The impact of people and projects on: • Capacity (human, physical, integration) • Knowledge & Innovation (quantity & quality) • Society (economic, health, culture , environment)

  14. Evaluation: how • Linking inputs to outputs • If it can be recorded it can be identified • Example: persononprojectwithfundingproducedoutputresulted inimpact

  15. CASRAI Dictionary Common concepts defined, structured and identified Core Common 1) Elements where meaning* & structures are used by all nations and all disciplines Core Discipline 2) Extensions to above elements that are unique by discipline Nation-specific 3) Extensions to above elements that are unique by nation * Including common classifications and constrained list values.

  16. Any database with... Project ID, Proposal, Team, Partners, Funding Requests Person ID, Contact, Education, Employment, Distinctions Funding ID, Source, Program, Amount, Period Infrastructure ID, Host Org, Utilization Contributions ID, Outputs, Outcomes, Impacts Organization ID, Institution, Funder, Partner can be reused to generate... Dean’s Report Financial Report Funding Opportunities Compliance Reports Proposal Progress Report Funding Application Academic CV Funding Results Public CV Peer Review Report Commercial Impact Report Statement of Intent Publications List Quality of Life Impact Report

  17. Using any software CONCEPTS RECORDED: researchers and organizations in projects produce outputs with impacts CVs Proposals Reports CONCEPTS SHARED.

  18. Recap • Research = multiplicity • Harmonization = efficiency/clarity • Harmonization = HARD (dictionary less hard) • Impact = evidence that can be connected

  19. Why connect the dots? Save time 42% Estimated time* spent administering research grants rather than doing the research. See patterns Identifiers reveal links between research inputs and outputs. Common dictionary enables better evidence for comparing and benchmarking. Build bridges Easier for researchers to collaborate across boundaries of discipline, institution, region, nation. Easier for organizations to raise or lower the information draw-bridge throughout the coopetition lifecycle. Position your organization as a champion of harmonization and standards. * Source: US-FDP

  20. CASRAI Status Adoption momentum within national and regional funders and universities. Endorsement by eruoCRIS and moving towards adoption of CASRAI dictionary within CERIF. Discussions started with NSF and NIH towards collaboration options. Introductions & first presentation made to the National Science Foundation of China. A commitment to explore options for collaboration. Discussions being planned for participation in Australia. Forum for European-Australian Science & Technology Cooperation (FEAST) acknowledges CASRAI in a recent discussion paper as a key opportunity for interoperability.

  21. Connecting Research Thank-you.

More Related