“DataWay” Towards a National Infrastructure for Heterogeneous Data

1. “DataWay”Towards a National Infrastructure for Heterogeneous Data Presentation at WebEx Meeting August 08, 2012

2. Webinar Outline

3. Why do we need DataWay? Science is being Transformed by Data and Computation • Integrative and multi-scale • Not bound by organizational limits • Multi-disciplinary collaboration • Data Forests • Heterogeneous • Distributed, diverse • Central repositories • Data needs to be accessible and interoperable across funding agency and national boundaries

4. Why do we need DataWay? Heterogeneous Data • Diverse sources and sizes. • Simulations, experiments, observations • From a variety of disciplines • Connected, distributed, or centralized. • Across a range of length and time scales, resolutions, and accuracies.

5. Why do we need DataWay? • Integration of data collected from multiple sources can combine the power of many experimental/observational tools for solving complex problems. Such approaches present infrastructure challenges including • scalability • sustainability • availability • security • integrity • a modeling paradigm for solving complex nanostructures. • no single data set contains sufficient information by itself to constrain a unique solution. See the 06/15/2012 Webinar slides for additional examples of science and applications enabled by heterogeneous data.

6. What is the Goal of DataWay? Computational tools Digital Data Experimental tools Digital Data Promote the conduct of research by supporting community-based cyberinfrastructure that supports integration of data and information for knowledge management

7. What is the Goal of DataWay? DataWay is one of several NSF activities launched in response to emerging data needs under CIF21: • DataNet • Long-term preservation and access of data • Data Infrastructure Building Blocks (DIBBs) • Software Infrastructure for Sustained Innovation (SI2) • Cyber-Enabled Discovery and Innovation (CDI) • Data enabled science and engineering • Core Techniques and Technologies for Advancing Big Data Science & Engineering (BIGDATA)

8. What is the Goal of DataWay? Build strategies that support the development of infrastructure that will: • facilitate the emergence of broadly useful tools that can be used by investigators in many fields • support the evolution of collaborative communities around the use of data infrastructure tools by promoting better communication, exchange and cross-education

9. What is the Goal of DataWay? A common architecture is needed to produce an effective, interworking, sustainable system to: • Support the development of integrated and interactive services that transcend fields, facilitate data use and accelerate discovery in complex, multi-scale problems. • Create interoperable digital-access infrastructures, providing open, extensible and sustainable networks. • Foster collaborations and the sharing of observations, simulations, and other relevant scientific information. • Facilitate data transfer between individual researchers and data systems & applications. • Integrate research and education.

10. Timeline Proposed framework approaches developed Short-term enabling awards Two WebEx events Charrette DCL Released Jun 2012 Jul-Aug 2012 Nov/Dec 2012 Jan/Feb 2012 Nov/12-Apr/13 May 2013

11. What are the Goals of the Charrette? • An engaged community, increasingly contributing to an interactive website. • A growing repository of white papers defining the elements of key issues and framework boundaries. • Iterative discovery process leading to consensus on the best approaches. • Integrated and sustained connections among elements of the discovery process.

12. What are the Goals of the Charrette? • A flexible plan for assembling an infrastructure framework that supports data • Collection • Curation • Analysis • Visualization • Integration • Searching • for data sets from observations, experiments and simulations from many sources and at many scales. • Salient issues include • Validation • Annotation • Interoperability • Ontology

13. Preparing for the Charrette • Supporting Collaborative Data Use in Research Across the Sciences • A charrette is a collaborative session in which a group of designers drafts a solution to a problem. • Often refers to activities that are focused on producing actionable plans for future funding. • The DataWay charrette is the beginning of a process. • To engage the community in developing strategies that identify and support the emergence of broadly useful ideas for a data infrastructure that facilitates and promotes efficient data utilization and management across the research communities.

14. Preparing for the Charrette • Charrette Logistics • Pre-Charrette contributions by the community are essential • Short (up to 6 pages) white papers in any of three focus areas will be welcome • Nov/Dec, 2012 • Washington, DC Area

15. Preparing for the Charrette • NSF seeks input from wide range of sources • Individuals, representatives of institutions, organizations, scientific groups or communities • Managers of facilities and CI endeavors • Participants from industry, federal labs, federal agencies, and international partners • NSF will establish on-line resources and forums to • Gather community inputs/requirements • Facilitate partnerships and collaborations

16. Preparing for the Charrette • NSF seeks input in three focus areas: • Identification of user requirements • Technology solutions for data management • emphasis on early components of administration • capture, sharing and curation • DataWay Initiative designs

17. Preparing for the Charrette:User Requirements • Physical Science drivers • Data Science drivers • The aim is to understand what would improve our ability to conduct research in the present and in 10 years.

18. Preparing for the Charrette:Technology Solutions • New, untested ideas and established CI solutions are welcome • Solutions from individuals, scientific communities, industry, academia, international groups, and federal agencies are welcome • Innovative CI solutions to data integration with the scientific process • emphasis on early components of administration • capture, sharing and curation

19. Preparing for the Charrette:DataWay Design • NSF seeks comments on • Visions for DataWay • Conceptual CI Architectures • Design and Implementation Processes • Operations and Sustainability Models • Community Based Governance models

20. Preparing for the Charrette Recap: • Short (up to 6 pages) white papers in any of the three focus areas will be welcome • We hope for wide representation of all communities involved • Access for remote participation in the charrette will also be provided

21. How to Participate • NSF will work with the community to prepare for the charrette. • An emphasis on engaging and connecting research: both in communities where data-enabled science is already a focus, as well as other communities on the cusp of data science. • We seek participation of other government agencies (e.g. DOE, NIH, NASA) and the scientific communities they support. • We seek participation of agencies in other countries that support projects requiring data sharing across borders. • Expected outcomes from the charrette include multiple enabling awards to design framework(s) and build community involvement • Short (up to 6 pages) white papers can be submitted and will be welcome.

22. How to Participate • The charrette planning process is open to all. • We welcome a wide range of ideas and strategies • Participant selection will consider the collective: • Expertise in relevant cyberinfrastructure, data management, and software fields • Representation of a broad range of scientific domains

23. How to Participate • A DataWay website will provide updated information on the charrette • Guidance for the community • White paper preparation instructions • FAQs • The charrette will be held in Nov or Dec Final details will be announced on the website and in a Dear Colleague Letter. • Questions/comments/requests to attend to DataWay@nsf.gov

24. What to expect at the Charrette • Summary Session • Comments from NSF, facilitators, and participants • NSF provides guidance on post-Charrette activities • The charrette will provide the opportunity to • discuss user requirements • discuss approaches to DataWay structure • develop partnerships and new collaborations • Remote participation and real-time comments system will be available

25. Commentsand/orQuestions Where discoveries begin