GEON Developments for Searching, Accessing, Integrating , and Visualizing Distributed Data

1. GEON Developments for Searching, Accessing, Integrating, and Visualizing Distributed Data Charles Meertens UNAVCO Dogan Seber, Chaitan Baru San Diego Supercomputing Center Mike Wright DLESE Program Center Image source credits: Mantle Tomography - Shapiro and Ritzwoller; Megnin and Romanowicz Geodynamics Model - McNamara and Zhong Global Strain Rate Map and Plate motions -Kreemer and Holt

2. Outline GEON Overview GEON Best Practices GEON Portal: Search Data Retrieval Resource Registration Integration UNAVCO/GEON Distributed Data Serving example Visualization with the IDV

3. GEON “GEOsciences Network” ActivitiesNSF Large Scale Information Technology Research (ITR) • Develop a distributed, services-based system that enables geoscientists to publish, share, integrate, analyze, and visualize their data, ontologies, tools, workflows, applications, and models • Conduct integrated scientific studies on targets of opportunities in the test beds, in concert with geosciences community Website: www.geongrid.org

4. Members Arizona State University Bryn Mawr College Penn State University Rice University San Diego State University San Diego Supercomputer Center / University of California, San Diego University of Arizona University of Idaho University of Missouri, Columbia University of Texas at El Paso University of Utah Virginia Tech UNAVCO, Inc. Digital Library for Earth System Education (DLESE) Partners California Institute for Telecommunications and Information Technology (Cal-(IT)2) Chronos CUAHSI ESRI Geological Survey of Canada Georeference Online IBM Kansas Geological Survey Lawrence Livermore National Laboratory U.S. Geological Survey (USGS) HP Other Affiliates Southern California Earthquake Center (SCEC), EarthScope, IRIS, NASA GEON PIs and Partner Institutions NSF ITR Supported Partners

5. GEON Cyberinfrastructure (CI) Principles GEON is based on a service-oriented architecture (SOA) with support for “intelligent” search, semantic data integration, visualization of 4D scientific datasets, and access to high performance computing platforms for data analysis and model execution -- via the GEON Portal. While focused on Earth Sciences, GEON cyberinfrastructure is generic and broadly applicable to a variety of other sciences and other application domains.

6. CI: Support the “day to day” conduct of science (e-science), in addition to “hero” computations The “two-tier” approach Use best practices, including use of commercial tools and open standards, where applicable… …while developing advanced technology, and doing CS research An equal partnership IT works in close conjunction with science to help create data sharing frameworks, best practices, and useful and usable capabilities and tools Create shared “science infrastructure” Integrated online databases, with advanced search and query engines Online models, robust tools and applications Leverage from other intersecting projects Much commonality in the technologies, regardless of science disciplines, e.g. BIRN, SEEK, and many others GEON Cyberinfrastructure Principles Cont.

7. Portal (login, myGEON) Registration GEONsearch GEONworkbench Community Modeling Environment Indexing Services Data Integration Services Workflow Services Registration Services Visualization & Mapping Services Core Grid Services Authentication, monitoring, scheduling, catalog, data transfer, Replication, collection management, databases Physical Grid RedHat Linux, ROCKS, Internet, I2, OptIPuter (planned) GEON Overall Architecture Data Physical model Modeling Environment Model results HPCC

8. Geological Survey of Canada Chronos KGS USGS ESRI CUAHSI SCEC PoP node PoP + Data PoP + Compute Partner services Partner Projects The GEONgridCommon Systems Development UNAVCO

9. Working in the GEON Portal: GEON Search Search for Resources Current Types: ASCII CUAHSI Data GMT Raster GeoTiff Relational Database Shapefile Tool WMS Service Web Service Search Constraints: Metadata Relation, Type, Subject, Keyword Spatial Coverage Temporal Coverage Ontology/Concept Relation Example of unconstrained search response

10. Working in the GEON Portal: GEON Search with constraints Search for Resources Current Types: ASCII CUAHSI Data GMT Raster GeoTiff Relational Database Shapefile Tool WMS Service Web Service Search Constraints: Metadata Relation, Type, Subject, Keyword Spatial Coverage Temporal Coverage Ontology/Concept Relation Sample search for: Resource Type - “Relational Database” Keyword - “GPS”

11. Working in the GEON Portal: GEON Ontology-based Query Search - a stepping stone to intelligent search Search can be constrained using selected ontologies and concepts. New ontologies are being developed by the science team through workshops and mechanisms exist at the GEON portal to register ongologies and resources to ontologies. Example: User selects an ontology (in this case the NASA “Earth Realm” with IceCore concept

12. The Future: Scientific Data Integrationor: … from Queries to Questions can be resolved through cyberinfrastructure To be able to “GEONSearch”: What is the distribution and U/Pb zircon ages of high chrome spinel kimberlites in the Appalachian Geologic Province? How does it relate to the thickness of the sub-cratonal lithospheric mantle? Quantitative Numerical Integration Information Integration Geologic knowledge Ontologies Database Mediation A.K.Sinha, Virginia Tech, 2005 Raw Data Lithosphere thickness Geologic map Geochronology Bulk chemistry Mineral chemistry

13. GEON Resource Access • Access Resources • View Metadata • Download files • Query Databases Example: GEON Portal Query generation tool and sample response from the GPS Seamless Archive Centers (GSAC) database located remotely on UNAVCO/GEON PoP Node

14. GEON Resource Registration • Register Resources • Submit metadata about resource (follows ADN Schema) • Register to Ontology. - Discovery of data resources (e.g., gravity, geologic maps, etc) requires registrationthrough use of high level index terms (a type of ontology)

15. GEON Portal Resource Integration • Gather Search-Selected Resources into your workbench • Make integrated maps (shapefiles, WMS) • Integrate Database • Integrate Workflows • “Integration Cart” Example: Integration of two external WMS services into new GEON WMS Web Browser Map Viewer (OGC-supplied)

16. An ongoing GEON effort is to address 4D (xyzt) representation of earth science datasets and models in a grid computing environment. Current desires and approaches include: Capable volume-time Integrative Visualization tools: Enhancing the Unidata IDV Java Application for earth science data 4D (and multi-parameter) Data Model: Adopting netCDF (used by IDV and soon by ESRI). Extensive Common Data Model effort at Unidata Data Discovery: GeonSearch at the GEON Portal Data delivery: html, OPeNDAP, OGC (WMS), Interoperable Automated Data/metadata registration: currently exploring OAI/ADN, DLESE Data Collection System and webservice, THREDDS (Unidata) Basically give me the specific types of data I want, for only the specific time and volume I specify, and in a way that I can find it quickly and easily use it with any application I desire! GEON 4D Data Access and Visualization

17. UNAVCO/GEON PoP Data Services and Visualization Example Below: Geodynamic and Tomographic models on OPeNDAP Server. Visualization with IDV.

18. UNAVCO/GEON PoP Server Details: Data, Models, Catalogs, Metadata Data Access http • UNAVCO/GEON • PoP Data Server • 1D/2D/3D/4D • Tomography • GPS data/vectors • Earthquakes • Focal Mechanisms • Strain rate • Topography • Image maps • Geodynamics • Faults • Paleogeography • Plus IDV visualization • “Bundles” (.xidv files) srb ftp gridftp OGC* • OPeNDAP • Data • Servers • netCDF • Freeform OPeNDAP • Thredds • Catalog elements • Digital Library • Metadata elements • (via OAI or DLESE • Webservice) • WMS Catalog *OGC=WMS/WFS/WCS Thredds Catalog Dataset Catalogs and Metadata Access *OGC: WMS/WCS/WFS

19. UNAVCO/ GEON Data Server and Visualization Access UNAVCO/GEON Data Node OPeNDAP Server Example: Seismic Tomography in NetCDF format WMS Server Example: GPS Seamless Archive Postgres/PostGIS Database Integrative Data Viewer THREDDS/OPeNDAP Catalog WMS Catalog HTML File Other distributed data servers Local File Still under development: registration of netCDF files and OPeNDAP servers into the GEON Portal; embedded GEONSearch within the IDV

20. Using a best practices approach, GEON has been developing data sharing frameworks, a registry for distributed databases, concept-based search mechanisms, advanced visualization software, and grid-computing resources for earth science and education applications. GEON Cyberinfrastructure will enable new interdisciplinary research in the geosciences, while extending the access to data and complex modeling tools from the hands of a few researchers to a much broader set of scientific and educational users. We invite you to try out the tools on the GEON Portal and to Submit or Use Resources of any type. Come and see GEON demos at the GEON Booth! Summary Website: www.geongrid.org