1 / 33

Hydrologic Information System for the Nation

Hydrologic Information System for the Nation. Ilya Zaslavsky Spatial Information Systems Lab San Diego Supercomputer Center UCSD. http://his.cuahsi.org http://hiscentral.cuahsi.org http://hydroseek.net http://river.sdsc.edu/ucsddash http://wron.net.au/DemosII/Modules/ODMKMLGatway.aspx

rosamund-jeremiah
Download Presentation

Hydrologic Information System for the Nation

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Hydrologic Information System for the Nation Ilya Zaslavsky Spatial Information Systems Lab San Diego Supercomputer Center UCSD http://his.cuahsi.org http://hiscentral.cuahsi.org http://hydroseek.net http://river.sdsc.edu/ucsddash http://wron.net.au/DemosII/Modules/ODMKMLGatway.aspx http://maxim.ucsd.edu/mapmaker/storet.aspx http://water.sdsc.edu:7788/demo/CUAHSI/index.html Alexandria Library talk, December 4, 2009

  2. San Diego Supercomputer Center SDSC building on UCSD campus Founded in 1985, as one of the five original supercomputer centers, funded by the National Science Foundation 400 employees Advanced research in high-performance computing and networking R&D and cyberinfrastructureprojects: in neuroscience, geology, astronomy, environmental sciences, molecular biology, hydrology

  3. SDSC Spatial Information Systems Lab http://spatial.sdsc.edu/lab/ Research and system development • Services-based spatial information integration infrastructure, CI projects • Mediation services for spatial data, query processing, map assembly services • Long-term spatial data preservation • Spatial data standards and technologies for online GIS (SVG, WMS/WFS) • Support of spatial data projects at SDSC and beyond In Geosciences (GEON, CUAHSI, CBEO,…) services In Neurosciences (BIRN, CCDB) In regional development (NIEHS SBRP, CRN…) Contact: zaslavsk@sdsc.edu

  4. Consortium of Universities for the Advancement of Hydrologic Science, Inc. 122 US Universities as of July 2008 An organization representing more than one hundred United States universities, receives support from the National Science Foundation to develop infrastructure and services for the advancement of hydrologic science and education in the U.S. http://www.cuahsi.org/

  5. What is the CUAHSI HIS? CUAHSI HIS: NSF support through 2012 (GEO) Partners: Academic: 11 NSF hydrologic observatories, CEO:P projects, LTER… Government: USGS, EPA, NCDC, NWS, state and local Commercial: Microsoft, ESRI, Kisters International: Australia, UK Standardization: OGC, WMO (Hydrology Domain WG, CHy); adopted by USGS, NCDC An online distributed system to support the sharing of hydrologic data from multiple repositories and databases via standard water data service protocols; software for data publication, discovery, access and integration.

  6. Water Data Water quantity and quality Soil water Rainfall & Snow Modeling Meteorology Remote sensing

  7. Sources of Observations Data

  8. Map for the US Build a common window on water data using web services Observation Stations Ameriflux Towers (NASA & DOE) NOAA Automated Surface Observing System USGS National Water Information System NOAA Climate Reference Network

  9. Getting Water Data (the old way) Different Query Pages Different Query Responses

  10. Web Pages versus Web Services http://www.safl.umn.edu/ Uses WaterML (a Markup Language for water data) Uses Hypertext Markup Language (HTML)

  11. CUAHSI Observations Data Model http://his.cuahsi.org/odmdatabases.html

  12. Water web pages Water web services Information communication Water Markup Language (WaterML) HyperText Markup Language (HTML)

  13. Set of query functions Returns data in WaterML Standard Water Data Services Next Step: WaterML 2.0; OGC Hydrology Domain Working Group https://lists.opengeospatial.org/mailman/listinfo/hydro.dwg http://external.opengis.org/twiki_public/bin/view/HydrologyDWG/WebHome NWIS Daily Values (discharge), NWIS Ground Water, NWIS Unit Values (real time), NWIS Instantaneous Irregular Data, EPA STORET, NCDC ASOS, DAYMET, MODIS, NAM12K, USGS SNOTEL, ODM (multiple sites)

  14. International Standardization of WaterML OGC/WMO Hydrology Domain Working Group

  15. Hydrologic Information System Service Oriented Architecture Test bed HIS Servers HIS Lite Servers Central HIS servers External data providers Global search (Hydroseek) Deployment to test beds Customizable web interface (DASH) Other popular online clients HTML - XML Desktop clients Data publishing HIS CentralRegistry & Harvester Water Data Web Services, WaterML WSDL - SOAP Ontology ETL services Controlled vocabularies Metadatacatalogs ArcGIS WSDL and ODM registration Matlab IDL, R Ontology tagging (Hydrotagger) Excel ODM DataLoader Programming (C#, VB..) Streaming Data Loading MapWindow ODMTools HISDesktop Modeling (OpenMI) Server config tools

  16. HIS Server Data Archives Real-time Sensors • Built for data • Storage • Loading • Analysis • Publication • HIS Software free of charge Observations DataModel Database HIS Server SQL Server WaterOneFlowWeb Service ODM Tools Outside Users, HIS Central, HydroDesktop Local Users

  17. HIS Central – Catalog and Search

  18. Managing Varying Semantics In measurement units… In parameter names… Nitrogen: e.g. NWIS parameter # 625 is labeled ‘ammonia + organic nitrogen‘, Kjeldahl method is used for determination but not mentioned in parameter description. In STORET this parameter is referred to as Kjeldahl Nitrogen. And: Dissloved oxygen

  19. Semantic Tagging of Harvested Variables

  20. HIS Central Services HICentralWeb Service • Service registry and metadata catalog • Networks • Sites • Variables • Search Keywords • Does not store actual observation data • Example: GetSitesInBox query function

  21. GetValues Requests Per Day from HIS Central

  22. HydroDesktopCapabilities GIS Hydrology • Add shapefiles to map • Change symbology and labels • Print and export map • GIS toolbox • Search for data • Download data • Display time series • Export data

  23. Hydroseekhttp://www.hydroseek.net Supports search by location and type of data across multiple observation networks including NWIS, Storet, and academic data

  24. Visualization and Analysis of Large Datasets Tiled wall OLAP cubes for repositories OLAP cubes for catalogs USGS NWIS catalog: measurement totals for selected nutrients over decades EPA STORET water quality repository

  25. How we work with agencies on web service access to observational data • Establish an agreement with the agency on joint development of water data services, identify agency partners (ideally, with time to support joint work) • Identify the scope of the service, databases to be exposed, and access control, assign network and vocabulary codes • Map semantics of the service to WaterML semantics, and verify with the agency • Include discussion of agency data and interoperability issues in the context of OGC Hydrology Domain WG (if needed) • Develop a first draft of the web service • Unit testing, over a series of validation cases developed jointly with the agency • Harvest an observations metadata catalog for agency data, to be housed either at SDSC or at the agency • Develop a procedure for catalog updates • Register the water data service at HISCentral (including mapping of variables to ontology terms), and test it using HydroSeek and HydroExcel. Document the service • Review and test the service together with the agency, for possible approval as “operational”

  26. Federal Agency Water Data Services at HISCentral (10/09)

  27. Integration with other infrastructures • Technical: with real time data management middleware: • OpenSourceDataTurbine:http://geo.sdsc.edu/jnlp/usgs.jnlp • Communities: • Superfund Basic Research Program (NIEHS) • CZOs (Boulder Creek, Stroud Water Research Center) • South East Asia/Malaysia (http://seahydro.um.edu.my/search)

  28. The International Workshop on Hydrologic Data Management and Modeling in South East AsiaJuly 20-24University of Malaya Learning how the system works Publishing hydrologic data Setting up a server for SEA Already published: sample data from JPS (Malaysia) and from Indonesia

  29. Looking for COD measurements In HydroSeek

  30. CUAHSI Water Data Services 43 services 15,000 variables 1.8 million sites 9 million series 4.3 billion data

  31. Summary • CUAHSI HIS = Cyberinfrastructurefor managing and publishing observational data • Supports many types of point observational data • Overcomes syntactic and semantic heterogeneity using a standard data model and controlled vocabularies • Supports a national network of observatory test beds • Maintains national registry of services (1.75 million stations – the largest in the world) • WaterML is a standard language for consistently communicating water observations data from academic and government sources using web services; already adopted by several federal agencies. Joint WMO and OGC activity to enhance it. • The system is already deployed at multiple locations • It is free and open source

More Related