his.cuahsi/

1. Development of a Community Hydrologic Information SystemDavid G TarbotonJeffery S Horsburgh, David R. Maidment (PI), Tim Whiteaker, IlyaZaslavsky, Michael Piasecki, Jon Goodall, David Valentine, Thomas Whitenackdtarb@usu.edu http://his.cuahsi.org/ CUAHSI HIS Sharing hydrologic data Support EAR 0622374

2. Outline • CUAHSI and HIS data publication system • WaterML and WaterOneFlow web services • Observations data model (ODM) • Data publication system • Analysis using HIS • Implementation • Performance

3. Consortium of Universities for the Advancement of Hydrologic Science, Inc. • 110 US University members • 6 affiliate members • 12 International affiliate members • (as of March 2009) An organization representing more than one hundred United States universities, receives support from the National Science Foundation to develop infrastructure and services for the advancement of hydrologic science and education in the U.S. http://www.cuahsi.org/

4. What is the CUAHSI HIS? Discovery Access Modeling Analysis Hydroseek HydroLink + OpenMI MATLAB, Excel, GIS, R, … HIS Desktop GetSites GetSiteInfo GetVariableInfo GetValues Web services and Schema WaterOneFlowand WaterML to transmit hydrologic data in a standard way Data repository Observatories ServiceRegistry 3rd-Party Servers HIS Server HIS Central publication and archival of field data include data from others catalog hydrologic data services and metadata store and share hydrologic data ODM An internet based system to support the sharing of hydrologic data comprising databases connected using the internet through web services as well as software for data discovery, access and publication.

5. Set of query functions ReturnsdatainWaterML WaterML and WaterOneFlow WaterML is an XML language for communicating water data WaterOneFlow is a set of web services based on WaterML NWIS Daily Values (discharge), NWIS Ground Water, NWIS Unit Values (real time), NWIS Instantaneous Irregular Data, EPA STORET, NCDC ASOS, DAYMET, MODIS, NAM12K, USGS SNOTEL, ODM (multiple sites) Slide from David Valentine

6. WaterML design principles Goal - capture semantics of hydrologic observations discovery and retrieval Role - exchange schema for CUAHSI web services Driven by Hydrologists (community review) ODM USGS NWIS, EPA STORET, Academic Sources Conformance with Open Geospatial Consortium standards. http://www.opengeospatial.org/ For XSD pros, the WaterML schema is athttp://his.cuahsi.org/wofws.html Slide from David Valentine

7. Values Each data value recorded in value element Timestamp, plus metadata for the value, recorded in element’s attributes qualifier ISO Time value Slide from David Valentine

8. What are the basic attributes to be associated with each single data value and how can these best be organized?

9. “When” Time, T t A data value vi (s,t) “Where” s Space, S Vi “What” Variables, V CUAHSI Observations Data Model Groundwater levels Streamflow • A relational database at the single observation level (atomic model) • Stores observation data made at points • Metadata for unambiguous interpretation • Traceable heritage from raw measurements to usable information • Standard format for data sharing • Cross dimension retrieval and analysis Precipitation & Climate Soil moisture data Flux tower data Water Quality

10. CUAHSI Observations Data Model http://his.cuahsi.org/odmdatabases.html Horsburgh, J. S., D. G. Tarboton, D. R. Maidment and I. Zaslavsky, (2008), A Relational Model for Environmental and Water Resources Data, Water Resour. Res., 44: W05406, doi:10.1029/2007WR006392.

11. Water Chemistry from Laboratory Sample

12. Stage and Streamflow Example

13. Base Station Computer(s) Telemetry Network Sensors CUAHSI HIS Data Publication System Query, Visualize, and Edit data using ODM Tools Discovery Analysis Access Hydroseek GIS Matlab Splus R IDL HydroExcel HydroGet HydroLink HydroObjects Java C++ VB ODM Database Service Registry Hydrotagger GetSites GetSiteInfo GetVariableInfo GetValues Streaming Data Loader Harvester WaterML WaterOneFlow Web Service ODM Data Loader Water Metadata Catalog ODM Excel Text ODM Contribute your ODM HIS Central http://his.cuahsi.org

14. Dynamic controlled vocabulary moderation system ODM Data Manager ODM Website ODM Tools ODM Controlled Vocabulary Moderator XML Master ODM Controlled Vocabulary Local ODM Database ODM Controlled Vocabulary Web Services Local Server http://his.cuahsi.org/mastercvreg.html From Jeff Horsburgh

15. Direct analysis from your favorite analysis environment. e.g. Excel, MATLAB

16. Direct analysis from your favorite analysis environment. e.g. Matlab % create NWIS Class and an instance of the class createClassFromWsdl('http://river.sdsc.edu/wateroneflow/NWIS/DailyValues.asmx?WSDL'); WS = NWISDailyValues; % GetValues to get the data siteid='NWIS:02087500'; bdate='2002-09-30T00:00:00'; edate='2006-10-16T00:00:00'; variable='NWIS:00060'; valuesxml=GetValues(WS,siteid,variable,bdate,edate,'');

17. Federal water data available through HIS Central (http://river.sdsc.edu) • Operational • USGS • Daily Values • Instantaneous Values • Irregular Data • Groundwater • EPA Storet • MODIS • NCEP North American Model • DayMet • Development • NCDC • SNOTEL

18. HIS Implementation in WATERS Network Information System National Hydrologic Information Server San Diego Supercomputer Center • 11 WATERS Network test bed projects • 16 ODM instances (some test beds have more than one ODM instance) • Data from 1246 sites, of these, 167 sites are operated by WATERS investigators

19. Prototype Texas HIS • TWDB is supporting a small project at University of Texas to start building a prototype Texas Hydrologic Information System HIS servers at data sources (State agencies, River authorities, Water Districts, Cities, Counties….) Web Services Texas Hydrologic Information Server (at TNRIS) Texas Observations Catalogs and some state water datasets

20. Intermountain Constellation of Experimental WATERsheds (ICEWATER) The Inland Northwest Research Alliance (INRA) Water Research Consortium is establishing a HIS Network to share experimental watershed data to address regional water resources challenges

21. Great Salt Lake Information System A common window for accessing, viewing and downloading data and information in the Great Salt Lake Basin Local Organizations State Agencies Universities Federal agencies

22. Conclusions • Data Storage in an Observations Data Model (ODM) • Data Access through internet-based Water Data Services using a consistent data language, called WaterML • Data Indexing through a National Water Metadata Catalog • Data Discovery through federated map and thematic keyword search system The combination of these capabilities creates a common window on water observations data for the United States unlike any that has existed before.

23. HIS Team and Collaborators • University of Texas at Austin – David Maidment, Tim Whiteaker, Ernest To, Bryan Enslein, Kate Marney • San Diego Supercomputer Center – Ilya Zaslavsky, David Valentine, Tom Whitenack • Utah State University – David Tarboton, Jeff Horsburgh, Kim Schreuders, Justin Berger • Drexel University – Michael Piasecki, Yoori Choi • University of South Carolina – Jon Goodall, Tony Castronova • Idaho State University – Dan Ames • CUAHSI Program Office – Rick Hooper, David Kirschtel, Conrad Matiuk • WATERS Network – Testbed Data Managers • HIS Standing Committee • USGS– Bob Hirsch, David Briar, Scott McFarlane • NCDC– Rich Baldwin

24. HIS Overview Report http://his.cuahsi.org/documents/HISOverview.pdf Summarizes the conceptual framework, methodology, and application tools for HIS version 1.1 Shows how to develop and publish a CUAHSI Water Data Service Available at: