1 / 22

USGS National Water Information System (NWIS)

USGS National Water Information System (NWIS). Joe Nielsen U.S. Geological Survey September 7, 2007. Topics. Database (NWIS) Data entry Processing (ADAPS) Review/QA Delivery (NWISWeb) Redundancy (NWIS-RT) Software development User Interaction Current directions and challenges.

fayre
Download Presentation

USGS National Water Information System (NWIS)

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. USGS National Water Information System (NWIS) Joe Nielsen U.S. Geological Survey September 7, 2007

  2. Topics • Database (NWIS) • Data entry • Processing (ADAPS) • Review/QA • Delivery (NWISWeb) • Redundancy (NWIS-RT) • Software development • User Interaction • Current directions and challenges

  3. NWIS Database Components • GWSI: site characteristics, and ground-water water levels and well construction information • QWDATA: water quality data obtained from field samples that are later analyzed at laboratories • SWUDS: site-specific water use (withdrawals, conveyances, transfers and returns) • AWUDS: aggregated water use • ADAPS: time-series data from ground-water and surface water continuous monitoring sites

  4. NWIS Databases • 45 separate databases in local Water Science Centers • Common structure • Common software • Independently (and creatively) managed • Independent data (mostly)

  5. -- NWIS Installation -- NatWeb Node Draft-10/12/2004

  6. NWIS Data Entry • Water quality lab samples • Direct upload from USGS lab to NWIS • Protocols for entry from non-USGS labs • Discrete groundwater readings • Water quality field data • Discrete streamflow measurements • Paper forms with hand entry • PDA or laptop based field forms with batch entry • Time series data • Satellite • Telephone • Manual retrieval of electronic files • LOS Radio, meteor burst, satellite phone

  7. Processing • Automated Data Processing System (ADAPS) • Data editing • Data corrections • Ratings and shifts • Data estimating

  8. ADAPS • 1970s vintage • Mostly character based • Unix OS on database server • 1,000,000 lines of Fortran

  9. New Developments in Data Processing • Commercial software coupled with NWIS database (GRSAT) • PC based graphical rating and shift development tool • Automated data processing (ART) • Automated entry of discrete streamflow measurements and application of shifts

  10. Data Review/QA • QA applications not in ADAPS • Locally written products • “go2” QA of real-time data collection • “swreview” QA of data processing • “SIMS” and “RMS” station analysis handling

  11. NWIS Data Delivery - NWISWeb

  12. What is NWISWeb? 48 NWIS hosts http://waterdata.usgs.gov/ NAD National Aggregate Database SecureRepository Public “View”

  13. NWISWeb Update Frequency Automated data push from each NWIS database • Daily updates • Site information • Direct streamflow measurements • Peak flows • GWSI discrete water levels from wells • QW samples (coming soon) • Five minute updates • Time series data

  14. NWISWeb Hits (in millions of requests per month)

  15. Before NWISWeb 10% missing record Published report Daily statistic Annual QA Hard number Constants Data quality Historical archive After NWISWeb <1% missing record On-line data Instantaneous data Continuous QA Uncertainty NWISWeb impact

  16. Data Redundancy

  17. Data Redundancy (NWIS-RT) • Ensures availability of real time (stream flow) data to the public • Handles transfer of real time data when a WSC computer is down • Continuous replication to NWIS-RT machines of key NWIS tables from all WSC databases • Independent downlink of satellite data feed with ability to process other telemetered data

  18. Software Development • User driven • Users define priorities • Users develop requirements • Users test and accept software • Formal Users Groups • Authority • Responsibility • Partnership with development staff • Multifaceted • Official NWIS software development • Commercial software • Locally written/nationally recognized products

  19. USGS User Interaction • Conferences • National Surface-Water meeting (every three years) • Regional data conferences (annual) • Discussions with regional data committees and other interested groups • Training • Webinars • On-line training • Centralized training • On-site training • Support • Email help groups • Telephone

  20. Current directions • Seamless data entry • Automated records processing • Efficient data review • Continuous quality assurance • Availability of instantaneous data • Incorporating uncertainty

  21. Challenges • Resources • Money • Staffing • Skills • Legacy systems • Database • Code • Local databases with local control • Change

More Related