1 / 29

Water Information System for Time Series Data Management

Explore the challenges of managing time series data and how WISKI software provides a solution for improved data quality and access. Case studies and potential applications are also discussed.

deborahmcox
Download Presentation

Water Information System for Time Series Data Management

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Water Information System for the Management and Storage of Time Series Data Presented by: Steve S. Di Lonardo & James C. Alair September 15th, 2009 West Point, New York Water Quality New York City Department of Environmental Protection Bureau of Water Supply

  2. Outline • Challenges associated with time series data • WISKI software as a solution • Improvements to NYC DEP time series data quality and access? • Case studies • Other potential applications Water Quality New York City Department of Environmental Protection Bureau of Water Supply

  3. Challenges of time-series data • Government & environmental agencies produce large amounts of data • Requires the establishment of information systems to acquire and store data • Limited or no built-in QA/QC capabilities • Often results in data silos • Limited data sharing / access between groups Water Quality New York City Department of Environmental Protection Bureau of Water Supply

  4. Time series data • As part of DEP efforts to improve and facilitate the availability of time series data: • Pilot study using WISKI software • Database manager software • Designed by Kisters North America Inc. Water Quality New York City Department of Environmental Protection Bureau of Water Supply

  5. WISKI database manager • Infrastructure to automatically IMPORT, PROCESS, COMPUTE, STORE, and REPORT all time series data • Unlimited sites, stations, parameters and data storage (only limited by hardware) • Based on MS-SQL, Oracle, etc…. • Scalable from a single user to hundreds of users Water Quality New York City Department of Environmental Protection Bureau of Water Supply

  6. WISKI database manager • Data file importing (current and archival) • All major data loggers formats • Telemetry data acquisition systems • SCADA systems • XML, ZRXP, & Comma delimited files • User defined time-series data Water Quality New York City Department of Environmental Protection Bureau of Water Supply

  7. Who uses WISKI? Water Quality New York City Department of Environmental Protection Bureau of Water Supply

  8. Surface water (temperature) Ground water (salinity) Meteorological (precipitation) Water quality (O2) Stream discharge (flood management) Any time-series data! Applications – Types of Data Water Quality New York City Department of Environmental Protection Bureau of Water Supply

  9. How/Where does WISKI fit at DEP? • LIMS – lab/field data • SAS – historical lab/field data • SCADA – real-time data (operations) • WISKI • Compatible with LIMS, SCADA, SAS, ARCGIS • Organization of high frequency data files into a manageable user-friendly format Water Quality New York City Department of Environmental Protection Bureau of Water Supply

  10. WISKI software at DEP • Purchased by NYC DEP (2005) • Used primarily by EOH Hydrology - Kensico streams • Advancements 2007 - Present • Kensico Streams • USGS gauge stations • Weather stations • Keypoints • Reservoir Elevation/Capacity • Water Security Initiative (EPA Grant) • Integral part of keypoint data acquisition and storage Water Quality New York City Department of Environmental Protection Bureau of Water Supply

  11. WISKI as a software solution • Access via BWS intranet to all DEP employees • Automated data imports (excel, html, asci) • Reduce need for data requests • Data available in a working format Water Quality New York City Department of Environmental Protection Bureau of Water Supply

  12. NYC Watershed & Distribution Water Quality New York City Department of Environmental Protection Bureau of Water Supply

  13. Water Quality New York City Department of Environmental Protection Bureau of Water Supply

  14. WISKI Data Management System Data Computations • Data Conversions • By Formula • Through Rating Tables • Creates Summary Data • Min, Max, Mean, Total • Daily, Monthly, & Yearly Water Quality New York City Department of Environmental Protection Bureau of Water Supply

  15. WISKI Data Reports • Standard Reports • Year End Reports • Monthly Reports • Rating Curve Reports • Discharge Measurement Summary • User-defined Reports Water Quality New York City Department of Environmental Protection Bureau of Water Supply

  16. WISKI Data Management System • Time and user stamped data QA/QC • Original imported time-series data cannot be edited • Altered data maintains history • User-defined plausibility flags (eg. Turbidity) • Restrict sensitive data to certain user groups Water Quality New York City Department of Environmental Protection Bureau of Water Supply

  17. WISKI Data Management System Tabular presentation of the Flags Graphical presentation of the Flags Comments and Remarks Water Quality New York City Department of Environmental Protection Bureau of Water Supply

  18. Case Studies & Potential Applications at NYC DEP Water Quality New York City Department of Environmental Protection Bureau of Water Supply

  19. Case Study: Sewage Spill Warning & Prevention Water Quality New York City Department of Environmental Protection Bureau of Water Supply

  20. Water Budgets / Storm Monitoring Water Quality New York City Department of Environmental Protection Bureau of Water Supply

  21. Event Detection Water Quality New York City Department of Environmental Protection Bureau of Water Supply

  22. Operational Shutdown Monitoring • Reservoir elevation • Discharge and turbidity • Plausibility checks for out of range values Water Quality New York City Department of Environmental Protection Bureau of Water Supply

  23. Flood forecasting • Create a flood forecasting system using existing gage data • Establish a web-based warning network for towns Flood warning Flood watch Water Quality New York City Department of Environmental Protection Bureau of Water Supply

  24. Data Modeling • Nodes: represent catchments, junctions or recording sites • Links: define how the information flows in the model Water Quality New York City Department of Environmental Protection Bureau of Water Supply

  25. Data analysis - Trends Water Quality New York City Department of Environmental Protection Bureau of Water Supply

  26. Water Meter Information • Efforts have been made by NYC to automate water meter data acquisition • WISKI could interface with the data stream and auto-generate reports • Provide a historical database for data analysis Water Quality New York City Department of Environmental Protection Bureau of Water Supply

  27. Summary • WISKI Software represents a state of the art tool for dealing with any time series data • Does not require special infrastructure – can interface with any data source • Significant improvement in QA/QC & data access • Success requires collaboration Water Quality New York City Department of Environmental Protection Bureau of Water Supply

  28. Acknowledgements • Kisters North America • Kerri Alderisio • Lorraine Janus • DEP Management Water Quality New York City Department of Environmental Protection Bureau of Water Supply

More Related