230 likes | 366 Views
WQX and FIFRA Data. Larry Theller, ABE, Purdue University Leighanne Hahn, OISC November 10, 2011. WQX and FIFRA Data. What is WQX How is it used Original concept for data upload Current “state of the art” data loader Process flow Dataloader upgrades created for this project
E N D
WQX and FIFRA Data Larry Theller, ABE, Purdue University Leighanne Hahn, OISC November 10, 2011
WQX and FIFRA Data • What is WQX • How is it used • Original concept for data upload • Current “state of the art” data loader • Process flow • Dataloader upgrades created for this project • Future Tools (2 year NEIEN project)
WQX as Framework • The Water Quality Exchange (WQX) is a new framework that makes it easier for States, Tribes, and others to submit and share water quality monitoring data over the Internet. • States, Tribes and other organizations can now submit data directly to the publicly-accessible STORET Data Warehouse using the WQX framework. • WQX will eventually replace the distributed STORET, the STORET Data Entry Module, Reports Module, and STORET Import Module or SIM as the primary means of submitting water quality monitoring data to EPA.
Win 2003 Server MySQL Backup of Prod. database abe2k3s2 Main Development Server Red Hat Entp MySQL Data Loader Test Query Test Web XML Traffic abeip867 Ubuntu MySQL Purdue-OISC EN WQX Node Network Design Interim Production Server ECN 8-Core Red Hat Server laptops Oracle Development (Test) computer Templeton.ecn Permanent Production Server
Project Name Monitoring Locations 2011 Activity - Results 2010Activity - Results 2009 Activity - Results http://www.epa.gov/storet/wqx/products/WQX_factsheet.pdf
In this typical spreadsheet layout, the measurements are in columns, and each set of samples from a location is a row.
The columns need to pivot so each measurement become rows, and the data collection notes need to be replicated.
The pink colored tab is used to export data for upload; The yellow tabs to set-up the input data; The green tabs provide a linked reference for documented elements in WQX.
STORET Web Service in ArcGIS 10 Easy to identify locations; Experienced GIS user can run queries