190 likes | 297 Views
Continuous Data Collection In Florida and the U.S. Virgin Islands. Judd Patterson Brian Witcher. NPS I&M South Florida/Caribbean Network Miami, FL. Overview. What we collect water temperature weather station Access database import wizard data validation Workarounds
E N D
Continuous Data Collection In Florida and the U.S. Virgin Islands Judd Patterson Brian Witcher NPS I&M South Florida/Caribbean Network Miami, FL
Overview • What we collect • water temperature • weather station • Access database • import wizard • data validation • Workarounds • Excel graphing (VB) • Problems • size of dataset • graphing improvements
Where We Work 1 weather station 4 reef temperature 40 reef temperature 10 reef temperature 2 weather stations 4 reef temperature
Water Temperature • HOBO water temperature loggers on coral reefs • located at 47 reef sites in BISC, BUIS, DRTO, and VIIS • several sites have paired sensors • data point every 2 hours • Yawzi Reef 1988-present • one of the longest water temperature datasets in the Caribbean
Why we do this… Historically HOTseawater temps Source: adapted from Miller et al. 2009
Why we do this… 2005 resulted in massive coral bleaching and disease… …and ultimately 60% decline in coral cover in the U.S. Virgin Islands
Weather Stations • land-based weather data collection in the USVI and Florida • full weather station • storing 9 sensor values • logging every 10 minutes • independent rain gauge • storing 2 sensor values • logging every 10 minutes
Weather Stations 1. Download data with a HOBO shuttle
Weather Stations 2. Open hobo/dtf and convert to csv
Data Validation Workflow 3. Access database – Import
Weather Stations 3. Access database – Import
Weather Stations 4. Access database – Manual Validation Spike Flatline • Check suspicious readings with local airport weather • http://www.wunderground.com/history/airport/TISX/2010/4/14/DailyHistory.html
Export/Graphing • Pick a station, pick a date range, select the export location... • VB creates appropriate query • VB creates Excel document from template and loads with query data
Remaining Issues • Size of dataset • With each new import a performance hit is noticeable • …inevitable switch to SQL Server on the horizon • Graphing • Excel is also at its limit when dealing with large datasets; particularly graphing