320 likes | 483 Views
Data Acquisition & Data Management. Ronald Muzzi Electronics Engineer GLERL’s Marine Instrumentation Lab. NOAA’s Next Generation Strategic Plan. Goal – Resilient Coastal Communities and Economies. Objective – Comprehensive Ocean and Coastal Planning and Management.
E N D
Data Acquisition & Data Management Ronald Muzzi Electronics Engineer GLERL’s Marine Instrumentation Lab
NOAA’s Next Generation Strategic Plan Goal – Resilient Coastal Communities and Economies Objective – Comprehensive Ocean and Coastal Planning and Management “Coastal and Great Lakes managers use new or enhanced models, data, tools, and best practices for informed spatial planning, management and stewardship of resources and ecosystems” 2 Great Lakes Environmental Research Laboratory Review – Ann Arbor, MI November 15-18, 2010
Great Lakes Ecosystem To best manage the Great Lakes Ecosystem we need data observations… ? Page 3 Great Lakes Environmental Research Laboratory Review – Ann Arbor, MI November 15-18, 2010
Converting Real World Parameters to Data Sample Collection remove from environment Real World Data + Location & Time Sensor measure in environment ? Remote Sensing measure at distance from environment 4
Moored Logger Observation Platform Deploy put sensor and logger in the environment Retrieve remove sensor and data from the environment Data in the environment Data in the office (raw) Typical 3 months to 1 year deployment 5
Real-Time Observation Platform Deploy put sensor and communications in the environment Service clean, repair, or install new sensors in the environment Data in the environment Data in the office (raw) Retrieve remove from the environment Page 6 Great Lakes Environmental Research Laboratory Review – Ann Arbor, MI November 15-18, 2010
Analysis and Processing of Data Data Management & Archive Data raw Data processed • Examples: • Converting pressure values to wave heights • Converting acoustic intensities to biomass estimates Process Data Page 7 Great Lakes Environmental Research Laboratory Review – Ann Arbor, MI November 15-18, 2010
Disseminating Observation Data GLERL & Partners: Modeling & Management Data Management & Archive Direct Access high resolution Secondary Users Data Centers Remote Access high resolution General Public Web Page simplified Page 8 Great Lakes Environmental Research Laboratory Review – Ann Arbor, MI November 15-18, 2010
Observation Data Collection Overview System Management Feedback – Email / Phone Feedback – Direct Data Management & Archive Sample Sensor Remote Data Observation Platform GLERL & Partners Data Centers General Public ? Page 9 Great Lakes Environmental Research Laboratory Review – Ann Arbor, MI November 15-18, 2010
To provide informed ecosystem management, • how do we advance real-time observation data? Data Management & Archive Data Observation Platform Page 10 Great Lakes Environmental Research Laboratory Review – Ann Arbor, MI November 15-18, 2010
Real-time Coastal Observation Network ReCON Project Parameters High bandwidth, bi-directional, real-time communications to the seafloor • Easy-to-deploy, flexible platform • Buoys • Navigational structures • Piers • Off-the-shelf components • Leverage state-of-the-art technology • Cost savings • Efficient upgrades Page 11
ReCON Overview Base Station: Internet GLERL Buoy or Station: Surface Sensors Satellite Buoy: Underwater Hub: Underwater Sensors
ReCONAdvanced Technology Linux General Purpose Operating System • Mission versatility Example: Florida Keys Hydrocarbon Sensor • In-situ development • MBARI SIAM: java-based plug-and-play instrument interoperability protocol • Diagnostic tools • Secure, encrypted access Page 13
ReCONAdvanced Technology Ethernet Backbone • High bandwidth communications • Bioacoustic and video applications • Multiplexing = concurrent, multiple sensor measurements Bioacoustics and video data collection, Florida Keys Page 14
ReCONAdvanced Technology Generic Interface Ports • Supports any sensor • Mid-mission deployments Deploying Underwater Sensors in Lake Erie Page 15
To provide informed ecosystem management, • how do we advance observation data management? Feedback – Email / Phone Feedback – Direct Data Management & Archive GLERL & Partners Data Centers General Public Page 16 Great Lakes Environmental Research Laboratory Review – Ann Arbor, MI November 15-18, 2010
Observation Data to GLERL and Partners Data Management & Archive GLERL & Partners Direct Access In-house Database: • Data file repository • Metadata repository • Network based for collaboration • Quality control • Public access Page 17 Great Lakes Environmental Research Laboratory Review – Ann Arbor, MI November 15-18, 2010
GLERL Observation Databases • Real-time Coastal Observation Network Data • Meteorological Observation Network Data • International Field Years on Lake Erie Data (IFYLE) • Saginaw Bay Multi-Stressors Data • Episodic Events Great Lakes Experiment Data (EEGLE) • Great Lakes Coastal Forecasting System Data Page 18 Great Lakes Environmental Research Laboratory Review – Ann Arbor, MI November 15-18, 2010
Observation Data to Data Centers Data Management & Archive Data Centers Internet Real-time Observation Data: • Data collection • Metadata • Quality control • Push to data center • Data center provides • More quality control • Dissemination • Archive Page 21 Great Lakes Environmental Research Laboratory Review – Ann Arbor, MI November 15-18, 2010
Example: Meteorological & ReCON Data Data Management & Archive Customers • NDBC • Dissemination • Archive AWIPS MET NOAAPORT • GLOS • Dissemination • Archive ReCON THREDDS Page 22 Great Lakes Environmental Research Laboratory Review – Ann Arbor, MI November 15-18, 2010
Observation Data to General Public Data Management & Archive General Public Web Server Publicly Accessible Data: • Simplified for public level • Data • Metadata • Web-based • Searchable (world wide) • E-mail / phone feedback Page 23 Great Lakes Environmental Research Laboratory Review – Ann Arbor, MI November 15-18, 2010
Partners / Customers • Federal: • GLERL Scientists • AOML – Atlantic Oceanographic and • Meteorological Laboratory • NASA Glenn Research Center • NDBC – National Data Buoy Center • NWS – National Weather Service • NOS TBNMS – National Ocean Service / • Thunder Bay National Marine Sanctuary • U.S. Coast Guard – Ninth District • Academic: • University of Michigan: CILER – • Cooperative Institute for Limnology • and Ecosystems Research • University of South Florida: FIO – • Florida Institute of Oceanography • Ohio Universities: OSC – • Ohio Supercomputer Center • University of Toledo: Lake Erie Center • University of Wisconsin / Milwaukee : • GLWI – Great Lakes Water Institute • Organizations: • Keys Marine Lab SEAKEYS • (Sustained Ecological Research • Related to Management of the Florida • Keys Seascape) • Integrated Coral Observing Network • GLOS – Great Lakes Observing System • IOOS – U.S. Integrated Ocean Observing • System • Lake Carriers Association • Community: • Ann Arbor Hands-On Museum • Chicago Museum of Science and Industry • City of Cleveland Division of Water • Milwaukee Community Sailing Center • The General Public Page 26 Great Lakes Environmental Research Laboratory Review – Ann Arbor, MI November 15-18, 2010
Partners / Customers • Federal: • GLERL Scientists • AOML – Atlantic Oceanographic and • Meteorological Laboratory • NASA Glenn Research Center • NDBC – National Data Buoy Center • NWS – National Weather Service • NOS TBNMS – National Ocean Service / • Thunder Bay National Marine Sanctuary • U.S. Coast Guard – Ninth District • Academic: • University of Michigan: CILER – • Cooperative Institute for Limnology • and Ecosystems Research • University of South Florida: FIO – • Florida Institute of Oceanography • Ohio Universities: OSC – • Ohio Supercomputer Center • University of Toledo: Lake Erie Center • University of Wisconsin / Milwaukee : • GLWI – Great Lakes Water Institute • Organizations: • Keys Marine Lab SEAKEYS • (Sustained Ecological Research • Related to Management of the Florida • Keys Seascape) • Integrated Coral Observing Network • GLOS – Great Lakes Observing System • IOOS – U.S. Integrated Ocean Observing • System • Lake Carriers Association • Community: • Ann Arbor Hands-On Museum • Chicago Museum of Science and Industry • City of Cleveland Division of Water • Milwaukee Community Sailing Center • The General Public Great Lakes Environmental Research Laboratory Review – Ann Arbor, MI November 15-18, 2010
Partners / Customers • Federal: • GLERL Scientists • AOML – Atlantic Oceanographic and • Meteorological Laboratory • NASA Glenn Research Center • NDBC – National Data Buoy Center • NWS – National Weather Service • NOS TBNMS – National Ocean Service / • Thunder Bay National Marine Sanctuary • U.S. Coast Guard – Ninth District • Academic: • University of Michigan: CILER – • Cooperative Institute for Limnology • and Ecosystems Research • University of South Florida: FIO – • Florida Institute of Oceanography • Ohio Universities: OSC – • Ohio Supercomputer Center • University of Toledo: Lake Erie Center • University of Wisconsin / Milwaukee : • GLWI – Great Lakes Water Institute • Organizations: • Keys Marine Lab SEAKEYS • (Sustained Ecological Research • Related to Management of the Florida • Keys Seascape) • Integrated Coral Observing Network • GLOS – Great Lakes Observing System • IOOS – U.S. Integrated Ocean Observing • System • Lake Carriers Association • Community: • Ann Arbor Hands-On Museum • Chicago Museum of Science and Industry • City of Cleveland Division of Water • Milwaukee Community Sailing Center • The General Public Great Lakes Environmental Research Laboratory Review – Ann Arbor, MI November 15-18, 2010
Partners / Customers • Federal: • GLERL Scientists • AOML – Atlantic Oceanographic and • Meteorological Laboratory • NASA Glenn Research Center • NDBC – National Data Buoy Center • NWS – National Weather Service • NOS TBNMS – National Ocean Service / • Thunder Bay National Marine Sanctuary • U.S. Coast Guard – Ninth District • Academic: • University of Michigan: CILER – • Cooperative Institute for Limnology • and Ecosystems Research • University of South Florida: FIO – • Florida Institute of Oceanography • Ohio Universities: OSC – • Ohio Supercomputer Center • University of Toledo: Lake Erie Center • University of Wisconsin / Milwaukee : • GLWI – Great Lakes Water Institute • Organizations: • Keys Marine Lab SEAKEYS • (Sustained Ecological Research • Related to Management of the Florida • Keys Seascape) • Integrated Coral Observing Network • GLOS – Great Lakes Observing System • IOOS – U.S. Integrated Ocean Observing • System • Lake Carriers Association • Community: • Ann Arbor Hands-On Museum • Chicago Museum of Science and Industry • City of Cleveland Division of Water • Milwaukee Community Sailing Center • The General Public Great Lakes Environmental Research Laboratory Review – Ann Arbor, MI November 15-18, 2010
Partners / Customers • Federal: • GLERL Scientists • AOML – Atlantic Oceanographic and • Meteorological Laboratory • NASA Glenn Research Center • NDBC – National Data Buoy Center • NWS – National Weather Service • NOS TBNMS – National Ocean Service / • Thunder Bay National Marine Sanctuary • U.S. Coast Guard – Ninth District GLERL Web Hits (2009): • Academic: • University of Michigan: CILER – • Cooperative Institute for Limnology • and Ecosystems Research • University of South Florida: FIO – • Florida Institute of Oceanography • Ohio Universities: OSC – • Ohio Supercomputer Center • University of Toledo: Lake Erie Center • University of Wisconsin / Milwaukee : • GLWI – Great Lakes Water Institute • Organizations: • Keys Marine Lab SEAKEYS • (Sustained Ecological Research • Related to Management of the Florida • Keys Seascape) • Integrated Coral Observing Network • GLOS – Great Lakes Observing System • IOOS – U.S. Integrated Ocean Observing • System • Lake Carriers Association • Community: • Ann Arbor Hands-On Museum • Chicago Museum of Science and Industry • City of Cleveland Division of Water • Milwaukee Community Sailing Center • The General Public Great Lakes Environmental Research Laboratory Review – Ann Arbor, MI November 15-18, 2010
Future Projects Great Lakes Profiler Updating Former Databases Cataloging data sets and metadata to state-of-the-art technologies Robust & economical for profiled time series observations More Data Dissemination AllReCON and other data to GLOS 31
Thank You! Deploying ReCON buoy in Lake Michigan My niece viewing the Mackinac Bridge from Mackinac Island, Lake Huron Adding sensor to underwater platform Reviewing real-time observations GLERL designed & fabricated