1 / 12

COMPS Data Management

COMPS Data Management. COMPS Data Management Components. Data Acquisition Systems Data Parsing and decoding System Quality Control Data Archival and Data Dissemination Web Data Display and Data Products COMPS Metadata Creation, Maintenance and update

gary
Download Presentation

COMPS Data Management

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. COMPS Data Management

  2. COMPS Data Management Components • Data Acquisition Systems • Data Parsing and decoding System • Quality Control • Data Archival and Data Dissemination • Web Data Display and Data Products • COMPS Metadata Creation, Maintenance and update • COMPS Stations Instruments/Maintenance Inventory

  3. Data Acquisition Systems • Local Readout Ground Station Receiver/Server (LRGS-USF1) • Local Readout Ground Station Backup Receiver/Server (LRGS-USF2) • DROT NESDIS Data Server 1 • CDADATA NESDIS Data Server 2 • USF Direct Readout Ground Station Receiver (USF-DRGS)

  4. Data Acquisition Systems – contd. • LRGS and NESDIS Systems 100, 300 and 1200 baud data • USF DRGS System – 100 baud – Upgrading the same is planned

  5. Data Parsing and decoding System (DPDS) • COMPS sites (Buoys and Coastal) – 19 sites in total • Coastal – Vitel 1100, Campbell (CR23-X and CR1000) – GOES/Freewave • Buoys – Coastal Climate, ASIMET and MiniCOMPS, Nortek and RDI wave buoys • Present Decoders are in C and Perl • We will use PHP and perl and store the data in database

  6. Quality Control (QC) • Real-time transmission problems • Range Checks are done for buoy as well as coastal sites • QC algorithms – (NDBC Manual) • QC Flags

  7. Data Archival and Data Dissemination • Raw Data Archive (Level 0) – LRGS and DRGS • Parsed/Decoded data archival (Level 1) with QC Flags • Post Processing QC (revision of flags - ?) • NetCDF format archive and other formats • Form based data access and graphics • Data Dissemination (NDBC, Sea-Coos and other users)

  8. Web Data Display and Data Products • Redesign COMPS web site (database driven site) is in progress • Identify the data products needs from users (what they need) and improve what we have present on the web pages and develop new data products • Add GIS

  9. Technologies • Linux • Apache • Perl and PHP • PostgreSQL • University of Minnesota’s MapServer • Gnuplot • GMT

  10. COMPS Metadata Creation, Maintenance and update • Need to follow a program we like and stick with it • Need to develop guidelines and follow to update the metadata records • For example: need info about a site – instrument info, parameters collected, averaging info, calibration records etc. • Presently very limited information • Start now and catch up with old records – Lots of effort

  11. COMPS Stations Instruments/Maintenance Inventory • Need to have one one. (From paper to electronic) • Started a database, but did not continue development • URL

  12. COMPS Development Site • Metadata URL • Instrument inventory

More Related