410 likes | 511 Views
Observing System Monitoring Center (OSMC) Status Update. Office of Climate Observation May 2006 Kevin O’Brien Steve Hankin – PMEL (co-PI) Kevin Kern – NDBC (co-PI) Ted Habermann – NGDC (co-PI). … to provide a system view of global ocean climate observations. A partnership ….
E N D
Observing System Monitoring Center (OSMC)Status Update Office of Climate Observation May 2006 Kevin O’Brien Steve Hankin – PMEL (co-PI) Kevin Kern – NDBC (co-PI) Ted Habermann – NGDC (co-PI)
… to provide a system view of global ocean climate observations OCO 4th Annual System Review
A partnership … • PMELUser interface logic & tools • NDBCData assembly & operations • NGDC Database & GIS consulting OCO 4th Annual System Review
OSMC (meta)database What is the “climate data record”? • Current (meta)data (“realtime”) • GTS -- primary source • Historical (meta)data • poorly integrated • need “DMAC” integration • for now … use a GTS archive(misses e.g. NOAA research cruises) OCO 4th Annual System Review
OSMC (meta)database at NDBC • Met and Ocean surface data are updated daily with GODAE “T-files” (06, 12, 18, 24) from the previous day~350 MB of data per day URL=http://usgodae2.fnmoc.navy.mil/ftp/outgoing/fnmoc/data/met/2005031706.tar.Z • 1x1 degree gridded metadata netCDF summary files are updated daily • The database repository begins 1 June 2004 OCO 4th Annual System Review
OSMC (meta)database at NDBC • Drifter updates from JCOMMOPS URL = ftp://ftp.jcommops.org/Argo/Status/status.txt • Profiling float data from US GODAE Server • Profile repository starts 1 January 2004 • Country information is assigned based on WMO allocation table URL = http://www.wmo.ch/web/aom/marprog/Operational-Information/buoy-ids.htm OCO 4th Annual System Review
OSMC_Datasource ID Name OSMC_Obs_Delay Platform_ID Ob_Date Latitude Longitude SLP SST ATMP DEWPOINT WINDSPD WINDDIR CLOUDS XML Country - is based on ISO 3166, which defines unique 2-character identifiers for each country. OSMC RDBMS – Entity Diagram Organization - identifies an agency, institute, university, or private company that owns or operates a reporting platform Datasource - identifies the source of the data. Platform - identifies a ship, drifting buoy, moored buoy station, or other platform that reports marine data. Observation - records the instance of a marine observation for a reporting date and time. Obs_Delay - used to retain ship observation to enforce the 48 hour delay. OCO 4th Annual System Review
OSMC Observations Summary OCO 4th Annual System Review
OSMC IT Environment • Hosted at NDBC • Dell PowerEdge 2650 • Dual Processor 3.06 GHz/1MB Cache • Five 146 GB Harddrive • Red Hat Enterprise Linux AS 4.0 • Oracle Database OCO 4th Annual System Review
Who are the users? • Office of Climate Observation • NOAA Observing system managers • Scientific Community OCO 4th Annual System Review
Tools OSMC should provide: • Overview (where are the obs?) • Drill-down (what are the obs?) • Evaluation (are the obs adequate?) OCO 4th Annual System Review
Visualization & evaluationOverview all platforms reporting today OCO 4th Annual System Review
Visualization & evaluationOverview all platforms reporting air temp. today OCO 4th Annual System Review
Visualization & evaluationOverview all platforms reporting SST today OCO 4th Annual System Review
Visualization & evaluationOverview all platforms reporting SST today colored by country OCO 4th Annual System Review
Visualization & evaluationOverview Drifters reporting SST today OCO 4th Annual System Review
Visualization & evaluationOverview U.S. drifters reporting SST today OCO 4th Annual System Review
Visualization & evaluationOverview U.S. drifters reporting SST this week OCO 4th Annual System Review
Visualization & evaluationOverview U.S. Pacific drifters reporting SST this month OCO 4th Annual System Review
Visualization & evaluationOverview U.S. Pacific drifters reporting SST this month, colored by tail OCO 4th Annual System Review
Visualization & evaluationOverview OCO 4th Annual System Review
User interface & tools for evaluation • Overview (where are the obs?) • Drill-down (what are the obs?) • Evaluation(adequacy of the observations) OCO 4th Annual System Review
Visualization & evaluationDrill Down mouse click for metadata summary OCO 4th Annual System Review
Visualization & evaluationDrill Down mouse click to view data OCO 4th Annual System Review
User interface & tools for evaluation • Overview (where are the obs?) • Drill-down (what are the obs?) • Evaluation(adequacy of the observations) OCO 4th Annual System Review
Visualization & evaluation Number of platforms per 1x1 degree box reporting SST today OCO 4th Annual System Review
Visualization & evaluation Number of platforms per 5x5 degree box reporting SST this month OCO 4th Annual System Review
Visualization & evaluation 5x5 degree boxes this month that had one or more SST obs every day OCO 4th Annual System Review
OSMC LAS The OSMC doesn’t look like a Live Access Server …but it is (Shown is the more traditional LAS user interface) OCO 4th Annual System Review
“Adopt-a-Drifter” is another specialized user interface to the same OSMC server OCO 4th Annual System Review
Can the database keep up? • Database performance evaluation • Performance has increased by orders of magnitude • Ever-increasing complexity of useful queries • Need for spatially-based queries • Can metrics be efficiently calculated directly from database? OCO 4th Annual System Review
A new view of the OSMC database OCO 4th Annual System Review
Providing an overview of OSMC • Developing summary OSMC data table views • Number of daily observations • by platform • by country, platform, and date, with drop-down country select • As a demonstration of spatial query capabilities: • # of platforms in Exclusive Economic Zones or ocean and sea polygons • Including drill down to observations OCO 4th Annual System Review
OSMC and Google Earth OCO 4th Annual System Review
What’s ahead • Security • Delay ship observations by 48 hours • Performance • Support “time-partitioning” of database • Create daily summary tables • Metrics • User feedback • Continue work with OCO on UI tools OCO 4th Annual System Review
What’s ahead • Accountability • Continue adding variables • Tease apart platforms better • Reduce unidentified/unknown platforms • Integration • With climate products • With ocean/climate modeling efforts • Into IOOS & GEOSS framework OCO 4th Annual System Review
How Can You Help? • Types of metrics needed • Useful tools • Other platforms/datasets/variables, etc • OSMC will be available through • http://www.oco.noaa.gov Thank You! OCO 4th Annual System Review