340 likes | 537 Views
Access to NCAR’s Historical Upper Air Archive By Joey Comeaux Steve Worley Bob Dattore Will Spangler Dennis Joseph Roy Jenne DSS/CISL/NCAR AMS - 2010. Objective : Provide access to approximately 80 million upper air soundings archived in NCAR’s Research Data Archive (RDA).
E N D
Access to NCAR’s Historical Upper Air Archive By Joey Comeaux Steve Worley Bob Dattore Will Spangler Dennis Joseph Roy Jenne DSS/CISL/NCAR AMS - 2010
Objective : Provide access to approximately 80 million upper air soundings archived in NCAR’s Research Data Archive (RDA)
Content of Upper Air Archive Global Coverage Plots : 1920-1980
Global Coverage of Upper Air Archive Global Coverage of Upper Air Archive
Foundation for Work • RDA U/A data Several reanalysis projects • Data collected since 1960’s • Much data added in early 1990’s • Some systematic problems fixed
Problems • Varying Units • Multiple Formats • Varying Station ID Metadata • Inconsistent QC • Duplicates • Intersource • Discovery
GOALS • Provide an archive of U/A data that contains homogeneous units, format(s), station metadata and QC • Support usage of data in multiple ways • Output in synoptic or time series • Multiple discovery options • Access various sources and/or merged version • Support both research and reanalysis communities • Ability to track all reports • Easy to Update • New Data • Bias corrected data • Metadata
TD53 TD52 USAF MIT NCEP ADP B3 TD54 Navy • Why Relational DB? • Data Management • Separate sources, yet together • Reproducibility • Tracking • Easily expandable • Users • Multiple access options • Synoptic or by TS • Domain, Region, Country… Relational Database
Current DB Status • ✓Homogeneous units and format(s) • Support usage of data in multiple ways ✓Output in synoptic or time series ✓Multiple discovery options ✓Access various sources • ✓Ability to track allreports • ✓Easy to Update • New Data • ✓Prototype Interface
http://dss.ucar.edu/datasets/ds370.0 • Temporal Range • ~ 1 month lag with real time • Only 2 source, no overlap 1973 2011-01-04
Request Sent -> You Receive • Email summary right away • Email with link to data when ready
Data File • Single ASCII format • All Units Homogenized • Record and Version tracking
Future Work • Improve Station Meta Data • Improve Interface • Improve QC • Coordination of Efforts with NCDC • Ingest New Sources • Bias Corrections • Include Aircraft Data • More Output Options • NetCDF
Station Metadata Problems • Primarily focusing on IDs • Archive contains WMO, WBAN and other IDs • Multiple sources use varying WMO libraries • Not trivial to access full available POR for a station WMO IDs for Belfast Station Lat Lon 3917 54.65 353.78 3918 54.50 353.66 3920 54.48 353.90 Distance : 15-20KM
Summary Where: Contact : joey@ucar.edu http://dss.ucar.edu/datasets/ds370.0