220 likes | 379 Views
The International Surface Pressure Databank (ISPD) and Twentieth Century Reanalysis at NCAR. Thomas Cram - NCAR, Boulder, CO Gilbert Compo & Chesley McColl – Univ . of Colorado-Boulder/NOAA-CIRES Doug Schuster & Steven Worley - NCAR, Boulder, CO.
E N D
The International Surface Pressure Databank (ISPD) and Twentieth Century Reanalysis at NCAR Thomas Cram - NCAR, Boulder, CO Gilbert Compo & Chesley McColl – Univ.of Colorado-Boulder/NOAA-CIRES Doug Schuster & Steven Worley- NCAR, Boulder, CO 7th ACRE Workshop, Toronto, 25-27 Aug 2014
Topics • RDA overview • ISPD and 20CR overview • RDA services • Data discovery & access • Custom services • Data citation
Research Data Archive (RDA) at NCAR rda.ucar.edu • 600+ distinct datasets for climate and weather research • Free and open access • 10,000+ unique users in FY2013 • Collections: ocean & atmosphere observations, analyses, reanalyses, operational NWP outputs • Each collection managed by a RDA data specialist
RDA data collections • Historical observations (ISPD, ICOADS, NCDCISD, Upper Air Database) • Reanalyses (20CR, ECMWF ERA, JRA-25, JRA-55, NCEP CSFR, BPRC ASR, … ) • Operational (NCEP observations, analyses, & forecasts) • Climate/regional models (CMIP5, NRCM, … ) • Remote sensing • Ancillary datasets--topography/bathymetry, vegetation, land use
ISPD (version 2) • World’s largest collection of surface & sea level pressure observations • Land station • Marine observations (ICOADS) • Tropical cyclone best track (IBTrACS) • Period: 1768 – 2012 • Volume: 562 GB • 60+ contributors • doi: 10.5065/D6SQ8XDW • Data access: rda.ucar.edu/datasets/ds132.0
Twentieth Century Reanalysis (20CR) • Global reanalysis • Observational inputs • Surface pressure (ISPD) • Sea surface temperature • Sea ice distribution • Period: 1871 - near present (currently through 2012) • Volume: 13.6 TB • Ensemble mean & spread analysis: 2 x 2 deg grid • Ensemble mean & spread forecast fields: T62 Gaussian grid • doi: 10.5065/D6QR4V37 • Data access: rda.ucar.edu/datasets/ds131.1
Data discovery • Detailed metadata collection • Dataset-, group-, and file-level metadata • Drive interfaces for file grouping and sub-setting tools • Support efficient back-end processing • Improve scalability • Provide “quick look” at data samples
ISPD Metadata: Dataset level Comprehensive view of dataset-level metadata • Observing platform • Data types • Data frequency • Temporal & geographical coverage
ISPD Metadata discovery: File level • Hourly files grouped into yearly tarballs • Looking glass icon loads discovery tool
ISPD Metadata discovery: File level • Interactive map • Browse and inspect observations
20CR Metadata discovery • Gridded data • Metadata classified by parameter
Data access features • Direct file download • Customized subsetting • Data format conversion • ISPD: HDF5 → ASCII, NetCDF • 20CR: GRIB → NetCDF • THREDDS services (OPeNDAP, WMS, WCS, etc.) -- currently 20CR only • RDA API web service (Python) • Supporting software
20CR data subsetting Format conversion Temporal Selection Spatial selection Parameter selection
ISPD data subsetting Temporal selection Spatial Selection (Lat/Lon region or Station ID) Observation type Output format (ASCII or NetCDF)
2014 online data downloads • Direct file downloads • ISPD: 869 GB • 20CR: 3.23 TB • Subset requests • ISPD: 3.14 TB accessed -> 694 GB served • 20CR: 2.65 TB accessed -> 1.27 TB served
Dataset citation service • Citation design – ESIP Guidelines Compo, G. P., et al. 2010. International Surface Pressure Databank (ISPDv2). Research Data Archive at the National Center for Atmospheric Research, Computational and Information Systems Laboratory.http://dx.doi.org/10.5065/D6SQ8XDW. Accesseddd mmm yyyy. • Citation styles • ESIP • AMS • AGU • DataCite
Upcoming ISPD • ISPD version 3 (1755-2010) • Geoscience Data Journal article (in review) • THREDDS services? General • Globus data transfer service (GridFTP protocol) -- https://www.globus.org/ • 20CR • Version 2c (1850-2013) • Version 3 (~1 deg resolution)
ISPD rda.ucar.edu/datasets/ds132.0 20CR rda.ucar.edu/datasets/ds131.1