300 likes | 500 Views
NCDC Activities Relevant to SURFA. Huai-Min Zhang NOAA National Climatic Data Center. NCDC & New Activities SURFA-related Examples: Sea Winds, SST, Ta, Qa, Land-surface products; Global, Remote-sensed Observational Datasets for future Reanalysis
E N D
NCDC Activities Relevant to SURFA Huai-Min Zhang NOAA National Climatic Data Center • NCDC & New Activities • SURFA-related Examples: Sea Winds, SST, Ta, Qa, Land-surface products; Global, Remote-sensed • Observational Datasets for future Reanalysis • Inter-operable Data Services – NOMADS (NOAA National Operational Model Archive and Distribution System) • Questions for SURFA Data Archive & Services
NOAA’s National Climatic Data Center[World Data Center for Meteorology] [World Data Center for Paleoclimatology] (ICOADS, VOSclim, IGRA, IGHSD, GHCN, GDCN …
NOAA’s National Data Centers: NCDC, NODC, NGDC NCDC • Congress mandate for archiving, including all NOAA’s satellite data • Scientific Date Stewardship for QA Climate Data Record • User friendly products and services • Blended & Gidded data • Interoperable servers • Common Data Model • OPeNDAP/DODS • LAS System • … NCDC NODC
One New Scientific Focus: Global Energy & Water Cycle • GEWEX: Bates, Zhang, Knapp … • ISCCP: Knapp • Land-Air Process (Kim, Nelson, Semunegus …) • Reynolds OI SST: 0.25º daily OI SST: AVHRR & Microwave (AMSR-E etc.) (Reynolds .Smith …) • Sea Surface Winds: 0.25º and 4 times per day from multiple satellites and in-situ observations (Zhang …) • Ta, Qa from satellites using Neural Network (Shi …) • Global Precipitation (Smith et al.; GPCP …) (Illustration from http://watercycle.gsfc.nasa.gov)
NCDC Activities Relevant to SURFA Talk Outline • NCDC & New Activities • Examples: Sea Winds, SST, Ta, Qa, Land-Air • Blending multiple remotely sensed observations to increase resolution & coverage and to reduce random & sampling errors • In-situ observations for systematic bias corrections of remotely sensed data • Observational Data for Reanalysis • Inter-operable Data Services – NOMADS (NOAA National Operational Model Archive and Distribution System) • Questions for SURFA Data Archive & Services
Global (Ocean) Observation Systems Present observations consist of multiple platforms and sensors Individual instruments have limitations (in coverage, systematic errors …) Blended products to increase resolution & reduce errors
Example: Under Sampling by Single Instrument:Hurricane Katrina shown by QuikSCAT, every 24 hrs ~ 00:00Z ~ 12:00Z ~ 00:00Z next day ~ 12:00Z next day
Example: Systematic Errors by Single Instrument: AVHRR SST after Pinatubo Eruption: bias > 2ºC _ Other Major biases by: Cloud Desert dust || Systematic Errors Efficient & Sufficient Integrated GCOS – SST: Zhang et al., 2006: J. Atmos. Oceanic Technol.
Complementary multiple satellites & Sensors:Increased Resolution in Blended Products • NOAA Operational/Reynolds OI SST: Weekly, 1º, AVHRR + in-situNew Reynolds OI SST: Daily, 0.25º, AVHRR + AMSR-E +in-situ Number of Days with Nighttime Obs: 0.25° • AVHRR - Pathfinder (top): • Absolute latitudes > 40° have roughly only 5 days of data • Number of days increases toward the tropics • Drop offs due to cloud cover • AMSR-E (bottom): • Absolute latitudes > 40° have more than 20 days of data • Drop offs due to precipitation in ITCZ and SPCZ 9
: No data under clouds : daily, 0.5°, AVHRR New Reynolds 0.25° Daily OI SST: Comparisons with obs & other analyses: 3-day averages of 1 May 2003 for all: OI.v2 1°, weekly OI daily, 1/4°, AVHRR : No data along coast Reynolds OI daily, 1/4°, AVHRR + AMSRE Future: TMI, ATSR, MODIS …
Sea Surface Wind Speed: Multiple Satellite Observations • Long term (operational) satellite SSWS observations from 1 DMSP SSMI in late 1987 to presently ≥ 6 US satellites • Others: NSCAT, ADEOS; ERS Satellites; TOPEX/Poseidon & Jason TMI SSMI SSMI Map: Instruments on the 6 US satellites orbiting the Earth since June 2002; One tropical + 5 polar orbits
Timeline of US SSWS Satellites • Research and weather-ocean forecasts demand high resolution obs. Data (e.g., WCRP reports: 3-6 hourly, 50 km) • In reality, what are the highest possible resolution for gridded global products from existing obs. System? • 0.25º global grid is chosen to resolve boundary currents & fronts such as Gulf Stream; Evaluate temporal resolutions Data from Remote Sensing Systems, Inc. • Multiple satellite processing • Uniformity in retrieval algorithms
Spatial Percentage of the Global Oceanic 0.25° Boxes with 6-hourly Samplings with a temporal coverage of 75% or better. Spatial Coverage ≥ 90% Are Highlighted by Yellow Shading. Zhang, Bates & Reynolds, 2006: Assessment of composite global sampling: sea surface wind speed. Geophys. Res. Lett., Vol. 33, L17714, doi: 10.1029/2006GL027086
Blended Global 0.25º,6-H Sea Winds • Gaussian-like weighting for “instantaneous” winds & reduce aliases in regions/time periods with sufficient data • Blended products: Global 0.25º and 4 snapshots per day at UTC 00:00, 06:00, 12:00 and 18:00 for late 1987 – present. Lower resolutions (twice-daily, daily, monthly) are simple arithmetic averages. • 11-Year monthly climatology: 1995-2005 T=6 hrs R=62.5 km Example: Blended Winds for 06 UTC, 1 Apr 2004
Ta & Qa Retrievals (Lead: Lei Shi) • Observations: NOAA Satellite Series; AMSU-A & -B • Neural network • Co-located buoy/ship & satellite obs • < 50 km, 0.5 hrs • ~10,000 pairs to learning; >7,000 pairs for test; in-dependent validation dataset • RMSE of 1.94C • Additional SST constraints: RMSE ~ 0.94C
Land Surface Products Observing Drought – NCDC Observational Framework with Remote Sensing (Next 3 slides from Hilawe Semunegus) • Philosophy - A multi-instrument approach constrained by a land surface model to bridge scales • Pilot studies- • Retrieval of land skin temperature and wetness using SSMI and Geostationary satellite data (CRN soil moisture for validation) • High resolution rainfall climatology using multisensor precipitation retrieval (MPR -NEXRAD and in situ data) Constraint: - Nudging - Forcing - Assimilation
Using Satellite-Derived Land-Surface Emissivities (εs) to Estimate Soil Wetness DMSP SSM/I SDR dataset (1987-present) ISCCP B1 dataset (1983-present) Infrared cloud-cleared land-surface skin temperatures (TS) Microwave brightness temperatures (TB) F(Soil Moisture) • Use microwave emissivity signals to detect soil wetness – most useful in simple vegetation areas • Will use land-surface type masks to distinguish between surfaces for accurate estimation • Weekly/monthly gridded product Microwave emissivity differences between: Dry Surface Wet Surface εs~0.9-1.0 εs~0.4-0.7
Multisensor Precipitation Reanalysis • Philosophy: Merging of in-situ estimates and NEXRAD data allows for bias adjusted high resolution precipitation estimates that are suited for many applications (1995- present). • Pilot studies: • Reprocessed HADS is a value added in-situ data set available at the hourly scale. • MPR combines in-situ (e.g. HADS) estimates and NEXRAD data though bias correction, data merging, and optimal parameter estimation providing a long-term high resolution precipitation data set. Number of HADS Gauge stations An example of High Resolution Precipitation
NCDC Activities Relevant to SURFA Talk Outline • NCDC & New Activities • Examples: Sea Winds, SST, Ta, Qa, Land-Air • Remote sensing observations for high resolutions and reduce random & sampling errors • In-situ observations for systematic bias corrections • Observational Data for Reanalysis • Inter-operable Data Services – NOMADS (NOAA National Operational Model Archive and Distribution System) • Questions for SURFA Data Archive & Services
Reanalysis Efforts at NCDC (Russell Vose) • 2005 Workshop on “The Development of Improved Observational Data Sets for Reanalysis” (ECMWF, NASA, NCAR, NOAA NCEP & NCDC, NSF) • Final Workshop Report (May 2006) • All main centers prepare inventories of reanalysis on obs • Form collaboration to sustain data refresh cycles & create high quality merged datasets for reanalysis • WCRP Obs & Assimilation Panel (WOAP) to appoint a Working Group …
Reanalysis Efforts at NCDC • NCDC/NCAR merged global land surface data • Near surface weather stations (i.e. OVER LAND), synoptic (hourly or 6-hourly) • Parameters: T, Tdew, P, Wind, Cloud Cover • Comprehensive inventory of hourly datasets at NCDC & NCAR (as well as ECMWF & JMA) • Major players: Neal Lott & Russ Vose of NCDC; Steve Worley & Joey Comeaux of NCAR
NCDC Activities Relevant to SURFA Talk Outline • NCDC & New Activities • Examples: Sea Winds, SST, Ta, Qa, Land-Air • Remote sensing observations for high resolutions and reduce random & sampling errors • In-situ observations for systematic bias corrections • Observational Data for Reanalysis • Inter-operable Data Services – NOMADS (NOAA National Operational Model Archive and Distribution System) • Questions for SURFA Data Archive & Services
NOMADSGlenn Rutledge • One of NCDC’s data archive & service system (others, CLASS ….) • Distributed pilot system for inter-operable, format-independent data services • Open source OPeNDAP • Provides server-side data manipulation on-the-fly (GDS, TDS, LAS; GrADS, IDL, MATLAB …) • Subset data in spaces of: parameter; physical, temporal • Data formats: GRIB, GRIB2, BURF, HDF, netCDF, ascii • Metadata convention: COADS, CF, FGDC • Closely follow UNIDATA for Common Data Model
NOMADS(cont’ed) • In response to the need of retrospective analysis & model intercomparison to verify & improve short term NWP models, seasonal forecasts, climate simulations and assessment & detection • Grass-roots effort for data sharing: NCDC, NCEP & GFDL in 2000 (next pg) • NOAA GEO-IDE : Global Earth Observation Integrated Data Environment • Founding member of the Global Organization for Earth Science Portals (GO-ESSP) • GEOSS data inter-operability in 2015
Collaborations for Multidisciplinary Research Founding Partners • CDC: Reanalysis, climate weather models, in-situ GFDL: Coupled Models, Control and Perturbation Integrations and historical 20th century simulations using solar, volcano, GHG and aerosol forcings. ESRL: MADIS mesoNets, Hi-Res RUC-II / AWIPS NCAR: Community Climate System Model / Land Surface CO2 predictive models (VEMAP), Reanalysis / Eta NCDC: Archive for NCEP model input/output / Select NCDC Observation datasets, Ocean/Ice WAVE, NARR, SST’s... NCEP: Real-time Input/Output, Reanalysis (I&II), Ensembles, Sea Ice Ocean, CDAS, Hourly Eta, Climate Forecast Models... LLNL: AMIP / Probabilistic information PMEL: Ocean and Climate datasets
Total NCDC Archive: ~80TB/yr FY06 ~160TB/yr FY07 NOMADS Data NWP Model • Global Forecast System (GFS), 1 and ½ degree • NCEP Spectral Statistical Interpolation (SSI) Global Data Assimilation System (GDAS) w/ restart files • North American Mesoscale (NAM, formally Eta) 1 and 3 hourly • Rapid Update Cycle (RUC) 13km and 20km • NCEP North American Regional Reanalysis (NARR) 30 years 32km • NCEP/NCAR R1/R2 Reanalysis (Climate Data Assimilation System -CDAS) • NCEP Regional Special Model (RSM) • NCEP Global Ensembles and SREF • NCEP Climate Forecast System (CFS) coupled climate model (Fall’06). • NCEP Ocean Wave models • NCEP Sea Ice Models • NWS Analysis of Record Real-time Mesoscale Analysis (RTMA) downscaled RUC to 5km (Jan ’07) In situ • NCDC Global Historical Climate Network (GHCN) surface temperature and precipitation anomalies • NCDC Integrated Global Radiosonde Archive (IGRA) upper air reference quality data set (formally CARDS) • NCDC Smith-Reynolds Extended Reconstructed Sea Surface Temperatures (ERSST) climatologies ) NOAA Satellite and Radar (II-III) • NODC AVHRR Pathfinder Sea Surface Temperature (SST) analysis; GOES and Radar in beta Climate Models / Coupled AOGCM • GFDL CM2.0 and CM2.1 Climate Experiments • Paleoclimate Model Intercomparison Project (PMIP)
Real-time Model-to-Model intercomparisons Live Access Server: NASA MAPS minus NCEP GFS 7
NCDC Activities Relevant to SURFA Talk Outline • NCDC & New Activities • Examples: Sea Winds, SST, Ta, Qa, Land-Air • Remote sensing observations for high resolutions and reduce random & sampling errors • In-situ observations for systematic bias corrections • Observational Data for Reanalysis • Inter-operable Data Services – NOMADS (NOAA National Operational Model Archive and Distribution System) • Questions for SURFA Data Archive & Services
SURFA Data Archiving & Service(“Right start is halfway done”!) • Bigger Issues: • Usefulness – users? For what? • Required resources (disks) & Efforts (manpower) • Commitment of the parties (Submission Agreements) • In-situ Datasets: • Tao/Pirata Buoys; WHOI Flux Reference Sites/Buoys; KESS Buoys (PMEL/Japan); NOAA/UNOLS Cruises; VOSclim (at NCDC already – subset? Also, relationship to ICOADS?); Others? • Resolutions? Hourly? Averages or sub-samplings? • Model Datasets: • NCEP? ECMWF? JMA? Others … • Resolutions: 3 or 6-hourly? Spatial resolutions?
SURFA Data Archiving & Service • Data Formats: • (gaussian/spectral to grid?) • Grid Data: GRIB, netCDF, … GRIB2 is preferred; CF convention for metadata • Buoy/Station Data: ??? in netCDF? • VOS/ship Data: ???? • Data Ingest: • through Ingest/Archive Brach; by active or passive ftp • DSI number; one for SURFA project datasets? • Data Services: who are the users? • ftp • NOMADS Web Plotter • http & wget • GDS, TDS • LAS, IDV