150 likes | 318 Views
CrIS -RAOB Match-Up PGE. March 12, 2013. Algorithm and Data Product. CrIS -RAOB Matchup Software. Software runs on NPP Science Investigator Processing System (NSIPS) Operates autonomously
E N D
CrIS-RAOB Match-Up PGE March 12, 2013 Algorithm and Data Product
CrIS-RAOB Matchup Software • Software runs on NPP Science Investigator Processing System (NSIPS) • Operates autonomously • Generates daily matchup file for radiosondes from the NCEP PrepBUFR, Global Forecast System (GFS) model output and S-NPP satellite products • Original intent to develop CrIS-RaOb-Matchup only (e.g. CrIS, RaOb, GFS). • During development process, expanded capability to matchup up not only with CrISSDR, but also CrIMSS EDR, CrIMSS IP and ATMS REMAP SDR as well
NPP Science Investigator Processing System NSIPS primary function • An offline facility to provide capability to the Cal/Val Team to calibrate the S-NPP sensors, and validate the mission data products with respect to specifications NSIPS primary capabilities • Data acquisition and archive maintenance • Integration of Cal/Val data processing algorithms • Cal/Val specific data production • Cal/Val data product distribution • Operational algorithm change evaluation
1 Planning Server Dispatcher 2 Executive 3 Processing Job 4 5 6 Generate Scripts Stage Inputs Invoke PGE Schedule Ingest of Outputs Job Workspace NSIPS Product Generation Executable (PGE) Flow 2. Dispatcher assigns job to Executive. 1. When inputs are complete, Planning Server notifies Dispatcher to initiate a processing job. 3. Executive creates job workspace, controls step execution. 7
CrIS-RAOB Matchup PGE Legacy • Software originally developed for Aqua EOS AIRS matchups • Code adapted for NSIPS environment by Raytheon (developer G. Kratz) under NPOESS sub-contract with NG • Code matched with AIRS, RAOB, GFS, GOES • Code subsequently adapted by NG to incorporate CrIMSS data (developer A. Foo)
CrIS-RAOB PGE Flow for Daily Matching RAOB XFORM – reformatted radiosonde data RAOB BUFR (PREPBUFR QC) RAOB and GFS reformatting and re-processing operations performed separately in AIRS-RAOB PGE GFS (GRIB2) GFS XFORM – model CrIMSS-RAOB-GFS- Matchup CrIMSS XFORM Binary output file CrIMSS (HDF5) CrIMSS extraction and reformatting operations performed in CrIS PGE and then matched with RAOB & GFS
Radiosonde/Model/CrIS Matching (1/2) • Global radiosondes utilized by NCEP ingest (PREPBUFR files) • <100 km and 4 hours of CrIMSS footprint • select only the closest match in time/space windows • averaging about 600 matches per day • CrIMSS data files produced by IDPS • ATMS Remapped SDR • CrIMSS EDRs, IPs select variables • CrISSDR • TC GEO • NCEP GFS model data interpolated to raob • 1 degree global grid with temp, rh, surface temp and press • 8 forecast files ingested daily (4 0z-03z runs) • QC by NCEP in creation of PREPBUFR files • Short-wave and long-wave radiation correction • Screened according to NMC’s DELETER or “Blacklist file” • QC performed in radiosonde match program • Vertical extent check • Data gap check • Superadiabatic check • Inversion check
Radiosonde/Model/CrIS Matching (2/2) 1. NPP satellite data of no aggregation (Standard size of 4 scans per granule. Data files packaged with GEO data are acceptable) - CrIMSS EDR - CrIMSS EDR GEO (and all relevant satellite viewing angles) - CrIMSS IR AVMP IP - CrIMSS IR AVTP IP - CrIMSS CC RAD IP - CrIMSS IR Surf Emissivity IP - CrIMSS MW Surf Emissivity IP - CrIMSS IR Ozone Profile IP - CrIS SDR - ATMS REMAP SDR - Surface Skin and Air Temp - Quality Flags (profiles) - Sunglint Flag - Clear Flag - NAF - Number clear FOVs - Terrain Height - Surface Type - Land fraction 2. ReformatedRaObs data from existing(installed in NSIPS) PGE RAOB-XFORM.7: - ADPUPA.YYYYMMDDHH 3. Pre-processed GFS data from existing(installed in NSIPS) PGE GFS-XFORM.1: - gfs.pgrbf00.tYYYYMMDDHHMMSS.eYYYYMMDDHHMMSS.sample - gfs.pgrbf03.tYYYYMMDDHHMMSS.eYYYYMMDDHHMMSS.sample 4. Static data files delivered with this tool(originally from AIRS RaObMatchUp Tool): - baseday.radiosondes - radiosonde parameters - base_terrain_map - terrain data - cdb.values.for.uraobs - limit values for use by the unified RaObs - DELTAS - criteria for unreasonable RaObs temperature difference - KIDS.x1 - diagnostic messages file used by code kids.f - retcoefs - regression coefficients
CrIS-RAOB Binary Output File Structure • RAOB-CrIMSS matchup binary data file structure • The first record of 1,1000 bytes is the header • Next record of 1,1000 bytes is data buffer • The first 4000 bytes of the data buffer are for RAOB data • The following 7000 bytes are for CrIMSS data • The data buffer is repeated to the end
Distribution of Ground Stations for CrIS-RAOB PGE Match-ups Distribution corresponding to three successive days Lihong Wang, NGAS
Sample of CrIMSS Focus Day (February 3, 2013) Ground Stations • Select 4 ground stations to compare RAOB data with CrIMSS • (hrs) and (km) are RAOB/CrIMSS time and space differences
Samples of RAOB Significant Level Temperature and CrIMSS AVTP Profile Match-ups (Feb 3, 2013 focus day) Ocean Tropics Land Subtropics RAOB appears anomalous but QC good Land Subtropics Land Tropics Lihong Wang, NGAS
Samples of RAOB Significant Level Moisture and CrIMSS Moisture Profile Match-ups (Feb 3, 2013 focus day) Land Subtropics Ocean Tropics Land Subtropics Land Tropics Lihong Wang, NGAS
Summary • CrIS-RAOB Match-up PGE runs daily at NSIPS • Daily output file log may lag actual date by few days depending on file loading at NSIPS • Multiple CrIMSS products, RAOB and GFS data are extracted, reformatted as needed, matched in time and space, packaged into single binary output file that includes hundreds of variables associated with the primary products