150 likes | 250 Views
The CrIMSS EDR Validation with PMRF RAOBs, ECMWF Analysis, and AIRS Retrievals. Murty Divakarla 1 , Eric Maddy 2 , Michael Wilson 1 , Nicholas Nalli 1 , Xiaozhen Xiong 1 , Changyi Tan, Flavio Iturbide-Sanchez 1 , Chris Barnet 2 , and Antonia Gambacorta 1
E N D
The CrIMSS EDR Validation with PMRF RAOBs, ECMWF Analysis, and AIRS Retrievals Murty Divakarla1, Eric Maddy2, Michael Wilson1, Nicholas Nalli1, Xiaozhen Xiong1, Changyi Tan, Flavio Iturbide-Sanchez1, Chris Barnet2, and Antonia Gambacorta1 1IM Systems Group, Inc., 6309 Executive Blvd, Rockville, MD, 20852. 2Science and Technology Corporation, Enterprise Parkway, Hampton, VA 23666. Tony Reale NOAA Center for Satellite Applications and Research (STAR) Andrew Mollner The Aerospace Corporation, El Segundo, CA 90245. Xu Liu3, Susan Kizer4, Degui Gu5, X.L. Ma5, and Denise Hagan5 3NASA Langley Research Center, Hampton, VA 23681. 4Northrop Grumman Aerospace Systems, One Space Park, Redondo Beach, CA 90278. 5Science Systems and Applications, Inc., Hampton, Virginia 23681.
Objective and Data Set Objective: Validate CrIMSS-EDRs with dedicated sondes, ECMWF analysis fields and evaluate against heritage algorithms (Aqua-AIRS) using collocated matches. As a part of CrIMSS EDR validations, the Aerospace Corporation has provided 40 Vaisala RS92 from Pacific Missile Range Facility (PMRF), Barking Sands, Hawaii, in May and September 2012. • Time mis-matches while generating CrIS/ATMS SDR granules has resulted about 36 RAOBs and CrIS/ATMS SDR matches. • CrIMSS EDR Products were generated using MX7.1 off-line emulations. • Lack of ECMWF raw data for certain days reduced the matches to about 30 collocated RAOB/ECMWF and CrIS/ATMS SDR/EDR matches. • Matched Aqua-AIRS V6 retrievals were obtained for these days from JPL/DAAC. Lack of exact Aqua-AIRS V6 matches has reduced this data set to 21 RAOBs/ECMWF, CrIMSS/Aqua-V6 Retrievals • Dedicated RAOBs were down-graded to 100 layer format, and were merged with ECMWF beyond the RAOB pop-up altitude to evaluate CrIMSS EDRs as well as Aqua-AIRS V6 (pbest QC) and Pgood (qc). • Evaluation of CrIMSS EDRs, Aqua-AIRS V6 pbest QC retrievals was carried out with reference to RAOBs, ECMWF
Earlier Presentations of InterestTo this Discussion • Divakarla et al., (2012), Provisional Maturity Assessment of CrIMSS EDRs (On going efforts with NPP-Aqua Matches and Dedicated RAOBs. • Divakarla et al., AIRS Science Team Meeting, November 2012. • ftp://www.star.nesdis.noaa.gov/pub/smcd/spb/nnalli/telecons/2012-10-09/ • Aqua-AIRS Retrievals • AIRS Version 6 uses Neural Network (NN) regression trained with ECMWF as the first guess for the final physical retrieval. • Uses pressure dependent QC for each profile, (1) high thresholds for data assimilation applications (pbest) , (2) loose thresholds for climate applications (pgood). The yield is yield is lower for pbest and the yield higher with pgood. • Validation results of CrIMSS AVTP and AVMP with PMRF dedicated sondes and V6-Pbest. • Divakarla et al., (2012), Implications on using island-based CrIMSS EDR Matches in Validations • ftp://www.star.nesdis.noaa.gov/pub/smcd/spb/nnalli/telecons/2012-12-18/
PMRF-Data Set - AVTP: CrIMSS, AIRS-V6, ECMWF and RAOB MatchesMay 2012 (8 Matches plotted as 0-7), September-2012 (13 Matches plotted as 8-20)CrIMSS Yield: 61%, Aqua-AIRS Yield: 71% (pbest); 100% (pgood)
PMRF-Data Set – AVMP: CrIMSS, AIRS-V6, ECMWF and RAOB MatchesMay 2012 (8 Matches plotted as 0-7), September-2012 (13 Matches plotted as 8-20) CrIMSS Yield: 61%, Aqua-AIRS Yield: 71% (pbest); 100% (pgood)
PMRF-Data Set – AVTP: CrIMSS (IR+MW, MW-only EDRs), RAOBMay 2012 (8 Matches), September-2012 (13 Matches) CrIMSS Yield: 61%
Aerospace RAOB (Kauai, Hawaii)Land Fraction/ATMS TBs 05/15/2012, 05/12/2012(Land fraction impacts MW BTs, and MW-only EDR Product
PMRF-Data Set – AVMP: CrIMSS (IR+MW, MW-only EDRs), RAOBMay 2012 (8 Matches), September-2012 (13 Matches)
PMRF-Data Set – AVTP: AIRS-V6 (PRET, FG, MIT), RAOBMay 2012 (8 Matches), September-2012 (13 Matches) Aqua-AIRS Yield: 71%
PMRF: Aerospace Dedicated RAOB Matches Bias and RMS Difference CrIMSS AVTP, AVMP vs. ECMWF(dashed lines) vs. RAOB (solid lines) NSAMP: 21 Data: May 12-31; September 16-30, 2012For the Current Sample that has AIRS-V6 Matches • Red : for 2nd Stage IR+MW; Blue : 1st Stage MW-only Solid Lines: with reference to RAOB; Dashed Lines with reference to ECMWF
PMRF: Aerospace Dedicated RAOB Matches Bias and RMS Difference AIRS-V6 Pbest AVTP, AVMP vs. ECMWF(dashed lines) vs. RAOB (solid lines) NSAMP: 21 Data: May 12-31; September 16-30, 2012 • Red : PR-pbest; Green: FG-Pbest; Blue: MIT-Pbest • Solid Lines: with reference to RAOB; Dashed Lines with reference to ECMWF
PMRF: Aerospace Dedicated RAOB Matches Bias and RMS Difference CrIMSS, AIRS-V6 Pbest, vs. RAOB. NSAMP: 21 Data: May 12-31; September 16-30, 2012 • CrIMSS (Solid Lines); AIRS-Pbest (Dashed Lines) • CrIMSS IR+MW (Solid Red); AIRS PR (dashed red) • CrIMSS MW-only (Solid Blue); AIRS MIT (dashed blue) • AIRS FG (Dashed Green)
PMRF: Aerospace Dedicated RAOB Matches Bias and RMS Difference AIRS-V6 (from Eric Maddy) • NOAA AIRS-PR Red • NOAA AIRS-MIT (blue) • NOAA AIRS-PR with MIT FG (cyan)
PMRF: Aerospace Dedicated RAOB Matches Bias and RMS Difference AIRS V6 (Eric) • NOAA Aqua-AMSU(MIT) • NASA Aqua-AMSU(MIT) • NASA ECMWF Climatology (MIT-a priori)
Results and Discussion • An evaluation of the CrIMSS operational product (MX7.1) was performed using PMRF-matched dedicated RAOBs, ECMWF and Aqua-AIRS retrieval Products. • These samples are mainly Tropical (22.05N; 159.78W) and appears to be of relatively ‘cloud-free to lower percentage of cloud amounts’. • As seen earlier using Focus-Day data sets, for low cloud amounts, and cloud-free samples the CrIMSS EDR algorithm appears to be very robust and the algorithm performance is very much similar to the AIRS-V6 heritage algorithm. • AVTP and AVMP RMS differences with RAOBs and ECMWF are very similar and the retrievals (CrIMSS as well as AIRS) tend to agree better with ECMWF except for the lowest layer AVMP. • These dedicated RAOB matches are not assimilated into ECMWF assimilation system. Despite that, comparisons with ECMWF reveal that ECMWF analysis fields are robust for an evaluation around data sparse open ocean areas. (Focus Day evaluations were carried out using ECMWF) • The RAOBs match well with the ECMWF indicates that the RAOBs are of good quality. • CrIMSS retrievals are very comparable (and in fact shows better promise mid-to-upper troposphere water vapor) AIRS-V6 pbest EDR retrievals. • The evaluation with dedicated RAOBs and ECMWF analysis fields supports all the results and conclusions discussed using Focus-Day’ CrIMSS EDR evaluations with ECMWF. • Given NUCAPS (CrIS+ATMS) Retrieval matches, they can be incorporated in to this analysis. • The AIRS-V6 pbest is only marginally better than the AIRS-FG (neural network regression operator) used as its first guess solution. • The difference between AST-V6 and the CrIMSS EDR is that the CrIMSS EDR is physical-only and does not incorporate any knowledge of ECMWF with in the retrieval. • Currently looking into (cloud-cleared radiances)-(calc radiances)