330 likes | 479 Views
ACSPO – IDPS - NAVO Global Comparison on 23 April 2014 27 April 2014, NCWCP, College Park, MD. Cross-comparison of ACSPO , IDPS , and NAVO VIIRS L2 SSTs using one day of global data Sasha Ignatov, Prasanjit Dash, Yury Kihai, John Stroup – STAR
E N D
ACSPO – IDPS - NAVO Global Comparison on 23 April 201427 April 2014, NCWCP, College Park, MD Cross-comparison of ACSPO, IDPS, and NAVO VIIRS L2 SSTs using one day of global data Sasha Ignatov, Prasanjit Dash, Yury Kihai, John Stroup – STAR Thanks to: John Sapper – OSPO, Xingming Liang, Feng Xu, Boris Petrenko – STAR ACSPO - IDPS - NAVO SST
Comparison Methodology • Compare SST domain & performance of IDPS,ACSPO,NAVO L2 SSTs against two global reference SSTs • L4 SST (Canadian Met Centre CMC0.2 Analysis. Note that VIIRS data are not assimilated in CMC0.2 yet) • in situ SST (QCed drifting buoys in iQuam www.star.nesdis.noaa.gov/sod/sst/iquam/) • Analysis of one representative day of global data • – 23 April 2014 - in SST Quality Monitor (SQUAM) • www.star.nesdis.noaa.gov/sod/sst/squam/ ACSPO - IDPS - NAVO SST
NIGHT Analyses ACSPO - IDPS - NAVO SST
NIGHT: IDPSL2 minus CMC L4 23 April 2014 • Delta close to zero as expected • Cold Spots – Residual Cloud/Aerosol leakages ACSPO - IDPS - NAVO SST
NIGHT: ACSPO L2 minus CMC L4 23 April 2014 • Delta close to zero as expected • Fewer Residual Cloud/Aerosol leakages ACSPO - IDPS - NAVO SST
NIGHT: NAVOL2 minus OSTIA L4 23 April 2014 • Delta close to zero as expected • Retrievals limited to VZA<54° swath ACSPO - IDPS - NAVO SST
NIGHT: IDPSL2 minus CMC L4 23 April 2014 • Shape near Gaussian ACSPO - IDPS - NAVO SST
NIGHT: ACSPO L2 minus CMC L4 23 April 2014 • Shape closer to Gaussian • Close domain, improved performance ACSPO - IDPS - NAVO SST
NIGHT: NAVOL2 minus CMC L4 23 April 2014 • Shape closer to Gaussian • Smaller domain, improved performance ACSPO - IDPS - NAVO SST
NIGHT: IDPSL2 minus in situ SST 23 April 2014 • Delta close to zero as expected • Cold Spots – Residual Cloud/Aerosol leakages ACSPO - IDPS - NAVO SST
NIGHT: ACSPO L2 minus in situ SST 23 April 2014 • Delta close to zero as expected • Fewer Residual Cloud/Aerosol leakages ACSPO - IDPS - NAVO SST
NIGHT: NAVOL2 minus in situ SST 23 April 2014 • Delta close to zero as expected • Fewer Residual Cloud/Aerosol leakages ACSPO - IDPS - NAVO SST
NIGHT: IDPSL2 minus in situ SST 23 April 2014 • Shape close to Gaussian but there is a cold tail – residual cloud • Performance Stats within specs (0.2K Accuracy/0.6K Precision) ACSPO - IDPS - NAVO SST
NIGHT: ACSPO L2 minus in situ SST 23 April 2014 • Shape closer to Gaussian – smaller cold tail • Performance Stats well within specs (0.2K Accuracy/0.6K Precision) ACSPO - IDPS - NAVO SST
NIGHT: NAVOL2 minus in situ SST 23 April 2014 • Shape close to Gaussian – small cold tail • Performance Stats well within specs (0.2K Accuracy/0.6K Precision) ACSPO - IDPS - NAVO SST
Night statistical time series (daily, against drifters) ACSPO - IDPS - NAVO SST
NIGHT 23 April 2014 – Summary ΔT = “VIIRS minus CMC” SST (expected ~0) • IDPS: SST domain is +1% larger than ACSPO, All stats degraded • NAVO: SST domain is factor of ×3 smaller than ACSPO, stats improved ΔT = “VIIRS minus in situ” SST (expected ~0) • IDPS: SST domain is +13% larger than ACSPO, All stats degraded • NAVO: SST domain is factor of ×3 smaller than ACSPO, stats comparable ACSPO - IDPS - NAVO SST
DAY Analyses ACSPO - IDPS - NAVO SST
DAY: IDPSL2 minus CMC L4 23 April 2014 • Delta close to zero as expected • Cold Spots – Residual Cloud/Aerosol leakages ACSPO - IDPS - NAVO SST
DAY: ACSPO L2 minus CMC L4 23 April 2014 • Delta close to zero as expected • Fewer Residual Cloud/Aerosol leakages ACSPO - IDPS - NAVO SST
DAY: NAVOL2 minus CMC L4 23 April 2014 • Delta close to zero as expected • Retrievals limited to VZA<54° swath ACSPO - IDPS - NAVO SST
DAY: IDPSL2 minus CMC L4 23 April 2014 • Shape near Gaussian ACSPO - IDPS - NAVO SST
DAY: ACSPO L2 minus CMC L4 23 April 2014 • Shape closer to Gaussian • Close domain, improved performance ACSPO - IDPS - NAVO SST
DAY: NAVOL2 minus CMC L4 23 April 2014 • Shape closer to Gaussian • Smaller domain, improved performance ACSPO - IDPS - NAVO SST
DAY: IDPSL2 minus in situ SST 23 April 2014 • Delta close to zero as expected • Cold Spots – Residual Cloud/Aerosol leakages ACSPO - IDPS - NAVO SST
DAY: ACSPO L2 minus in situ SST 23 April 2014 • Delta close to zero as expected • Fewer Residual Cloud/Aerosol leakages ACSPO - IDPS - NAVO SST
DAY: NAVOL2 minus in situ SST 23 April 2014 • Delta close to zero as expected • Fewer Residual Cloud/Aerosol leakages ACSPO - IDPS - NAVO SST
DAY: IDPSL2 minus in situ SST 23 April 2014 • Shape close to Gaussian but there is a cold tail – residual cloud • Performance Stats within specs (0.2K Accuracy/0.6K Precision) ACSPO - IDPS - NAVO SST
DAY: ACSPO L2 minus in situ SST 23 April 2014 • Shape closer to Gaussian – smaller cold tail • Performance Stats well within specs (0.2K Accuracy/0.6K Precision) ACSPO - IDPS - NAVO SST
DAY: NAVOL2 minus in situ SST 23 April 2014 • Shape close to Gaussian – small cold tail • Performance Stats well within specs (0.2K Accuracy/0.6K Precision) ACSPO - IDPS - NAVO SST
Day statistical time series (daily, against drifters) ACSPO - IDPS - NAVO SST
DAY 23 April 2014 – Summary ΔT = “VIIRS minus CMC” SST (expected ~0) • IDPS: SST domain is comparable with ACSPO, All stats degraded • NAVO: SST domain is factor of ×3 smaller than ACSPO, stats comparable ΔT = “VIIRS minus in situ” SST (expected ~0) • IDPS: SST domain is +5% larger than ACSPO, All stats degraded • NAVO: SST domain is factor of ×3 smaller than ACSPO, stats improved ACSPO - IDPS - NAVO SST
IDPS–ACSPO– NAVO Summary • SST Domain (both Day and Night) • ACSPO and IDPS retrieval domains are comparable • NAVO: retrieval domain smaller than IDPS/ACSPO (by a factor of ~3). Reasons: 1) Narrow NAVO swath VZA<54°, 2) more conservative cloud mask • Nighttime Performance (wrt. in situ) • NAVO outperforms ACSPO by a narrow margin • Both NAVO/ACSPO outperform IDPS by a wide margin • All three products meet specs (|BIAS|<0.2K; RMSD<0.6K) • Daytime Performance wrt. in situ • NAVO outperforms ACSPO by a narrow-to-moderate margin • NAVO/ACSPO both outperform IDPS by a wider margin • ACSPO and NAVO both meet specs (|BIAS|<0.2K; RMSD<0.6K) • IDPS does not meet specs (RMSD>0.6K) • Future work • Improve ACSPO coverage in dynamic and coastal areas, using pattern recognition techniques, while keeping optimal coverage/performance combination ACSPO - IDPS - NAVO SST