1 / 47

Outline

Validation Plan Presented by Zhaohui Cheng Chris Barnet and Mitch Goldberg Lihang Zhou, Murty Divakarla, Eric Maddy, Xiaozhen Xiong, Jennifer Wei, Antonia Gambacorta, Walter Wolf, Thomas King, Nicholas Nalli, Fengying Sun, Xingpin Liu, Shuang Qiu. Outline. Overview Validation core products

vaughn
Download Presentation

Outline

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Validation PlanPresented byZhaohui ChengChris Barnet and Mitch GoldbergLihang Zhou, Murty Divakarla, Eric Maddy, Xiaozhen Xiong, Jennifer Wei, Antonia Gambacorta, Walter Wolf,Thomas King, Nicholas Nalli,Fengying Sun, Xingpin Liu, Shuang Qiu

  2. Outline • Overview • Validation core products • Cloud-cleared radiances • Temperature and Water vapor • Ozone • Carbon Monoxide • Methane • Carbon Dioxide • Summary

  3. Overview • L2 Products • Cloud-cleared radiances • Temperature • Water Vapor • Ozone • Carbon Monoxide • Methane • Carbon Dioxide • Validation of products versus operational sonde networks • T, Q and O3 • Validation of products versus model outputs • cloud clear radiances • T, Q and O3 • Validation of products versus in-situ campaign experiments • CH4, CO2, O3 and CO

  4. In-situ Campaign Experiments • Experiments we have participated in are: • INTEX-A CO • AEROSE Aerosols, dust • INTEX-B/Milagro CO, CH4, O3 • START O3 in UT/LS • AMMA Aerosols, dust, smoke and o3 • WAVES O3, H2O • NOAA/ESRL/GMD aircraft CH4 and carbon trace gas • AWEX T, H2O • ARM CART Site Exploit scientific collaboration to provide science community to exchange low cost validation

  5. Collaborators • Temperature and water vapor product • Tobin and Susskind • Water vapor product • Fetzer, Gettelman, Rama Varma Raja, Hagan and Whiteman • Ozone product • Irion, Newchurch and Pan • Cloud product • Kahn • CO product • McMillan and Warner • CH4 product • Houweling • CO2 product • Strow, Chahine and Kawa

  6. Cloud-Cleared Radiance(Lihang Zhou) • Validation of cloud- cleared radiance with • Model simulation • RMS requirement: 1K

  7. Cloud-Cleared Radiances

  8. Temperature and Water Vapor • Validation of Temperature and Water vapor products with • Operational radiosonde • Models • Dedicated sondes • RMS requirement • Temperature: 1K for 1km layer • Water Vapor: 15% for 2km layer

  9. Radiosonde stations distributionCollocated Data (N= 82,000)NH (90N-20N) 84% ; Tropics (23N-23S) – 8% SH (20S-90S) – 8%

  10. ALL (Sea/Land/Coastal) Data Temperature and WV RMS Difference RAOB vs. AIRSAVNATOVSFGECMWF

  11. Compare retrieved T vs. Forecast Models(Lihang Zhou) Retrieval - ECMWF First_Guess - ECMWF

  12. Dedicated Sondes (ARM – Atmospheric Radiation and Measurement) SGP (97.5W, 36.6N), TWP (166.9E, 0.5S) , NSA (156.6W,71.3N)

  13. (AntoniaGambacorta) Compared with Dedicated Sondes (T, Q at TWP) Q3 flag accepted cases Total Column precipitable water vapor statistics

  14. Ozone • Validation of Ozone products with • Operational ozonesonde network • In-situ measurements: START (Laura Pan, NCAR) TOMS and Aura/OMI (Bill Irion, JPL) • Precision we want to approach is: 10% http://ozonewatch.gsfc.nasa.gov/

  15. Ozonesonde Station Distribution(Murty Divakarla) ±3 Hrs100 Km Sel: 481 Acc: 360O3 Stns with some some samples: 26O3Stns with zero samples: 9 ±36 Hrs100 Km Sel: 2657 Acc: 2030O3 Stns: 35

  16. Ozone Statistics (RMS & Bias, ALL Stations) RMS BIAS O3SND vs. AIRS Ret. ECMWFAIRS FG , ECWMF vs AIRS Ret.

  17. Ozone Scatter Plots (All Stations Data)Collocations ±0-3 Hrs; 100 Kms Total Ozone AIRS_RET ECMWF AIRS FG O3SND

  18. Stratospheric-Tropospheric Analysis of Regional Transport (START) Experiment • Laura Pan is PI of START Ozone team • Nov. 21 to Dec. 23, 2005, 48 flight hours using NCAR’s new Golfstream V “HAIPER” aircraft. • Ozone measured with NCAR’s UV-abs spectrometer • NOAA NESDIS supported this experiment with real time AIRS L1b & L2 products, including ozone and carbon monoxide. • Jennifer Wei is the NOAA/NESDIS liason to START team. • 3 stratospheric fold events were measured during this campaign • analysis is in process.

  19. Example START comparison for Dec. 7, 2005 (Courtesy of Laura Pan, NCAR)

  20. Carbon Monoxide(Mcmillan et al.) • Validation of CO products with • INTEX-A (Intercontinental chemical Transport Experiment-North America) • Precision we want to approach is: 15% Fire(7/04) CO

  21. INTEX-A The in situ CO profiles from the DC-8 DACOM appear in red along with the closest AIRS CO Retrievals (mean in blue and STD in dash blue) The AIRS first guess CO profiles (black) and In situ convolved with the verticality functions (green). Mean CO verticality function for the closest AIRS retrieval to the location of DC-8 spirals on July 1st.

  22. Of the 17 flights of the NASA DC-8 during INTEX-A, 9 included spiral profiles of the DC-8 that are usable for comparison to AIRS CO retrievals. Convolution of the in situ profiles with AIRS vertically functions demonstrate AIRS 400-500 mb CO retrievals are biased by approximately 8% with a standard deviation slightly less than 5%

  23. July 2004 AIRS Daily Global CO Analysis of NOAA products by Wallace McMillan, Juying Warner, & Michele McCourt Univ. Maryland, Baltimore County (UMBC)

  24. Trajectory models of transport of CO Wallace McMillan, et al, UMBC • NASA Goddard kinematic trajectory model with AVN winds • Initialized at 500mb 1200 UTC 13 July 2004 from fires

  25. AIRS CO and Trajectories 500 mb 700 mb 850 mb

  26. Methane(Xiaozhen Xiong) • Validation of Methane products with • ESRL/GMD (Earth System Research Laboratory/Global Monitoring Division) aircraft • Precision we want to approach is: 20ppb CH4 & Tsurf Wetlands?

  27. Validation (ESRL/GMD data 2003-2004) Aircraft Observatory Tall Tower Network NOAA ESRL/GMD North American Sampling Sites pfa lef car hfm haa rta http://www.cmdl.noaa.gov/ccgg/index.html

  28. AIRS CH4 vs Aircraft Measurement (200, 300, 400, 650 mb ) ESRL/GMD aircraft profiles are the best validation for thermal sounders since they measure a thick atmospheric layer. Collocation ∆R < 200 km ∆t < 24 hour

  29. Carbon Dioxide(Eric Maddy) • Validation of CO2 products with • ESRL/GMD aircraft • Precision we want to approach is: 2ppm CO2 Global Warming

  30. NOAA ESDL/GMD Sites Description • BGI ― Bradgate, Iowa (42.82N, 94.4W) • BNE ― Beaver Crossing, Nebraska (40.8N, 97.18W) • BRM ― Berms, Saskatchewan, Canada (54.34N, 104.99W) • CAR ― Briggsdale, Colorado. (40.37N, 104.3W) • ESP ― Estevan Point, British Columbia, Canada (49.58N, 126.37W) • CMA ― Cape May, New Jersey (38.83N, 74.32W) • DND ― Dahlen, North Dakota (48.14N, 97.99W) • FWI ― Fair Child, Wisconsin (44.66N, 90.96W) • HFM ― Harvard Forest, Massachusetts. (42.54N, 72.17W) • HIL ― Homer, Illinois (40.07N, 87.91W) • HAA ― Molokai Island, Hawaii. (21.23N, 158.95W) • NHA ― Worcester, Massachusetts (40.07N, 87.91W) • OIL ― Oglesby, Illinois (41.28N, 88.94W) • LEF ― Park Falls, Wisconsin. (45.93N, 90.27W) • PFA ― Poker Flat, Alaska. (65.07N, 147.29W) • RTA ― Rarotonga, Cook Islands (21.25S, 159.83W) • RIA ― Rowley, Iowa (42.4N, 91.84W) • THD ― Trinidad Head, California (41.05N, 124.15W)

  31. Aircraft Observatory Tall Tower Network NOAA ESRL/GMD North American Sampling Sites http://www.cmdl.noaa.gov/ccgg/index.html

  32. Comparisons to ESRL/GMD aircraft

  33. Retrieved CO2 vs in-situ data at site ESP (49.58N, 126.37W)

  34. EAQUATE (European AQUA Thermodynamic Experiment) • Dr Jonathan P Taylor is PI of Met office team • Bill Smith is PI of NASA WB57 aircraft • Validate the radiance and L2 product from AIRS • Phase I: took place in Italy and used the Scaled Composites Proteus aircraft as well as a range of ground based remote sensing instruments • Phase II: took place in the UK in September 2004 and used both the Proteus and the FAAMBAE 146 aircrafts based at Cranfield • Plan validation field campaigns for IASI cover the period from 5 months to 15 months after launch • Phase 1: BAe146-301 aircraft operations over open oceans around the UK. ― T, Q, O3, CO and CO2 • Phase 2: BAe146-301 aircraft and IASI-balloon over forests around Kiruna ― T, Q, O3, CO, CO2, CH4 and N2O • Phase 3: (April 14~May 04, 2007) BAe146-301 and NASA WB57 aircraft (NAST-I) over Gulf of Mexico and ARM CART Site Oklahoma ― IASI L2 profiles • Phase 4: BAe146-301 aircraft over open oceans around the UK. ― T, Q, O3, CO, CO2, CH4 and N2O • Phase 5: BAe146-301 aircraft and IASI-balloon over forests around Kiruna― T, Q, O3, CO and CO2

  35. ARM Sites (SGP, TWP and NSA) • For IASI Cal/Val the most important measurements available at the Central Facility are: • Atmospheric profiling (balloon-borne sondes, microwave radiometer and Raman lidar) • Cloud properties (ceilometer, various imagery, 95 GHz cloud radar) • Radiometric measurements (AERI instrument similar to ARIES, sun photometer, shortwave spectrometer (SWS) and instruments covering other wavelengths) • Meteorology (temperature, pressure, wind, humidity)

  36. Water Vapor Validation Experiment – Satellite/Sondes (WAVES) • July 7 – August 10, 2006 centered on the Howard University Research Campus in Beltsville, MD • The goal is acquiring a statistically robust set of summertime measurements of atmospheric water vapor, aerosols and trace gases useful for instrument accuracy assessment as well as AURA/Aqua satellite retrieval assessment. http://ecotronics.com/lidar-misc/WAVES.htm We are working on the validation of the ozone and water vapor with WAVES observations The experiment to validate IASI is scheduled next summer.

  37. Summary • AIRS algorithm’s and core products have had extensive validation. We will do same work for IASI validation. • Murty’s sondes • CH4 & CO2 validation w/ NOAA ESRL • ARM Cart Sites • Continue to work with the collaborators and participate the experiments for IASI L2 products validation. • START • INTEX/Milagro • Ozone and Water Vapor validation with WAVES • EAQUATE

  38. Back-up Slides

  39. National Polar - Orbiting Operational Environmental Satellite System Airborne Sounder Testbed - Interferometer (NAST-I) • The NAST-Interferometer (NAST-I) is a Fourier Transform Spectrometer providing spectrally continuous and very high resolution (i.e., 0.25 cm-1) spectral radiances between 3.5 and 16 microns with very high absolute radiometric accuracy (~ 0.5 K, or better). Thus, NAST-I possesses the same spectral coverage and spectral resolution as the MetOpIASI.

  40. Publications for AIRS validation • Chahine, M.T. et al., 2006. AIRS: improving weather forecasting and providing new data on greenhouse gases. BAMS v.87 p.911-926. • Divakarla, M.G. et al., 2006. Validation of Atmospheric Infrared Sounder temperature and water vapor retrievals with matched radiosonde measurements and forecasts. J. Geophys. Res. v.111 D09S15 • Gettelman, A. et al., 2004. Validation of Aqua satellite data in the upper troposphere and lower stratosphere with in situ aircraft. Geophys. Res. Lett. v.31 • Hagan, D.E. et al., 2004. Validating AIRS upper atmosphere water vapor retrievals using aircraft and balloon in situ measurements. Geophys. Res. Lett. v.31 p.1-4 • Hagan, D.E. and P.J. Minnett 2003. AIRS radiance validation over ocean from sea surface temperature measurements. IEEE Trans. Geosci. Remote Sens. v.41 • Huang, X. and Y.L. Yung 2005. Spatial and spectral variability of the outgoing thermal IR spectra from AIRS: A case study of July 2003. J. Geophys. Res. v.110 • Irion, F.W et al., 2006. Validation of AIRS version 4 ozone columns and profiles. J. Geophys. Res. • Kahn, B.H. et al., 2003. Near micron-sized cirrus cloud particles in high-resolution infrared spectra: an orographic study. Geophys. Res. Lett. v.30 p.1441-1445. • McMillan, W.W. et al., 2006. AIRS views of transport from 12-22 July 2004 Alaskan/Canadian fires: correl. of AIRS CO and MODIS AOD with forward trajectories and comparison of AIRS CO ret's with DC-8 in-situ meas. during INTEX-A/ICARTT. J. Geophys. Res. (preprint). • McMillin, L.M. et al.,2005. Validation of AIRS moisture products using three-way intercomparisons with radiosondes and GPS sensors. 85th AMS IOAS/AOLS.

  41. Publications for AIRS validation • Nalli, N.R. et al., 2006. Ship-based measurements for infrared sensor validation during Aerosol and Ocean Science Expedition 2004. J. Geophys. Res. v.111 • Rama Varma Raja et al., 2006. Comparison of column integrated water vapor measurements from atmospheric Infrared Sounder (AIRS) and surface-based Global Positioning System receivers. 86th AMS IOAS/AOLS • Randel, Q.J. et al. 2006. Deep convective influence on the Asian summer monsoon anticyclone and associated tracer variability observed with Atmospheric Infrared Sounder (AIRS). J. Geophys. Res. v.111 • Susskind, J. et al., 2006. Validation of interannual differences of AIRS monthly mean parameters. J. Geophys. Res. (preprint) • Susskind, J. et al., 2006. Accuracy of geophysical parameters derived from Atmospheric Infrared Sounder/ Advanced Microwave Sounding Unit as a function of fractional cloud cover. J. Geophys. Res. v.111 • Tobin, D.C. et al., 2006. Use of Atmospheric Infrared Sounder high spectral resolution spectra to assess the calibration of Moderate resolution Imaging Spectroradiometer on EOS Aqua. J. Geophys. Res. v.111 • Tobin, D.C. et al., 2006. Atmospheric Radiation Measurement site atmospheric state best estimates for Atmospheric Infrared Sounder temperature and water retrieval validation. J. Geophys. Res. v.111 • Warner, J. et al., 2006. A Comparison of Satellite Tropospheric Carbon Monoxide Measurements from AIRS and MOPITT during INTEX-A. J. Geophys. Res. (preprint). • Whiteman, D.N. et al., 2006. Analysis of Raman lidar and radiosonde measurements from the AWEX-G field campaign and its relation to Aqua validation. J. Geophys. Res. v.111

  42. Example of Diagnostic Tool to Study L2 product for Difficult and Interesting Cases

  43. AIRS CO and Trajectories 500 mb 700 mb 850 mb

  44. An example of things that go wrong with “truth” These 2 sondes were launched 1.5 hours apart from same location.

  45. ALL (Sea/Land/Coastal) Data Temperature and WV RMS DifferenceNSTAT=59,433 N_ECMWF= 12,874 RAOB vs. AIRSAVNATOVSFGECMWF

  46. Compared with Dedicated Sondes (Water Vapor)Tobin et al., 2006 Water Vapor RMS: • ~25% below 500mb, increasing to ~35% at 200mb (SGP) • ~10% below 400mb, increasing to ~20% at 200mb (TWP) Water Vapor BIAS: • ~5% below 400mb, increasing to ~-10% at 300mb (SGP) • ~5% below 400mb, increasing to ~10% at 300mb (TWP) (2002-2004) – within 2 hours from overpass - 120km collocation

  47. Retrieved CH4 vs. in-situ data at site RTA (21.25S, 159.83W)

More Related