1 / 44

evaluation

This study evaluates daily global AOD and Angstrom data for the year 2008 from Aerosol-CCI retrievals and MACC assimilations, comparing to AERONET and MODIS. The scoring concept involves rescaling data, establishing regional scores, and identifying bias and correlation in various regions. The assessment includes total, bias, spatial, and temporal errors, determining overall performance and improvement areas.

lcaudle
Download Presentation

evaluation

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. evaluation aerosol CCI satellite retrievals MACC assimilations Reading 2012

  2. the participants / the task • AATSR F v142 • AATSR O v202/v2q2 • AATSR S v040/v031 • MERIS A v21 • MERIS B v11 • MERIS E 802 • PARASOL v30 • MODIS_aquac5.1 • MODIS_terrac5.1 • SEAWIFS • MISR v31 • FBOV  AOD (MODIS) • FMNG AOD & fine-fr • evaluate for the year 2008 daily global AOD and Angstrom data of • aerosol-CCI retrievals • MACC assimilations • compare to • AERONET / MAN • MODIS (AOD)

  3. the scoring concept • rescale all data to a common 1x1 lat/lon grid • establish 1x1 gridded AERONET daily data) • identify local data pairs (satellite/model test data versus AERONET reference data) • require 10+ days with 10+ sites (spatial test) or 10+ sites with 10+ temporal records (time test) to evaluate bias and correlation in any region • both, a valid spatial score and a valid temporal score, are required for a valid regional score

  4. scoring steps • establish regional scores (1: best, 0: poor) • step1 regional spatial score for each day • (rank) correlation and (rank) bias • step2 regional temporal score for each 1x1 • (rank) correlation and (rank) biast • step3combined regional score • total score = bias * spat.corr * temp.corr • step4combine regional to one global score • ‘single score’ from regional total scores • investigated properties: AOD550, Angstrom

  5. error / bias evaluation • explore • total error = (1 - |score, total|) • bias error = (1 - |score, bias|) • spatial error = (1 - score, space) • temporal error = (1 - score, time) score, total = score, bias * score, space * score, time • bias • general direction ( + > test-data / - < test-data ) • absolute bias (IQ test-data minusIQ reference) • test vs AERONET: AOD, Angstrom • test vs MODIS, terra: AOD

  6. AOD scores vs AERONET global land ocean • MODIS A/T.63 .59 .66 • AATSR S v40 -.60 .63 -.61 • FMNG -.59-.54-.62 • FBOV .57.55.59 • AATSR O v202 -.56 -.56 -.58 • MISR .53 .58 .53 • AATSR F v142 -.52 -.56 -.53 • AATSR S v31 -.48 -.56 -.47 • MERIS ESA 802 .45.48 • MERIS B v11 .42 .35 .46 • SEAWIFS -.41 -.37 -.45 • PARASOL .64 • MERIS A 21 .49 based on a 10+ sample statistics absolute larger score is better +/- sign for overall bias

  7. AOD score detail vs AERONET 10 + events global land ocean • FBOV • total score .57 .55 .59 • seasonal score .83 .82 .84 • bias score .84 .86 .84 • spatial score .82 .77 .84 • FMNG • total score -.59 -.54 -.62 • seasonal score .82 .81 .84 • bias score -.88 -.86 -.91 • spatial score .81 .77 .81

  8. Angstrom scores vs AERONET global land ocean • AATSR S v40 .60 .56 .65 • FBOV .56.55.55 • FMNG .48-.49.48 • AATSR S v31 .52 .47.57 • AATSR F v142 .47.51.47 • AATSR O v202.41 .38 .43 • MISR .38 .43 .37 • MERIS ESA 802 . 38 .34 .37 • PARASOL .44 • MERIS A 21.33 based on a 10+ sample statistics absolute larger score is better +/- sign for overall bias

  9. ANG score detail vs AERONET 10 + events global land ocean • FBOV • total score .56 .55 .55 • seasonal score .82 .80 .82 • bias score .81 .84 .80 • spatial score .84 .83 .85 • FMNG • total score .48 -.49 .48 • seasonal score .73 .73 .72 • bias score .85 -.85 .86 • spatial score .77 .79 .77

  10. assimilation data performance • regional error assessment • vs AERONET AOD • vs MODIS-AOD • vsAERONET Angstrom

  11. ECMWF AOD FBOV (single assim.) FMNG (dual assim.)

  12. FBOV AOD performance • total error • bias • spatial • temporal • bias • tendency • absolute

  13. FMNG AOD performance • total error • bias • spatial • temporal • bias • tendency • absolute

  14. 2ass … minus … 1 ass  improvementdeteriation 

  15. FBOV AOD performance • total error • bias • spatial • temporal • bias • tendency • absolute

  16. FMNG AOD performance • total error • bias • spatial • temporal • bias • tendency • absolute

  17. 2ass … minus … 1 ass  improvementdeteriation 

  18. ECMWF Angstrom FBOV (single assim.) FMNG (dual assim.)

  19. FBOV ANG performance • total error • bias • spatial • temporal • bias • tendency • absolute

  20. FNMG ANG performance • total error • bias • spatial • temporal • bias • tendency • absolute

  21. 2ass … minus … 1 ass  improvementdeteriation 

  22. satellite data performance • regional error assessment • vs AERONET AOD • vs MODIS-AOD

  23. the participants / the task • AATSR F v142 • AATSR O v202/v2q2 • AATSR S v040/v031 • MERIS A v21 • MERIS B v11 • MERIS E 802 • PARASOL v30 • MODIS_aquac5.1 • MODIS_terrac5.1 • SEAWIFS • MISR v31 • evaluate daily global ‘CCI-aerosol’ retrievals • for the entire year 2008 • AOD 550nm • Angstrom (if offered) • versus AERONET / MAN • performance in context of established retrievals

  24. data content AOD year 2008 MODIS TERRA MERIS-ESA ATSR-SU MISR MERIS-BAER ATSR ORAC PARASOL MERIS-ALAMO ATSR ADV

  25. data volume AOD 1/1/2008 ATSR-SU MERIS-ESA MODIS AQUA MODIS TERRA MISR ATSR ORAC MERIS-BAER MERIS-ALAMO PARASOL ATSR ADV

  26. MODIS TERRAAOD performance • total error • bias • spatial • temporal • bias • tendency • albsolute

  27. MODIS AQUAAOD performance • total error • bias • spatial • temporal • bias • tendency • absolute

  28. MISR AOD performance • total error • bias • spatial • temporal • bias • tendency • absolute

  29. POLDER AOD performance • total error • bias • spatial • temporal • bias • tendency • absolute

  30. MERIS ESAAOD performance • total error • bias • spatial • temporal • bias • tendency • absolute

  31. MERISBEARAOD performance • total error • bias • spatial • temporal • bias • tendency • absolute

  32. MERIS ALAMOAOD performance • total error • bias • spatial • temporal • bias • tendency • absolute

  33. AATSR SU40AOD performance • total error • bias • spatial • temporal • bias • tendency • absolute

  34. AATSR SU31AOD performance • total error • bias • spatial • temporal • bias • tendency • absolute

  35. AATSR O202AOD performance • total error • bias • spatial • temporal • bias • tendency • absolute

  36. AATSR O202iqAOD performance • total error • bias • spatial • temporal • bias • tendency • absolute effectively ‘identical to O202

  37. AATSR ADV142AOD performance • total error • bias • spatial • temporal • bias • tendency • absolute

  38. AATSR SU40AOD performance MODIS terra • total error • bias • spatial • temporal • bias • tendency • absolute

  39. AATSR O202AOD performance MODIS terra • total error • bias • spatial • temporal • bias • tendency • absolute

  40. AATSR ADV142AOD performance MODIS terra • total error • bias • spatial • temporal • bias • tendency • absolute

  41. POLDER AOD performance • total error • bias • spatial • temporal • bias • tendency • absolute

  42. MERIS ESAAOD performance • total error • bias • spatial • temporal • bias • tendency • absolute

  43. MERISBEARAOD performance • total error • bias • spatial • temporal • bias • tendency • absolute

  44. MERIS ALAMOAOD performance • total error • bias • spatial • temporal • bias • tendency • absolute

More Related