790 likes | 896 Views
ROSA – ROSSA Validation results. R. Notarpietro, G. Perona, M. Cucca riccardo.notarpietro@polito.it. INPUT DATA. COSMIC Data - COSMIC 1: 75 events ( 10 rising) well distributed in time (2 days for each 06-07 season) and space - COSMIC 2: data related 31/12/2007 ( 1120 events).
E N D
ROSA – ROSSA Validation results R. Notarpietro, G. Perona, M. Cucca riccardo.notarpietro@polito.it
INPUT DATA • COSMIC Data • - COSMIC 1: 75 events (10 rising) well distributed in time (2 days for each 06-07 season) and space - COSMIC 2: data related 31/12/2007 (1120 events) CHAMP Data - 120 setting events related to 22/01/2004 observations:
COSMIC 2: data related 31/12/2007 (> 1200 events) INPUT DATA * These figures are related to data couples compared at different levels after outliers removal R S TOT* 90° 65° North Polar regions 2456 80 65° 35° North Temperate regions 56188 244 35° 35° Tropics 68336 404 35° 65° South Temp. regions 59149 208 1747 64 65° 90° South Polar regions
1 Validation considering Third Level Benchmarks (output of other RO SWs) COSMIC Data CHAMP Data We can quantify differences due to different algorithm implementations (CHAMP Data, COSMIC Data or future ROSA-ROSSA products ARE NOTFirst Level Benchmark) This analysis has been carried out even if it is not an absolute validation of ROSA-ROSSA software CDAAC (COSMIC) ISDC (CHAMP) ROSA-ROSSA
CHAMP Data 22/01/04 1 Orbits Excess phases COSMIC 1/2 Data 2006/2007 Ne(h) Validation considering Third Level Benchmarks (output of other RO SWs) COSMIC 2 Data 31/12/2007 stratosph. optimized (a) iono-free n(h) COSMIC 2 Data 31/12/2007 T(h) Specific humidity (h) pwet(h)
2 Validation considering Second Level Benchmarks (ECMWF Re-analysis) Dati COSMIC 2 31/12/2007 CDAAC (COSMIC) ISDC (CHAMP) ROSA-ROSSA NRSA(h) NCOS(h) TRSA(h) TCOS(h) WVRSA(h) WVCOS(h)
2 Validation considering Second Level Benchmarks (ECMWF Re-analysis) Dati COSMIC 2 31/12/2007 ECMWF Re-analysis spatially and temporally co-located following Tangent Points CDAAC (COSMIC) ISDC (CHAMP) ROSA-ROSSA NRSA(h) NCOS(h) NECM(h) TRSA(h) TCOS(h) TECM(h) WVECM(h) WVRSA(h) WVCOS(h)
2 Validation considering Second Level Benchmarks (ECMWF Re-analysis) Dati COSMIC 2 31/12/2007 ECMWF Re-analysis spatially and temporally co-located following Tangent Points CDAAC (COSMIC) ISDC (CHAMP) ROSA-ROSSA NRSA(h) NCOS(h) NECM(h) TRSA(h) TCOS(h) TECM(h) WVECM(h) WVRSA(h) WVCOS(h)
2 Validation considering Second Level Benchmarks (ECMWF Re-analysis) Dati COSMIC 2 31/12/2007 ECMWF Re-analysis spatially and temporally co-located following Tangent Points CDAAC (COSMIC) ISDC (CHAMP) ROSA-ROSSA NRSA(h) NCOS(h) NECM(h) TRSA(h) TCOS(h) TECM(h) WVECM(h) WVRSA(h) WVCOS(h) Outliers identification and removal and Mean Fractional Error evaluation
Statistic definition mean Outlier Identification through T-Student test ( 3 threshold) and rejection Mean + Std Mean - Std
OPEN PROBLEMS WITH THE FIRST ROSA-ROSSA RELEASE Cosmic Raw Excess-phase profiles filtering
OPEN PROBLEMS WITH THE FIRST ROSA-ROSSA RELEASE Cosmic Raw Excess-phase profiles filtering
OPEN PROBLEMS WITH THE FIRST ROSA-ROSSA RELEASE Cosmic Raw Excess-phases filtering Statospheric Bending optimization (we are actually using CIRA-Q climatology; ROSA-ROSSA VE will adopt data coming from Numerical Weather Prediction Models) Wave Optics techniques for Bending angle extraction in low troposphere (foreseen for ROSA-ROSSA VE). Actually DG_ATMO is validated giving COSMIC data in input. Electron Density profile extraction through ROSA observations is critical given ROSA configuration and observation scheduling
1 CDAAC (COSMIC) Validation considering Third Level Benchmarks (output of other RO SWs) BENDING LEVEL COS(a) RSA(a)
SW ROSA-ROSSA 3.0 VALIDATION VS COSMIC DATA Rising Setting North Pole North Temperate Tropics South Temperate South Pole Number of events
SW ROSA-ROSSA 3.0 VALIDATION VS COSMIC DATA (a) North Pole North Temperate Tropics South Temperate South Pole
SW ROSA-ROSSA 3.0 VALIDATION VS COSMIC DATA (a) North Pole North Temperate Tropics South Temperate South Pole
SW ROSA-ROSSA 3.0 VALIDATION VS COSMIC DATA (a) North Pole North Temperate Tropics South Temperate South Pole
SW ROSA-ROSSA 3.0 VALIDATION VS COSMIC DATA (a) North Pole North Temperate Tropics South Temperate South Pole
1 CDAAC (COSMIC) Validation considering Third Level Benchmarks (output of other RO SWs) REFRACTIVITY LEVEL NCOS(h) NRSA(h)
SW ROSA-ROSSA 3.0 VALIDATION VS COSMIC DATA N(h) North Pole North Temperate Tropics South Temperate South Pole
SW ROSA-ROSSA 3.0 VALIDATION VS COSMIC DATA N(h) North Pole North Temperate Tropics South Temperate South Pole
1 CDAAC (COSMIC) Validation considering Third Level Benchmarks (output of other RO SWs) TEMPERATURE and humidity LEVEL DG_ATMO TCOS(h) TRSA(h) qCOS(h) qRSA(h) eCOS(h) eRSA(h)
DG_ATMO • DG_ATMO is a 1-D VAR scheme developed for retrieving temperature, humidity and pressure (only as dependent variable) for the ROSA observations. • The Background profile is extracted by NCEP long-term mean (365 days) reanalysis. • Simplified version of error covariance matrices
SW ROSA-ROSSA 3.0 VALIDATION VS COSMIC DATA T(h)
SW ROSA-ROSSA 3.0 VALIDATION VS COSMIC DATA e(h)
SW ROSA-ROSSA 3.0 VALIDATION VS COSMIC DATA q(h)
DG_ATMO • Our scheme differs from the COSMIC one. • Formulation of hypotheses to develop the 1D-VAR scheme • Formulation of error covariance matrices • Background fields • Results are not any different!
1 CDAAC (COSMIC) Validation considering Third Level Benchmarks (output of other RO SWs) ELECTRON DENSITY LEVEL DG_DELN NeRSA(h) NeCOS(h)
DG_DELN • The DG_DELN Data Generator evaluates the electron density profile in the ionosphere, using the Onion Peeling algorithm. • Since the ray bending in the ionosphere is small enough, the straight-line propagation from GPS to LEO satellites has been assumed for the GPS signals. • As required by the inversion technique adopted, the spherical symmetry for the electron density of the ionosphere has been assumed. • Excess phase measurements at L1 and L2 GPS frequencies during one occultation event are used to compute the TEC in the shell determined by the LEO orbit (calibrated TEC).
COSMIC DG_DELN SW ROSA-ROSSA 3.0 VALIDATION VS COSMIC DATA Ne(h)
COSMIC DG_DELN SW ROSA-ROSSA 3.0 VALIDATION VS COSMIC DATA Ne(h)
COSMIC DG_DELN SW ROSA-ROSSA 3.0 VALIDATION VS COSMIC DATA
COSMIC DG_DELN SW ROSA-ROSSA 3.0 VALIDATION VS COSMIC DATA
COSMIC DG_DELN SW ROSA-ROSSA 3.0 VALIDATION VS COSMIC DATA Ne(h)
COSMIC DG_DELN SW ROSA-ROSSA 3.0 VALIDATION VS COSMIC DATA Ne(h)
COSMIC DG_DELN SW ROSA-ROSSA 3.0 VALIDATION VS COSMIC DATA Ne(h)
COSMIC DG_DELN SW ROSA-ROSSA 3.0 VALIDATION VS COSMIC DATA Ne(h)
COSMIC DG_DELN SW ROSA-ROSSA 3.0 VALIDATION VS COSMIC DATA Ne(h)
COSMIC DG_DELN SW ROSA-ROSSA 3.0 VALIDATION VS COSMIC DATA Ne(h)
average average +/- st.dev. SW ROSA-ROSSA 3.0 VALIDATION VS COSMIC DATA Ne(h)
2 Validation considering Second Level Benchmarks (ECMWF Re-analysis) REFRACTIVITY LEVEL ECMWF Re-analysis spatially and temporally co-located CDAAC (COSMIC) ROSA-ROSSA NRSA(h) NCOS(h) NECM(h)
SW ROSA-ROSSA 3.0 VALIDATION VS ECMWF RISING RISING North Pole North Temperate Tropics South Temperate South Pole Number of events
50 40 Height [km] 30 25 16 12 10 7 3 0 SW ROSA-ROSSA 3.0 VALIDATION VS ECMWF N(h) RISING North Pole North Temperate Tropics South Temperate South Pole
50 40 Height [km] 30 25 16 12 10 7 3 0 SW ROSA-ROSSA 3.0 VALIDATION VS ECMWF N(h) RISING North Pole North Temperate Tropics South Temperate South Pole
SW ROSA-ROSSA 3.0 VALIDATION VS ECMWF SETTING North Pole North Temperate Tropics South Temperate South Pole Number of events
50 40 Height [km] 30 25 16 12 10 7 3 0 SW ROSA-ROSSA 3.0 VALIDATION VS ECMWF N(h) SETTING North Pole North Temperate Tropics South Temperate South Pole