250 likes | 402 Views
Sensor Performance Statistics. TAMDAR (and other aircraft) observations are compared with NMC 20km RUC 1-h forecast RUC forecast interpolated in x,y, and log-p to each observation point no TAMDAR data used in NMC RUC No data below 950 mb are included
E N D
Sensor Performance Statistics • TAMDAR (and other aircraft) observations are compared with NMC 20km RUC 1-h forecast • RUC forecast interpolated in x,y, and log-p to each observation point • no TAMDAR data used in NMC RUC • No data below 950 mb are included • We don’t consider the RUC perfect, but it is consistent in space and time, so can reveal some observation errors
Distribution of TAMDAR obs in the vertical 27-March - 9-April, 0030Z-0130Z
Airline Comparison, 27 March - 9 April, in TAMDAR region, daytime only, p > 500 mb Airline --------Temperature ----- ------Wind Speed -------- N RUC-avg Bias Std N RUC-avg Bias Std AA 21188 1.77 -0.04 0.89 21182 12.40 -0.08 2.49 Canada 12636 -0.91 0.35 1.45 12633 14.24 -0.32 4.08 DL 14936 -0.88 0.21 1.21 13592 15.66 0.42 4.01 FX 33373 2.48 -0.09 1.18 33327 13.14 -0.12 3.16 NW 7262 -3.32 0.31 1.17 7262 12.90 0.24 2.79 TAMDAR 85676 1.08 -0.37 5.14 70297 12.49 1.13 4.09 UA 14318 -3.01 0.07 0.98 14318 12.34 0.15 2.48 UP 14829 3.54 0.28 1.18 14829 13.23 -0.04 3.13
Airline Comparison, 27 March - 9 April, in TAMDAR region, daytime only, p > 500 mb, excluding two bad TAMDAR aircraft Airline --------Temperature ----- ------Wind Speed -------- N RUC-avg Bias Std N RUC-avg Bias Std AA 21188 1.77 -0.04 0.89 21182 12.40 -0.08 2.49 Canada 12636 -0.91 0.35 1.45 12633 14.24 -0.32 4.08 DL 14936 -0.88 0.21 1.21 13592 15.66 0.42 4.01 FX 33373 2.48 -0.09 1.18 33327 13.14 -0.12 3.16 NW 7262 -3.32 0.31 1.17 7262 12.90 0.24 2.79 TAMDAR 84999 1.12 -0.14 2.28 70024 12.48 1.13 4.08 UA 14318 -3.01 0.07 0.98 14318 12.34 0.15 2.48 UP 14829 3.54 0.28 1.18 14829 13.23 -0.04 3.13
Airline Comparison, 27 March - 9 April, in TAMDAR region, daytime only, p > 500 mb, excluding six bad TAMDAR (and Canadian--accidentally) aircraft Airline --------Temperature ----- ------Wind Speed -------- N RUC-avg Bias Std N RUC-avg Bias Std AA 21188 1.77 -0.04 0.89 21182 12.40 -0.08 2.49 Canada 12409 -0.95 0.35 1.46 12406 14.21 -0.31 4.07 DL 14936 -0.88 0.21 1.21 13592 15.66 0.42 4.01 FX 33373 2.48 -0.09 1.18 33327 13.14 -0.12 3.16 NW 7262 -3.32 0.31 1.17 7262 12.90 0.24 2.79 TAMDAR 79047 1.17 -0.19 1.28 65048 12.51 1.10 4.03 UA 14318 -3.01 0.07 0.98 14318 12.34 0.15 2.48 UP 14829 3.54 0.28 1.18 14829 13.23 -0.04 3.13
Airline Comparison, 27 March - 9 April, in TAMDAR region, daytime only, p > 500 mb, excluding five TAMDAR aircraft with bad wind speeds (and five Canadian--accidentally) Airline --------Temperature ----- ------Wind Speed -------- N RUC-avg Bias Std N RUC-avg Bias Std AA 21188 1.77 -0.04 0.89 21182 12.40 -0.08 2.49 Canada 11822 -0.97 0.35 1.44 11822 14.27 -0.29 4.08 DL 14936 -0.88 0.21 1.21 13592 15.66 0.42 4.01 FX 33373 2.48 -0.09 1.18 33327 13.14 -0.12 3.16 NW 7262 -3.32 0.31 1.17 7262 12.90 0.24 2.79 TAMDAR 78977 1.13 -0.12 1.71 65101 12.47 1.07 3.97 UA 14318 -3.01 0.07 0.98 14318 12.34 0.15 2.48 UP 14829 3.54 0.28 1.18 14829 13.23 -0.04 3.13
TAMDAR time series (Four-day periods) All TAMDAR aircraft (T and W) Start Date --------Temperature ----- ------Wind Speed -------- N RUC-avg Bias Std N RUC-avg Bias Std 2005-02-18 26057 -10.94 -2.97 16.03 26057 16.02 1.98 5.03 2005-02-22 26440 -11.79 -0.37 2.56 26440 12.85 1.85 3.97 2005-02-26 24912 -12.03 -0.96 7.85 24912 12.72 1.52 4.09 2005-03-02 28479 -11.18 -0.56 4.01 28479 12.37 1.52 4.26 2005-03-06 28140 -10.54 -0.59 1.22 28140 16.91 1.43 4.25 2005-03-10 27603 -12.64 -0.50 1.66 27603 16.47 1.58 4.75 2005-03-14 34569 -11.93 -0.59 1.20 27955 11.19 2.33 6.23 2005-03-18 31266 -8.42 -0.72 7.03 24761 9.63 1.56 4.10 2005-03-22 35380 -5.01 -0.31 2.12 28282 8.53 1.85 4.16 2005-03-26 34760 0.19 -0.04 3.39 28255 10.15 1.39 3.95 2005-03-30 30101 -1.18 -1.04 8.05* 24745 15.14 1.03 4.37 2005-04-03 22110 1.44 -0.05 1.14 18182 13.21 1.28 4.07 2005-04-07 29334 3.48 -0.09 1.28 23698 9.99 1.12 3.84
TAMDAR time series (Four-day periods) All TAMDAR aircraft (T and W) Start Date ---------RH -------------- N RUC-avg Bias Std 2005-02-18 22534 53.57 2.94 21.08 2005-02-22 23246 55.61 3.87 18.33 2005-02-26 20583 55.84 1.86 16.60 2005-03-02 24238 49.85 2.42 16.31 2005-03-06 23665 49.30 2.52 16.75 2005-03-10 23528 54.97 4.91 17.35 2005-03-14 29650 50.26 6.70 15.95 2005-03-18 25934 58.26 3.87 15.52 2005-03-22 29576 59.22 -0.89 14.77 2005-03-26 29413 48.29 -1.73 15.97 2005-03-30 26201 48.76 3.03 15.01 2005-04-03 19188 44.86 -1.05 13.62 2005-04-07 24400 45.44 0.54 14.06
TAMDAR compared with RUC 1h forecast Most of the following plots show: • TAMDAR measurements (x) • RUC 1h forecast (y) • 45° line is perfect agreement
RH: RUC vs TAMDAR, 0030-0130 UTC, 27 March through 9 April (n = 3302)
Temperature: RUC vs TAMDAR, 0030-0130 UTC, 27 March through 9 April. 2 bad aircraft removed (n = 3302)
Temperature bias (ob minus RUC) , 0030-0130 UTC, 27 March through 9 April, with 10 bad T aircraft removed (some outliers remain)
Same data as previous, showing Temperature bias not correlated with Observed Temperature
Temperature bias (ob minus RUC) , 0030-0130 UTC, 27 March through 9 April, with 10 bad T aircraft removed. Ascents and Descents
Wind analysis • It is helpful to divide winds into along-track and cross-track components • The along-track component is similar to the tailwind. Air Speed errors primarily affect this component • The cross-track component is affected by heading errors.
Along-track wind: RUC vs TAMDAR, 0030-0130 UTC, 27 March through 9 April (n = 3302)
Along-track wind: RUC vs non-TAMDAR, p > 500 mb, 0030-0130 UTC, 27 March through 9 April (n = 12508)
Along-track wind: RUC vs TAMDAR and non-TAMDAR, p > 500 mb, 0030-0130 UTC, 27 March - 9 April
Cross-track wind: RUC vs TAMDAR, 0030-0130 UTC, 27 March through 9 April (n = 3302)
Cross-track wind: RUC vs TAMDAR andnon-TAMDAR, 0030-0130 UTC, 27 March - 9 April
Wind Speed RUC vs TAMDAR, 0030-0130 UTC, 27 March through 9 April
Wind Speed RUC vs TAMDAR and non-TAMDAR, 0030-0130 UTC, 27 March through 9 April