Data Quality Monitoring and Control (QM / QC)

1. Data Quality Monitoring and Control (QM / QC) Axel HoffConvenor of WMO AMDAR Panel‘sScience and Technical Sub-Group Deutscher Wetterdienst (DWD)German Meteorological ServiceDivision: Measurement Technology, TI 22Frankfurter Strasse 13563067 Offenbach am MainGermany Mexico Regional AMDAR Workshop

2. Which features of the AMDAR data have to be monitored and controlled ? Quality Data transmission (format, validity, ...) Physical features (bias, RMSE, ...) Amount Statistics about frequency in space and time Targeting, optimisation Timeliness Transmission delays Mexico Regional AMDAR Workshop

3. What are the quality requirements ? Interested Party Parameter Airlines AMDAR ATM __ Navigation Data  Position (Precision) ± 30 m X X  Groundspeed Vector ± 2 m/s X  True Heading (Precision) ± 0.1 ° X Air Data  Primary Air Data - Static Pressure ± 1 hPa X X - Total Pressure ± 1 hPa X - Temperature ± 1 K XX - Humidity ± 1 % RH in future ? X  Secondary Air Data - True Airspeed ± 2 m/s X - Wind vector ± 2.5 m/s XX RVSM AMDAR is the freeloader of the air traffic’s requests Mexico Regional AMDAR Workshop

4. What does AMDAR’s Quality Management consist of ? • Real-Time Quality Control • At the measurement stage on board • At the code conversion for GTS • At the assimilation stage for numerical forecast • Quality Evaluation for long-term behaviour • Systematic biases • Trends and drift effects Mexico Regional AMDAR Workshop

5. AMDAR Data Management Mexico Regional AMDAR Workshop

6. Where do we find QM / QC in AMDAR ? • Observing Platform (Aircraft) • Data sampling • Online calculation of the final parameters • Basic QC (plausibility checks) • Transmission to ground Mexico Regional AMDAR Workshop

7. Where do we find QM / QC in AMDAR ? • Communication Service Provider(e.g. ARINC or SITA) • Relay observations to ground network (downlink)(airline or Data Reception and Switching Centre) • Transmit uplink commands to aircraft Mexico Regional AMDAR Workshop

8. Where do we find QM / QC in AMDAR ? • Data Reception and Switching Centre (DRSC) • Real-time QC • Passing the data via GTS to all participating institutions • Reporting to System Manager and QEv Centre Mexico Regional AMDAR Workshop

9. Real-Time QC: Check for transmission errors Check for duplicates Range check Values to be within plausible limits Position and time check in time series from single aircraft Check against reject list of QEv Centre Mexico Regional AMDAR Workshop

10. Where do we find QM / QC in AMDAR ? • Data Assimilation and Numerical Modelling Centre • Assimilation of the AMDAR data • Identify outliers, sensor biases, RMS errors by checking against the model’s “first guess” fields Mexico Regional AMDAR Workshop

11. Where do we find QM / QC in AMDAR ? • Quality Evaluation Centre • Near-real-time checks • Update reject lists • Reporting to System Manager and/or DRSC Mexico Regional AMDAR Workshop

12. Near-Real-Time Check: • If not already done in real-time checks • Transmission errors • Duplicates • Range (values to be within plausible limits) • Consistency in position and time in time series from single aircraft • Timeliness • Identify observing platforms appearing with biases, drifts, scattering phenomena Mexico Regional AMDAR Workshop

13. Where do we find QM / QC in AMDAR ? • System Manager • Manage programme (incl. status reports, etc.) • Manage data optimization and targeting • Initiate QC actions (notify airline of bad data) • Coordination with other AMDAR programmes in the neighbourhood and worldwide Mexico Regional AMDAR Workshop

14. Where do we find QM / QC in AMDAR ? • Airlines • Implement and operate AMDAR functionality modules(on-board software, humidity sensor, ground software) • Support up-link control for external commands • Forward measurement data reports to DRSC • System repair on aircraft reporting erroneous data Mexico Regional AMDAR Workshop

15. Where do we find QM / QC in AMDAR ? • External AMDAR Programme • Insert data on GTS • Disseminate QM reports and statistics Mexico Regional AMDAR Workshop

16. Where do we find QM / QC in AMDAR ? • Monitoring Centres • Publish quality statistics • Provide regular platform reject lists Mexico Regional AMDAR Workshop

17. Where do we find QM / QC in AMDAR ? • AMDAR Panel Technical Coordinator • Coordinate AMDAR management and development within WMO AMDAR Panel • Coordinate quality reporting activity Mexico Regional AMDAR Workshop

18. Where do we find QM / QC in AMDAR ? • Data Archiving Centre • Access all AMDAR GTS data from the DRSC • Eliminate duplicates • Flag data having quality deficits • Archive data in databases • Publish data catalogues Mexico Regional AMDAR Workshop

19. Where do we find QM / QC in AMDAR ? • QC Forum • Provide network for interchange and discussion of data management issues, problems, reports, actions, and initiatives Mexico Regional AMDAR Workshop

20. Exemplary Results from NOAA Observations compared to GSI background (num. model) Mexico Regional AMDAR Workshop

21. Exemplary Results from E-AMDAR Amounts and Timeliness amounts and timeliness, daily trend timeliness, distribution for all E-AMDAR aircraft Mexico Regional AMDAR Workshop

22. Exemplary Results from E-AMDAR Observation minus first guess of HIRLAM Daily trend Temperature Bias distribution for all E-AMDAR aircraft Mexico Regional AMDAR Workshop

23. Exemplary Results from E-AMDAR Mean daily biases in temperature and wind Mexico Regional AMDAR Workshop

24. Exemplary Results from E-AMDAR Identification of outlying aircraft and single events Mexico Regional AMDAR Workshop

25. AMDAR’s quality control gives vital feedback for both • Meteorological Servicesto • sort out erroneous data sources • learn for assimilation strategies • Airlinesto identify aircraft with problems in • pressure measurement (  altitude’s accuracy) • temperature measurement (  engines) • true airspeed / wind (  range calculation) Mexico Regional AMDAR Workshop

26. Questions ? Mexico Regional AMDAR Workshop