1 / 20

Enhanced Dataflow and QC System at .Met.no with Realtime Forecast Deviation Processing

This project focuses on upgrading the Dataflow and QC system at .Met.no with enhanced quality control measures, real-time deviation processing, and improved data aggregation. It involves the implementation of QC1 and QC2 modules, enhancing the HQC functionality, and introducing new quality flags. Additionally, the project aims to include radar information in QC2, collaborate with SMHI Climate Services, and maintain and develop met-stations. The focus is on improving the quality of climate data through enhanced QC tools and support for stations and QC services.

friedel
Download Presentation

Enhanced Dataflow and QC System at .Met.no with Realtime Forecast Deviation Processing

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Met.no Organisation January 2011Dataflow and QC SystemKvalobs Project 2010 per-ove.kjensli@met.no met.no Nov.2010

  2. met.no -2011 Per-Ove Knut Paul Børge Vegard

  3. Dataflow and QC-system at met.no QC0 Station Realtime data ComObs AutoObs NORCOM Realtime Forecast SYNOP KVALOBSDB Near realtime eKlima.no wsKlima.no yr.no KDVHDB

  4. Dataflow and QC-system at met.no QC0 Station Realtime data ComObs AutoObs NORCOM Realtime Forecast DIANA MODELS Deviation and message processing KVALOBSDB KRODB QC1/QC2 HQC DIANA Near realtime eKlima.no wsKlima.no yr.no Nonrealtime data Station QC0 Registration KLIMADB KDVHDB

  5. Kvalitetsstatistikk for september 2009

  6. Kvalitetsstatistikk for september 2009 No flags at aggregated values

  7. Kvalitetsstatistikk for september 2009 Noise in checks or metadata

  8. Kvalitetsstatistikk for september 2009 Do not treat several sensors and levels at one station

  9. Kvalitetsstatistikk september 2009

  10. Kvalitetsstatistikk september 2009 Less noise

  11. Kvalitetsstatistikk september 2009 Less noise HQC - to be stable

  12. Kvalitetsstatistikk september 2009 Less noise HQC - more functionality HQC - to be stable

  13. Kvalitetsstatistikk september 2009 Less noise To be automated by QC2 HQC - more functionality HQC - to be stable

  14. Dataflow and QC-system at met.no QC0 Station Realtime data ComObs AutoObs NORCOM Realtime Forecast KVALOBSDB Near realtime eKlima.no wsKlima.no yr.no KDVHDB

  15. ComObs AutoObs NORCOM Realtime Forecast Deviation and message processing KVALOBSDB KRODB Near realtime eKlima.no wsKlima.no yr.no KDVHDB Kvalobs Project 2010 Enhanced metadata tables and content Complete Test enviroment Some new Quality flags Bugfix BUFR encoder and decoder QC2 in operation Enhanced QC1 to reduce noise Enhanced HQC on Qt4 Enhanced dataflow to DB QAbase handles complex stations ( n sensors, m levels ) Aggregating diurnal values Kvalobs on Lucid Installation packages Quality flags on aggregated values

  16. Possible activities from 2011… • QC2 modules (spatial, statistical,…) • Include radar information in QC2? • QC1 enhancements • Cooperation with SMHI

  17. Climate Services • Quality of climate data - Development of QC2-tools, and support QC1 and HQC

  18. Station and QC Services • Maintain and develop the met-stations • Metadata system (STINFOSYS) • Dataflow from stations to met.no • Quality of observations. Realtime QC, QC1, QC2 and HQC • Deviation processing (KRODB)

  19. Climate Data Warehouse (KDVHDB) • Observations in separate tables depending on measurement frequency: • Minute data (tipping bucket) • Hourly data(AWS) • 3-12 hourly data (MWS) • Diurnal data (Precipitation) • Statistical tabels: • - Updated from observations by event triggers in real time • Diurnal values (main parameters are produced in Kvalobs) • Monthly values • Extreme values

More Related