200 likes | 217 Views
Met.no Organisation January 2011 Dataflow and QC System Kvalobs Project 2010. per-ove.kjensli@met.no met.no Nov.2010. met.no -2011. Per-Ove. Knut Paul. Børge Vegard. Dataflow and QC-system at met.no. QC0 Station Realtime data. ComObs AutoObs. NORCOM. Realtime Forecast. SYNOP.
E N D
Met.no Organisation January 2011Dataflow and QC SystemKvalobs Project 2010 per-ove.kjensli@met.no met.no Nov.2010
met.no -2011 Per-Ove Knut Paul Børge Vegard
Dataflow and QC-system at met.no QC0 Station Realtime data ComObs AutoObs NORCOM Realtime Forecast SYNOP KVALOBSDB Near realtime eKlima.no wsKlima.no yr.no KDVHDB
Dataflow and QC-system at met.no QC0 Station Realtime data ComObs AutoObs NORCOM Realtime Forecast DIANA MODELS Deviation and message processing KVALOBSDB KRODB QC1/QC2 HQC DIANA Near realtime eKlima.no wsKlima.no yr.no Nonrealtime data Station QC0 Registration KLIMADB KDVHDB
Kvalitetsstatistikk for september 2009 No flags at aggregated values
Kvalitetsstatistikk for september 2009 Noise in checks or metadata
Kvalitetsstatistikk for september 2009 Do not treat several sensors and levels at one station
Kvalitetsstatistikk september 2009 Less noise
Kvalitetsstatistikk september 2009 Less noise HQC - to be stable
Kvalitetsstatistikk september 2009 Less noise HQC - more functionality HQC - to be stable
Kvalitetsstatistikk september 2009 Less noise To be automated by QC2 HQC - more functionality HQC - to be stable
Dataflow and QC-system at met.no QC0 Station Realtime data ComObs AutoObs NORCOM Realtime Forecast KVALOBSDB Near realtime eKlima.no wsKlima.no yr.no KDVHDB
ComObs AutoObs NORCOM Realtime Forecast Deviation and message processing KVALOBSDB KRODB Near realtime eKlima.no wsKlima.no yr.no KDVHDB Kvalobs Project 2010 Enhanced metadata tables and content Complete Test enviroment Some new Quality flags Bugfix BUFR encoder and decoder QC2 in operation Enhanced QC1 to reduce noise Enhanced HQC on Qt4 Enhanced dataflow to DB QAbase handles complex stations ( n sensors, m levels ) Aggregating diurnal values Kvalobs on Lucid Installation packages Quality flags on aggregated values
Possible activities from 2011… • QC2 modules (spatial, statistical,…) • Include radar information in QC2? • QC1 enhancements • Cooperation with SMHI
Climate Services • Quality of climate data - Development of QC2-tools, and support QC1 and HQC
Station and QC Services • Maintain and develop the met-stations • Metadata system (STINFOSYS) • Dataflow from stations to met.no • Quality of observations. Realtime QC, QC1, QC2 and HQC • Deviation processing (KRODB)
Climate Data Warehouse (KDVHDB) • Observations in separate tables depending on measurement frequency: • Minute data (tipping bucket) • Hourly data(AWS) • 3-12 hourly data (MWS) • Diurnal data (Precipitation) • Statistical tabels: • - Updated from observations by event triggers in real time • Diurnal values (main parameters are produced in Kvalobs) • Monthly values • Extreme values