DWD GISC Node Current Status

1. DWD GISC NodeCurrent Status

2. Agenda • Welcome • Current status: Overview based on functional blocks • High Level Architecture • Web Interface • DAR Component • Catalogue systems, Metadata and identified issues • GISC-to-GISC communication • Experience with Blog solution and AFD • Schema for GISC backup scenario • Data Components • MSS, AFD and subscription management • Topics for further collaborations • Q&A

3. High level architecture: Functional blocks Logging, Monitoring and Reporting Authorisation/Authentication services SubscriptionManagement Gray List Container WMO GISC-GISC Interface • Delivery tools • Moving Weather • AFD • controller • Datapool(s) • controller/manager • access adapter • data sources Input Management Receiver External DCPC • Web functions • Frontend • Web services (interfaces) • Web services (core) • Business logic • DAR component • controller/manager • catalogue • editor DAR-Generator/Importer

4. Web functions • Frontend • Web services (interfaces) • Web services (core) • Business logic • DAR component • controller/manager • catalogue • editor HLA: Web Interface (User/Admin/Customer) Logging, Monitoring and Reporting Authorisation/Authentication services SubscriptionManagement Gray List Container WMO GISC-GISC Interface • Delivery tools • Moving Weather • AFD • controller • Datapool(s) • controller/manager • access adapter • data sources Input Management Receiver External DCPC DAR-Generator/Importer

5. HLA: Web Interface (User/Admin/Customer) • WebWerdis • Redesign of WebWerdis • Navigation structure / search functions • Internationalization • Integrate logging framework (necessary for monitoring) • Code clean-up • Integration with Geonetwork • Geonetwork • Customization of GUI

6. SubscriptionManagement Gray List Container • Datapool(s) • controller/manager • access adapter • data sources Receiver • DAR component • controller/manager • catalogue • editor DAR-Generator/Importer High level architecture: Metadata Management Logging, Monitoring and Reporting Authorisation/Authentication services WMO GISC-GISC Interface • Delivery tools • Moving Weather • AFD • controller Input Management External DCPC • Web functions • Frontend • Web services (interfaces) • Web services (core) • Business logic

7. High level architecture: Metadata Management • DAR Catalogue • Did extensively Performance Tests (Geonetwork 2.2, terraCatalog 2.3) • DWD formulated test cases • Contracted external partner for tests • Functional Tests • DAR Generator / Importer • Developed DAR metadata generator (template driven architecture) • External review of DAR metadata • Prototype DAR importer • Issues we identified during our work • Tested DAR catalogues fulfilled most, but not all INSPIRE and WMO requirements • DAR Metadata • Paper with Request for Clarification (JMA, CMA and DWD) • Schematron rules for validating WMO profile would be very helpful

8. High level architecture: Metadata Management • Metadata Harvesting • CMA and DWD did several functional tests with OAI-PMH in 09/09 • Different implementations of OAI-PMH could not harvest each other • Deleted metadata records: different implementations • Standard vanilla implementations modify harvested metadata • Ongoing tests between CMA and DWD • Started January 2010 • Initial tests showed 1 record ~ 1 second  space for improvement • Backup strategy • Exchange of metadata files as products

9. High level architecture: G2G communication Logging, Monitoring and Reporting Authorisation/Authentication services SubscriptionManagement Gray List Container WMO GISC-GISC Interface • Delivery tools • Moving Weather • AFD • controller • Datapool(s) • controller/manager • access adapter • data sources Input Management Receiver External DCPC • Web functions • Frontend • Web services (interfaces) • Web services (core) • Business logic • DAR component • controller/manager • catalogue • editor DAR-Generator/Importer

10. HLA: GISC-to-GISC communication • Collaboration CMA and DWD • Memorandum of Understanding signed end of last year • Two Workshops held • GISC-to-GISC communication tests with CMA • CMA and DWD installed Blog solution and AFD solution • Data sets with appropriated time profile (issue warning during model transfer) • Blog solution • CMA and DWD did several improvements on publishing and polling components • Usage of tar minimize latency of transfer • Necessary to include size of “metadata” (AtomFeed) into calculation of transfer volume • Identified several further improvements like prioritization, AtomFeed handling, logging • JMA has provided a new improved solution in 10/2009 • AFD solution • Average transport time between 4-5 sec during 24hour continuously test, warnings between 3-4 sec • In case of unsecured connection sometimes corrupted data occur

11. HLA: GISC-to-GISC communication backup • Technical specification requires a bilateral agreement from 2 GISC for a backup scenario • CMA and DWD prepared proposal for priorities in DAR metadata • First common draft of dissemination metadata (XML schema) • Need to prove in practice

12. SubscriptionManagement • Delivery tools • Moving Weather • AFD • controller • Datapool(s) • controller/manager • access adapter • data sources High level architecture: Delivery components Logging, Monitoring and Reporting Authorisation/Authentication services Gray List Container WMO GISC-GISC Interface Input Management Receiver External DCPC • Web functions • Frontend • Web services (interfaces) • Web services (core) • Business logic • DAR component • controller/manager • catalogue • editor DAR-Generator/Importer

13. High level architecture: Delivery components • Message Switching System • REST Web-Service to manage and control Moving Weather • First proposal for generic Interface • Integration into WebWerdis (still under work) • AFD • Web-Service to manage and control AFD (in consideration) • Manage AtomFeed (in consideration) • Subscription Management • Controller: time and event triggered management (still under work) • Customization according to GISC-to-GISC backup necessary

14. Q&A