220 likes | 399 Views
Web Weather Request and Distribution System (WebWerdis (2006/7)) Fechner, Siegfried (siegfried.fechner@dwd.de). Contents: – WebWerdis – What is it? – WebWerdis – Design and components – WebWerdis – Relation to WIS. S. Fechner, DWD, siegfried.fechner@dwd.de 2006, November.
E N D
Web Weather Request and Distribution System (WebWerdis (2006/7)) Fechner, Siegfried (siegfried.fechner@dwd.de) Contents: – WebWerdis – What is it? – WebWerdis – Design and components – WebWerdis – Relation to WIS S. Fechner, DWD, siegfried.fechner@dwd.de 2006, November
WebWerdis (2006/7) – What is it? Web Weather Request and Distribution System, WebWerdis, is a new generation of internet based distribution system. It is one part of redesigned Meteorological Portal of the DWD (start in 2007; preoperativ installation: “http://werdis-cbs.dwd.de/bvbw/bvbwDWD.portal”). Aims: – Accommodation of special usergroups with meteorological data and products (delivery via pull and push/subscription mode) – Harmonisation of the metadata (product, distribution and customer catalogues) of the currently main distribution tools of the DWD (based on on the recommendation of the “CBS INTER-PROGRAMME EXPERT TEAM ON METADATA IMPLEMENTATION“, http://www.wmo.int/web/www/WDM/IPET-MI-II/IPET-MI-II_Final_report.doc) – Unification of the request/response interfaces between the distribution tool and the different datasources as well as production tools of the Deutscher Wetterdienst S. Fechner, DWD, siegfried.fechner@dwd.de 2006, November
WebWerdis (2006/7) – What is it? Technical standards: Programming – Java (jdk 1.4 or 1.5), jakarta struts 1.1, EJB 2.0 – Opensource components: AFD http://www.dwd.de/AFD quartz http://www.opensynphony.com/quartz OGSA-DAI http://ogsadai.org.uk Metadata design – Product and product instance catalogue (WMO-core metadata standard “formal draft version 1.0”; 2005, St. Petersburg) Server – Webfrontend (Bea-Portal, Weblogic 8.1.5) – Web-Business-components (each J2EE-container/server) – OGSA-DAI-gridservice (servlet or J2EE-container/server, e.g. Tomcat or Oracle Applicationserver) – Database (Oracle 9i XML-DB) S. Fechner, DWD, siegfried.fechner@dwd.de 2006, November
WebWerdis (2006/7) – roots of WebWerdis WebWerdis 2001/2 - https://tiofas13.dwd.de/ - without metadata catalogues - hardcoded navigation - GTS-global dataset - DWDSat-products - inflexible structure and products CBS-Prototype 2005 - http://vgisc-2.dwd.de/vgisc/ - WMO-metadata vers. 02 - customised product (timeseries, only pull) - pull and push for routine data (GTS-bulletins and DWDSat-products) S. Fechner, DWD, siegfried.fechner@dwd.de 2006, November
GRID-Service Climate DB Intranet KMA Metadata DB GRID-Service Climate DB Intranet met.no GRID-Service Model DB Climate DB Datapool(s) GRID-Service Climate DB Intranet fmi legend: data flow: metadata flow: internet: intranet: GTS: WebWerdis (2006/7) – Design and components Customer(s) Push-software Webfrontend (DWD-Portal) Web-Business Logic Unidart- Adapter Datapool- Adapter MSS- Adapter „GTS-Customer“ „GTS-Customer“ MSS GTS DWD MSS Internet Intranet DWD S. Fechner, DWD, siegfried.fechner@dwd.de 2006, November
GRID-Service Climate DB Intranet KMA Metadata DB GRID-Service Climate DB Intranet met.no GRID-Service Model DB Climate DB Datapool(s) GRID-Service Climate DB Intranet fmi legend: data flow: metadata flow: internet: intranet: GTS: WebWerdis (2006/7) – Design and components - registered customers: research centres and universities in germany, - access to customised range of products for pull and push (question of data policy), - pull: view, download, email, ftp, - Push (subscription): ftp, email attachment, - access to all product metadata, - single-handed administration of own carts, destination details and subscriptions (only push) Customer(s) Push-software Webfrontend (DWD-Portal) Web-Business Logic Unidart- Adapter Datapool- Adapter MSS- Adapter „GTS-Customer“ „GTS-Customer“ MSS GTS DWD MSS Internet Intranet DWD S. Fechner, DWD, siegfried.fechner@dwd.de 2006, November
GRID-Service Climate DB Intranet KMA Metadata DB GRID-Service Climate DB Intranet met.no GRID-Service Model DB Climate DB Datapool(s) GRID-Service Climate DB Intranet fmi legend: data flow: metadata flow: internet: intranet: GTS: WebWerdis (2006/7) – Design and components Customer(s) Push-software Webfrontend (DWD-Portal) Web-Business Logic „GTS-Customer“: - demonstration of connection to the GTS via push-technology (WebWerdis), - metadata publication of new defined bulletins in the Metadata DB (product description) - routinely generation of bulletins and storing in the datapool, - formulation of subscriptions to transfer these bulletins into the GTS Unidart- Adapter Datapool- Adapter MSS- Adapter „GTS-Customer“ „GTS-Customer“ MSS GTS DWD MSS Internet Intranet DWD S. Fechner, DWD, siegfried.fechner@dwd.de 2006, November
GRID-Service Climate DB Intranet KMA Metadata DB GRID-Service Climate DB Intranet met.no GRID-Service Model DB Climate DB Datapool(s) GRID-Service Climate DB Intranet fmi legend: data flow: metadata flow: internet: intranet: GTS: WebWerdis (2006/7) – Design and components - product, product instance catalogue based on WMO-core standard version 0.2 (WMO-volume A (station catalogue), volume C (GTS-bulletins), DWD-internal metadata (DWDSat- and model description)), - customer catalogue (customer data for authorisation and authentication), - distribution catalogue (carts, destination details, subscriptions), - logging catalogue (custimised production and transfer logging informations) Customer(s) Push-software Webfrontend (DWD-Portal) Web-Business Logic Unidart- Adapter Datapool- Adapter MSS- Adapter „GTS-Customer“ „GTS-Customer“ MSS GTS DWD MSS Internet Intranet DWD S. Fechner, DWD, siegfried.fechner@dwd.de 2006, November
GRID-Service Climate DB Intranet KMA Metadata DB GRID-Service Climate DB Intranet met.no GRID-Service Model DB Climate DB Datapool(s) GRID-Service Climate DB Intranet fmi legend: data flow: metadata flow: internet: intranet: GTS: WebWerdis (2006/7) – Design and components Customer(s) - part of the new DWD-portal (Bea-portal-2006), - secondary version: runnable on each J2EE-conform webcontainer, - customised webfrontend for registrated customer(s) or „free user“ Push-software Webfrontend (DWD-Portal) Web-Business Logic Unidart- Adapter Datapool- Adapter MSS- Adapter „GTS-Customer“ „GTS-Customer“ MSS GTS DWD MSS Internet Intranet DWD S. Fechner, DWD, siegfried.fechner@dwd.de 2006, November
GRID-Service Climate DB Intranet KMA Metadata DB GRID-Service Climate DB Intranet met.no GRID-Service Model DB Climate DB Datapool(s) GRID-Service Climate DB Intranet fmi legend: data flow: metadata flow: internet: intranet: GTS: WebWerdis (2006/7) – Design and components Customer(s) - implementation: sessionbeans (J2EE), - controls the product discovery and selection, - controls the definition and administration of customised carts, destinations and subscriptions (push-distribution), - controls the requests to the MSS-, Datapool- and Unidart-adapters for pull and interprets the adapter responses (show, download or send data via email) Push-software Webfrontend (DWD-Portal) Web-Business Logic Unidart- Adapter Datapool- Adapter MSS- Adapter „GTS-Customer“ „GTS-Customer“ MSS GTS DWD MSS Internet Intranet DWD S. Fechner, DWD, siegfried.fechner@dwd.de 2006, November
GRID-Service Climate DB Intranet KMA Metadata DB GRID-Service Climate DB Intranet met.no GRID-Service Model DB Climate DB Datapool(s) GRID-Service Climate DB Intranet fmi legend: data flow: metadata flow: internet: intranet: GTS: WebWerdis (2006/7) – Design and components - implementation based on: „job scheduling system – quartz “ : http:www.opensynphony.com, „Automatic File Distributor“: http://www.dwd.de/AFD, - generates an activity list, based on incoming subscription list (for the Metadata DB), - controls the time triggered and the event triggered scheduler (schedulers send requests to the adapters), - controls the responses from the MSS-, Datapool- and Unidart-adapters - sends the products to the customers (via ftp or email attachment) Customer(s) Push-software Webfrontend (DWD-Portal) Web-Business Logic Unidart- Adapter Datapool- Adapter MSS- Adapter „GTS-Customer“ „GTS-Customer“ MSS GTS DWD MSS Internet Intranet DWD S. Fechner, DWD, siegfried.fechner@dwd.de 2006, November
WebWerdis (2006/7) – push or subscription-software subscription list as XML-document (Metadata DB) Scheduler-Layer Distribution-Layer Adapter-Layer Unidart- Adapter subscription- directory Activity List Generator customised data via OGSA-DAI-Gridservice Distribution via email ftp … Generation of an acitvity list, based on incoming subscription list MSS- Adapter AFD (Automatic File Distributor – opensource customised bulletins via DWD-MSS Controller (time triggered) Controller (event triggered) based on quartz-software (opensource: http://www.open- synhony.com/ quartz) based on AFD-software (opensource: http://www.dwd.de/ AFD) Datapool- Adapter routine data (GTS-bulletins, other data from global data set and dwd-specifical data … universal Interface (request and response) legend: data flow: metadata flow: S. Fechner, DWD, siegfried.fechner@dwd.de 2006, November
GRID-Service Climate DB Intranet KMA Metadata DB GRID-Service Climate DB Intranet met.no GRID-Service Model DB Climate DB Datapool(s) GRID-Service Climate DB Intranet fmi legend: data flow: metadata flow: internet: intranet: GTS: WebWerdis (2006/7) – Design and components Customer(s) Push-software Webfrontend (DWD-Portal) Web-Business Logic - request routing to the datapool(s), - interpretation of adapter response metadata, - packaging of response data for transfer (push or pull) Unidart- Adapter Datapool- Adapter MSS- Adapter „GTS-Customer“ „GTS-Customer“ MSS GTS DWD MSS Internet Intranet DWD S. Fechner, DWD, siegfried.fechner@dwd.de 2006, November
GRID-Service Climate DB Intranet KMA Metadata DB GRID-Service Climate DB Intranet met.no GRID-Service Model DB Climate DB Datapool(s) GRID-Service Climate DB Intranet fmi legend: data flow: metadata flow: internet: intranet: GTS: WebWerdis (2006/7) – Design and components Customer(s) Push-software Webfrontend (DWD-Portal) Web-Business Logic Unidart- Adapter Datapool- Adapter filebased datapool(s), contents: routine products like: - GTS-standard bulletins - DWDSat -products (satellite images, maps, ...) MSS- Adapter „GTS-Customer“ „GTS-Customer“ MSS GTS DWD MSS Internet Intranet DWD S. Fechner, DWD, siegfried.fechner@dwd.de 2006, November
GRID-Service Climate DB Intranet KMA Metadata DB GRID-Service Climate DB Intranet met.no GRID-Service Model DB Climate DB Datapool(s) GRID-Service Climate DB Intranet fmi legend: data flow: metadata flow: internet: intranet: GTS: WebWerdis (2006/7) – Design and components Customer(s) Push-software Webfrontend (DWD-Portal) Web-Business Logic Unidart- Adapter - formulation of an validated MSS statement, - request routing to the DWD MSS, - interpretation of adapter response metadata, - transfer of response data into files (bulletin-, ascii-text- or other formats), - packaging of response files for transfer (push or pull) Datapool- Adapter MSS- Adapter „GTS-Customer“ „GTS-Customer“ MSS GTS DWD MSS Internet Intranet DWD S. Fechner, DWD, siegfried.fechner@dwd.de 2006, November
GRID-Service Climate DB Intranet KMA Metadata DB GRID-Service Climate DB Intranet met.no GRID-Service Model DB Climate DB Datapool(s) GRID-Service Climate DB Intranet fmi legend: data flow: metadata flow: internet: intranet: GTS: WebWerdis (2006/7) – Design and components Customer(s) Push-software Webfrontend (DWD-Portal) Web-Business Logic Unidart- Adapter Datapool- Adapter - dispatch of incoming routine bulletins (corresponding to WMO volume C) to the datapool(s), - generation of customised bulletins (request from MSS-adapter), - dispatch of customised bulletins back to the MSS-adapter MSS- Adapter „GTS-Customer“ „GTS-Customer“ MSS GTS DWD MSS Internet Intranet DWD S. Fechner, DWD, siegfried.fechner@dwd.de 2006, November
GRID-Service Climate DB Intranet KMA Metadata DB GRID-Service Climate DB Intranet met.no GRID-Service Model DB Climate DB Datapool(s) GRID-Service Climate DB Intranet fmi legend: data flow: metadata flow: internet: intranet: GTS: WebWerdis (2006/7) – Design and components Customer(s) Push-software Webfrontend (DWD-Portal) Web-Business Logic - formulation of an validated UNIDART request statement, - request routing to the GRID-Services, - interpretation of adapter response metadata, - transfer the response data into file(s) (xml-format), - packaging of response files for transfer (push or pull) Unidart- Adapter Datapool- Adapter MSS- Adapter „GTS-Customer“ „GTS-Customer“ MSS GTS DWD MSS Internet Intranet DWD S. Fechner, DWD, siegfried.fechner@dwd.de 2006, November
GRID-Service Climate DB Intranet KMA Metadata DB GRID-Service Climate DB Intranet met.no GRID-Service Model DB Climate DB Datapool(s) GRID-Service Climate DB Intranet fmi legend: data flow: metadata flow: internet: intranet: GTS: WebWerdis (2006/7) – Design and components Customer(s) Push-software Webfrontend (DWD-Portal) Web-Business Logic Unidart- Adapter - OGSA-DAI-gridservice UNIDART-project (DWD, Germany), - part of DWD-Intranet, - connector to climate database and NWP (numerical weather predication) model(s) database (planned), - customised database request Datapool- Adapter MSS- Adapter „GTS-Customer“ „GTS-Customer“ MSS GTS DWD MSS Internet Intranet DWD S. Fechner, DWD, siegfried.fechner@dwd.de 2006, November
GRID-Service Climate DB Intranet KMA Metadata DB GRID-Service Climate DB Intranet met.no GRID-Service Model DB Climate DB Datapool(s) GRID-Service Climate DB Intranet fmi legend: data flow: metadata flow: internet: intranet: GTS: WebWerdis (2006/7) – Design and components - OGSA-DAI-gridservice UNIDART-project (KMI, Republic of Korea), - VPN, certified gridservice, - connector to climate database, - customised database request Customer(s) Push-software Webfrontend (DWD-Portal) Web-Business Logic - OGSA-DAI-gridservice UNIDART-project (met.no, Norway), - certified gridservice, - connector to climate database, - customised database request Unidart- Adapter Datapool- Adapter - OGSA-DAI-gridservice UNIDART-project (fmi, Finland). - certified gridservice, - connector to climate database, - customised database request MSS- Adapter „GTS-Customer“ „GTS-Customer“ MSS GTS DWD MSS Internet Intranet DWD S. Fechner, DWD, siegfried.fechner@dwd.de 2006, November
WebWerdis (2006/7) – Relation to WIS WebWerdis is not a prototype of an GISC or VGISC. The primary aim was the development of a modern internet based request and distribution system as part of the redesigned DWD Meteorological portal. but: – WebWerdis design is geared to the design principles for the WIS data communication structure of the “INTER-COMMISSION COORDINATION GROUP ON THE WMO INFORMATION SYSTEM, THIRD Session” (http://www.wmo.int/web/www/ISS/ICG-WIS-III/Doc3-1(3)WIS-ComStructure.doc) – Metadata structures are be based on the recommendation of the “CBS INTER-PROGRAMME EXPERT TEAM ON METADATA IMPLEMENTATION“, http://www.wmo.int/web/www/WDM/IPET-MI-II/IPET-MI-II_Final_report.doc) – Structure and implementation would be incorporate into future WIS distribution tools (e.g. VGISC/SIMDAT- or UNIDART-project: http://www.ecmwf.int/services/grid/simdat/wiki/do/get/simdat or http://www.dwd.de/UNIDART/) S. Fechner, DWD, siegfried.fechner@dwd.de 2006, November
WebWerdis (2006/7) – Relation to WIS Next planned adjustments: – Extension of the range of data and products (currently range: climatological information from selected stations across Germany, Norway, Finland and the Republic of Korea; Weather messages in accordance with the international exchange of data and a selection of satellite images, of weather forecast charts and of analytic-data) – Redesign of all metadata catalogues to bring them into agreement with the recommendation of the “CBS INTER-PROGRAMME EXPERT TEAM ON METADATA IMPLEMENTATION“, http://www.wmo.int/web/www/WDM/IPET-MI-II/IPET-MI-II_Final_report.doc). Important requirements are: as ISO-19100 documents. – Incorporation of the main components of WebWerdis into the VGISC/SIMDAT project 1. the appropriation of the main catalogues (e.g. WMO Meteorological Bulletins Volume C1 and Volume A) and 2. the redesign of the DWD-internal product and station catalogues S. Fechner, DWD, siegfried.fechner@dwd.de 2006, November
WebWerdis (2006/7) – Relation to WIS S. Fechner, DWD, siegfried.fechner@dwd.de 2006, November