280 likes | 382 Views
JMA's Status Report related to WIS. Tatsuya Noyori JMA ET-WISC 2-5 February 2010. Contents. WIS VPN Pilot Project in RAs II and V Metadata and Catalog Blog software and related technologies. Internet VPN. Internet VPN. WIS VPN Pilot Project in RAs II and V. JMA Operational System.
E N D
JMA's Status Report related to WIS Tatsuya Noyori JMA ET-WISC 2-5 February 2010
Contents • WIS VPN Pilot Project in RAs II and V • Metadata and Catalog • Blog software and related technologies
Internet VPN Internet VPN
WIS VPN Pilot Project in RAs II and V JMA Operational System Cloud-II (RMDCN) RTH Tokyo MPLS (OBS) Frame Relay (BT) Cloud-I • Main purpose is to evaluate the availability of VPN • 17participants in total • Themes in Advanced Phase • NC Application (SATAID) • Data input support DMZ Supercomputer System for NWP Met. Sat. Center DDB SV. Etc. RSMC Data SV. Internet BoM JMA Test System CMA • CMA has implemented Web Input and BUFR Encoding • JMA is evaluating them NAS Other PP Participants VPN Pilot Proj. VPN 100Mbps (Best effort)
Metadata and Catalog Metadata and Catalog
Design of Catalog/Metadata • What human interface do we need for catalog and metadata? • What element do we need in metadata? Let’s learn best practice from existing website.
Example: WDCGG JMA World Data Centre for Greenhouse Gases http://gaw.kishou.go.jp/cgi-bin/wdcgg/catalogue.cgi • Catalog search, Form Search, Map search
WDC (Greenhouse Gasses) • There are a lot of domain-specific elements as metadata, such as parameter and contributor and etc. • The domain-specific elements are used as search key for search functions. Therefore, the use of domain-specific elements are important to search metadata effectively.
Design of Catalog/Metadata learned lesson • Usefulness of multiple search interfaces • Usefulness of domain-specific search terms and interface (e.g. "parameter", "station type" in WDCGG) Do you think we need VolA/VolC-specific features?
Website of Metadata of VolA/VolC http://www.shiken.kishou.go.jp/roller/tokyometadata/ • Catalog search, Map search
Metadata for bulk data like GRIBs http://www.ecmwf.int/products/additional/gts_headers_dcpc_essential.html
Website of Metadata of Volume C and A • The way of writing a file name list of a group in a page enable users to understand the relationship between the files of the group. • Therefore, writing a file name list of a group in a page is important.
Website of Metadata of VolA/VolC http://www.shiken.kishou.go.jp/roller/tokyometadata/ http://akira.inmet.gov.br/roller/brasilmetadata/ Feed Aggregator: http://en.wikipedia.org/wiki/Aggregator
Suggestion for Metadata • Atom is one of metadata. • KML is also one of metadata. • If WMO adopts KML and Atom as one of the metadata, we could easily build the website that I have shown. • So, I would like to suggest that WMO adopts KML and Atom as metadata.
Website using ISO19139 Metadata http://server.shiken.kishou.go.jp/testwar/search.jsp 70,000 metadata that are created per each static data files have been stored. • Full-text search, bounding box search, time range search
Website using ISO19139 Metadata • ISO19139 does not permit domain-specific elements and tabular listing. • So, I am not sure how I can use ISO19139 effectively. • But I will keep studying how we can built useful website on ISO19139.
Blog software and related technologies Blog software and related technologies
Blog software and related technologies • Japan has been investigating blog software and related technologies in cooperation with Brazil and China, since 2008. I have investigated • Notification of priority messages using blog post • File synchronization like podcast
Customization of blog software for test • The blog software has been customized to reply minimized Atom feeds. • The customized blog software has been used for the investigation.
Test Results Notification of priority messages • It was confirmed that the notification of test tsunami warnings generated on a routine schedule was completed within 20 seconds.
Test Results File synchronization • The maximum transfer rate was 9Mbps. • Messages (SYNOP, SHIP, BUOY, TEMP, TEMP SHIP and PILOT) generated on a routine basis were synchronized within 60 seconds. • A product of numerical weather prediction (The total size is 70Mbytes, the number of files is 9116) was synchronized within 150 seconds. • A large file of 100Mbytes was synchronized within 150 seconds.
Conclusion desirable usage scenes • Data providers provide users with data on a near-real-time basis over the Internet. • Data providers provide users with data at intervals over the Internet. • Data providers receive a priority message from the GTS, and then post the priority message to their blog server on the Internet
Suggestion • I would like to suggest using blog technologies in WIS Part B (the Internet)
Suggestion • Timely delivery service can also be implemented by “pull” mechanism using the file synchronization of blog technologies. Therefore, I would like to suggest that the sentence of WIS fundamental services is revised like ”Push or Pull”.
Other test I have done Atom+KML metadata synchronization http://www.shiken.kishou.go.jp/roller/tokyometadata/ http://akira.inmet.gov.br/roller/brasilmetadata/
Other test I have done Decoded Data (HTML 5 Microdata) synchronization http://www.shiken.kishou.go.jp/roller/tokyomicrodata/ http://akira.inmet.gov.br/roller/brasilmicrodata/
Future Plan • Investigate PubSubHubbub protocol • conduct experiment of scalability