170 likes | 325 Views
Status report on the implementation of GISC at CMA. Li Xiang NMIC, CMA 2010.2. Development of GISC service. Metadata generation Metadata Synchronization Metadata search Data subscription Data dissemination Web interfaces.
E N D
Status report on the implementation of GISC at CMA Li Xiang NMIC, CMA 2010.2
Development of GISC service • Metadata generation • Metadata Synchronization • Metadata search • Data subscription • Data dissemination • Web interfaces To support WIS/GISC’s functions and provide the services of DAR, Data request, Data subscription and GTS data ingest to WIS centers and authorized users.
Metadata File Generating GTS Bulletin VolC1 CMA NWP Data CMA Satellite Data VolC1 + CMA TIGGE Data Static Referance Information. Vol A Table B1-B6 from OP for GTS code list. ...... Metadata Information Generating Metadata Basic Info. Metadata Generator Software Template XML File Metadata Generation
Metadata Generation • Auto-generation • - DAR metadata for GTS Bulletin • WMO Volume C1 (Catalogue of Meteorological Bulletins) • - CMA NWP, FY Satellite Data, TIGGE data • Metadata files: 114,495, including the metadata files for • GTS data (Vol C1): 59,175 • CMA NWP + FY satellite data : 1,222 • TIGGE products: 54,098 (10 centers’ products)
Metadata Synchronization (OAI, FTP) Harvest System Provider System • Development environment • Java jdk1.5 • Oracle 10g • OAI framework: • - OAICat • OAIHarvester2 • Web container • Tomcat Metadata synchronization system JMA,DWD … JMA,DWD …
Metadata Synchronization – provider configuration, monitoring
Metadata Synchronization – harvester configuration, monitoring
Metadata Search • Directory navigation • Simple Search (keywords, title, time, …) • Complex Search (geographical location+keywords+…) • SRU service, being implemented based on OCLC’s SRW/SRU open source
Data subscription • Web Interface (subscribe data) • Subscription parser (data order, dissemination metadata) • Service management (queue, monitoring) • Data dissemination (ftp, http, email)
Data dissemination • GTS • protocols: ftp, tcp sockets • other GTS centers • Internet • protocols: ftp, http, email • other centers, end-users
Collaboration with JMA • Implemented the services • Metadata synchronization • OAI-PMH, FTP • Remote data request/reply • Access JMA data from CMA WIS portal • Access CMA data from JMA WIS portal • Web Data Ingest • CMA:bulletin-based interface, TAC->BUFR • JMA: report-based interface • software shared between CMA and JMA • Data Synchronization using blog-based technology
Collaboration with DWD • Metadata • DWD Metadata generator • Dissemination metadata • Contents, XML template • Service backup • CMA Metadata synchronization components: harvester and provider • Data synchronization test (2009.9) • AFD/FTP/SFTP, BLOG/HTTP/HTTPS • test results: AFD has a better performance on making routine data exchange
Collaboration with DWD • Metadata synchronization test (2010.1) • Test beds • CMA: in-house software • DWD: GeoNetwork • Test results • CMA harvesting metadata from DWD provider:12387 metadata in 14940s (1.206s/rec) • DWD harvesting metadata from CMA provider :47326 metadata in 64441s (1.361s/rec) -> more tests planned in March -> analyze performance and make improvement
Collaboration meeting on WIS development • Participants: • CMA, DWD, JMA • WISPO • Discussion on • DAR Metadata • Data Synchronization • Metadata Synchronization • Service Monitoring and Service Backup • Outcomes • test plans for metadata synchronization • the document related to DAR metadata, including metadata file identifier, usage of keywords, usage of ISO element <CI_OnlineResource> for accessing online data and products, and submited it to CBS expert team.
Collaboration with HKO • HKO will operate a DCPC in connection with the World Weather Information Service (WWIS) and Severe Weather Information Centre (SWIC) under the WMO Public Weather Services Programme. • Beijing will be one of its the associated GISC • NMIC, CMA and HKO made discussion on WIS development in Beijing in November, 2009 • DAR metadata • metadata provision • Metadata provision tests • planned in March