Download
1 / 18
180 likes | 201 Views
Detailed specifications for Climate Data Management Systems (CDMS) focusing on data rescue techniques and components for optimal data recovery and storage. Includes recommendations and guidelines for imaging, OCR, chart digitization, and monitoring metrics.
E N D
Data Rescue Relevant sections ET-DARE, ET-CDMS – Joint Session Bruce Bannerman Australian Bureau of Meteorology e-mail: b.bannerman@bom.gov.au Denis Stuber MeteoFrance e-mail: denis.stuber@meteo.fr Co-Chairs Expert Team – Climate Data Management Systems, Commission for Climatology ET-CDMS, Geneva, 04-07 November 2014
CDMS Specifications Document https://googledrive.com/host/0BwdvoC9AeWjUazhkNTdXRXUzOEU/wmo_1131_en.pdf. Defines requirements for Climate Data Management Systems
WMO CDMS specifications a Component approach Each main component is splitted into sub-components Each main component and sub-component are assigned with: • Explanation • Classification : • Required • Recommended • Optional • References (WMO & others)
Data Rescue > Imaging > Document Imaging Recommended • This component supports the functionality required to digitally capture a physical document and store the resultant file and associated discovery metadata, perhaps within the climate database. • Some examples of the types of documents to be digitally captured are: • Scanned paper observation forms • Scanned microfiche/microfilm • Relevant observations metadata documents such as instrument calibration reports • Technical manuals • Site location plans and sections • For more information, see: • Guidelines on Climate Data Rescue (WMO/TD-No. 1210), WCDMP-55 6
Data Rescue > Imaging > Optical Character Recognition Optional • This component provides the functionality required to digitally capture data stored in scanned documents such as hand written and/or typed meteorological observation form 7
Data Rescue > Imaging > Chart Digitization Optional • This component refers to the capacity to digitize data from recording cards such as those used with a Campbell-Stokes sunshine recorder, thermograph, barograph or other meteorological instrument. • The typical functionality required for this component would be to: • Scan a physical recording chart (or card) using the Document imaging component (5.2.1.1). • Analyse the image of the chart. • Extract numeric points from the chart. • Calculate a value for those points. • Store the resultant data in the climate database. 8
Data Rescue > Monitoring> Data Rescue Metric Recommended • This component maintains metrics relating to the capture of historical observations data. These may contain: • Name and brief description of data rescue project • Countries where activity is taking place • Contact person for project • Types of data rescued • Summary and per cent digitized • Summary and per cent scanned • Summary and per cent scanned but not digitized • Summary and per cent undigitized 9
Questions / Discussion Forgotten specifications for Data Rescue in the CDMS Specifications document? • How to work together? • Governance : a Data Rescue policy as a Climatology policy (Security: Data storage, Disaster Recovery)? • Is there any WMO Technical Regulations on Data Rescue?
