180 likes | 196 Views
Data Rescue Relevant sections. ET-DARE, ET-CDMS – Joint Session. Bruce Bannerman Australian Bureau of Meteorology e-mail: b.bannerman@bom.gov.au Denis Stuber MeteoFrance e-mail: denis.stuber@meteo.fr Co-Chairs Expert Team – Climate Data Management Systems, Commission for Climatology.
E N D
Data Rescue Relevant sections ET-DARE, ET-CDMS – Joint Session Bruce Bannerman Australian Bureau of Meteorology e-mail: b.bannerman@bom.gov.au Denis Stuber MeteoFrance e-mail: denis.stuber@meteo.fr Co-Chairs Expert Team – Climate Data Management Systems, Commission for Climatology ET-CDMS, Geneva, 04-07 November 2014
CDMS Specifications Document https://googledrive.com/host/0BwdvoC9AeWjUazhkNTdXRXUzOEU/wmo_1131_en.pdf. Defines requirements for Climate Data Management Systems
WMO CDMS specifications a Component approach Each main component is splitted into sub-components Each main component and sub-component are assigned with: • Explanation • Classification : • Required • Recommended • Optional • References (WMO & others)
Data Rescue > Imaging > Document Imaging Recommended • This component supports the functionality required to digitally capture a physical document and store the resultant file and associated discovery metadata, perhaps within the climate database. • Some examples of the types of documents to be digitally captured are: • Scanned paper observation forms • Scanned microfiche/microfilm • Relevant observations metadata documents such as instrument calibration reports • Technical manuals • Site location plans and sections • For more information, see: • Guidelines on Climate Data Rescue (WMO/TD-No. 1210), WCDMP-55 6
Data Rescue > Imaging > Optical Character Recognition Optional • This component provides the functionality required to digitally capture data stored in scanned documents such as hand written and/or typed meteorological observation form 7
Data Rescue > Imaging > Chart Digitization Optional • This component refers to the capacity to digitize data from recording cards such as those used with a Campbell-Stokes sunshine recorder, thermograph, barograph or other meteorological instrument. • The typical functionality required for this component would be to: • Scan a physical recording chart (or card) using the Document imaging component (5.2.1.1). • Analyse the image of the chart. • Extract numeric points from the chart. • Calculate a value for those points. • Store the resultant data in the climate database. 8
Data Rescue > Monitoring> Data Rescue Metric Recommended • This component maintains metrics relating to the capture of historical observations data. These may contain: • Name and brief description of data rescue project • Countries where activity is taking place • Contact person for project • Types of data rescued • Summary and per cent digitized • Summary and per cent scanned • Summary and per cent scanned but not digitized • Summary and per cent undigitized 9
Questions / Discussion Forgotten specifications for Data Rescue in the CDMS Specifications document? • How to work together? • Governance : a Data Rescue policy as a Climatology policy (Security: Data storage, Disaster Recovery)? • Is there any WMO Technical Regulations on Data Rescue?