140 likes | 208 Views
Metadata Implementation Ted Habermann NOAA National Geophysical Data Center.
E N D
Metadata ImplementationTed HabermannNOAA National Geophysical Data Center i checked my 2002 email archives, and here is what i found out: it appears that the current 3rd generation algorithm was implemented into operations around Oct-Nov 2002 time frame. cannot say more precisely, as all email correspondence i am looking at, talks about this indirectly. (maybe it's what's refered to as the Phase II algorithm.) At the same time, we had implemented quite a few other changes fixing data bugs and formats: view angle problem, increased digitization in all channel's reflectances and AODs, etc. The jump is deemed due to introducing 3rd generation algorithm, which replaced the 2nd generation. The new numbers (~0.08) look more realistic than the previous ones (~0.05 or so). The changes seen in the data is close to the expected effect of this change. The 3rd gen alg takes into account the exact spectral response, whereas the 2nd gen is generic ("one size fits all"). hopefully this settles the issue.. Why? 50% change in global average Documentation: It’s not just discovery...
New Documentation Needs The climate scientists at the centre of a media storm over leaked emails were yesterday cleared of accusations that they fudged their results and silenced critics, but a review found they had failed to be open enough about their work. For skeptics, the 1,000 or so e-mails and documents hacked last year from the Climactic Research Unit of the University of East Anglia (UEA), in England, establish that global warming is a scientific conspiracy.
Designated Communities - Users Data preservation is communicating with the future
Spiral Development / Training Metadata Content Independent of standard Spiral 1: Initial Content Check Back With Data Collectors/ Providers Check Back With Users Standard Guidance / Implementation Spiral 2-N: Scientific Questions New Requirements New Use Cases
Discovery Potential Spirals Understanding Identification Id Title Abstract Resource Date Topic Category Theme Keyword Metadata Contact Science Contact Extent Geospatial Bounding Box Temporal Start/End Vertical Min/Max Place Keywords Acquisition Information Instrument Platform Instrument Keywords Platform Keywords Content Information Attribute Type Attribute Names Attribute Definitions Attribute Units Connection OnlineResource: Name Description Function Application Schema Distribution Distributor Contact Online Resource Distribution Format Data Center Keywords Browse Graphic Text Searches Purpose Extent Description Lineage Statement Project Keywords Quality/Lineage Sources Process Steps Quality Reports / Coverages
Spirals and Rubrics G O A L S Progress Metadata Evaluation for Dataset X Date: 2010/10/24 Each record has a score that can be calculated using a consistent, standard tool
Web Accessible Folders - Populations of Records Web Accessible Folder Web Accessible Folder Web Accessible Folder 25 15 26 14 24 14 14 26 18 18 17 17 17 15 16 14 17 24 17 26 22 25 17 17 17 17 17 16 15 16 26 17 27 17 24 22
Completeness Distributions Machine Generated Records Hand Hewn Records
Hierarchical Organization: Data File +has 0..* + readme + parentDirectory0..* Directory + subdirectory 0..* Platform Sensor Sensor
Hierarchical Organization: Documentation MI_Metadata (from Metadata entity set information) +has 1..* + seriesMetadata 1..* + superset 0..* Multiple Aggregation + composedOf 1..* + subset 0..* DS_DataSet DS_Platform DS_Sensor DS_Series
Multiple Dialects and Connections ISO DIF, FGDC, Data.Gov Documentation Repository ISO 19115, 19115-2, 19119 and extensions netCDF SensorML THREDDS WCS, WMS, WFS, SOS KML