1 / 21

GEM METADATA DEVELOPMENT

Develop EML-compliant metadata documents for GEM datasets using Oracle Database. Learn about EML advantages, metadata elements, dataset module usage, and metadata file generation process.

ewestman
Download Presentation

GEM METADATA DEVELOPMENT

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. GEM METADATA DEVELOPMENT Xiaoping Wang, Macrosearch Allen Macklin, PMEL and Bernard Megrey, AFSC

  2. TOPICS • Introduction about EML metadata standard • GEM metadatabase development • Advantages of Oracle Database

  3. GOAL Generate EML-compliant metadata documents for the datasets that are in the interests of GEM (Gulf of Alaska Ecosystem Monitoring, a program of the Exxon Valdez Oil spill Trustee Council).

  4. WHAT IS EML • Stands for Ecological Metadata Language. • Exists as a set of XML Schema documents. • Allows for the structural expression of metadata elements.

  5. ADVANTAGES OF EML • Includes almost all metadata elements covered by other metadata standards. • Can be used in a modular and extensible manner. • Can be used to describe: - Dataset - Literature - Software - Protocol

  6. USE OF DATASET MODULE • Data table • Spatial raster • Spatial vector • Stored procedure • Other entity

  7. METADATA ELEMENTS(1) General Information • Dataset title, abstract and purpose • Data creator(s), metadata provider(s) and contact information • Keywords • Data maintenance • Data distribution • Geographic/time coverage

  8. METADATA ELEMENTS(2) Research Project Information • Project title and description • Participants and their roles • Funding sources • Study area description • Design description

  9. METADATA ELEMENTS(3) Method Information • Method description • Sampling • Instruments • Software

  10. METADATA ELEMENTS(4) Data Information • Table name and description • Attribute name and definition • Attribute domain code and definition • Data unit • Data precision • Missing value code • Accuracy

  11. METADATABASE DEVELOPMENT(1) Database Table Design • Main table – One row for each dataset • Other tables – One or multiple rows for each dataset. - Keywords - Personnel - Data tables - Table attributes - Attribute domain codes - Instruments.

  12. METADATABASE DEVELOPMENT(2) Integrity Constraints • Primary key – dataset record ID in main table • Foreign key – dataset record ID in other tables • Check constraints – allowed values of EML elements • NOT Null constraints – mandatory EML elements

  13. METADATABASE DEVELOPMENT(3) Stored Procedures • Handle repeated database operations • Input large text files

  14. METADATA FILE GENERATION • Java Program development • Read data from metadatabase • Generate EML-compliant metadata files • Validate metadata files against EML • no XML errors • no EML errors

  15. ORACLE DATABASE • Advantages • Can be used on multiple platforms (Windows, Unix, and Linux…) • Has the best security features • Has the highest availability and reliability • Has a powerful language (PL/SQL) for data query and manipulation • Disadvantage • More expensive

  16. FUNDAMENTAL DATA SECURITY REQUIREMENTS • Confidentiality - users can see only the data that they are supposed to see. • Integrity - data is protected from deletion and corruption. • Availability - data is available to authorized users without delay.

  17. DATA AVAILABILITY(1) Real Application Clusters

  18. DATA AVAILABILITY(2) Replication

  19. DATA AVAILABILITY(3) Data Guard

  20. DATA AVAILABILITY(4) Stream

  21. DATA MANAGEMENT • Database management - Data storage • Metadata management - Data documentation • Data availability - Online data share

More Related