1 / 16

METAFOR: WP 6: CIM Creation Tools

METAFOR: WP 6: CIM Creation Tools. WP6 - CIM Creation Tools, Metadata. Metadata sources community: ESG Publisher database CMIP5 questionnaire local: modelling environment (e.g. ESMF, IMDI) legacy datamangement (e.g. CERA) human Metadata capture methods

fergal
Download Presentation

METAFOR: WP 6: CIM Creation Tools

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. METAFOR:WP 6: CIM Creation Tools M. Lautenschlager, H. Ramthun 1 Metafor Review 5 / 2010

  2. WP6 - CIM Creation Tools, Metadata • Metadata sources • community: • ESG Publisher database • CMIP5 questionnaire • local: • modelling environment (e.g. ESMF, IMDI) • legacy datamangement (e.g. CERA) • human • Metadata capture methods • access to legacy databases (e.g. ESG Publisher) • XML output of CMIP5 questionnaire • GeoNetwork (view and edit) M. Lautenschlager, H. Ramthun 2 Metafor Review 5 / 2010

  3. WP6 - CIM Metadata • Activity: • dataProcessing * from CMIP5 questionnaire • ensemble * from ESG Publisher • numericalExperiment • simulationComposite * • simulationRun * • Software: • deployment* • modelComponent* • processorComponent • Data: • dataObject * * • Grid: • gridSpec • CIM objects: • CIMRecordSet (some objects of the list) • CIMRecord (one object of the list) M. Lautenschlager, H. Ramthun 3 Metafor Review 5 / 2010

  4. WP6 - Metadata data flow ESG Gateway ESG publisher ESG Data Node model environment datamanagement human CIM ingestion API Database /THREDDS API Questionnaire Metadata Capture Intermediate CIM XML CIM dataObject CIM Model / SIM CIM population Completion / Repository for Metafor / IS-ENES / ESG M. Lautenschlager, H. Ramthun 4 Metafor Review 5 / 2010

  5. WP6 - CIM XML Architecture Intermediate CIM XML Metadata sources GUI for interactive CIM completion CIM complete? NO GeoNetwork (DKRZ/MPI) Create/Update CIM instances YES CIM correct? NO YES CIM XML (instance) - provided on OAI server - transfer with FTP/Atom CIM repository M. Lautenschlager, H. Ramthun 5 Metafor Review 5 / 2010

  6. WP6 - CIM world(detailed metadata flow) Metadata Database data files (archive) GUI ESG (RDF) Metadata Capturing CMIP5 questionnaire rdb access ESG publisher THREDDS CIM world portal Intermediate CIM XML query viewer compare GeoNetwork CIM repository (Central CIM db) M. Lautenschlager, H. Ramthun 6 Metafor Review 5 / 2010

  7. WP6 – THREDDS to CIM data files (archive with CMIP5 structure) CMOR2 model output controlled by esg.ini ESG Publisher Postgres RDBMS THREDDS Catalog <dataObject> … <content> <topic>CF-Topic from ESG database</topic> <unit value=“unit from ESG database"> <server>default controlled vocabulary server</server> </unit> <aggregation>aggregation from ESG database</aggregation> … </content>… </dataObject> Intermediate CIM XML • THREDDS to CIM API • python script • access / transform with lxml • into intermediate CIM XML CIM dataObject template M. Lautenschlager, H. Ramthun 7 Metafor Review 5 / 2010

  8. WP6 – GeoNetwork (features) Technology • Ajax (Asynchronous JavaScript Technology and XML) • http://geonetwork-opensource.org/ Implementation at: http://cera-www.dkrz.de/geonetwork • Advantages • Java + JavaScript capability • simple and advanced search (on Lucene index) • CV implementation by XML / RDF file access • database MySQL, Oracle, postgresSQL • XML handling (with XSLT) • document view types: flat, advanced, XML • schematron rules • OAI server included • multiple schemas • User administration (incl. LDAP and Shibboleth) M. Lautenschlager, H. Ramthun 8 Metafor Review 5 / 2010

  9. WP6 – GeoNetwork (query) Text to be searched in all text fields some text any any M. Lautenschlager, H. Ramthun 9 Metafor Review 5 / 2010

  10. WP6 – GeoNetwork (result) M. Lautenschlager, H. Ramthun 10 Metafor Review 5 / 2010

  11. WP6 – GeoNetwork (example: dataObject) incomplete mandatory field M. Lautenschlager, H. Ramthun 11 Metafor Review 5 / 2010

  12. WP6 – GeoNetwork (example: modelComponent) incomplete mandatory field M. Lautenschlager, H. Ramthun 12 Metafor Review 5 / 2010

  13. WP6 – GeoNetwork (example: simulationRun) incomplete mandatory field M. Lautenschlager, H. Ramthun 13 Metafor Review 5 / 2010

  14. WP6 – GeoNetwork (issues for CIM completion) • performance of XML document loading • implementation of: • complete Metafor CV • helptext (from questionnaire) • Atom support • OpenID support M. Lautenschlager, H. Ramthun 14 Metafor Review 5 / 2010

  15. WP6 - Next steps • GeoNetwork issues: • complete integration of Metafor controlled vocabulary (CV) • complete integration of Metafor helptext • implementation of Atom • implementation of OpenID authentification CIM service: - tool / service to access THREDDS catalog CIM service: - tool / service for upload XML into questionnaire M. Lautenschlager, H. Ramthun 15 Metafor Review 5 / 2010

  16. WP6 – ... Thank You! M. Lautenschlager, H. Ramthun 16 Metafor Review 5 / 2010

More Related