1 / 7

PaNdata ODI Open Data Infrastructure

PaNdata ODI Open Data Infrastructure. INFRA-2011-1.2.2: Data infrastructures for e-Science PaNdata-ODI will develop, deploy and operate an Open Data Infrastructure across the participating facilities with user and data services which support the tracing of provenance of data,

sal
Download Presentation

PaNdata ODI Open Data Infrastructure

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. PaNdata ODIOpen Data Infrastructure INFRA-2011-1.2.2: Data infrastructures for e-Science PaNdata-ODI will develop, deploy and operate an Open Data Infrastructure across the participating facilities with user and data services which support the • tracing of provenance of data, • preservation, and • scalability through parallel access. It will be instantiated through three virtual laboratories supporting • powder diffraction, • small angle scattering and • tomography

  2. Objectives Objective 2 – Users To deploy, operate and evaluate a system for pan-European user identification across the participating facilities and implement common processes for the joint maintenance of that system. Objective 3 – Data To deploy, operate and evaluate a generic catalogue of scientific data across the participating facilities and promote its integration with other catalogues beyond the project. Objective 4 – Provenance To research and develop a conceptual framework, defined as a metadata model, which can record the analysis process, and to provide a software infrastructure which implements that model to record analysis steps hence enabling the tracing of the derivation of analysed data outputs. Objective 5 – Preservation To add to the PaNdata infrastructure extra capabilities oriented towards long-term preservation and to integrate these within selected virtual laboratories of the project to demonstrate benefits. These capabilities should, as for the developments in the provenance JRA, be integrated into the normal scientific lifecycle as far as possible. The conceptual foundations will be the OAIS standard and the NeXus file format. Objective 6 – Scalability To develop a scalable data processing framework, combining parallel filesystems with a parallelized standard data formats (pNexus pHDF5) to permit applications to make most efficient use of dedicated multi-core environments and to permit simultaneous ingest of data from various sources, while maintaining the possibility for real-time data processing. Objective 7 – Demonstration To deploy and operate the services and technology developed in the project in virtual laboratories for three specific techniques providing a set of integrated end-to-end data services.

  3. ERA Open Access Sharing Initiatives (examples, etc) PaNdata ODI (begins end2011) Services PaNdata Support Action (Ends 30 Nov 11) Policies and Standards Users PaNdata ODI Users Data Data Virtual Labs PaNdata ODI (begins end2011) JRAs Policies Powder Diff SAXS & SANS Software Tomography Provenance Integration Preservation Scalability ERA Infrastructure Platform Initiatives (EGI, etc)

  4. Standards from PaNdata Support Action PaNdata ODI Service Releases Rel 1 Rel 2 Rel 3 Rel4 PaNdata ODI Service Activities users uCat data dCat vLabs PaNdata ODI Joint Research Activities s/w Prov Integ Pres Scale

  5. Effort levels Project duration: 30 months

More Related