100 likes | 125 Views
Euclid ST Status : Data Model & EMA mockup Maurice Poncet (CNES) on behalf of EC SGS System Team. System Team. System Team main work packages are : Architecture & Performance Monitoring & Control Processing & Data distribution orchestration Data Model (J.M. Delouis) EMA (O.R. Williams)
E N D
Euclid ST Status : Data Model & EMA mockup Maurice Poncet (CNES) on behalf of EC SGS System Team
System Team System Team main work packages are : Architecture & Performance Monitoring & Control Processing & Data distribution orchestration Data Model (J.M. Delouis) EMA (O.R. Williams) Data Transfers Infrastructure Abstraction Layer (IAL) Common Tools (inc. Collab. Dev. platform)
Data Model Definition of I/F between (or inside) pipelines Defined by OUs pairs (input/output) From textual description to formal description (SWG -> OU -> SDC) Formal description allows for Unambiguous description Automation Validity check Facilitate S/W development and maintenance Configuration management Naming conventions (type, unique id, some semantic info.)
Metadata/Data Distinction between : Metadata (data description) XML files (text !) Structure described by XML Schema Generic information (type, creator, date, location,…) Specific information depending on type Stored at EMA Data Format : FITS files … Stored at SDCs (+ for prototype where storage is available & accessible) Data location (e.g. URL) stored at EMA
Data Model Status First draft release available (dictionary) Formal description basic types (dictionary, should be in line with system product tree) Interfaces (TBD based on dictionary) Configuration management under SVN (RSSD) Model tree (one custodian per leaf) Release, Work, Archive CCB (Change Control Board) One delegate per OU/SDC, EMA, PO+ WP Lead Next in September Working groups on hot topics FITS/Data model Catalog description (N. Apostolakos) Instrument Model (E. Jullo) IVOA reuse
CCB members - LE1 / SOC & SDC-FR & SDC-IT (P. Osuna + M. Frailis) - VIS / SDC-FR (C.Grenet) - NIR / SDC-IT (?) - SIR / SDC-IT (L. Paioro) - EXT / SDC-NL (O.R Williams) - EXT / SDC-DE (R. Henderson) - SIM / SDC-ES (C. Neissner) - MER / SDC-IT (J. Koppenhoefer) - SPE / SDC-FR (J.C Meunier) - SHE / SDC-GB (R. Collins) - PHZ / SDC-CH (P. Dubath) - LE3 / SDC-FR (No One) - EMA (A. Belikov) - PO:CM (O. Mansutti) - DM-WP (J.M. Delouis)
EMA Mock Up Status EMA mock up available in September Main functions : Ingestion of metadata Browser Query interface Location of data (either SDC, or lab, …)
For SIM prototypes Contribute to the data model Textual description Formal description (one custodian per OU/SDC pair) Register the products Generate metadata for products Submit them to EMA mockup for ingestion Use the EMA mockup to retrieve data
For more information System Team : Ch. Dabin Data Model : J.M. Delouis EMA Mock Up : A. Belikov System Team on Redmine http://euclid.roe.ac.uk/projects/sgsst Data model under SVN http://euclid.esac.esa.int/svn/EC/SGS/ST/4-2-05-DM/schema