430 likes | 648 Views
BEST : final presentation. Frascati, 21st April 2005. BEST : FINAL PRESENTATION CONTENTS. Welcome (A. Ciarlo) DEBAT project short history (A. Ciarlo) Applied standards (CCSDS / ISO) (D. Minguillon) Tools vs. Data life cycle (F. Berriri, J. Ferreira) - Demonstration
E N D
BEST : final presentation Frascati, 21st April 2005
BEST : FINAL PRESENTATION CONTENTS • Welcome (A. Ciarlo) • DEBAT project short history (A. Ciarlo) • Applied standards (CCSDS / ISO) (D. Minguillon) • Tools vs. Data life cycle (F. Berriri, J. Ferreira) - Demonstration • XML improvements (D. Minguillon) – Demonstration • Success story (D.Minguillon) • Near future (A. Ciarlo, D.Minguillon) • Contacts • Conclusion (A. Ciarlo)
Applied standards • EAST (Enhanced Ada subset) • The data description language EAST specification • CCSDS recommendation CCSDS 644.0-B-2 (nov 2002) • ISO standard ISO 15889:2003 • Used to describe data structure on its medium • Not to be mastered thanks to the description tool • Makes I/O software easy to maintain thanks to the EAST I/O library • EAST V3 Standard will include DEBAT evolutions
Applied standards (2) • DEDSL • Data Entity Dictionary Specification Language • XML/DTD Syntax • CCSDS recommendation CCSDS 647.3-B-1(jan 2002) • Used to describe data semantics • Each data field or type is described through attributes (standard ones or user purpose ones) • Based on XML syntax • Produced by the same description tool than EAST
Applied standards (3) • Tools before DEBAT project User application Write Read EAST description OASIS V4 or previous EAST I/O library Read/Write DEDSL description DATA ICD Document Editor
The data life cycle can be summarised as: Modelling : syntactic and semantic data description Generating / Simulating : data generation for test or validation Processing : editing, checking, extracting … Post processing : data transformation Distribution : CDROM, Internet… Data life cycle
Data Processed Data Generating/ Simulating Post Processing Modelling Distribution Processing Model Data life cycle
BEST • BEST framework offers a direct access to the tools. • Easy way to add plug-ins sharing models and data. • Project managing facilities.
Data Processed Data Generating/ Simulating Post Processing Distribution Processing Modelling Modelling Model
OASIS Modeller • Modelling of data through a performing graphical user interface. • A XML internal format. • Several output formats : • EAST, • DEDSL (PVL and XML), • XML schemas, • RTF, PDF and HTML documentation. • Library concept available
Menu Type Librairies Tree-View of the Model Internal Types of the Model Syntactic and Semantic Information about the selected Element Internal Constants of the Model OASIS Modeller
OASIS Modeller • Demonstration • Modelling from scratch, using a documentation of CRYOSAT. • Finishing a model : making some fields optional. • File generation : EAST and DEDSL-XML.
Processed Data Generating/ Simulating Post Processing Modelling Distribution Processing Model Generating & Simulating Data
DPE (Data Producer & Editor) • Displaying the tree-view of the Model • Generation of Data according to a Model : • Custom generation : default value, degraded value, computed value and random value. • Modification of an existing Data • Displaying the Data : • Navigation through the Data • Search for particular elements
Values of the selected element Tree-View of the Model Formula Editor Generation directive DPE (Data Producer & Editor)
DPE (Data Producer & Editor) • Demonstration : • Opening existing data product • Generating from scratch a new data product
Data Processed Data Generating/ Simulating Post Processing Modelling Distribution Processing Model Processing
DEQ (Data Extractor & Querying) • Displaying the tree-view of the Model • Displaying the Data : • Navigation through the Data • Search for particular elements • Extraction : • Definition of the extraction made thanks to a wizard • Storage of the extracted Data • Batch processing
Same display as the DPE Definition of the Query DEQ (Data Extractor & Querying)
DEQ (Data Extractor & Querying) • Demonstration • Opening existing data product • Extracting subset from the edited data product
Utilities • Data Checker : • Checks a Data against a Model. • ASCII Dump : • Generates an ASCII representation of Data with possibility of XML structure. • Comparison Tool : • Compares two versions of a Model and displays the difference in a tree-view.
ASCII Dump • Demonstration • Generating a simple text file • Generating a flat XML file • Generating a hierarchical XML file
Data Generating/ Simulating Post Processing Modelling Distribution Processing Model Post Processing Processed Data
PPT (Post Processing Tools) • XML Tagging • Generates a XML file from any Data • Quick Look • Smart presentation of extracted Data • Visu2d • Draws some graphs from Data
Quick Look • Demonstration • Quick visualisation of an image included in the data
Data Processed Data Generating/ Simulating Post Processing Modelling Distribution Processing Model Distribution
Distribution • Packaging : • Creates an archive for diffusion • WEB services : • Model Reading • Data Reading • Data Checking • Data Extraction • XML Tagging
XML improvements • Just before the start of DEBAT project XML became very used • As a data format • As a data description format (DTD or schemas) • The modeller was very suitable to design data (why not XML ones?) • The output were easy to enhance with schema production
XML improvements (2) • CNES had just issued an internal recommendation for XML data ICDs • The PLEIADES project (Earth observation) had just decided to have all its interfaces in XML • So, we decided to enhance the modeller with XML schema production facilities and to take some PLEIADES interfaces as use-cases applying the recommendation
XML improvements (3) • 2 additional plug-ins based on XML • ALADIN : XML description comparisons • SCRIBE : XML post processor transforming XML data descriptions into ICDs (Word or HTML) Both are in test in PLEIADES context to produce and compare ICD versions SCRIBE is already operational on Helios project
Success story • The list of project using EAST and DEDSL is now quite long... • SPOT (Earth observation) was the historical first one, describing and checking its metadata with OASIS and EAST Ascii dump tool. • then SSALTO (altimetry) was the first one to use the EAST I/O library in its operational software.
Success story (2) • CDPP (data centre for plasma physics) made the EAST/DEDSL description mandatory accept the data he hosted. Based on these generic descriptions it offers some extraction facilities. • PHARAO (embedded atomic clock) designed all its telemetry with OASIS, then made a simulation for instrument tests purpose with EAST I/O library and produced its documentation with SCRIBE and ALADIN
Success story (3) • Helios II described all its ground segment interfaces with OASIS and used te EAST I/O libraries to read and write the corresponding files. The ICDs are managed with SCRIBE. From that experience we learnt a lot comparing with Helios I... The sub-system integration faced much less problems due to the formal definition of the interfaces. That was the initial goal and it was reached.
Near future • Even if we still propose EAST technology for binary telemetries (most difficult cases of COROT telemetry for instance) we are investing a lot on the XML part of BEST. • Generic XML tools offer an XML grammar but do not support any domain skills. • The modeller could help in designing data and producing the documentation.
Contacts • For any EAST/DEDSL question there is a hot-line at : • eastcnes.fr • To get BEST version 1.0 and related information : • http://debat.c-s.fr • To get the previous versions : • logiciels.cnes.fr