310 likes | 440 Views
VO-oriented activities of the CDPP. M. Gangloff, E. Budnik, M. Bouchemit C. Jacquey, V. Génot, N. André, B. Cecconi, B. Lavraud. Key points of the CDPP activities : Involvement in SPASE Searchable registries AMDA IVOA connection (OV-France)
E N D
VO-oriented activities of the CDPP M. Gangloff, E. Budnik, M. Bouchemit C. Jacquey, V. Génot, N. André, B. Cecconi, B. Lavraud Key points of the CDPP activities: Involvement in SPASE Searchable registries AMDA IVOA connection (OV-France) Projects under development: EUROPLANET/IDIS Time-Table exchange (CAA , CDPP, QSAS, CL) Project in perspective: HELIO-2 HDMC VxO SPASE 10-12 June 2008
EuroPlaNet • What is EuroPlaNet ? • What is IDIS ? Current status • EuroPlaNet Resource inventory • IDIS Plasma Node Registry Demonstrator • IDIS Plasma Node Science Demonstrator • What is AMDA ? • Access remote data in AMDA • Current status ( data tree as a whole ) • The future ( selected data only) • Lessons learned • Event tables management with AMDA • The future of EuroPlaNet (2009-2012) HDMC VxO SPASE 10-12 June 2008
What is EuroPlaNet ? • A European network for the development of planetary sciences in Europe • Coordinates different activities : • N1-Management • N2-Discipline working group • N3-Coordination of earth-based and space observations • N4-Outreach • N5-Personnel exchanges • N6-Meetings and conferences • N7-Integrated and Distributed Information Service (IDIS) • IDIS will provide a common and user-friendly access to the data and information produced by the various types of research activities • IDIS is the first step towards a European Planetary VO HDMC VxO SPASE 10-12 June 2008
EuroPlaNet IDIS Architecture IDIS TOP NODE europlanet-idis.fi Interiors and Surfaces DLR Berlin Atmospheres IPSL/SA Paris Plasma Sciences IWF Graz CDPP Toulouse Small bodies and Dust INAF-IFSI Rome Other labs Other labs Other labs Other labs Node structure HDMC VxO SPASE 10-12 June 2008
Current status of IDIS • Every node provides a web server with a list of resources • Every node implements a prototype of searchable registry of resources in XML according to the SPASE model • The Plasma Node implements 2 demonstrators : registry and science HDMC VxO SPASE 10-12 June 2008
Plasma Node Registry Demonstrator • Set of XML descriptors of planetary plasma data (MAPSKP, VEX, MEX) • Compliant with the SPASE data model 1.2.1 • eXist database (native XML, parameter level) • Search engine ( measurement type, region) • Goals: demonstration and experimentation HDMC VxO SPASE 10-12 June 2008
Plasma Node Registry Search Engine • Available @ : http://cdpp-spase.cesr.fr:8800/exist-1.1.1/xquery/PlasmaNodeRegistry.xql • Search criteria: • Time span • Measurement type • Observed region • Resource type ( numerical data , display data or catalog) • Response: • Spase Xml descriptor • Possibility to use XSL style sheet to customize presentation HDMC VxO SPASE 10-12 June 2008
Plasma Node registry Interface Possibility to select a measurement type HDMC VxO SPASE 10-12 June 2008
Response is a list of SPASE descriptors HDMC VxO SPASE 10-12 June 2008
Plasma Node Science Demonstrator • Based on the AMDA Service • Access remote data (MAPSKP, Vex-MAG,HST) with a SPASE compatible description HDMC VxO SPASE 10-12 June 2008
AMDA Remote data access Automated Mutiple Dataset Analysis Parameter editor Service available @ http://cdpp-amda.cesr.fr Visualisation • Multi spacecraft and multi-instrument data • Visualisation • User defined parameter computation • Standard model computation • Data and computed parameter extraction • Automated or visual search on the data • AMDA local database (CLUSTER, ACE, THEMIS, GEOTAIL, WIND, …, ISEE) • Access to remote databases (CDAWeb, MAPSKP, THEMIS/CESR, …) Download data Conditional or Visual search Time-Table manager Possible to get a « guest « account for a limited period (one hour) or a permanent login HDMC VxO SPASE 10-12 June 2008
Data access in AMDA Local DB HDMC VxO SPASE 10-12 June 2008
AMDA:externaltree Save parameter to user’s workspace Select data on a remote server HDMC VxO SPASE 10-12 June 2008
Access remote data in AMDA Local DB Spase Compatible Registry GetAvailableData GetDatasetInfo GetDatasetURLs AMDA VEX-MAG (remote) HST (remote) MAPSKP(remote) HDMC VxO SPASE 10-12 June 2008
Plasma Node registry interfaces AMDA Build data tree Build parameters spase descriptor URLs of granules data tree Wget(datasetURLs) getAvailableData getDatasetInfo getDatasetURLs WEB SERVICES XQUERY Registry MapsKP server Spase XML Descriptors describes (data) (metadata) Daily update HDMC VxO SPASE 10-12 June 2008
Plasma Node registry interfaces AMDA Build data tree Build parameters data tree spase descriptor URLs of granules getAvailableData (measurementType= ThermalPlasma) Wget(datasetURLs) getDatasetInfo getDatasetURLs WEB SERVICES XQUERY Registry MapsKP server Spase XML Descriptors describes (data) (metadata) Daily update HDMC VxO SPASE 10-12 June 2008
Lessons learned • The SPASE model may be used for the EuroPlaNet IDIS Plasma Node • Some additions/modifications needed to read data files • Need to update some lists (coordinate systems, regions) HDMC VxO SPASE 10-12 June 2008
Cassini coordinate systems not available in the SPASE lists [KSM, KSO, KG] HDMC VxO SPASE 10-12 June 2008
Use « ParameterKey » to read Elements HDMC VxO SPASE 10-12 June 2008
An example of Data File : Magnetic Field in KG Coordinates Parameter key Field 0 Field 1 Field2 Field3 Field4 Time [UTC] Bx By Bz |B| 2004-182T00:00:58.000 0.897 5.648 -2.254 6.147 2004-182T00:01:58.000 0.954 5.669 -2.222 6.163 2004-182T00:02:58.000 0.897 5.648 -2.254 6.147 2004-182T00:03:58.000 0.897 5.648 -2.254 6.147 HDMC VxO SPASE 10-12 June 2008
An auxiliary XML descriptor is used to describe information needed to access the tabular data in an ASCII file <dataset xml:id="MAG_KG"> <parameter xml:id="VECTOR"> <data_type>FLOAT</data_type> </parameter> <parameter xml:id="MAGNITUDE"> <data_type>FLOAT</data_type> </parameter> </dataset> HDMC VxO SPASE 10-12 June 2008
The future of EuroPlaNet (2009-2012) Key challenge for FP 7 Datamodel (s) for planetology The CDPP will be responsible for this work package HDMC VxO SPASE 10-12 June 2008
Event tables management in AMDA Current status: • Time (or Event) Tables are collections of times when ‘something’ happens or time spans when some conditions are true. • Currently produced and managed « manually » by the scientists for their own use or for a community of users. • AMDA is increasing the possibilities of these tables : it provides a generic tool to create, manage and share these objects • How to generate Time tables with AMDA : • With the search tool based on mathematical criteria applied to the contents of the data • With the visual search tool • AMDA can ingest Time Tables : • Coming from statistical studies ( e.g magnetopause crossing lists ) • Produced by users HDMC VxO SPASE 10-12 June 2008
VISUALSEARCH Record intervals of interest in time table by mouse click HDMC VxO SPASE 10-12 June 2008
Edit search criteria with math operators or functions Define a time interval HDMC VxO SPASE 10-12 June 2008
Edit search criteria with math operators or functions Define a time interval HDMC VxO SPASE 10-12 June 2008
<VOTABLE version="1.1"> <DESCRIPTION> Time Table generated by AMDA @ CDPP; Conditions: MOM_C1(6)/MOM_C1(5)>1; Source: AMDA Search ; Creation Date : Tue Jun 3 14:10:39 2008; </DESCRIPTION> <RESOURCE> <DESCRIPTION> AMDA @ CDPP </DESCRIPTION> <TABLE> <FIELD datatype="char" name="Start Time" ID="TimeIntervalStart" ucd="time.start"> <DESCRIPTION>time tag for beginning of interval</DESCRIPTION> </FIELD> <FIELD datatype="char" name="Stop Time" ID="TimeIntervalStop" ucd="time.stop"> <DESCRIPTION>time tag for end of interval</DESCRIPTION> </FIELD> <DATA> <TABLEDATA> <TR> <TD>2001-06-30T02:00:00</TD> <TD>2001-06-30T04:10:00</TD> </TR> <TR> <TD>2001-06-30T04:40:00</TD> <TD>2001-06-30T06:20:00</TD> </TR><TR> <TD>2001-06-30T06:30:00</TD> <TD>2001-06-30T07:10:00</TD> </TR> </TABLEDATA> </DATA> </TABLE> </RESOURCE> </VOTABLE> Tables may be exported in VOTable Format (IVOA Standard to exchange tabular data) An example of Time Table generated with AMDA Management of Time Tables HDMC VxO SPASE 10-12 June 2008
<TABLE> <FIELD datatype="char" name="Start Time" ID="TimeIntervalStart" ucd="time.start"> <DESCRIPTION>time tag for beginning of interval</DESCRIPTION> </FIELD> <FIELD datatype="char" name="Stop Time" ID="TimeIntervalStop" ucd="time.stop"> <DESCRIPTION>time tag for end of interval</DESCRIPTION> </FIELD> <FIELD datatype="float" name="GeoMagnetic Latitude" ID="GeoMagLat" > <DESCRIPTION>Geomagnetic Latitude</DESCRIPTION> </FIELD> <FIELD datatype="float" name="GeoMagnetic Longitude" ID="GeoMagLon" > <DESCRIPTION>Geomagnetic Longitude</DESCRIPTION> </FIELD> <FIELD datatype="float" name="Local Time of onset" ID="onset" > <DESCRIPTION>Local Time of onset</DESCRIPTION> </FIELD> <DATA> <TABLEDATA> <TR> <TD>2001-06-30T02:00:00</TD> <TD>2001-06-30T04:10:00</TD> <TD>66.33</TD> <TD>161.37</TD> <TD>23.06</TD> HDMC VxO SPASE 10-12 June 2008
Event tables : Next step • Exchange of standardized time tables between data centres, services, tools. • A complete description of a time table may be difficult : • Description of the data source • Description of search criteria : visual, mathematical • Description of the methods used (models, …) • Use Spase « catalog » resource ? • A project started (early 2008) : Exchange of TT between CAA QSAS CL and AMDA HDMC VxO SPASE 10-12 June 2008
In perspective : HELIO 2 Virtual Observatory for the 4D heliosphere • VO for solar and solar system plasma data • Allow search, access, extraction of data • Provide tools and services for : • feature recognition • catalogue management • data mining… Call: FP7-INFRASTRUCTURES-2008-2 , September 11, 2008 Likely interfaces with US VxOs and EUROPLANET-IDIS HDMC VxO SPASE 10-12 June 2008