C. Huc/CNES, D. Boucon/CNES-SILOGIC, D.M. Sawyer/NASA/GSFC, J.G. Garrett/NASA-Raytheon

1. Producer-Archive Interface MethodologyAbstract Standard PAIMAS C. Huc/CNES, D. Boucon/CNES-SILOGIC,D.M. Sawyer/NASA/GSFC, J.G. Garrett/NASA-Raytheon

2. Contents • Why a new standard? • Space data archiving • Needs for standardization • What standardization will bring • Abstract standard status • Proposed methodology • Context - description • The 4 phases • Specialization • Aid Tool for the use of the Methodology • Towards an implementation standard • Conclusions Producer-Archive Methodology

3. Mission control system Telemetry Operation control Payload control Mission exploitation Mission archives Scientific multi-mission data centers: long-term archives Why a new standard?Space data archiving: archive types Producer-Archive Methodology

4. aProducer-Archive Project is a set of activities and the means used by the Information Producer as well as the Archive to ingest a given set of information into the Archive. Why a new standard?Space data archiving: key roles and players • Data Producers: • the operating systems of each mission • the mission processing and archiving centres • the scientific teams in the laboratories • Archive • specialized independent organizations (CDS) • specialized services within the agencies (NSSDC) • services common to several organizations (CDPP) Producer-Archive Methodology

5. Why a new standard?Needs for standardization: problems • The relations between archives and data Producers are rarely simple and easy: • nonconformity of received data • unclear and imprecise definition of the data to be delivered, • failure to meet delivery schedule, • late detection of errors in archived data, • non-management of modifications ==> Can be detrimental to archived information quality and the cost of the operation. • Ever increasing diversity of the producers • Data complexity • Each project develops its own methodology on the basis of a process that is roughly the same from one project to another ==> Work duplicated, no generality, excessively high costs, etc. Producer-Archive Methodology

6. Why a new standard?Needs for standardization: multiple standards PAIMAS Generic abstract standard Approved by the CCSDS PAIMAS Implementation standard Community abstract standard Development in progress Producer-Archive Methodology

7. Why a new standard?What standardization will bring • Ease some typical problems (as noted earlier) • Make it easier to follow schedules and commitments • Help with human resources turnover • Anticipate new problems • Address the legal aspects early • Increase data quality of archive holdings • Have weight and credibility for adoption • And finally, save time (and money) Producer-Archive Methodology

8. Why a new standard?Abstract standard status • Today: CCSDS standard (blue book) and standardization with ISO in progress • Various communities have helped produce this document : • space agencies (CNES, NASA, ESA, …) • archivists (NARA, …) and • librarians (BNF -French National Library, RLG-Research Library Group). Producer-Archive Methodology

9. Contents • Why a new standard? • Space data archiving • Needs for standardization • What standardization will bring • Abstract standard status • Proposed methodology • Context - description • The 4 phases • Specialization • Aid Tool for the use of the Methodology • Towards an implementation standard • Conclusion Producer-Archive Methodology

10. MethodologyContext: OAIS environment Producer-Archive Methodology

11. MethodologyContext: PAIMAS focus AIP : Archival Information Package, SIP : Submission Information Package, DIP : Dissemination Information package Producer-Archive Methodology

12. MethodologyContext: PAIMAS focus Ingest AIP : Archival Information Package, SIP : Submission Information Package, DIP : Dissemination Information package Producer-Archive Methodology

13. MethodologyDescription • The archive project is broken down into 4 main phases: • Preliminary Phase, • Formal Definition Phase, • Transfer Phase, • Validation Phase. • Each phase has extensive action tables. • Specification for a community. Producer-Archive Methodology

14. Validation Phase Transfer Phase MethodologyThe phases: relationships • Negotiate the Submission Develop agreement (data to be delivered, complementary elements, schedule) • Identification and preliminary agreement Define the information to be archived • resources estimation • Actual transfer of the data Actual transfer of the objects Validate the transferred objects Phase objective Transferred object files Preliminary Phase Formal Definition Phase Validation agreement Preliminary Agreement Dictionary Formal model Submission Agreement Anomalies Data ready to archive Producer-Archive Methodology

15. Methodology Preliminary phase: context Producer Preliminary Phase Preliminary Agreement Archive Producer-Archive Methodology

16. Action table Description MethodologyPreliminary phase: sub-phases Producer-Archive Methodology

17. MethodologyFormal Definition Phase: context Preliminary Agreement Formal Definition Phase Dictionary Data Model Submission Agreement Producer-Archive Methodology

18. MethodologyFormal Definition Phase: sub-phases and action table Producer-Archive Methodology

19. MethodologyTransfer Phase Data Model of object files to deliver Schedule Transfer Phase • Actual transfer of the objects: • carry out the transfer test • manage the transfer Transferred object files Producer-Archive Methodology

20. MethodologyValidation Phase Transferred object files Data ready to archive Validation Phase • Validate the transferred objects: • carry out the validation test • manage the validation Anomalies Validation acknowledgement Producer Producer-Archive Methodology

21. Contents • Why a new standard? • Space data archiving • Needs for standardization • What standardization will bring • Abstract standard status • Proposed methodology • Context - description • The 4 phases • Specialization • Aid Tool for the use of the Methodology • Towards an implementation standard • Conclusion Producer-Archive Methodology

22. Specialization • Adapt the generic standard to a particular community (which can range from an international organization to a simple archive service) • Steps involved to define a community standard • terminology, • data dictionary and information model, • standards, • common tools. • Analyze each action of the generic standard (add actions if necessary) Producer-Archive Methodology

23. Use the Data Description Language EAST Specification defined by the CCSDS for the syntactic data description Specific Action (CDPP) Use the CCSDS DEDSL- Data Entity Dictionary Structure Language- —XML/DTD Syntax for the semantic data description Apply the ‘specification of products for delivery to the CDPP’ including Use the CCSDS time code format for the date and time coding Etc. Specialization: Example • Example (CDPP -Plasma Physics Data Center- Archive) Generic Action (Methodology) F-4: Define the formats, coding rules, and standards to be applied for the objects to be delivered Producer-Archive Methodology

24. Contents • Why a new standard? • Space data archiving • Needs for standardization • What standardization will bring • Abstract standard status • Proposed methodology • Context - description • The 4 phases • Specialization • Aid Tool for the use of the Methodology • Towards an implementation standard • Conclusion Producer-Archive Methodology

25. Aid Tool A methodology application and archive project aid tool would be a real advantage for both the Producer and the Archive. First mockups produced Producer-Archive Methodology

26. Aid Tool Producer-Archive Methodology

27. Contents • Why a new standard? • Space data archiving • Needs for standardization • What standardization will bring • Abstract standard status • Proposed methodology • Context - description • The 4 phases • Specialization • Aid Tool for the use of the Methodology • Towards an implementation standard • Conclusion Producer-Archive Methodology

28. Community standard Towards an implementation standardContext Methodology application aid PAIMAS Generic abstract standard Implementation standard Languages Tools Archive project Producer-Archive Methodology

29. Towards an implementation standardApproach • generic data model • transfer data model (generic objects) • transfer data dictionary (generic descriptors) • community dictionary • diagram of data to transfer for the archive project • transfer sequencing and chronology • transfer session Implementation standard DEDSL XML Schema XML Languages Tools UML XMLScheme DTD XMLScheme XFDU Producer-Archive Methodology

30. Towards an implementation standardRelationships CLUSTER CIS CODIF HIA CLUS-CIS-CODIF-EAST CLUS-CIS-HIA-EAST CLUS-CIS-HIA-Jn CLUS-CIS-CODIF-Jm Producer-Archive Methodology

31. Towards an implementation standardSchema • Delivery plan • all the elements to be delivered • easy to understand from the Producer side • expression of constraints Producer-Archive Methodology

32. Conclusion • PAIMAS identifies: • the phases in the process of transferring information, • the objective of the phases, • the actions that must be carried out, • the expected results. • PAIMAS is a basis: • for the identification of standards and implementation guides, • for identification and development of a set of software tools. Producer-Archive Methodology

33. End of presentation Producer-Archive Methodology