170 likes | 185 Views
Learn about the upcoming Build 8a of PDS4, including system builds, major releases, software components, testing, and governance approach. Get insights into information model changes, software tools, release plans, and standards. Explore the I&T process and major software changes.
E N D
Build 8A Plan PDS MC F2F Pasadena, California Aug 29-30, 2017
Introduction Build 8a is next planned build and release of PDS4 which will include model, documents, and software (system and tools). Delivery to I&T is planned for Sept 29, 2017 Integration and Test is planned for Oct 2017. Deployment to start in early November 2017. Build 8a Plan
System Builds and Governance Approach Discipline Node/IPDA Info Models Distribute to Community Transfer to Core Core PDS System, Model, Tools, Libraries (1) Information Models (2) Software PDS Core System Components Change Control Board System Builds (Software+ Model Integration, Regression Testing, etc) System Release Distribute to Community PDS Management, Requirements Transfer to Core Major releases every 6 months Discipline Node and Community Software Tools Support co-development with the community Distribute to Community
Information Model and Standards Components Information Model Specification (HTML) Release Notes Data Dictionary (HTML and PDF) XML Schema and Schematron Build 8a Plan
Summary of Information Model Changes • Common dictionary – Implemented 13 approved SCRs • Detailed list in backup. • CCB-184 requires the regeneration of LDDs (LDDTool) • CCB-178 further restricts the values for <local_identifiers> • Cartography LDD ingested • Ingested Rings LDD updated • Files exported from IM for tools and services. • Added “abstract” and “deprecated” flags to the JSON file • Local Data Dictionary (LDD) changes. • Ingested new version of Rings LDD - V1501_1800 • Spectral LDD released – V1800 • Spectral Library LDD released – V1000 Build 8a Plan
PDS4 Information Model Discipline and Mission Dictionaries Build 8a Plan
Information Model Build 8A Testing and Release Plan • Aug 17 - 30, 2017 – Finish implementation of SCRs • Aug 31 – Sept 13, 2017 – EN, DN, and IPDA testing • Sep 14 - 28, 2017 – Prepare IM for release to System I&T • Sep 29, 2017 – Release IM to release directory • At this point all changes are versioned • Oct 2 - 31, 2017 - System I&T - System Testing • Nov 1 – 30, 2017 – System Deployment Build 8a Plan
Build 8a Software Components Tools Services Registry and Search Includes support for Tool and Data Dictionary content Transport Backward compatible with the PDS-D Product Server Report Generating monthly HQ reports • Ingest • Harvest Tool • Catalog Tool • Preparation • Generate Tool • Transform Tool • Validate Tool • Core and PDS4 Tools Libraries • Inspect Tool Build 8a Plan
Major Software Changes • Validate Tool • Adding support for data content validation of tables against the label description • Transform Tool • Adding support for transforming PDS3 labeled tables to CSV • Adding support for transforming PDS4 label to PDS3 label (ODL) • Inspect Tool • Initial release supporting visualization of PDS4 products • Tracking Service • Initial release supporting API access to tracking services. • Search Service • Adding performance improvement for index generation. Build 8a Plan
Changes to Standards Reference and Documents. • Documents now part of build process • Document Authoring Team (DAT) • S.Slavney; R.Simpson & R.Joyner • Document Review Team (DRT) • S.McLaughlin; S.LaVoie; E.Guinness; T.King • SR & DPH & Concepts • v1900 updated by DAT; reviewed by DRT; ready for release. • Changes summarized by SCR in “Change Log” of each document. Build 8a Plan
Schedule for Document Changes DWT send docs to DRT Aug 25, 2017 DRT responses due Sep 8, 2017 DWT responds to DRT review thru Sep 29, 2017 Publish Docs as part og Build – Oct 1, 2017 Build 8a Plan
I&T Plan • System I&T is an iterative process. • Test cases are derived from requirements. • Regression testing is mandatory for each build. • Test cases are used to exercise software and services with example data products delivered with each build. • All issues found are recorded in the tracking system JIRA. • Prior to completion of a system build, all show stopper issues must be corrected and the fix must be verified, follow by regression testing. • Only when I&T is completed without major anomaly, then system can be deployed. • Full details are captured in test report which identifies result of each test case, and their traceability to requirements. Build 8a Plan
Build 8a I&T Process SCRs (approved by CCB) IM V1.9.0.0 candidate Issues (in JIRA) Test Data Build 8a Software Build 8a Test Plan (test cases) IM I&T IM V1.9.0.0 Build 8a System I&T Issues (in JIRA) Build 8a Test Report Build 8a Plan
I&T Input/Output • Input • IM V1.9.0.0 as a result of Node testing of candidate IM based on approved SCRs by CCB • Build 8a system software including upgrades and fixes of issues captured in JIRA • Build 8a test plan including new test cases of any new features and regression test cases • Build 8a test data • Output • Any new issues found will be added to JIRA • Any fixed issues will be closed in JIRA • Test result will be documented (including requirement traceability matrix) Build 8a Plan
Summary EN is approaching build 8a I&T and release process We welcome node and IPDA involvement Build 8a Plan
Questions/Comments Build 8a Plan
Details of Information Model Changes CCB-162 - Move <md5_checksum> from Object_Statistics to Byte_Stream CCB-165 - Ambiguity of ASCII_Numeric_Base CCB-166 - Deprecate bit_mask from IM CCB-171 - Split hardware-compatible ASCII numeric types from the unbounded CCB-172 - Add movie format(s) to list of acceptable documents. CCB-176 - Update Node names in the IM CCB-178 - Internal Reference Implementation CCB-179 - In PDS4 'pds' namespace, use ASCII_NonNegative_Integer CCB-184 - The xs:choice element does not validate as expected CCB-185 - Allow multiple instances of purpose and processing_level CCB-191 - Add Indian Space Research Organisation (ISRO) to the Namespace Registry CCB-192 - Add Product_Metadata_Supplemental (M.Gordon) CCB-193 - Add Geosciences and Radio Science as permissible values Build 8a Plan