230 likes | 248 Views
Build 9a. November 08, 2018 MC F2F in Houston. Outline. Build 9a Summary Information Model Software Documents Test and Release Process Beta Test by Nodes and IPDA Model Testing Results Tools Testing Results I&T Approach I&T Results Summary. Build 9a Summary.
E N D
Build 9a November 08, 2018 MC F2F in Houston
Outline • Build 9a Summary • Information Model • Software • Documents • Test and Release Process • Beta Test by Nodes and IPDA • Model Testing Results • Tools Testing Results • I&T Approach • I&T Results • Summary PDS MC F2F at Houston
Build 9a Summary • Completed IM V 1.11.0.0 testing by EN and Nodes (9/4-9/14) • Completed tools beta testing by Nodes (9/5-9/14) • Completed services and tools development, released for I&T (9/30) • Completed documentation update (10/1) • Completed I&T (10/1 – 10/30) • Plan to deploy Build 9a by end of November PDS MC F2F at Houston
Information Model and Standards Components • Information Model Specification (HTML) • Release Notes • Data Dictionary (HTML and PDF) • XML Schema and Schematron PDS MC F2F at Houston
Summary of Information Model Changes • Common dictionary – Implemented 13 approved SCRs • Notable Changes (detailed list in backup) • CCB-206 Add "doi" to Citation_Information • CCB-219 Add Context_Area to Product_Browse • CCB-226 DATE_TIME microseconds precision • Local Data Dictionary (LDD) • LDD Ingestion Process developed and deployed PDS MC F2F at Houston
Discipline and Mission LDDs PDS MC F2F at Houston
Build 9a Software Components Tools Services Registry and Search Includes support for Tool and Data Dictionary content Transport Backward compatible with the PDS-D Product Server Report Generating monthly HQ reports • Ingest • Harvest Tool • Catalog Tool • Preparation • Generate Tool • Transform Tool • Validate Tool • Inspect Tool • Core and PDS4 Tools Libraries PDS MC F2F at Houston
Major Software Changes • Validate Tool • Adding support for enhanced reporting • Adding support for objects greater than 2GB • Addressed a number of issues related to fine tuning content validation • Transform Tool • Addressed a number of issues handling various PDS3 to PDS4 transformations • Adding initial support for transforming to FITS • Inspect Tool • Adding enhanced support for visualization of PDS4 products • Tracking Service • Adding support for delivery and DOI tracking PDS MC F2F at Houston
Changes to Standards Reference and Documents • Documents now part of build process • Document Authoring Team (DAT) • S.Slavney; R.Simpson & R.Joyner • Document Review Team (DRT) • S.McLaughlin; S.LaVoie; E.Guinness; T.King • Document update plans • 9/24 – Distribute Data Author Team (DAT) updates to the Data Review Team (DRT) • 10/5 – Data Review Team (DRT) responses due • 10/19 – Document updates completed and posted PDS MC F2F at Houston
Test and Release Process EN & Node IM Beta Test IM Beta Test Data Tools Beta Plan/Data I&T Plan/Data DDWG Beta IM Ops IM Node Tools Beta Test EN System I&T I&T Results Beta Software Build Software CCB Approved SCRs S/W JIRA Issues TWG CCB Draft Std Ref, DPH, Concepts Doc Review Ops Std Ref, DPH, Concepts Ops Software DWT DRT PDS MC F2F at Houston
Beta Tests by Nodes & IPDA • Model and Tool beta testing by the nodes and IPDA were part of Build 9a test and release process • Model beta testing was conducted on (9/4- 9/14) • Node tool testing was conducted on (9/5 – 9/14) • Test data and test cases were encouraged to be submitted to be included in I&T PDS MC F2F at Houston
IM Beta Test Results • Requested that the Discipline Nodes test all active Local Data Dictionaries (LDDs) for consistency against V1.11.0.0 of the Common dictionary • No issue was reported PDS MC F2F at Houston
Tool Beta Test • Focus on Validate and Transform Tools • Test Information available on: https://pds-engineering.jpl.nasa.gov/content/build_9a_tool_test_information • ATM, ESA, GEO and SBN participated and their test summaries were captured at: https://docs.google.com/spreadsheets/d/1FNzpLdzR-J35kPgEAYaso90SANHxoKnLP5T-R8NQErU/edit#gid=1687588224 • SBN – Validate Tool resolved previous issues seen with orex binary tables • ESA – Beta version of Validate Tool did not yet reflect new microseconds precision in datetime values due to a CCB change; EN followed up by delivering an early version of the tool to support this change • ATM – Overall, Validate and Transform ran as expected; Issues installing Inspect Tool prototype. EN will follow up on details • GEO – Reported a minor issue regarding Validate Tool; SW-37 was created PDS MC F2F at Houston
I&T Approach • System I&T is an iterative process • Test cases are derived from requirements • Regression testing is mandatory for each build • Test cases are used to exercise software and services with example data products delivered with each build • All issues found are recorded in the tracking system JIRA • Prior to completion of a system build, all show stopper issues must be corrected and the fix must be verified, follow by regression testing • Only when I&T is completed without major anomaly, then system can be deployed • Full details are captured in test report which identifies result of each test case, and their traceability to requirements PDS MC F2F at Houston
I&T Input/Output • Input • IM V1.11.0.0 as a result of Node testing of candidate IM based on approved SCRs by CCB • Build 9a system software including upgrades and fixes of issues captured in JIRA • Build 9a test plan with modified test cases for new features and regression test • Build 9a test data • Output • New issues found have been added to JIRA • Fixed issues were closed in JIRA • Test result has been documented in the test report PDS MC F2F at Houston
I&T Results • Total of 53 test cases exercised and passed, no failure • 91 requirements met • 0 major issues found, no show stopper • 4 minor issues and 1 suggested improvement created in JIRA. 3 of the 4 minor issues were fixed and regression tested during I&T. • Test report and data posted at: • https://pds-engineering.jpl.nasa.gov/content/build_9a_deliverables PDS MC F2F at Houston
Summary • Completed IM V 1.11.0.0 testing by EN and Nodes • Completed tools beta testing by Nodes • Completed services and tools development, released for I&T • Completed documentation update • Completed I&T without major anomalies • Plan to deploy Build 9a by end of November PDS MC F2F at Houston
Backup PDS MC F2F at Houston
Build 9a anomalies PDS MC F2F at Houston
Updated Test Cases • HVT.7: added 2 steps to show new schematron values for various reference_types • MOD.1: added 1 step to show a simple bug fix • POR.1: merged (and deleted) SRCH.9 to show multiple search entries for a single PDS3 data_set_id • POR.2: added 2 steps to show a simple bug fix • PRT.1: added 2 steps to show transform's creation of a FITS file • PRT.3: added 7 steps to show 9 bug fixes • PRV.7: added 10 steps to show 11 bug fixes PDS MC F2F at Houston
Issue Visibility • Tickets initiated by Node Staff or PDS Operator in project JIRA [1] • Possibly triggered by user • EN dev team tracks with internal tickets mapped back to project ticket • When ticket is resolved, test case is pushed to test repository [2] [1] https://pds-jira.jpl.nasa.gov [2] https://starbase.jpl.nasa.gov/pds4/test PDS MC F2F at Houston
Test Cases PDS MC F2F at Houston