MBSE for System Testing

1. MBSE for System Testing Managing the development of system testing using the principles of Model Based System Engineering Ron Kratzke, Vitech Corporation rkratzke@vitechcorp.com

2. Context Diagram - Verification Process(Ref: INCOSE Handbook Ver 3.2.2 Oct 2011) Controls - Applicable Laws and Regulations - Industry Standards - Agreements - Project Procedures and Standards -Project Directives Inputs - System Requirements - Verification Criteria - Specification Tree - Updated RVTM - Interface Requirements - Integrated System - Interface Control Documents - Integration Report Outputs - Verification Strategy - Verification Enabling System Requirements - Verification Constraints on Design - Verification Procedures -Final RVTM - Verified System - Verification Report Activities - Plan Verification - Perform Verification Enablers - Organization / Enterprise Policies, Practices, and Procedures - Organization / Enterprise Infrastructure - Project Infrastructure - Verification Enabling Systems Vitech Corporation

3. Model-Based Systems Engineering • Model-based systems engineering (MBSE) is the formalized application of modeling to support system requirements, design, analysis, verification and validation activities beginning in the conceptual design phase and continuing throughout development and later life cycle phases. • From “INCOSE Systems Engineering Vision” 2020 INCOSE-TP-2004-004-02 September, 2007 Vitech Corporation

4. Models Vitech Corporation

5. Everyone has a model … VITECH CORPORATION

6. System Testing has to account for a number of items… Components (Physical Architecture) Testing Functions (Behavior Architecture) Requirements Vitech Corporation

7. MBSE Verification Process ModelMust … • Provides insight into the problem and potential solutions • Provide order and traceability • Possess integrity and consistency • Have ability demonstrate and explain the test program Vitech Corporation

8. Is The VCRM Enough??? Vitech Corporation

9. Additional Information Needed • In addition to the method, shouldn’t we also know? • Objective • Environment • Special Conditions • Success Criteria Ref: A Day in the Life of a Verification Requirement Tutorial, Northrop Grumman, Steve Scukanec, 27th Annual T&E Conference, March 14, 2011 Vitech Corporation

10. Status of Completing the Verification • Wouldn’t we also want to track? • Method (which is in the VCRM) • Planning Status • Completion Status • Where / When the Verification Event will take place Vitech Corporation

11. Verification Requirement Statement Verification Requirement Description statement provides the details on HOW the verification will be accomplished Vitech Corporation

12. Relating Requirements to Verification Function, Requirement Verification Requirement attributes: - Description - Method - Status - Level verified by (verifies) Add two more attributes Verification Requirement Vitech Corporation

13. Table Output from Model … Provides the data from the model to provide overall status of verification planning… But what about the test events? Vitech Corporation

14. What about the actual Testing? Function, Requirement verified by (verifies) Verification Requirement What test events are planned? Which Verification Requirements will be verified in which test event? Who is doing the testing? What Organization is responsible? What configuration is going to be used in testing? Which Test Procedures will be used during any particular Test Event? Vitech Corporation

15. What about the actual Testing? Function, Requirement verified by (verifies) Verification Event Verification Requirement fulfilled by (fulfills) Add “Verification Event” to specify and describe a Test Event which will be used to verify a subset of Verification Requirements (for example, Limited User Test, Laboratory Bench Test, Operational Test, etc.) Vitech Corporation

16. What about the actual Testing? Function, Requirement Organization verified by (verifies) assigned to (responsible for) Verification Event Verification Requirement fulfilled by (fulfills) employs (employed by) Relate the Verification Event to an Organization, Test Configuration, and Test Procedure employs (employed by) Test Configuration Test Procedure Vitech Corporation

17. Provide a complete picture… Vitech Corporation

18. Verification Event Information Vitech Corporation

19. What about time and resources for the Verification Requirement? Function, Requirement Organization verified by (verifies) assigned to (responsible for) Verification Event Verification Requirement fulfilled by (fulfills) executed by (executes) employs (employed by) employs (employed by) Test Activity Test Configuration Test Procedure Vitech Corporation

20. Test Activity – Detailed Test Planning Vitech Corporation

21. Produce a Test Plan from the Model Vitech Corporation

22. Summary … • System Testing model • Extends traditional VCRM to provide added insight • Plan Verification Events including support resources • Manage Testing Activity sequence and timing • Produce Test Plans • Traceability • Completeness • Consistency • Document Generation Vitech Corporation

23. MBSE for System Testing Questions ??? Ron Kratzke, Vitech Corporation rkratzke@vitechcorp.com