50 likes | 306 Views
Model-Based Testing @ ETSI. Stephan Schulz Director, Testing Methodologies Conformiq Software OY. ETSI and Model-Based Testing. Model-Based Testing (MBT) is an umbrella of approaches that generate tests from models
E N D
Model-Based Testing @ ETSI Stephan SchulzDirector, Testing MethodologiesConformiq Software OY
ETSI and Model-Based Testing • Model-Based Testing (MBT) is an umbrella of approaches that generate tests from models • May be based on system models, models of the environment, or even graphical test specification • Is promising due to a new generation of tools in the market to make test design and specification much more effective • ETSI is evaluating and working on the use of MBT in the context of standardization • ETSI CTI has lead a case study in the ITEA2 D-MINT project • ETSI TC MTS has published first standards related to MBT(e.g., ETSI TR 102 840) • MTS TR WI ongoing on “Model-Based Testing in Telecom”
First Trends from MBT work • Models … • Should be a testing and not specification artifact • Should encode testable requirements, i.e., test purposes • Should not be normative but could available for “own use” • Generated tests … • Should follow conformance testing methodology and standardized formats to be acceptable in standardization context • (A selected set of tests) should be normative • Perceived benefits of this approach include • Improved quality of ETSI test specifications • Faster creation of TTCN-3 test suites and more effective test maintenance • Ability to customize and use models for own test generation
MBT in test development Model ofSpecification Test Cases in Intermediate Format Encode TestableRequirements Render asTest Description Real System Test SystemAdaptation TTCN-3 Test Cases Generate Tests Render inTTCN-3
New WI: Concepts for Model Specification • Identify and collect all relevant concepts that model specifications developed for testing should include • Help users to understand what information a model should contain to be suitable for the generation of test specifications that can be standardized • Indirectly it also mandates concepts that MBT tools need to support to facilitate the generation of such tests • Concepts are to be specified independent of a specific modelling language • Mappings to concrete modelling languages could be placed in the Annex (follow idea of TRI) • Intended to be a first standard in a series of standards on model-based testing