1 / 20

LO-5: Testing

LO-5: Testing. Lecturer: Ricardo Gonçalves. Contents. Testing Overview Conformance Testing Definition Methodologies Application Architecture Interoperability Checking Definition Methodologies Application Architecture. What is Testing?. Testing is the process used to help identify:

tave
Download Presentation

LO-5: Testing

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. LO-5: Testing Lecturer: Ricardo Gonçalves

  2. Contents • Testing Overview • Conformance Testing • Definition • Methodologies • Application Architecture • Interoperability Checking • Definition • Methodologies • Application Architecture

  3. What is Testing? Testing is the process used to help identify: • Correctness • Completeness • Security • Quality … of developed computer software. Testing is a process of technical investigation, performed on behalf of stakeholders, that is intended to reveal quality-related information about the product with respect to the context in which it is intended to operate.

  4. Testing life cycle • Software testing life cycle: Requirement Analysis Test Planning Test Development Test Reporting Test Execution Retesting the Defects

  5. Types of Testing There are many types of tests, like: • Performance; • Robustness; • Behaviour; • Functions; • Conformance; • Interoperability;

  6. Conformance Testing (CT)

  7. Conformance Testing (CT) • ISO/IEC TR 13233 defined conformance and conformity as “fulfilment by a product, process or service of all relevant specified conformance requirements”. • ISO/IEC DIS 10641 defined conformance testing as "test to evaluate the adherence or no adherence of a candidate implementation to a standard”.

  8. Conformance Testing (CT) To apply the conformance testing to an implementation, the standards or specifications, must specify the requirements or criteria for conformance. In general this are done in a conformance clause or conformance statement. Also, to help in the conformance testing, some standards describe methodologies and platforms to implement the conformance testing.

  9. CT - Methodologies • ISO 9646: “Conformance Testing Methodology and Framework” • ISO10303 30’s parts a Conformance testing methodology and framework • ETS 300 406 (Methods for Testing and Specification (MTS), Protocol and profile conformance testing specifications, Standardization methodology

  10. CT General concepts • System Under Test (SUT) • Implementation Under Test (IUT) • Abstract Test Suits (ATS). SUT adopts IUT Is verified and certified via Standard ATS

  11. CTAbstractTestSuits(ATS) • ATSisdefinedbyasetofAbstractTestCases(ATC)describinginaconceptualformat • WiththeATSdefinedforoneAP,theConformanceTestingprocedurescanbeexecutedontheIUT • ATSneedstobeinstantiatedcreatingtheExecutableTestCases(ETC),whicharethedataandcommandstobeusedtoexecutethetestdescribedincomputerformat.

  12. CTAbstractTestSuits(ATS)

  13. CT – “A Methodology” ISO10303,Conformancetestingmethodology

  14. CT – Application example <Request_for_quotation> <buyer>Tomas Smith</buyer> <sellller>Furniture Shop</sellller> <product>Blue Chair</product> <quantity>20</quantity> </Request_for_quotation> Retailer ENTITY Request_for_quotation buyer: STRING seller: STRING product: STRING quantity: STRING Request_for_quotation XML DATA EXPRESSModel Is in conformance?? <Request_for_quotation> <buyer>Tomas Smith</buyer> <seller>Furniture Shop</seller> <product>Blue Chair</product> <quantity>20</quantity> </Request_for_quotation> Conformance testing of messages Model of exchanged messages Request quotation received well format Manufacturer

  15. CT – Application Architecture

  16. Interoperability Checking (IC)

  17. Interoperability Checking • IEEE define interoperability as "the ability of two or more systems or components to exchange information and to use the information that has been exchanged.” • Interoperability testing is the act of determining if end-to-end functionality between (at least) two communicating systems is as required by those base systems’ standards. “ETSI”

  18. IC Methodology – General concepts • SystemUnderTest(SUT) • ImplementationUnderTest(IUT) • AbstractTestSuits(ATS) • TestSuiteStructureandTestPurposes(TSS&TP) • InteroperableFunctionsStatement(IFS) • ImplementationeXtraInformationforTesting(IXIT) • ExecutableTestSuite(ETS)

  19. Test selection and Implementation Manual Testing SUT parameterization RE EUT Filled-in IFS and IXIT non-ETSI activities ETSI activities Base (Protocol) TSS & TP ATS IFS and IXIT Standards Development of Interoperability Test Specifications IC – “A Methodology” • TS 102 237-1; Interoperability test methods & approaches; Part 1: Generic approach to interoperability testing From: In Pursuit of Interoperability (ITJ2582) - Scott Moseley; Steve Randall; Anthony Wiles.

  20. IC – Application Architecture From: In Pursuit of Interoperability (ITJ2582) - Scott Moseley; Steve Randall; Anthony Wiles.

More Related