380 likes | 581 Views
AETG Web Service Tutorial. AETG is a service mark of Telcordia Technologies. Telcordia Technologies - Licensed Material
E N D
AETG Web Service Tutorial AETG is a service mark of Telcordia Technologies. Telcordia Technologies - Licensed Material Access to this tutorial is provided solely to the registered users who have agreed to access and use the AETG Web Service according to the terms of the “Click-on license agreement” accepted during the registration process.
AETG Web Service • Create tests for: • Communications protocols • Feature interaction • Interoperability • Graphical User Interfaces (GUIs) • Contracts • etc. • Improves tester productivity by allowing a tester to create more, higher quality tests
AETG Web Service • WHAT - Helps testers design test sets. • Is especially helpful where combinatorial explosion of input combinations is a problem. • HOW - Tester provides input parameters and parameter values. • AETG Web provides test cases with a specific value for each parameter. • AETG Web lets you choose the degree of interaction between the parameters • E.g., degree of interaction = 2 means pair-wise combinations
Example Scenario, part 1 • Call Processing • Consider testing telephone-switch software • A call has the following characteristics: • Call Type: one of Local, Long Distance, International • Billing: one of Caller, Collect, 800 • Access: one of Loop, ISDN, PBX • Result: one of Success, Busy, Blocked • This scenario uses 4 input parameters, each with 3 possible values • Just using valid values in this example • All combinations are valid.
Example Scenario, part 2 • Each call characteristic is called a field • The AETG term for a test parameter • Values and relationships among fields appear in a relation • The AETG term for a collection of fields that together model a test scenario • The AETG model that you will build in this tutorial will have: • 4 fields (“call type”, etc.) • 1 relation with the 3 values for each field (“local”, etc.) • This basic example does not use any compounds or constraints
Numbers of Tests • Consider just 2 parameters: Call Type and Billing • Each has 3 distinct values. We need 3 x 3 = 9 tests to test all possible combinations of two parameters. • Consider all 4 parameters • Testing all possible combinations of the 4 parameters requires 3 x 3 x 3 x 3 = 81 tests. • AETG Web can cover all pair-wise combinations of these 4 parameters with only 9 tests.
Using the AETG Web Service for the Example • In the basic tutorial you will • Create a Test Specification (TS) • Specify fields • Specify relations (field interactions) • Specify valid values • No invalid values • Generate test sets • View, download, and print test sets
AETG Web Service - Access • Access URLhttp://aetgweb.argreenhouse.com • Note that all access to the service uses secure http (i.e., https) • Any modern web browser should work • E.g., Firefox, Internet Explorer, Netscape, Mozilla
Home Page Click on “Log In” under Registered Users Access to user documentation requires login. Please checkthe news page occasionally.
Login Page Enter your user name & password to start a new session. Please do not bookmark this page. Note the “lock” icon in the browser.
Welcome Page Bookmark this page!
Steps to create a New Test Specification • Pick a name and create an empty test specification • Open the test specification for edit • Create all required fields in the spec • Create a relation • Select fields for that relation • Enter values for each field in the relation Refer to Section 2 : Starting a Test Generation Session in the User Manual
Manage Specifications This page shows folders and test specifications that you have defined. Links allow you to create, delete, rename, etc.
Enter name for the new specification Enter a new name (“calls”) and click on the “Add” link to create an empty test specification.
Edit the newly created specification Select the specification name in the list box and click on the “Edit” link to open it.
Create fields in the test specification Enter each field name, and click on the “Add” link. Field names from the example: Call_TypeBillingAccessResult
Create a relation in the test specification Enter a relation name, then click on the “Add” link.
Empty relation created in the test specification Next, click on the “Select Components” link to add fields to the relation.
Select fields for the newly created relation Select all the fields, click on the >>Add>>” link.
Fields selected for the newly created relation All fields are now in the “Used” column. Click on the “Submit Selections” link at the bottom to save the changes.
Relation with fields Click on the “Edit values” link next.
Enter values for fields in the relation Enter values, one per line, in the text boxes. Click on the “Submit values” link to save changes.
Generate tests Click on the “Generate tests” link next.
Output from test generator (top) Next slide, please.
Output from test generator (scrolled down) Click on the “View all test cases” link next.
Overview of generated tests Click on the “XML” link to view as XML.
View generated tests as XML XML is easily processed by programs, such as in a test harness.
View generated tests as spreadsheet (“DIF”) Click on the “DIF” link from the results overview page to save or view the tests in spreadsheet format.
Duplicate Values • For performance, load balancing, or user data simulation purposes, we may want to ensure that certain values are represented more often than others • AETG Web will accept duplicate values for a parameter. Duplicate values are treated as if they are distinct.
Exercise • Modify the relation by inserting a duplicate value 800 for the parameter billing, then generate tests • How many valid tuples does it find? • Are there more tests? • Does 800 occur more often than other values? • Remove the duplicate value & submit the relation.
Test Seeds • Seeds are used to specify tests that must be in the test set (for example, you specify pairwise interaction, but you want a particular triple to be in the test set)
Add seed tests Click on the “Edit seeds” link to specify seed tests.
Choose values for seed tests Use the pull-down selection boxes to choose a value for each member of the seed tuple, then click on the “Submit values” link to save changes. Then click “Generate Tests”
Re-generate to include seed tests Pairs covered by the seed are taken into account, so the addition of this seed test does not increase the total number of cases. Choosing a different seed can cause the generator to require 9 or even 10 cases. The starting point has a big influence.
Generated tests with a seed test The seed is the last test. Note that the valid tests are different from those created without the seed.
Exercises • Create a second seed for the relation, view the spec, and generate tests • Delete the seeds for the relation • Generate tests for Interaction degree of • 3 (triples) • 1 (no pair-wise coverage requested) • Note how many tests are created in each case