1 / 9

TTCN-3 CONFORMANCE TEST SUITE STF 470 STATUS REPORT

1. TTCN-3 CONFORMANCE TEST SUITE STF 470 STATUS REPORT. Andras Kovacs / BroadBit Zoltan Jako / BroadBit Nikolay Pakulin / ISPRAS Bostjan Pintar / Sintesio Tomas Urban / Elvior. 2. Contents. Session plan Current status Remaining STF470 work Issues reported as CRs Conclusion. 3.

zia-talley
Download Presentation

TTCN-3 CONFORMANCE TEST SUITE STF 470 STATUS REPORT

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. 1 TTCN-3 CONFORMANCE TEST SUITE STF 470 STATUS REPORT Andras Kovacs / BroadBit Zoltan Jako / BroadBit Nikolay Pakulin / ISPRAS Bostjan Pintar / Sintesio Tomas Urban / Elvior

  2. 2 Contents • Session plan • Current status • Remaining STF470 work • Issues reported as CRs • Conclusion

  3. 3 Session plan • October: • 3 days session at ETSI • 2013 October - December: • 30 days of work - done • 2014 January - May: • 55 days of work remaining • We are about 1/3 into the scheduled STF470 sessions.

  4. 4 Current status (1/3) • The planned test cases have been more than 50% written, the next phase of ATS work will concentrate on their completion and validation • Drafts are not yet available… • While many of the planned test cases have been already written, their validation is still to be done. Draft ATS will be contributed to the next MTS meeting.

  5. 5 Current status (2/3) • Time spent on the following: • New test case development (extending ATS from STF451) • Coverage of differences between TTCN-3 ed. 4.4.1 and ed. 4.5.1. All changed or new clauses are being covered. • Testing of previously non-covered parts (e.g. universal charstring tests, various sub-sections). • Taking ‘on-hold’ test cases from STF451 into use, based on the resolution of CRs raised by the preceding STF. • Validation and documentation • Validation with two independent TTCN-3 tools (TTWorkbench + Testcast). • Tooling for automated test execution for TestCast and TTworkbench has been inherited from preceding STF. • Creation of documents.

  6. 6 Current status (3/3) • ATS shall be validated with 2 tools: • TTworkbench: compile-time and execution. • TestCast: compile-time and execution. • Total number of conformance tests is 1456: • All of the core standard sections shall be covered when the STF completes its work • All changes between the 2012 and 2013 editions of the TTCN-3 standard have been covered; tool vendors may validate their implementation of the latest features.

  7. 7 Remaining STF470 work • Work to be done in 2014: • Validation of test cases by batch execution of the ATS and analysing reason for unexpected results of some test cases (including regression testing) • Follow-up on the resolution of raised CRs • Write up and publication of results

  8. 8 Handling reported CRs • 4 CRs were written by STF470 • All of the CRs raised by preceding STF have been resolved, we checked through the on-hold test cases, and added some into the ATS.

  9. 9 Conclusion • STF470 work is progressing on track • STF470 will be finished by end of May. • Draft deliverable will be available for commenting in April • There will be a continuous dialog with tool vendors regarding the analysis of observed errors • Special thanks to Elvior and TestingTech for the active tool support, which makes the continuous validation of results possible.

More Related