1 / 10

3rd Generation Mobile Reference Test System to enable TTCN-3 Tool Assurance

3rd Generation Mobile Reference Test System to enable TTCN-3 Tool Assurance. STF343 Final Report. Dirk Tepelmann STF343 Leader. TC-MTS#47 6-8 October 2008 47TD33. STF Objectives and Approach.

serina-stephenson
Download Presentation

3rd Generation Mobile Reference Test System to enable TTCN-3 Tool Assurance

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. 3rd Generation Mobile Reference Test System to enable TTCN-3 Tool Assurance STF343 Final Report Dirk Tepelmann STF343 Leader TC-MTS#47 6-8 October 2008 47TD33 STF343 Final Report

  2. STF Objectives and Approach • Objective: Develop solutions that will enable the validation and testing of TTCN-3 tools (i.e. compilers/interpreters and their runtime system). • Motivated by intent of 3GPP RAN5 to use from LTE/SAE (Rel-8) onwards TTCN-3 instead of TTCN-2. • Observation of ETSI MCC TF160: TTCN-3 test suites are not exchangeable between different TTCN-3 tools. • Approach: • Reference ATS based on 3GPP benchmark ATS from MCC TF160. • Develop Mirror ATS that replaces SUT of reference ATS. • Execute reference ATS and mirror ATS against each other by running them on TTCN-3 tools. STF343 Final Report

  3. Involved People and Timescale • Experts selected December 2007 • STF leader: Dirk Tepelmann (Testing Technologies) • Andy Rauland (Nokia Siemens Networks) • Helmut Neukirchen (Uni Göttingen) • 35 funded days and 28 voluntary days spent • Provided budget for funded days was even 48 days, but lack of experts. • Letter of engagements refers only to Priority 1 tasks of ToR. • Steering Group: • Dieter Hogrefe • Laurent Vreck • Shicheng Hu • Stephan Schulz • Alberto Berrini • Duration: January 2008 – September 2008 STF343 Final Report

  4. Achievements • Milestone B completed: • Final Report (47TD30), • Final draft technical report DTR/MTS-00104 (47TD31 + ATS 47TD32)(to become ETSI TR 102 976): • Covering priority 1 tasks only, i.e. • Design test architecture & Draft TR architecture element, • Adapt 3G benchmark ATS • Write TTCN for mirror ATS. • As a bonus: Priority 2 tasks covered partially, i.e. • Define System Adaptors & Draft TR SA element (Only sketched in Final DTR). • No further Priority 2 and 3 tasks, i.e. • No coverage of full TTCN-3 standard or other technologies than 3GPP. • No feedback from field tests and updates of technical report. STF343 Final Report

  5. Intra TTCN-3 Executable approach Reference ATS Mirror ATS • Advantage: minimal efforts. • no CoDecs or System Adapters must be implemented. • No real disadvantages. MTC PTC1 PTC1_mirror MTC_mirror PTC2 PTC2_mirror test system interface STF343 Final Report

  6. Inter TTCN-3 Executable approach Reference ATS Mirror ATS • Disadvantage: Huge efforts. • CoDecs and System Adapters must be defined and implemented. • Advantage: Includes all interfaces of a TTCN-3 test system. MTC PTC1 PTC1_mirror MTC_mirror PTC2 PTC2_mirror test system interface • test system interface STF343 Final Report

  7. Reference ATS and Mirror ATS • Reference ATS based on (unvalidated) benchmark ATS from MCC TF160. • AGPS (TC_17_2_4_1), • HSU (tc_14_7_4), • MAC (tc_7_1_3_1), • RAB (tc_14_2_57), • RRC (TC8_1_2_1, TC8_3_1_30, TC8_4_1_6), • GERAN (TC20_22_29), • RLC (tc_7_2_3_22). • Reference ATS and Mirror ATS together probably the largest publicly available TTCN-3 test suite: 138 KLOC TTCN-3 (incl. converted ASN.1) • 9 reference test cases and 9 mirror test cases. • Using ETSI ES 201 873-1 Core language V3.3.2 (2008-03), ETSI ES 201 873-4 Op. Sem. V3.3.1 (2008-03), ETSI ES 201 873-7 ASN.1 V3.3.1 (2008-03): • Validated by running mirror ATS against reference ATS. STF343 Final Report

  8. Obtained coverage • 55% coverage of the TTCN-3 Core language statements. • According to ToR, coverage criterion was 3GPP, not TTCN-3 concepts! • Suggestion: STF343 continuation. • Based on the TTCN-3 standard as coverage criterion. STF343 Final Report

  9. Priority 2 bonus work • Applied Intra approach: • Experimental assessment of TTCN-3 tools. • Supported by TestingTechnologies, Telelogic, Danet, and Elvior. • Proof-of-concept application of Inter approach: • XML-based CoDec and TCP-based System Adapter sketched in Annex of TR. • Used for running two instances of TTworkbench against each other. STF343 Final Report

  10. End of Presentation • Thank you for you attention! • Any questions? • Milestone B • Final report (47TD30) • Final draft technical report (47TD31) incl. ATS (47TD32) to be endorsed by MTS #47. • Continuation of STF343? • More systematic coverage of TTCN-3 standards reasonable!(Instead of covering 3GPP test purposes.) STF343 Final Report

More Related