280 likes | 462 Views
The employment of TTCN-3 for testing the Application Server in the IMS network. Damian Zolich , TTCN-3 User Conference 20 11 Ericpol Telecom Sp. z o.o. 7 – 9 June 2011 - Bled, Slovenia damian.zolich @ericpol. com Tel. : +48 663 426 716. Agenda. Introduction Step 1 Without TTCN-3
E N D
The employment of TTCN-3 for testing the Application Server in theIMS network. Damian Zolich,TTCN-3 User Conference 2011 Ericpol Telecom Sp. z o.o.7 – 9 June 2011 - Bled, Slovenia damian.zolich@ericpol.com Tel.: +48 663 426 716
Agenda Introduction Step 1 Without TTCN-3 Step 2 New test environment with TTCN-3 Step 3 Make testing easy Step 4 Our future
Our environment in numbers • About 7000 test cases • Up to 80 components in one test case • About 45 users • 930 files • 1,5 million code lines • Support for 7 different protocols • 11 interfaces
Step 1 Without TTCN-3 • Only one protocol (SIP) • Very basic scenarios • Simple environment • Simple matching mechanism
Application Server Caller Traffic Generator Callee Simple environment
New challenges • New traffic generator (H.248) • More and more complex scenarios • New protocols in the near future • More and more pressure on matching mechanism
Traffic Generator H.248 Application Server Caller MRFP Traffic Generator SIP Callee Second protocol ?
Test team problems • Preparation for the test execution • Exchanging information between traffic generators • No flexibility • Poor matching mechanism • Code reuse • Message synchronisation • Verification of correct message sequence • Timers
Solution We need something completely different. So let’s try TTCN-3
Step 2 New test environment with TTCN-3 Charging SLF Px App Px Ro (online charging) Rf(offline charging) Dh Diameter/TCP Provisioning Muta Diameter CM,PM LDAP CAI3G/XCAP IMS AS Mp Mr H.248 LDAP Audio & Video Announcements Audio & Video Conference Sh SIP MRFP Diameter/TCP ISC SIP MRFC Voice & Video mail Cx S-CSCF HSS SIP MGW I-CSCF Dx SIP MGCF PSTN/PLMN SIP P-CSCF SIP other SIPnetwork CSCF CSCF SBG SIP NNI or H.323
New challenges Test environment which enables: • Simulation of nodes around the Application Server • Support of all required interfaces • Support of all required protocols • Support of advance matching mechanism • Coordination between interfaces
Function Test Environment IMS AS HSS S-CSCF HSS Operator PM S-CSCF PIPETestport MRFP MRFP2 SLF MRFP MRFP1 Operator CM Operator PM CCF Provisioning ECF Ro (Diameter) Rf (Diameter) Sh (Diameter) Muta (LDAP) Dh (Diameter) MTAS CAI3G/ Ut (XCAP) ISC(SIP) MP (H.248) TTCN-3
SIP:INVITE SIP:180 Ringing SIP:200 OK SIP:ACK SIP:ACK SIP:INVITE Originating IMS AS SIP:INVITE SIP:ACK Alice SIP:INVITE SIP:ACK SIP:180 Ringing SIP:200 OK Terminating CSCF Originating CSCF Terminating network SIP:200 OK SIP:180 Ringing SIP:200 OK SIP:180 Ringing DIAMETER: Accounting-Request Start DIAMETER: Accounting-Answer Start Basic call setup vs. Test simulation Primary CCF
New test team problems • Testing is time consuming • Development of test cases difficult to learn • Lots of code to write for one test case • Test execution quite complex
Solution We need a good test Framework and Automation
Step 3 Make testing easy TTCN-3 function library & API • Creation and initialization of test components, routing of messages and verification of message content Test automation scripts • Run before and after the TC call flow. • Ensures test environment integrity and checks for problemscaused by TC execution.
Test Object – Service I Test Object – Service II … Test module Test module Private functions Test module Private functions Framework Scripts Test automation H248 SIP DIAMETER DNS Mp Ma Isc Mr Sh/Dh Rf Ro Directory Structure
Outgoing IMS AS Port IMS AS Incoming IMS AS Port 3. Invite 7. 200 OK 6. 200 OK 2. Invite 4. Invite 1. Invite 8. 200 OK 5. 200 OK ISC_SESSION_CTISC1 ISC_SESSION_CTISC2 Messages exchange on ports between the SUT and the Framework components (defaults used) SIP_DISPATCHER_CT 5060 ISC1 5061ISC2
Caller (ISC Session) Callee (ISC Session) HSS dispatcher Sh session X Sh session 1 IMS AS Rf Session 1 Rf Session X CCF dispatcher Non session related data Framework component overview Non-Session CSCF (SIP dispatcher) Sip caller and callee are together a SIP session Non-Session Dispatchersuses list of keys todifferientiate sessions
Framework benefits • Higher abstraction level for writing TCs • More readable/understandable test cases written in a consistent style • Complex and extensive common verification details are handled transparently and automatically • Simplifies TC maintenance and development • New checks can be added automatically to existing TCs via the framework
Framework benefits • Majority of TC’s automated • Full automated regression test • Flexibility in test case creation • User friendly
Examples of automated test activities Pre execution activity: • cleaning environment • checking environment • run external applications (e.g. wireshark) Post execution activity • collecting all logs into one archive file • monitor for hanging processes, memory leaks & system crashes
Step 4 Our future • Environment very flexible to test new features required by customers • Smart way of regression testing • More testing in shorter time
Damian Zolich,TTCN-3 User Conference 2011 Ericpol Telecom Sp. z o.o.7 – 9 June 2011 - Bled, Slovenia damian.zolich@ericpol.com Tel.: +48 663 426 716 Thank you