1 / 34

SIP Testing Methodology

Elie Cohen ProLab PM 17/01/2003. SIP Testing Methodology. Agenda. SIP Testing Overview SIP Test Topology SIP Server and SIP User Agent Testing Building a Practical SIP Testing Environment ProLab Test Management Suite. SIP Testing Overview Requirement.

betty_james
Download Presentation

SIP Testing Methodology

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Elie Cohen ProLab PM 17/01/2003 SIP Testing Methodology

  2. Agenda • SIP Testing Overview • SIP Test Topology • SIP Server and SIP User Agent Testing • Building a Practical SIP Testing Environment • ProLab TestManagement Suite

  3. SIP Testing OverviewRequirement

  4. The Importance of Early Bug Detection • Early detection of software and hardware defects is crucial for mainlining development costs low Test early & Test often Cost of bug fixes% Software Cycle

  5. SIP Testing System Challenges • Minimize testing time & improve time-to-market • Testing throughout the development cycle • Perform comprehensive testing: • Load and stress • Protocol compliance • Error conditions • Network simulation • Test both signaling and media

  6. SIP Testing System Challenges (cont.) • Flexibility to change tests as needed • Change test parameters quickly • Change test topology • Ease-of-use for developers and QA engineers • Full network simulation • One or more endpoints SIP User agent • Simulate Full SIP Server application • RTP Network Simulation • Varying network topology

  7. SIP Testing System Challenges (cont.) • High performance and scalability • Generate very high rates of calls/transactions per second • Standards compliant • Based on SIP RFC3261 for User agent

  8. SIP Test Topology

  9. UAC UAS SIP Test Environment • Simulates an endpoint capable of handling thousands of calls Scenario SIP protocol Test results IP System Under Test Test results Scenario SIP protocol

  10. UAC/UAS DUT SIP Functional Test Topology IP

  11. UAC UAC UAC UAS UAS UAS SIP Stress Test Topology • Verify that the system performs under extreme conditions and test to see that system can handle intended load IP DUT

  12. SIP Server and User Agent Testing

  13. SIP Server Functional Test Topics • Proxy testing • Request and response forwarding • State full and Stateless • Reject responses (Forwarding, registration) • Server functionality routing with address resolution (forking) & loose routing • Redirect Server Functionality: Returns “Contact this address” response • Message Validation and Invalid response handling • Record route • Outbound proxy

  14. SIP Server Performance Metrics • SIP servers typically need to handle high transaction rates • Transactions statistics: • Total Transactions per second • Total Transactions Capacity • Transactions failed per second • Percentage Transactions rejected • Calls statistics: • Calls requested per second • Calls Connected per second • Call establishment time (call setup delay)

  15. SIP Server Performance Metrics (cont.) • Registration statistics: • Total Registrations per second • Percentage Registrations rejected • Registrations requested per second • Registrations confirm per second

  16. SIP Server Registrar Test • Registrar & location database • Different types of expiration • Different type of TO header • Registration with other contact • Unregistration (expires=0) • Update existing registration • Registration with multiple contact • Multiple registration

  17. SIP Server Registrar Test (cont.) • Security • Authentication header • Different type of nonce and Realm • Existing and non existing user • User expired

  18. High Volume of Concurrent Calls • Capability to send and receive thousands of concurrent calls from single or multiple endpoints • Capability to simulate thousands of media calls simultaneously • Capability to send thousands of concurrent registrations to an SIP Server • Capability to simulate different scenarios simultaneously

  19. SIP Stress Method Testing • Burst Testing (multiple invite simultaneous) • Poisson Call distribution • Poisson Call duration • Constant Call distribution (X Calls per second) • Constant call duration • Load testing • Stress Test using only signaling • Stress Test using signaling and media

  20. Methods (invite,re-invite, cancel, bye, info, notify, subscribe, options, re-invite, refer , …) Retransmission mechanism Provisional response Register and authentication Add contact to register Timer configuration Atypical testing SIP Parsing coding and decoding headers Non standard message Call Flow - State Machine Reject response handling Multipart mime Body message SIP headers test TCP & UDP Interface SIP User Agent Testing

  21. SDP Packet • Session information • Session name and purpose. • Time(s) the session is active. • Media information • Type of media, such as video and audio. Transport protocol, such as RTP/UDP/IP and H.320. Media format, such as H.261 video and MPEG video. • SDP With different type of Media information • SDP with Telephone-event • Different Type of SDP

  22. RESPONSE TYPES Provisional (1xx class)—provisional responses are used by the server to indicate progress, but they do not terminate SIP transactions Final (2xx, 3xx, 4xx, 5xx, 6xx classes)—final responses terminate SIP transactions. CLASSES 1xx = provisional, searching, ringing, queuing etc. 2xx = success 3xx = redirection, forwarding 4xx = request failure (client mistakes) 5xx = server failures 6xx = global failure (busy, refusal,not available anywhere) Response Message

  23. Advanced RTP Testing • RTP Simulation • Packet loss , Duplicate Packets , Packets ordering • Corrupted packet & SSRC Corrupted • Delay, Jitter • Stop Sending RTP and resume. • DTMF in band and RFC 2833, DTMF in band

  24. Advanced RTP Testing (cont.) • RTP Monitoring and statistics • Packet loss and Packet distribution (sender & receiver) • RTP General information (Payload, low seq #,High Seq #, SSRC, UDP, …) • Different Codecs G711, g728, G729, G722, G723.1, H261, H263,. • RTCP • Jitter, Cumulative lost , fractional lost, …

  25. Building a Practical SIP Testing Environment

  26. Run Test SIP Testing Environment User Agent Client 1..X SIP Server SIP Server Test Management IP Device Under Test User Agent Server 1..X Media Testing

  27. Testing Lab Components • Test Management • Script and configuration Management (typical and Atypical) • Control Test Execution (Saving result, Notification ) • Test Scheduling ( Test Scheduler, Compare test result) • SIP Server • Full SIP Server Simulation (Proxy, Registrar, Location DB, Authentication) • Positive and negative response • Multi SIP Server

  28. Testing Lab Components (cont.) • SIP User Agent Client/Server P Server • Simulation UAC and UAS • Media Testing • Full Media Network simulation and media monitoring

  29. ProLab Test Management Suite SIP Testing Solutions

  30. Controlling ProLab Test Agents and scripts management Full SIP Proxy, Registrar and Redirect Server simulation SIP advanced User Agent simulation Full H.323 gatekeeper simulation H.323 advanced endpoint simulation RTP monitoring and simulation Scheduling test scenarios ProLab™ Test Management Suite ProLab Test Manager ProLab SIP Server Agent ProLab SIP Test Agent ProLab Gatekeeper Agent ProLab H.323 Test Agent ProLab RTP Analyzer ProLab Test Scheduler Voice and Video Over IP Complete Test Solution

  31. ProLab Advantage • Full Network simulation (SIP UAC/UAS, SIP Server , Advanced RTP and full automation) • Closely synchronized with protocol updates • Distributed Solution • SIP & H.323 Advanced Testing • Script Driven • Script & Result management • High performance and volume of calls

  32. Message Statistics Incoming and Outgoing Messages Multiple Agents Call Performance RTP – Packets Loss RTP- Packets Distribution ProLab Application

  33. Summary • Testing Media & Signaling over IP is typically complicated and costly if not done thoroughly • Cost effective for Media over IP • Script-driven is highly flexible and good solution for full automation • Numerous powerful testing capabilities for both SIP UAC/UAS, SIP Server, SDP and RTP. • Full SIP Network Simulation

  34. Thank You Booth #1 RADVISION www.radvision.com elic@radvision.com

More Related