180 likes | 300 Views
3T-Net@ 2nd IMTC - ETSI TIPHON H.323 Interoperability event. 19-23 April 99. Wakefield (MA). Eric Mannie (mannie@helios.iihe.ac.be) Université Libre de Bruxelles (ULB) Brussels, Belgium. The Interop Event in Brief. Jointly organized by IMTC and TIPHON.
E N D
3T-Net@ 2nd IMTC - ETSI TIPHONH.323 Interoperability event.19-23 April 99.Wakefield (MA). Eric Mannie (mannie@helios.iihe.ac.be) Université Libre de Bruxelles (ULB) Brussels, Belgium.
The Interop Event in Brief. • Jointly organized by IMTC and TIPHON. • 5 days at the Sheraton Colonial Hotel. • 28 companies participated. • more than 80 participants. • Rules of Engagement for confidentiality. • Two test schedules : IMTC and TIPHON. • Again a real test event. • with real developers . • Contacts: Greg Meyer & Reinhard Scholl.
Participating Manufacturers 8x8, Inc Accord Telecom. Applio Cisco Systems. Data Connection Ltd. DataBeam. Delta Information. Elemedia Ericsson FVC.COM Intel Lucent (Netherlands & NJ). Microsoft. Mitel Corporation. Motorola. Natural MicroSystems. NEC Europe. PictureTel Corporation. Polycom, Inc. RADvision. Smith Micro Software. Sorenson Vision, Inc. Telscom AG. Brussels University (ULB). VideoServer, Inc. VocalTec. WhitePine Zydacron.
Timing : 19-23/4/99. • Monday 19th : Installation & ad-hoc tests. • Tuesday 20th : IMTC scheduled tests. • Wednesday 21th : TIPHON ad-hoc tests. • Thursday 22th : IMTC scheduled & on- demand tests. • Friday 23rd : TIPHON scheduled tests for fast connect [and tunneling].
IMTC Tests • IMTC profiles : • profile 1 : G.711, H.261, T.120, E.164/H323ID • profile 2 : G.723, H.263, T.120, E.164/H323ID • profile 4 : G.711, H.262, T.120, E.164 • 3 scenarios (out of 5) : • test 1 : EP1 -- GK -- EP2 • test 2 : EP1 -- GK1 -- GK2 -- EP2 • test 3 : 3 EPs, 2 GKs, 1 MCU : exact topology ? • Score was taken into account, ... last time it was pass or fail.
IMTC & TIPHON Tests (1). • Tests scenarios used : • IMTC H.323 Test Scenarios (Interoperability/ Compatibility Testing). Draft 0.2, August 1998. • TS 101 337 v0.1.3 (1999-03). ETSI TIPHON. previously known as 6004. • But same ones were used in Sophia (1/99) ! • What is the difference ? • TIPHON Tests 1-3 = IMTC Test 1 : 2 “EPs”, 1 GK. • TIPHON Tests 4-6 = IMTC Test 2 : 2 “EPs”, 2 GKs IMTC : EP = terminal or GW-EP ! nothing about SCN interface in test scenarios & score table.
IMTC & TIPHON Tests (2). • All scheduled TIPHON tests were ±IMTC tests. • but IMTC clearly differentiate profiles (1, 2, 4). • and TIPHON clearly differentiate the role. • Not all IMTC test scenarios were scheduled. • Scenario 0 : PC to PC was... never scheduled ! neither by IMTC nor by TIPHON. • TIPHON added requirements and test cases in 6005. Is the IMTC document progressing ? • Should we have a better synchronization between TIPHON WG6 and IMTC CoIP ?
IMTC & TIPHON Tests (2). • Personal observations : • current IMTC & TIPHON test cases are simple. • isn’t it time to have more elaborated test cases ? • where are the PICS ? • should we test abnormal conditions too ? • source of most crashes during Interop Events. • bugs of other implementations are very useful to test how my implementation reacts ! • that kind of condition is very difficult to generate without a tool (who has one ?). • Tests for Voice quality, DTMF use,....
IMTC Scheduled Tests on Tuesday. • 9 one hour time-slots with // groups : • test 1, prof 1, 8 // groups, 15 minutes per test. • test 1, prof 2, 8 // groups, 15 minutes per test. • test 1, prof 4, 7 // groups, 15 minutes per test. • test 2, prof 1, 6 // groups, 20 minutes per test. • test 2, prof 2, 6 // groups, 20 minutes per test. • test 2, prof 4, 6 // groups, 20 minutes per test. • test 3, prof 1, 5 // groups, 30 minutes per test. • test 3, prof 2, 5 // groups, 30 minutes per test. • test 3, prof 4, 5 // groups, 30 minutes per test.
TIPHON Ad-hoc Tests on Wednesday. • Ad-hoc Tiphon tests 1 to 6 : • test 1 : IP-Host -> SCN-Phone with single GK • test 2 : SCN-Phone -> IP-Host with single GK • test 3 : SCN-Phone -> SCN-Phone with single GK • test 4 : IP-Host -> SCN-Phone with 2 GKs • test 5 : SCN-Phone -> IP-Phone with 2 GK • test 6 : SCN-Phone -> SCN-Phone with 2 GKs • But everybody was busy to debug...
IMTC Tests on Thursday. • Morning : scheduled tests : • test 1 (repetition). • 3 one hour time-slots with // groups. • test 1, prof 1, 7 // groups, 3x15 minutes test. • test 1, prof 2, 6 // groups, 3x15 minutes test. • test 1, prof 4, 6 // groups, 3x15 minutes test. • 15 minutes free at the end of each hour to re-synchronize. • After-noon : scheduled on-demand tests : • tests 2 and 3 (repetition).
TIPHON Scheduled Tests on Friday Morning. • Morning : fast connect [and tunneling] : • fast connect : 4 EPs, 3 GWs, 5 GKs. • tunneling : 3 EPs, 0 GWs, 4 GKs. • After-noon : almost everybody was packaging.
Personal Observations (1) • People participating to Interop events and people participating to TIPHON standardization meetings are not the same ! • Still basic interoperability testing. • But almost everybody was H.323v2 this time. • More bugs than during the Sophia Interop ? • Problems with keep-alives (RAS & Q.931). • Still plenty of problems with RAS interoperability.
Personal Observations (2) • Hand-made H.323 protocol analyzers : • We tested (“simple”) normal situations : • should test abnormal situations too. • Problems during this event : • NO Internet access, printer, copy machine, free phone calls, phones on each table, Web site,... • “Network problem” : one switch and a few hubs ! • Don’t do MCU tests at the end of the day. • No VLAN (?) to test multicasted messages: GRQ.
Personal Observations (3) • 2nd Interop was a kind of repetition of the first one, scheduled differently. • still very useful... but how to progress ? • Do we need “pre-production” Interops vs. “production” Interops ?
Next TIPHON-IMTCInteroperability Events • 3rd Join Interop will be in 2 months : • Sophia-Antipolis : ETSI premises. • Last (full) week of June : June 21-25. • 4th Join Interop is a SuperOp : • Hawaii : IMTC : September 13-17. • Cost is 2000 US$ per company for 2 people. • additional people : 600 US$. • Registration before the 7th of June. • It will be the last one of 3T-Net (phase 1).
References • 13td094 : Guidelines for the Organization of Interop Events. Reinhard Scholl, ETSI-TIPHON STF114. • 13td083 : Report of 2nd Joint IMTC/ETSI-TIPHON Interop, Boston, 19-23 April 1999. Reinhard Scholl, ETSI-TIPHON STF114.