270 likes | 280 Views
Explore cutting-edge low-latency video technologies at McGill University, enabling seamless remote collaboration in music, media, and technology research. Discover the future of shared spaces and undersea window projects with near-equivalent quality video compression. Dive into past projects like distributed violin duets and jazz jams, emphasizing the importance of network speed. Learn about the challenges and solutions in achieving real-time mosaicing and the significance of network and system architectures in enhancing interactive experiences.
E N D
John Roston and Jeremy R. CooperstockCentre for Interdisciplinary Research in Music Media and TechnologyMcGill University Low-latency HD: Shared Spaces and Undersea Window
Videoconferencing: The Future? • Zack Snyder’s “Online Jam”, October 2001
For those with DSL at home... • yeah, right!
“Playing Together” experiment • New York-Ottawa, Remote Masters class, Dec. 8, 2000 Pinchas Zuckerman, Columbia U, NYC Wu Ji, Canarie ARDNOC, Ottawa
Latency: The Interaction-Killer • or put another way...
Bandwidth vs. Latency • near-equivalent quality of encoded video (HD-SDI vs HDV or SDI vs DV/MPEG) at greatly reduced bandwidth • but… compression takes time
smallensemble large ensemble speech, drumming lip synch compress acquire transmit MPEG* light speed: Mtl-LA net latency Mtl-LA networks Tolerated Synchronicity activity 100ms 90 0 10 20 80 30 40 60 70 50 * This is a theoretical “best-case” scenario. Actual performance may vary. The manufacturer makes no warranties, either express or implied, and will not be held liable for damage resulting from use of the product. Certain restrictions may apply. Offer void where prohibited by law. Batteries not included.
Going deep under… to 2000m • HD video over new undersea networks – • VENUS and NEPTUNE
“Undersea Window” Project • VENUS – Test Camera 100m • NEPTUNE – Cameras 2,000m
Shared Spaces: Panoramic High-Def • See everything - no camera panning
local loop for end-end lightpath prgram scope Network Architecture C4 OME @RISQ C4 OME @BCnet UBC 10G switch McGill 10G switch BCnet fibre RISQ fibre to servers w/ GbE i/f to servers w/ GbE i/f CA*net 4 10G Wan Phy OC-192 10G Wan Phy
Sample Result • Can your camera do this?
Distributed Violin Duet • McGill-Université de Montréal demo, Nov. 21, 2001 • IP over 1 Gbps fiber link • < 30ms latency
McLuhan: “The medium is the message” • Cooperstock's Corollary: • “The medium must be faster than the message.” * * but between protocol deficiencies (TCP, UDP), competing data flows, process scheduling on a budget, ARQ (retransmission management) without QoS, interface HW/SW “uncooperativeness”, aggressive router policies, multi-format support, echo suppression, and interface complexity… it’s much more than just the medium
Violin Masters Class • Montreal-Ottawa Trial with Pinchas Zuckerman, Feb. 20, 2002
Distributed Jazz Jam • Montreal-Stanford (CCRMA), Research Demo, Oct. 24, 2002
Vibrosensory Transmission • VRQ demo, March 8, 2004
Thank you. Further information available:http://ultravideo.mcgill.edu