ResearchChannel

1. ResearchChannel Michael Wellings, Director, Engineering Immersive Medical Telepresence Workshop Phoenix 2006 Innovations in Interactive HD Video Over High-Bandwidth NetworksSeptember 6-7, 2006

2. What Is ResearchChannel? • As a consortium of universities and research institutions, we are an intellectual community that makes knowledge available to all by sharing our developments, insights and discoveries with a global audience. • We bring together ideas from the world’s premier institutions and disseminate those ideas to the public directly. • We engage our audience in the research process by communicating developments as they unfold. • We experiment with technology to enable alternative, leading-edge exchanges of our resources. • We are committed to looking forward, both in terms of our technological innovation and our continual diversification and expansion of resources for our audience.

3. Pioneering Technology Innovations • To advance global networking technologies • To explore new methods of media distribution and sharing for teaching learning and research • To further multidisciplinary multinational scientific collaboration • Because the consortium is uniquely qualified to do so

4. Our Consortium ofUniversity Participants Arizona State University California State College, Monterey Bay Duke University George Mason University Indiana University, School of Informatics Johns Hopkins University Massachusetts Institute of Technology National University of Singapore New York University Pennsylvania State University Rice University Rutgers, The State University of New Jersey Stanford University Medical Center Texas A&M University Tulane University, Freeman School of Business Universidad de Puerto Rico Universidade de São Paulo University of Alaska - Fairbanks University of Chicago University of Hawaii University of Kentucky University of Maryland University of Michigan University of Pennsylvania University of Southern California University of Virginia University of Washington University of Wisconsin-Madison Virginia Tech Yale University

5. andResearch Centers/Affiliates AARNet Advanced Network Forum AJA Video Systems Inc. Fujinon Howard Hughes Medical Institute IBM Corporation Intel Corporation Internet2 Johnson & Johnson Library of Congress Microsoft Research National Academies National Academy of Engineering National Academy of Sciences National Institute of Nursing National Institute of Standards and Technology National Institutes of Health National Library of Medicine National Science Foundation National Sea Grant College Program NTT Labs Pacific Northwest Gigapop Poznañ Supercomputing and Networking Center R1edu.org SURFnet Vulcan Northwest Inc. Wisconsin Public Television

6. OurNewest Participants

7. OurMulti-platform Distribution Cable and Satellite Television DishNetwork satellite system • 11.4 million homes Cable systems • 10.3 million homes • Streaming Worldwide • Video on demand • Broadband and multiple bit rate

8. ResearchChannel Distribution

9. U.S. Television Distribution 21.7 million households • DishNetwork satellite system • 11.5 million homes • Cable systems • 10.2 million homes • 35 states

10. New Distribution Initiatives:Cable VOD • Ideally suited to VOD platform • Charter Communications agreement adds2 million VOD subscribers • Launch first quarter 2006 with 15 titles per month • Google Video, Open Media Network

11. DigitalWell: Grid EnabledDigital Asset Management Project Focus • Easy way to acquire, collect, classify, store ,deliver large collections of digital media over IP networks. • Proxy for any type of large data sets but initially focused on video and audio assets – content agnostic • Includes broadcast/Internet Integration • Exploits next generation networking to ensure high quality – Deliver Realism • Easy-to-use Web services-based interface compatible with current Web browsers and computing platforms. • Uses pluggable authentication to ensure security and control access to collections.  • Scalable architecture ensures that collections can be built, accessed, searched and shared between disparate networked communities.  • D-Lib/Data Grid Interoperation via SRB and OAI for content and metadata sharing.. • Middleware – modular integration model • Metadata, DRM/IP, AAI, WSAPI, Grid • Automation – End to End • Capture, Describe, Preserve, Deliver

12. Grid Enabled Digital Broadcast Acquisition Tape Ingest Dub Television Scheduling Broadcast Services Encoding Captioning Services Final Cut Edit Suites DigitalWell SRB TSM Metadata Storage Tape/Disk Services Streaming VoD Services Content Distribution Services Manage Digital Essence Edit, Transcode, … Automate Metadata Device Acquisition MXF, AAF, SMPTE, MPEG7,… Archive/Preservation Re-purpose, Footage, … Service Flows

13. Near-line Archive 1st Tier Disk Cache Data Grid Storage Abstraction SRB Stage Disk Cache Near-line Archive 1st Tier Disk Cache Data Grid Storage Abstraction SRB Stage Disk Cache

15. Data Grid - Digital Library Integration • SRB and Digital Libraries • Conduit for sharing metadata and/or content in a federation • Platform for building a preservation environment • D-Libs using or considering SRB • MIT D-Space - +120 sites • Cornell Fedora – +30 sites • ResearchChannel DigitalWell • UCSD TV • CDL • Data Grids • WUNGrid • PRAGMA Grid

17. SC’05 DigitalWell SRB Data Grid Diagram – HD Collaborative Video Demonstration

18. DigitalWell Collections Existing, Ongoing, New … • +2100 hrs ResearchChannel, UWTV • +180 Ocean Science uncompressed HD • Microsoft Research Lecture Series • Multi-University Research Library • Forestry Old Growth Satellite Imagery • Deep Space Astronomy – WUNGrid Project • KEXP Radio Live Broadcasts, In Studio Sessions • +15,000 hrs Ethnomusicology • Research Instructional Medical Datasets • UW Library Collections

19. Innovations in Technology

20. Why? • To advance global networking technologies • To explore new methods of media distribution and sharing for teaching learning and research • To further multidisciplinary multinational scientific collaboration • Because the consortium is uniquely qualified to do so

21. On the Leading Edge • ResearchChannel is a collaboration among experts in Internet networking, storage/search infrastructure development, emerging streaming media and interactive technologies, digital television engineering, and video production.

22. Projects • First Internet HDTV transmission - iHDTV • Digital Asset Management System Development - DigitalWell • Automation of multiple format encoding • Webcasting (SD and HD over IP in multiple formats) • Streaming to handheld devices • ResearchChannel Internet2 Working Group

23. Advanced Media Delivery Methods • “Big Video” • HD Multiple Unicast • HD Multicast • SD Multicast • SD Multiple Unicast • WMV VOD • HD VOD • “small video” • Enhanced Phone unicast delivery • “Podcasting” • AUP of R&E networks (NLR, for example) can make 10gige Lambdas available • The Commodity Internet will catch up

24. Advanced on-line Services • 2500 hours of content on the web in multiple formats: • MPEG2 @ 5.6mbps • WMV 1300mbps • WMV multi-resolution feed • Pocket-video files being created • Programming is encoded automatically and pushed to the web • When the show first airs on the channel, the encoded VOD version is available on the web • Google downloads of ResearchChannel programming available soon

25. iHDTV Software Suite • iHDTV Explained • iHD1500 • iHD270 • HD to the Desktop • WindowsXP-based application suite • Released as Open Source as of April 24th, 2006 • Announcement at Internet2 Spring Member Meeting

26. iHDTV Explained • iHD1500 • Uncompressed SMPTE 292M 4:2:2 • Data rate total approx 1.5 gbps • Requires: • high-end HD capture cards • PCI Express platforms • Windows XP • 2 x gige network connection • Jumbo frame transport and routing

27. iHDTV Explained • iHD270 (first introduced aug 99) • Sony HDCamtm compression • SDTI data format 270mbps • AJA Xena I/O • Requires: • AJA Xena-HD capture cards • Dual Processor P4 • Windows XP • Sony HDCam Hardware encoder/decoder • Gige network connection

28. Recent Demonstrations • Sept 2005 - iGrid San Diego • Enhanced HD interactive - USA118: Global N-Way Uncompressed Interactive Conferencing • Underwater research using HD from SS Thompson – USA119: 20,000 Terabits Under the Sea • Nov 2005 - SC05 Seattle • Enhanced HD Interactive Conferencing/HD Storage, capture and editing using SRB (Storage Resource Broker)

29. iGRID 2005 San Diego • USA118: Global N-Way Interactive HD • USA119: 20,000 Terabits under the sea

30. iGrid DemonstrationUSA118: Global N-Way Interactive HD

31. Technology Support

32. iGRID 05 – USA118 • Sept 2005 - iGrid San Diego • Enhanced HD interactive - USA118: Global N-Way Uncompressed Interactive Conferencing • Remote sites: • Pacific Northwest Gigapop - University of Washington - Seattle • The WIDE (Widely Integrated Distributed Environment) Project - Tokyo • University of Wisconsin - Madison • University of Michigan – Ann Arbor • SURFnet - Amsterdam

33. iGRID 05 – USA118 • Sept 2005 - iGrid San Diego • Remote site equipment: • 2 RX iHD1500 Hosts (multicast from iGRID) • 1 TX iHD1500 Client (unicast to iGRID) • Central site equipment: • 6 RX iHD1500 Clients • 2 TX iHD1500 Hosts (Multicast) • Evertz VIP-12 HD Video Tile Generator • Multichannel mix-minus audio system

34. iGRID 05 – USA118 • iHD500 – first demonstrated at SuperComputing 2004 • Real-time HD communication: Australia and Seattle > Pittsburgh @ 1.5gbps each direction • At that time relatively high latency (1500ms RT) • 500ms hardware/software one-way • 250ms network delay one-way

36. iGRID USA 118 Network Diagram

37. iGRID USA 118

38. iGRID USA 118

40. iGRID 05 – USA119 • Sept 2005 - iGrid San Diego • First ever live HD/ip from a ship at sea to viewers on shore • Ku-Band equipment upgrade to SeaTel antenna • Careful RF engineering to design satellite Link-Budget • Real-time MPEG-2 MP@HL encoding • Ip gateway • Satellite modem 20mbps

41. Internet HDTV: VISIONS’05

42. iGRID USA 119

43. iGRID USA 119 Network

44. iHD1500 application • SMPTE 292M/ip • ~1.5gbps • 1080-60i HD video with multiplexed audio • ResearchChannel partner Intel PCE-Express 3.4GHz Dual Xeon platforms • ResearchChannel partner AJA Video Systems supplied initial round of Xena-HD capture boards

45. iHD1500 application Latency about 4 frames end to end plus network delay • 4 frames=133ms or ~ 1/7 sec • Network delay Australia>Philadelphia ~ 250ms • Satellite latency about 250ms per hop • H.323 devices about 220ms plus network delay • No significant delay in video equipment

46. Software Enhancements • iHD1500 Enhancements: • tile display generated in software • Audio mixing in software • Audio mix-minus in software • Video switching in software

47. iHD-X: Open Source Initiative • iHDTV Open Source Group • Launched Spring quarter 2006 • iHDTV Trusted Partners Group formed • Advisory groups: • Executive Team • Technical Team • Enhancement planed as first step • Wide deployment desired • Multicast tunnel nodes • Interoperability with other HD systems is an important goal

48. High Definition Video to the Desktop FORMATS MPEG2 MP@HL VC-1 (WMV-HD) H.264/AVC/MPEG4 Part 10 HDV (MPEG2 MP@H14) PLAYERS VLC WM9/10 QuickTime/MPEG4 VLC

49. Advanced Delivery Methods • The content is important, not the delivery method • We will use what works best for the application • Quality will scale to match the receiving device • Multiple delivery methods will be used • Wired delivery for stationary receivers • Non-wired delivery for mobile devices • As high speed connectivity proliferates, over-the-air transmission becomes less important for stationary receivers • The multiple use, highly connected devices in the home receive all content over high speed network connections using several forms of transport media • Ip over cable, fiber, copper, RF • CATV operators will migrate to an all-IP delivery scheme and broadcasters will be hard-pressed to compete • Traditional Broadcasting’s last stand will be rural areas in advance of expanding IP networks

50. Advanced Delivery Methods It took about a year for cable modems downstream speeds to increase from 2mbps to 8mbps in the Seattle area • High bandwidth connectivity means non-linear viewing of multi-res content which will change the face of media delivery • Global reach • Old Model: • Broadcast in your own geographic area • Compete with local broadcasters and print media • New Model: • “X-cast” (Podcast, multicast, unicast etc) to the world and become part of an immense soup of content • Compete with everyone for a small slice of a universal market