1 / 147

Realizing High Quality Digital Video Over Internet

Explore the advancements in digital video transport systems and compression techniques discussed in the TEIN2 NOC Workshop by Kazunori Sugiura on July 16th, 2008, focusing on media formats, resolutions, bandwidth requirements, and streaming technologies.

tludwig
Download Presentation

Realizing High Quality Digital Video Over Internet

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Realizing High Quality Digital Video Over Internet July 16th 2008 TEIN2 NOC Workshop Kazunori Sugiura ( uhyo@kmd.keio.ac.jp )

  2. Digitized VideoTransport System How can we transport live multi-media contents?

  3. Hardware Media Format MPEG-2 H.264 DV Raw-HD WMV MOV RM WAV MP3 Ogg Analog TXT Meta-Data

  4. Sea, and Air Transportation Education Houses, Apartments, Buildings Social Services Metro, Regional Transportation Aerospace and Satellite Cars, Bikes Digital Broadcast Contents on Demand Society New Generation Internet: GLOBAL COMPUTING ENVIRONMENT To fulfill the IT requirements of every social and living activities in Asia, This project aims new generation Internet infrastructure by inter-connecting every activities. Global Computing Environment in Asia Core Technology for New Asia Internet Digital Media and Contents Life style and Livings Social and Public Activities

  5. Once upon a time

  6. Streaming ?! 1996 Internet World Exposition

  7. Rally Raid Mongolia1996 Internet World Expo

  8. Frame rate and Resolution • fps (frames per second) • NTSC：30fps (29.97fps) • PAL：25fps • Films：24fps • Resolutions ( dot resolutions) 30 Picts 30picts. 30fps 30fps 1 Second 1 Second

  9. Quality and Contents • By means of media contents • Quality ( SD to QHD ) • Bandwidth ( 1.5M to 4.5G up) • Encoding Characteristics • ( High Computation, Delays…)

  10. We are here 802.11g 100BaseT DVD DV World (720x480) 1000BT TCP Friendly IPv4/IPv6 802.11n Embedded Digital BS HDV World (MPEG2 720p 1080i) Multicast HDDVD Blu-ray FEC We are here DRM HD World (MPEG2，H.264 1080p) IPTV 10G NGN Digital Cinema (MJ 4096x2160, 2048x1080) Real HD World Uncompressed (1920 x 1080 p) QHD (3840x2160) 10GStack 16HD(SHD) (7680x4320) 64HD(VSHD) (15360x8640)

  11. Resolution and Bandwidth

  12. Summary • Media streaming over Internet is a challenge • Bandwidth • Computational power • Resolution and video quality • Advances in media compression technique • Advances in packet transport technology

  13. Compression Technique

  14. Compression Technique • Frame based Compression Method • Motion JPEG • DV • Inter Frame Compression Method • MPEG2 • MPEG4 • H.264

  15. JPEG/Motion JPEG • JPEG • Lossy data compression picture format • DCT(Discrete Cosine Transform) algorithm • Cutting High frequency • Motion JPEG • Combining JPEG pictures to make frame based video

  16. Compress even more • Using higher compression method • Motion based lossy compression • No movement • background • Movement • Target • Using the recently used • Inter Frame compression

  17. MPEG • Video CODEC • MPEG1 • MPEG2 • (MPEG3 is gone ) • MPEG4 (H.264) • Data standard • MPEG7 • Data handling • MPEG21

  18. MPEG1 • Specifications • Bandwidth: 1.5Mbps • Standards for Video CD • MPEG1 uses SIF Format • Non Interlace • 360×240×29.97Hz(NTSC)

  19. GOP(Group Of Picture) structure • GOP • Frame combination • I picture (Intra picture) • P picture (Predictive picture) • B picture (Bi-directional predictive picture) Forward prediction Bi-directional prediction I Pictire B Pictire P Pictire 15Picture/1GOP B B I B B P B B P B B P B B P

  20. MPEG2 • Higher quality encoding compared to MPEG1 • Broadcast Quality • Examples • DVD • HDV • Digital Broadcast

  21. Resolutions for MPEG2

  22. MPEG4 • Higher Compression method than MPEG2 • 1998 – • Object based encoding • For low bandwidth • MPEG-4 AVC (Part 10 ) H.264

  23. DV • DV(Digital Video) 35.382Mbps • IEC61834 (1999) • Resolution：720x480(NTSC) 25.146Mbps • Audio 1.536Mbps • 48kHz/16bit 2 channel • 32kHz/12bit 4 channel • Frame Compression using DCT • DV Cassette • mini-DV Cassette

  24. HDV • Canon, Sharp, Sony, Victor (2003) • Resolution • 1280x720 (720p) 19.7Mbps • 1440x1080 (1080i) 25Mbps • 1080/25p 1080/30p 1080/24p • Audio：48kHz/16bit 2 channel • MPEG1 Audio Layer2 (384Kbps) • MPEG2 • Inter Frame Compression • DV, mini-DV

  25. DVCPRO • Panasonic (1996) • DVCPRO • 480i(NTSC) 25Mbps • DVCPRO 50 • 480i(NTSC) 50Mbps • DVCPRO P • 480p(EDTV-II) 50Mbps • DVCPRO HD • 1080i/720p 100MBps • Interoperability with DV Format • DVCPRO Cassette

  26. What is Streaming? • Streaming • Receive Data while playing • Does not store data as a file ( DRM (Digital Rights Management) perspective • Download Playback • Download contents as a file, and playback afterwards Internet Internet Download Playback Streaming

  27. Streaming Technology • To absorb characteristics of the Internet • Some of the software technologies • Buffering ( Delays) • Session Management • Multiple Bit-rate ( Multiple Quality) • Bandwidth reservation, QoS • Error Correction • Contents Protection

  28. History in Streaming • 1994 • StreamWorks1.0(First Commercial streaming applications) • VIC, VAT, RAT developed by UCL (University College London) • 1995 • Real Audio1.0 • 1996 • Internet World Exposition IWE’96 • RTP(RFC1889) • 1997 • MS NetShow2.0

  29. History in Streaming (contd.) • 1999 • QuickTime4.0(ストリーミングへ対応) • VLC (Video Lan Client) • DVTS • 2002 • Helix( Open source ) • 2003 • Windows Media 9

  30. Streaming Theory

  31. TCP and streaming • TCP • Retransmission method • Packet receiving order guarantee • Congestion Management • Using TCP for streaming • How can we manage the real-time when • Retransmission occurs? • Congestion Management happens?

  32. UDP Streaming • UDP • No Retransmission • No Packet order guarantee • No Congestion Management • To maintain some sort of packet transport guarantee to End-toEnd • RTP/RTCP

  33. RTP/RTCP • RTP Real-time Transport Protocol • RTCP Real-time Transport Control Protocol • Standardized in RFC1890 • Standardization to transport real-time data through the network

  34. RTP Real-time Transport Protocol RFC1889 • Standard protocol for streaming • Common information required to send real-time data • Sequence Number • Timestamp • Dedicate RFC for data dependent part • Many payload format dependent on their compression method and media formats • RTP itself does not reserve resources or manage and guarantee the QoS

  35. RTP Packet v p X Extension CC CSRC Count Marker Payload Type Sequence Number Time Stamp Synchronization Source (SSRC) Contribution Source (CSRC)

  36. RTP related RFCs

  37. RTP Payload Format

  38. RTP Payload Type

  39. RTCP(Realtime Control Protocol) • RFC1889 • To Control RTP • Packet flow control, clock transmission between sender and receiver • Quality report by receiver • Jitter • Lost packet • RTCP Sender Report • Reports to receiver or the 3rd application for status report on sending conditions

  40. RTCP Packet v=2 P RC Payload TypeSR=200 Length • Report block comes afterwards Header Sender Synchronization Source SSRC NTP Timestamp Fore 32bit(Send time for reports) NTP Timestamp Lower 32bit RTP Timestamp Sender Info Sender Packet count Sender Octet Count

  41. RTCP Method • RTCP Receiver Report • Packet Loss rate, Sum of packet losses, Sequence number of received packet, jitter, last timestamp of sender report (LSR), and Delay between LSR (DLSR) • BYE • APP • Application Extension

  42. SDES Receiver information CNAME Receiver identifier NAME Receiver name EMAIL Mail address PHONE Phone No. LOC Location TOOL Application name NOTE User condition PRIV Application extension RTCP Method

  43. Summary • Streaming application over Internet uses • UDP / IP • RTP • RTCP • Ensure real-time isochronous transmission

  44. DVTS Design

  45. Video format used in IEEE1394 • DV Format • A.K.A “DV Camera” • Frame base compression • 30Mbps • 720 x 480 Pixels (NTSC) • 720 x 576 Pixels (PAL) • HDV Format • MPEG2-TS(PS) compressed High Definition DV • Inter Frame compression ( = Latency ) • Somewhat different from “HDTV” • 1080i (1440 x 1080)25Mbps, (1920 x 1080 ) • 720p (1280 x 720) 19Mbps • Less Bandwidth compared to DV 30 > 25

  46. Past frame data Is used Past frame Reused frame Simple MechanismPacket Losses • What happens when packet losses occur: • Reuse the past frame data Packet losses Present frame

  47. Frame rate reduction and Bandwidthin DV Format Bandwidth (Mbps) Frame Rate

  48. Network Friendly streaming • Packet shaping and burst-less transmission Packets time

  49. Shaping packets BURSTY PACKETS BURSTY PACKETS BURSTY PACKETS VIDEO VIDEO VIDEO AUDIO AUDIO AUDIO AUDIO AUDIO AUDIO Fragmented Video Frames AUDIO AUDIO AUDIO AUDIO AUDIO AUDIO

More Related