920 likes | 937 Views
Reminder. Project Proposal Due Next Mon. Submit by Email. Problems with Internet. Limited Bandwidth Varying Bandwidth Delay Delay Jitter Packet Loss Heterogeneity :. Error Recovery. You Are Here. Encoder. Decoder. Middlebox. Receiver. Sender. Network. Overview.
E N D
Reminder Project Proposal Due Next Mon. Submit by Email
Problems with Internet • Limited Bandwidth • Varying Bandwidth • Delay • Delay Jitter • Packet Loss • Heterogeneity : NUS.SOC.CS5248 OOI WEI TSANG
You Are Here Encoder Decoder Middlebox Receiver Sender Network NUS.SOC.CS5248 OOI WEI TSANG
Overview • Characteristics of the Internet • General techniques • Error recovery for audio • Effect of loss on MPEG • Error recovery for MPEG NUS.SOC.CS5248 OOI WEI TSANG
Characteristics of Internet • 60-70% of paths do not show any loss • Those with loss have an average of 4.5 – 6% packet loss [Paxson97] End-to-end Internet packet dynamics NUS.SOC.CS5248 OOI WEI TSANG
Packet Loss Pattern 1000 30 NUS.SOC.CS5248 OOI WEI TSANG
Characteristic of Internet • Bursts of loss are typically short (2-3 consecutively loss packets) • Long burst do occur • Burst may occur periodically NUS.SOC.CS5248 OOI WEI TSANG
Wireless Link • Loss rate measured in my office 10 ~ 20% • up to 50% reported! NUS.SOC.CS5248 OOI WEI TSANG
A Survey of Packet-Loss Recovery Techniques for Streaming Audio Perkins, Hodson and Hardman IEEE Network Magazine 1998
Retransmission 1 2 3 4 3 1 2 4 3 NUS.SOC.CS5248 OOI WEI TSANG
Redundant Data 1 2 2 3 3 4 4 5 1 2 2 3 3 4 5 NUS.SOC.CS5248 OOI WEI TSANG
Error Concealment 1 2 3 4 1 2 4 NUS.SOC.CS5248 OOI WEI TSANG
Pros and Cons • retransmission • redundant data • error concealment NUS.SOC.CS5248 OOI WEI TSANG
Retransmission for audio
Retransmission is Bad • Need scalable feedback • NACK consumes bandwidth • May need to retransmit frequently • Retransmission maybe useless NUS.SOC.CS5248 OOI WEI TSANG
Retransmission is Good • Only retransmit when needed NUS.SOC.CS5248 OOI WEI TSANG
Scalable Retransmission • On packet loss • T = random(0, RTT) • wait for T • multicast NACK • On receiving NACK from others • suppress own NACK NUS.SOC.CS5248 OOI WEI TSANG
Retransmit when • group size is small • loss rate is low • large latency acceptable NUS.SOC.CS5248 OOI WEI TSANG
Redundant Data for audio
Parity FEC 1011001 XOR 1000010 0010010 0001001 NUS.SOC.CS5248 OOI WEI TSANG
Parity FEC 1011001 1000010 0001001 0010010 NUS.SOC.CS5248 OOI WEI TSANG
Parity FEC Ordering NUS.SOC.CS5248 OOI WEI TSANG
Parity FEC Ordering NUS.SOC.CS5248 OOI WEI TSANG
Parity FEC Ordering NUS.SOC.CS5248 OOI WEI TSANG
Parity FEC Ordering NUS.SOC.CS5248 OOI WEI TSANG
Parity FEC Ordering NUS.SOC.CS5248 OOI WEI TSANG
Reed-Solomon Code • RS(n,k) RS NUS.SOC.CS5248 OOI WEI TSANG
Reed-Solomon Code NUS.SOC.CS5248 OOI WEI TSANG
Media Specific FEC 1 2 2 3 3 4 4 5 1 2 2 3 3 4 5 NUS.SOC.CS5248 OOI WEI TSANG
Interleaving NUS.SOC.CS5248 OOI WEI TSANG
Effect of Loss on Audio • Speech • Human ears can interpolate • Loss up to length of phoneme can still be tolerable NUS.SOC.CS5248 OOI WEI TSANG
Insertion-based Repair • Splice • Silence Substitution • Noise Substitution • Repetition NUS.SOC.CS5248 OOI WEI TSANG
Other Repair Methods • Interpolation • Regeneration NUS.SOC.CS5248 OOI WEI TSANG
Non-Interactive Apps • Interleaving • FEC • Retransmission for unicast only NUS.SOC.CS5248 OOI WEI TSANG
Interactive Applications • Media Specific FEC NUS.SOC.CS5248 OOI WEI TSANG
Error Concealment • Repeat NUS.SOC.CS5248 OOI WEI TSANG
Packet Loss Effects on MPEG Video Sent over the Public Internet Jill Boyce and Robert Gaglianello ACM Multimedia 1998
Measurement-based Study • Need to understand the problem before proposing solution NUS.SOC.CS5248 OOI WEI TSANG
NUS.SOC.CS5248 OOI WEI TSANG
Data Gathering Method • From: NYC13 , Austin21, London18 • To: Holmdel, NJ NUS.SOC.CS5248 OOI WEI TSANG
Data Gathering Method • Video: • Two 5-mins MPEG • 30 fps • 384 kbps and 1 Mbps • IBBPBBPBBPBBPBB • QSIF 176x112 and SIF 352x240 • One row per slice NUS.SOC.CS5248 OOI WEI TSANG
Average Packet Loss NUS.SOC.CS5248 OOI WEI TSANG
Packet Loss vs Time NUS.SOC.CS5248 OOI WEI TSANG
How to Fill Packets • B 1 frame 1 packet • P 1 slice 1 packet • I 1 slice 1 packet NUS.SOC.CS5248 OOI WEI TSANG
Packet Size Distributions NUS.SOC.CS5248 OOI WEI TSANG
Packet Size vs Loss Rate NUS.SOC.CS5248 OOI WEI TSANG