270 likes | 617 Views
A Brief Review of Joint Source-Channel Coding. CUBAN/BEATS Meeting 29th April, 2004 Fredrik Hekland Department of Electronics and Telecommunication NTNU. Outline. Traditional Tandem Structure (The Separation Principle). The Source and Channel Coders’ Roles.
E N D
A Brief Review of Joint Source-Channel Coding CUBAN/BEATS Meeting29th April, 2004 Fredrik Hekland Department of Electronics and Telecommunication NTNU
Outline • Traditional Tandem Structure (The Separation Principle). • The Source and Channel Coders’ Roles. • Joint Source-Channel Coding (JSCC). • Review some Approaches to JSCC. • Transcoding/Digitizing the JSCC Symbols.
The Traditional Approach Add Structured Redundancy Remove Redundancy Adapt to Channel Input Signal Source Coder Channel Coder Modulation Channel Reconstructed Signal Source Decoder Channel Decoder De- Modulation
The Traditional Approach (Cont’d) • Source coder seeks to remove all redundancy. • Channel coder seeks to obtain error-free transmission. Important question: Is this optimal when communicating analogue sources?
Pros&Cons with the Separation Theorem • Source and Channel Coders can be optimised independently. • Change source coder without affecting channel coder (and vice-versa). • Optimal for most channels. • Very robust above design CSNR. • Optimality requires infinite delay/complexity. • Not valid for certain multiuser and packet network channels. • Break-down below design CSNR. • Does not adapt changing channel qualities (No graceful degradation/improvement, Worst-case CSNR design).
Joint Source-Channel Coding (JSCC) Source and Channel Coders co-optimised to some extent. Possible benefits: • Can perform better when subjected to a delay/complexity constraint. • Provides robustness against changing channel qualities. • Broadcast channels when sender has no CSI. • Less complex systems can perform optimally without explicit coding. • Can allow channel noise to be part of the total distortion. But: All this comes at a cost of reduced flexibility!
Some Possible Approaches • Rate-Distortion Source-Channel (resource control). • Unequal Error Protection (UEP) / Hierarchical Protection. • Exploit residual correlation remaining after source coding. • Index Assignment. • Channel Optimised Vector Quantization. • Direct Modulation Organizing Schemes. Channel Code not necessary
The First “Obvious” Step towards JSCC R(D) optimized resource control CSI Source Coder Channel Coder Channel • Standard coder blocks. Channel capacity is shared “intelligently”. • CSI dependent. • Not quite “true JSCC”. No joint optimisation except for the rate. For example: 3D sub-band video coder with RCPC (Cheung&Zakhor)
Graceful Degradation/Improvement • Traditional tandem systems designed for worst-case CSNR. • No improvement when the channel is better. • Breakdown below the design threshold. • Hybrid Digital-Analogue (HDA) Systems (Mittal&Phamdo) • The linear analogue part provides robustness and/or improvement.
Multi-resolution Modulation (Kozintsev&Ramchandran) Modulation space with three levels of protection. Wavelet transform in source coder.
Direct Source-Channel Mappings • No explicit channel code. • Operate on e.g. • Quantization + Index Assignment • Channel Optimised VQ • Distribute total distortion on quantization noise and channel noise.
Direct Source-Channel Mappings • No explicit channel code. • Operate on e.g. • Quantization + Index Assignment • Channel Optimised VQ • Distribute total distortion on quantization noise and channel noise.
Example – Dimension Expansion • Problem: Signal points have more neighbours in the channel space than in the source space. • Important to utilise the entire channel space.
Example – Dimension Reduction • A Dimension Reduction mapping should: • Cover the entire source space to lower the approximation noise. • Map the most probable symbols to low-amplitude channel symbols. • Map close channel symbols back to signals close in the source space. • Match the channel symbol statistics to the channel statistics in order to attain capacity.
Example – Dimension Reduction (Cont’d) Distortion components: • Approximation noise • Channel noise • Quantization noise (transcoding)
Quantizing the JSCC symbols • Digitization necessary for further transmission in transport networks. • Transcode instead of recoding. (Avoid re-quantization and complexity at the expense of higher bit-rate) • Uniform SQ with entropy coding.
Quantizing the JSCC symbols (Cont’d) • Uniform quantization with arbitrarily number of levels + entropy coding. • Quantization step closely linked to spiral arm distance.Constant ratio between quantization step and spiral arm distance gives constant loss.