190 likes | 309 Views
A -domain Rate Controller for Multiplexed Video Sequences. G. Valenzise * , M. Tagliasacchi * , S. Tubaro * , L. Piccarreta. * Dipartimento di Elettronica e Informazione, Politecnico di Milano. Picture Coding Symposium 2007 November 7-9, 2007 – Lisboa, Portugal.
E N D
A -domain Rate Controller for Multiplexed Video Sequences G. Valenzise*, M. Tagliasacchi*, S. Tubaro*, L. Piccarreta *Dipartimento di Elettronica e Informazione, Politecnico di Milano Picture Coding Symposium 2007 November 7-9, 2007 – Lisboa, Portugal
Multiplexing of video sequences • Transmitmultiple video streamsover a sharedchannel • Broadcast television • Video-surveillance • etc… • The channelbandwidthislimited • Equalbandwidthpartitioningisnotoptimal
Optimal multiplexing quality quality time MINAVE Minimize the output averagedistortion MINVAR Minimize the output distortionvariance time quality time • Findanoptimal way to allocate channelbandwidthamongsequences • Example: two video sequences
Agenda • Formulate the MINAVE and MINVAR problems in the -domain • Assumptions: • Constant bit rate (CBR) channel • Frame-by-frameoptimization • Find a closedformsolutionfor the MINVAR • Compare the MINAVE and MINVAR criteria • Check the codingefficiency loss for the averagedistortion • Relax the CBR assumption • Temporalsmoothing
Problem formulation Rate-distortion operational curve of each frame can be described in the ρ-domain (He and Mitra, 2002): ρ-domain parameters can be estimated from decoded sequences
Problem formulation - MINAVE (He and Mitra, 2002)
Problem formulation - MINVAR Which is equivalent to solving When
MINAVE vs. MINVAR (simulation) MINAVE MINVAR
MINAVE vs. MINVAR • AveragedistortionofMINAVE • AveragedistortionofMINVAR • Weknow (bydefinition!) • QUESTION: • Whatis the codingefficiencyloss?
MINAVE vs. MINVAR: averagedistortionsurface MINVAR (suboptimal) Global Optimum (MINAVE)
CodingEfficiency Loss • Averagedistortionof MINAVE • Averagedistortionof MINVAR • The codingefficiency loss is
TemporalSmoothing • Relax the CBR assumption • Introduce a shared encoder buffer toperform VBR encoding • Weapply the MINVAR rate allocationwhile at the sametimeachievingtemporalsmoothing • Foreachtimeinstant: • Compute the CBR distortionprofile • Smoothitwith the low-passfilter (He, Zen and Chen, 2005) • Set Dsmoothas the target distortion and computeratesRi • Relax or tighten the rate constraintaccordingto the current buffer level
Experiment: transcoding Rate controller H.264 bitstream H.264 decoder H.264 encoder BUFFER H.264 decoder H.264 encoder H.264 bitstream ... H.264 decoder H.264 encoder H.264 bitstream
H.264/AVC results MINAVE MINVAR smoothed MINVAR
H.264/AVC results MINAVE MINVAR smoothedMINVAR
Conclusions • Summary: • Proposed a MINVAR bit allocationformultiplexed video sequences • The MINVAR allocationleverages on the -domain model (butworks on anyexponentialmodel, i.e. at high rates) • The codingefficiency loss w.r.t. MINAVE is, on average, of 0.5 dB • Future work: • Apply the MINVAR approachtoScalable Video Coding solve a discreteoptimizationproblem…
Thankyou! Questions?