340 likes | 442 Views
H.264 and DIS. 指導教授:楊士萱 老師 學生:鄭馥銘. Outline. Introduction of DIS Combine DIS and H.264 Some problem for combination issue Future work. Outline. Introduction of DIS Combine DIS and H.264 Some problem for combination issue Future work. Introduction. Why use DIS in video-footage device
E N D
H.264 and DIS 指導教授:楊士萱 老師 學生:鄭馥銘
Outline • Introduction of DIS • Combine DIS and H.264 • Some problem for combination issue • Future work
Outline • Introduction of DIS • Combine DIS and H.264 • Some problem for combination issue • Future work
Introduction • Why use DIS in video-footage device • Video footage from hand-held camera is typically jerky due to small,unwanted camera movements. • We present a video stabilization algorithm aimed to produce a compensated video sequence so that the camera’s undesirable shake or jiggle can be removed.
Categories of DIS • Mechanical-Optical system • Mechanical-Digital system • Fully Digital system
Architecture of DIS - 1 • Pre-processing Diadv :Need additional memory、sensor、chip input output Stabilization Video-Encoder Video-Decoder
Architecture of DIS - 2 • Post-processing Adv:No motion estimation computation Disadv:Coding efficiency can not be increased Stabilization input output Video-Encoder Video-Decoder
Architecture of DIS - 3 • Combine-Encoder • Adv:Save memory、sensor、chip、Coding efficiency can be increased。 • Disdv :? Stabilization input output Video-Encoder Video-Decoder
Summarize the goal of DIS-system • Combine DIS and H.264 Encoder • Our DIS using block-base ME is suited with encoder so that DIS can immediate get MV form encoder. • Coding efficiency can be increased • Jitter can be removed
Outline • Introduction of DIS • Combine DIS and H.264 • Some problem for combination issue • Future work
H.264 Baseline Profile • Free to use • Tools • I Slice • P Slice • CAVLC • Slice Group • Redundant Slice
Review of DIS system Block-Blased Motion Estimation MVs MV Validation LMVs FMV Generation FMV Hand – shake Estimation SMV , HMV , AMV Motion correction
Review of DIS system Block-Blased Motion Estimation MVs MV Validation LMVs FMV Generation FMV Hand – shake Estimation SMV , HMV , AMV Motion correction
ME - In DIS system • MB Size
ME - In DIS system • Reference picture management • Short term • Long term
ME - In DIS system • Pixel Resolution • Full pixel • Half pixel • Quarter pixel
ME - In DIS system • H.264 Main profile • B Slice
ME - In DIS system • H.264 Main profile • Interlaced
ME - In DIS system • Slice group • Ex 1:interlace • Ex 2:foreground & background
Combine DIS system and H.264 Block-Blased Motion Estimation Block-Blased Motion Estimation MVs MV Validation MVs LMVs Hand – shake Estimation FMV Generation FMV Hand – shake Estimation SMV , HMV , AMV SMV , HMV , AMV Motion correction Motion correction
Combine DIS system and H.264 Block-Blased Motion Estimation MVs Hand – shake Estimation SMV , HMV , AMV Motion correction
H.264 Encoder Architecture HE Motion Correction ?
Outline • Introduction of DIS • Combine DIS and H.264 • Some problem for combination issue • Future work
Some problem of combination issue • Where to place Motion Correction module • What we need • MV buffer • Delay residual coding
DIS-H.264 system architecture-1 MV Buffer HE Motion Correction
Some problem of combination issue • DIS-H.264 system architecture-1 • Maybe jitter can be removed • But it does not increase coding efficiency
Remark of combination issue • Shifting frame to stable position(Motion Correction) before motion estimation, in order to increase coding efficiency. • Shifting frame to stable position(Motion Correction) before motion estimation ,Because the size of reference frame is smaller than current frame.
Future work • Ability to modify reference software program • To assess the effects of DIS-H.264 system