320 likes | 510 Views
Real time Color- FilteredAperture Depth Estimation with single image . Outline. Color Filtered Aperture Depth Estimation Box Filter Matlab C Code With Intel IPP Library Compute Shader Depth E stimation Result. Color filtered aperture. Color filtered aperture Depth estimation.
E N D
Real time Color-FilteredAperture Depth Estimation with single image
Outline • Color Filtered Aperture • Depth Estimation • Box Filter • Matlab • C Code With Intel IPP Library • Compute Shader • Depth EstimationResult
Color filtered aperture • Color filtered aperture • Depth estimation
Color filtered aperture Canon EF 50mm f/1.8 II lens Aperture part of the disassembled lens Theprototype lens with color-filters FujifilterSC-58, BPB-53, and BPB-45
Explain The Color Misaligned Color filters Background Foreground object Image sensor Lens Color filters Background Image sensor Lens
Depth estimation • Color filtered aperture • Depth estimation
Color-Alignment Measure • Color alignment metric • where are the eigenvalues of the covariance matrix of the color distribution. • According to PCA (Principle Component Analysis )
Color-Alignment Measure • Complicated computation
Explain the complexity R G Disparity=0 Disparity=1 Disparity=2 Disparity=maxD B
Box Filter • Using box filter method to calculate the average of all blocks Simultaneously. 4 = 9 - 3 - 3 + 1
Depth Estimation Result Background (far) Foreground object Background (near)
C Code with Intel IPP Library • We also use Intel IPP(Integrated Performance Primitives)library to reduce the running time . • Intel IPP is an extensive library of multicore-ready, highly optimized software functions for digital media and data-processing applications. • It runs faster while using Intel IPP library because the IPP library uses SIMD (Single Instruction Multiple Data) instructions.
Compute Shader • A compute shader provides high-speed general purpose computing and takes advantage of the large numbers of parallel processors on the graphics processing unit (GPU). • A compute shader is designed and implemented with HLSL.