VIEW-DEPENDENT NON-UNIFORM SAMPLING FOR IMAGE-BASED RENDERING

1. VIEW-DEPENDENT NON-UNIFORM SAMPLING FOR IMAGE-BASED RENDERING Cha Zhang and Tsuhan Chen Dept. of Electrical and Computer Engineering, Carnegie Mellon University ICIP 2004

2. Introduction • Aims at further reducing the number of images required by IBR • Recursive weighted vector quantization (VQ) • The cameras can be rearranged

3. Outline • Introduction • IBR SCENE CAPTURING AND RENDERING • VIEW-DEPENDENT IBR NON-UNIFORM SAMPLING • Formulation Based on the Angular Difference • Formulation Based on the Local Color Consistency • A Recursive Algorithm for View-Dependent Non-Uniform Sampling • EXPERIMENTAL RESULTS

4. IBR SCENE CAPTURING AND RENDERING • Split the virtual view into many light rays • Assume a constant depth plane as geometry model

5. VIEW-DEPENDENT IBR NON-UNIFORM SAMPLING

6. Formulation Based on the Angular Difference • Cameras’ positions cj , j = 1, 2, · · · , N • Light rays li, i = 1, 2, · · · , L Equ. 3

7. Formulation Based on the Local Color Consistency • Use the local color consistency as a better condition • σi is the variance of the projections of O to the k nearest neighboring images • f(·) is a function which produces a large wi when Ci is small,vise versa.

8. A Recursive Algorithm for View-Dependent Non-Uniform Sampling • Initialzation wi • Update Wi • Weighted VQ as Equ. 3

9. EXPERIMENTAL RESULTS constant depth plane at the teapot’s mouth constant depth plane at the teapot’s lid