1 / 15

Jyh-Kuen Horng, Ming Ouhyoung Communications and Multimedia Lab.

Photo VR Editor: A Panoramic and Spherical Environment Map Authoring Tool for Image-Based VR Browsers. Jyh-Kuen Horng, Ming Ouhyoung Communications and Multimedia Lab. Dept. of Computer Science and Information Engineering National Taiwan University, Taipei, Taiwan, R.O.C. Outline.

neylan
Download Presentation

Jyh-Kuen Horng, Ming Ouhyoung Communications and Multimedia Lab.

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Photo VR Editor: A Panoramic and Spherical Environment Map Authoring Tool for Image-Based VR Browsers Jyh-Kuen Horng, Ming Ouhyoung Communications and Multimedia Lab. Dept. of Computer Science and Information Engineering National Taiwan University, Taipei, Taiwan, R.O.C.

  2. Outline • Introduction • Related works • System overview - two sub-systems • Manual editor • Automatic stitching method • Conclusions & Future work

  3. Introduction • Image-based rendering becomes more and more important • Compare with geometry-based rendering • constant rendering time regardless of scene complexity • low computational power needed • photo-realistic • How to construct a virtual environment?

  4. Related Works • Image warping • QuickTime VR by Apple Corp. • Video clips • VideoBrush • rich frame information • Hardware sensitive • IPIX • fisheye-lens camera

  5. System Overview

  6. Manual Editing (1/3) • Based on real 3D graphics model • Each photograph is taken as a texture of a 3D image plane • All kinds of affine transformation are allowed, such as translation, rotation, scaling • Pixel color is determined by multiple hit plane • ray casting • bilinear interpolation

  7. Manual Editing (2/3) • Intensity tuning • the aperture cannot be controlled - Before intensity tuning - After intensity tuning

  8. Manual Editing (3/3) • Form panoramic image • Gap closing : f’ = (360 - g) * f / 360 • f’ : adjusted focal length, f : original focal length • g : gap angle • easily propagate the error • Smoothing intensity discontinuity blending color =

  9. Automatic Stitching (1/5) • 3D point p = (X, Y, Z) • image coordinates x = (x, y, 1) p x Camera

  10. Automatic Stitching (2/5) • 3D point p = (X, Y, Z) • image coordinates xk, xkl p xl Imagek xk Imagel Camera

  11. Automatic Stitching (3/5) • The relationship between p and x • can be described using rotational model ……(1) • The mapping between image k and l is ……(2)

  12. Automatic Stitching (4/5) • We wish to minimize the squared error metric ……(3) g : gradient, J : Jacobian matrix • After d is solved, the matrix M is adapted by ……(4) D is the deformation matrix defined by d

  13. Automatic Stitching (5/5) • To eliminate the ghosting • a local search pass is introduced • do 3-D search based on x-, y-, z-rotation • perform an incremental update to R ……(5)  : angular velocity

  14. Conclusions and Future Work (1/2) • Performance • Results

  15. Conclusions and Future Work (2/2) • Some topics are under investigation • An extension of the algorithm to construct spherical environment map automatically • A faster and more robust method • Other kind of image source (e.g. video clips)

More Related