1 / 33

An Automatic Calibration Approach for

An Automatic Calibration Approach for Interactive Multi-resolution Tabletop Display System. 互動式多重解析度桌面顯示系統之自動校正. Speaker: Bo- Shiun Chiou. 2010.05.21. Outline. Introduction Related Work System Design Projector and Camera Calibration

winona
Download Presentation

An Automatic Calibration Approach for

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. An Automatic Calibration Approach for Interactive Multi-resolution Tabletop Display System • 互動式多重解析度桌面顯示系統之自動校正 Speaker: Bo-ShiunChiou 2010.05.21

  2. Outline • Introduction • Related Work • System Design • Projector and Camera Calibration • Experimental Result • Conclusion

  3. Introduction • Motivation • Multi-resolution • Featuring nature of human-vision • Cost-effective large high-res display • Projector mosaic • Hardware/software configuration • Seamless multi-projector display

  4. Introduction • Issues • Geometric Calibration • Distortion effect • Misalignment • Photometric Uniformity • Common color gamut • Overlapping/Inter/Intra color variation • Auto/Manual Approach • Cost, accuracy, stability, etc.

  5. Outline • Introduction • Related Work • System Design • Projector and Camera Calibration • Experimental Result • Conclusion

  6. Related Work • Multi-Resolution Display • Focus Plus Context • Projector + LCD monitor • Fixed high-res area P. Baudisch and N. Good, “Focus plus context screens: visual context and immersion on the desktop,” in SIGGRAPH ’02: ACM SIGGRAPH 2002 conference abstracts and applications. New York, NY, USA: ACM, 2002, pp.70–70.

  7. Related Work • Multi-Resolution Display • Fovea Tablett • Tablets as high-res area • Coded markers for tracking • Support multiple high-res • Physical Boundary • Visual discontinuity J. Geisler, R. Eck, N. Rehfeld, E. Peinsipp-Byma, C. Sch‥utz, and S. Geggus, “Fovea-tablett: A new paradigm for the interaction with large screens,” in HCI (8), 2007, pp. 278–287.

  8. Related Work • Multi-Resolution Display • i-m-Top • Fovea + peripheral projectors • Movable high-res area • Multi-touch • Intuitive interaction T. T. Hu, Y. W. Chia, L. W. Chan, Y. P. Hung, & J. Hsu, (2008). i-m-Top: An interactive multi-resolution tabletop system accommodating to multi-resolution human vision.3rd IEEE International Workshop on Horizontal Interactive Human Computer Systems, 2008. TABLETOP 2008,177-180

  9. Related Work • Automatic projector calibration • Light sensors embedded • Structured light patterns • Cover planar/non-planar surface • Simple and accurate Lee, J., Dietz, P., Aminzade, D., Raskar, R., and Hudson, S. "Automatic Projector Calibration using Embedded Light Sensors", Proceedings of the ACM Symposium on User Interface Software and Technology, October 2004.

  10. Related Work • Automatic projector calibration • Camera homography trees • Form single virtual camera • Scalable multi-projector display H. Chen, R. Sukthankar, G. Wallace, T.-J. Cham, “Calibrating Scalable Multi-Projector Displays Using Camera Homography Trees,” CVPR Technical Sketch, 2001.

  11. Related Work • Automatic projector calibration • Array of ARTag Markers • Time-saving M. Fiala. Automatic Projector Calibration Using Self- Identifying Patterns. In Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR ’05) - Workshops (PROCAMS 2005), volume3, page 113. IEEE Computer Society, 2005.

  12. Related Work • Automatic projector calibration • Continuous Self-Calibration • Recover 3D model of surface J. Zhou, L. Wang, A. Akbarzadeh, and R. Yang, “Multi-projector display with continuous self-calibration. In Workshop on Projector- Camera Systems (PROCAMS), 2008.

  13. Outline • Introduction • Related Work • System Design • Hardware Configuration • Software Architecture • Projector and Camera Calibration • Experimental Result • Conclusion

  14. Hardware Configuration (3) Mirror (7) Color Camera (4) Pan-Tilt Unit (2) Fovea Projector (6) IR Camera (1) Peripheral Projector (5) IR Illuminator

  15. Outline • Introduction • Related Work • System Design • Hardware Configuration • Software Architecture • Projector and Camera Calibration • Experimental Result • Conclusion

  16. Software Architecture Analysis Status Control Camera Candidate Point Selection Encoding Decoding Pre-Processing Un-distortion Mapping Function Projector Application Rendering Applications Pattern Select

  17. Outline • Introduction • Related Work • System Design • Projector and Camera Calibration • Peripheral Projector Calibration • Fovea Projector Calibration • IR Camera Calibration • Experimental Result • Conclusion

  18. Peripheral Projector Calibration H H H H H H Table Table Table Table PP PP Cam Cam Cam PP Cam PP • Use gray code patterns Camera View : PP -1 = Pre-warped image

  19. Peripheral Projector Calibration • Homography(Cam, Table) C1 C0 C3 C2 Mean Shift Edge Detect Line Fitting Corner ID Mapping

  20. Peripheral Projector Calibration Preprocess Point Select Encoding Decoding Mapping Masking C1 C2 C3 C0 ... Denoise Contrast Stretch P0 P1 P2 P3

  21. Outline • Introduction • Related Work • System Design • Projector and Camera Calibration • Peripheral Projector Calibration • Fovea Projector Calibration • IR Camera Calibration • Experimental Result • Conclusion

  22. Fovea Projector Calibration H H H H H H Table Table Table Table FP FP Cam Cam FP FP Cam Cam • Use gray code patterns Camera View : PP FP -1 = Pre-warped image

  23. Outline • Introduction • Related Work • System Design • Projector and Camera Calibration • Peripheral Projector Calibration • Fovea Projector Calibration • Homography Estimation using Lookup Tables • IR Camera Calibration • Experimental Result • Conclusion

  24. Homography Estimation using Lookup Tables • Interpolate (Pan, Tilt) for new point N P0 P1 d0 d2 d1 T0 T1 Table X d3 Y

  25. Homography Estimation using Lookup Tables • Interpolate candidate point P0 NP P1 T0 NT T1 Table X Y

  26. Outline • Introduction • Related Work • System Design • Projector and Camera Calibration • Peripheral Projector Calibration • Fovea Projector Calibration • IR Camera Calibration • Experimental Result • Conclusion

  27. IR Camera Calibration • Semi-automatic approach • Finger detection • Easy & user-friendly PP IR Camera

  28. Outline • Introduction • Related Work • System Design • Projector and Camera Calibration • Experimental Result • Conclusion

  29. Experimental Result • Comparison-manual approach • Google map • Incomplete fovea region • Take about 60 mins for 36 calibration poses Y F1 F1 : Calibration Pose F2 F2 V1 V2 V1 V2 : Touch Point X V3 V4 V3 V4 F3 F3 F4 F4

  30. Experimental Result • Comparison-automatic approach • Google map • Complete fovea region • Take about 40 mins for 290 calibration poses

  31. Outline • Introduction • Related Work • System Design • Projector and Camera Calibration • Experimental Result • Conclusion

  32. Conclusion • We provide an automatic calibration method in multi-resolution display with vision-based techniques • Continuous pan-tilt/homography map

  33. Thank you

More Related