1 / 32

Finger Detection for Multi-Touch Tabletop Display System 多重觸控桌面顯示系統之手指偵測

Finger Detection for Multi-Touch Tabletop Display System 多重觸控桌面顯示系統之手指偵測. Su-ting, Chuang 2010/8/2. Outline. Introduction Related Work System and Method Experiment Conclusion & Future Work. Outline. Introduction Related Work System and Method Experiments Conclusion & Future Work.

jason-forbes
Download Presentation

Finger Detection for Multi-Touch Tabletop Display System 多重觸控桌面顯示系統之手指偵測

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Finger Detection for Multi-Touch Tabletop Display System多重觸控桌面顯示系統之手指偵測 Su-ting, Chuang 2010/8/2

  2. Outline • Introduction • Related Work • System and Method • Experiment • Conclusion & Future Work

  3. Outline • Introduction • Related Work • System and Method • Experiments • Conclusion & Future Work

  4. Introduction

  5. Outline • Introduction • Related Work • System and Method • Experiments • Conclusion & Future Work

  6. Related Work • FTIR (Frustrated Total Internal Reflection) J. Y. Han, “Low-cost multi-touch sensing through frustrated total internal reflection," in Proceedings of the 18th annual ACM symposium on User interface software and technology (UIST '05). New York, NY, USA: ACM Press, 2005, pp. 115-118.

  7. Related Work • DI (Diffused Illumination) J. Rekimoto and N. Matsushita, “Perceptual surfaces: Towards a human and object sensitive interactive display," Workshop on Perceptural User Interfaces (PUI'97), 1997.

  8. Related Work • TouchLib • A multi-touch development kit • Finger detection processing flow chart Background Subtraction Simple Highpass Scale Threshold

  9. Outline • Introduction • Related Work • System and Method • Experiments • Conclusion & Future Work

  10. Hardware Configuration (2) IR Camera (3) IR Illuminator (1) Peripheral Projector

  11. Hardware Configuration • Order of diffuser layer and touch-glass layer spot IRcamera IRcamera 4 3 Diffuser layer Touch-glass layer 2 spot 1 IR illuminator IR illuminator IRcamera IRcamera

  12. Hardware Configuration • Problem: • IR rays will be reflected by the touch-glass and resulting hot spot regions in camera views • Solution: • Use other cameras to recover the regions which are sheltered by IR spots

  13. Software Architecture • Detection system • Image Stitching • FingerDetection • Finger Tracking • Parameter determination Image Stiching Finger Detection Finger Tracking

  14. Software Architecture • DirectShow • Filter-based framework • GShow • GPU-accelerated framework

  15. Image Stitching IR Camera Undistortion HomoWarp Image Blending IR camera Undistortion HomoWarp

  16. Image Stitching • HomoWarp • Goal • Unify finger size among different position of table

  17. Image Stitching 5 2 2 5 • HomoWarp • Method • Calculate homography in advance 6 1 3 4 1 2 3 6 5 4

  18. Image Stitching • HomoWarp • Warp image from each camera to virtual space

  19. Image Stitching • Image Blending

  20. Parameter Determination • Requirements of ideal finger detection system • Sensitive • Noise-free • Evaluation of parameters • Data Collection • Depict trace • Measurement • Minimize miss and false alarm Miss False Alarm

  21. Parameter Determination • Ideal finger detection • Only one fingertip landing on trace • Continuity among frames

  22. Parameter Determination

  23. Parameter Determination Touch Data Detection System Test Set Parameter Combination Detection Result Parameters Determinator Applicable set of Parameters Ground Truth (Trace)

  24. Outline • Introduction • Related Work • System and Method • Experiments • Conclusion & Future Work

  25. Experiments • Performance evaluation

  26. Experiments • Parameter determination • Decide parameters in our system • Adopt sampling-based parameter search technique Background Subtraction Normalization Difference of Gaussian Binary Finger Analysis Subtract value Smooth kernel Threshold Finger Size

  27. Experiments • Parameter determination • Exhaustive search • Parameter combination • 5 (step) *5 (step) *5 (step) *5 (step) = 625 • Applicable parameter num • 16/625 = 2.56%

  28. Experiments • Parameter determination • Particle filtering Sampling Measure

  29. Experiments

  30. Experiments

  31. Outline • Introduction • Related Work • System and Method • Experiments • Conclusion & Future Work

More Related