1 / 52

Hybrid Infrared and Visible Light Projection for Location Tracking

Hybrid Infrared and Visible Light Projection for Location Tracking. Johnny Lee, Scott Hudson, Paul Dietz Carnegie Mellon University Mitsubishi Electric Research Labs UIST 2007 – Newport, RI. Hybrid Projection. one projector. infrared. visible. But, why?.

melangell
Download Presentation

Hybrid Infrared and Visible Light Projection for Location Tracking

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Hybrid Infrared and Visible Light Projection for Location Tracking Johnny Lee, Scott Hudson, Paul Dietz Carnegie Mellon University Mitsubishi Electric Research Labs UIST 2007 – Newport, RI

  2. Hybrid Projection one projector infrared visible But, why?

  3. Projector-Based Location Discovery [Lee, UIST’04] Light sensors Projector Electronics & computer

  4. Projector-Based Location Discovery calibration free: - no computer vision - no alignment - no manual input Scalable and robust

  5. Moveable Surfaces [Lee, UIST 2005] • calibration free • no external tracker • - interactive content

  6. Drawbacks Location Discovery [‘04] Moveable Surfaces [‘05] Incremental tracking Caustic B&W patterns Momentary movement

  7. Ideally Full-screen Application Content Full-screen Location Patterns

  8. Hybrid Projection one projector infrared visible for the computer for the human

  9. Infrared & Visible Projection Visible Infrared

  10. Infrared & Visible Projection Visible Infrared

  11. Infrared & Visible Projection Visible Infrared

  12. Infrared & Visible Projection Visible Infrared

  13. Infrared & Visible Projection Visible Infrared

  14. Infrared & Visible Projection Visible Infrared

  15. Infrared & Visible Projection Visible Infrared

  16. Infrared & Visible Projection Visible Infrared

  17. Infrared & Visible Projection Visible Infrared

  18. Infrared & Visible Projection Visible Infrared

  19. How?

  20. Light Source: Lamps Xenon Arc Lamp

  21. Light Technologies

  22. More Efficient and Better Lifespan Products emerging on market this year, 2007

  23. IR and Visible Light LEDs 1000 LEDs/mm2 University of Strathclyde, Institute of Photonics

  24. LED Array DMD Lens Projection optics

  25. Our Dev Kit: 180 binary images/s High-Speed Dev Kit: 16,500 binary images/s Production Unit: +50,000 binary images/s 1024x768 area = 20 binary images 60Hz tracking = 2.4% duty cycle of production DMD Required changes to commercial designs would be minimal.

  26. Demo of Capability Uses a second projector for visible content

  27. Inherent Multi-Stylus Tracking

  28. Non-Planar and Discontinuous Surfaces

  29. Static IR Patterns

  30. Concept Applications Simulated using external tracking (calibration)

  31. Hand-held projection with photosensitive tags [Siggraph 2004]

  32. Foldable Interactive Displays [submitted to CHI]

  33. Acknowledgements Funded in part by the National Science Foundation under grants IIS-0121560 and IIS-0325351 Funded in part by Mitsubishi Electric Research Labs Johnny Chung Lee johnny@cs.cmu.edu

  34. Other ways to make invisible patterns • Other non-visible wavelengths • Steganography • Color shifting • Noise encoding • Bit Timing • Synchronization may be difficult

  35. Camera-Based Tracking • Requires calibration • Requires markers for segmentation • IR sensors + transmitter is less power than 4 IR LEDs • Does not provide ID • Limitation on the number of points • Limitation on tracking rate • Limitation on scene/target complexity • Resolution is not as scalable • Less optically robust • Optical path geometry and variable illumination

  36. Projector vs Camera Tracking • Sensors provide point ID • Independent of scene/surface complexity

  37. Space-Labeling Projectors 11 Infrared LED slide projectors Potentially Low-cost Per axis: 500Hz tracking at 10-bits Outdoor motion tracking

  38. Binary Gray 0000 0001 0010 0011 0100 0101 0110 0111 1000 1001 1010 1011 1100 1101 1110 1111 0000 0001 0011 0010 0110 0111 0101 0100 1100 1101 1111 1110 1010 1011 1001 1000

  39. Binary Gray 0000 0001 0010 0011 0100 0101 0110 0111 1000 1001 1010 1011 1100 1101 1110 1111 0000 0001 0011 0010 0110 0111 0101 0100 1100 1101 1111 1110 1010 1011 1001 1000

  40. Binary Gray

  41. Binary Gray

  42. Binary Gray

  43. Binary Gray

  44. Binary Gray

  45. Binary Gray

  46. Binary Gray

  47. Binary Gray

  48. Binary Gray

  49. Binary Gray

  50. Binary Gray

More Related