1 / 44

SmartSkin: Interactive Surfaces for Freehand Manipulation

SmartSkin is an infrastructure that allows for freehand manipulation on interactive surfaces. It supports collaborative work and fusion of virtual and real elements, using camera-based input technologies that are sensitive to lighting conditions and occlusion. The system utilizes a sensing principle based on conductive and grounded objects, enabling multi-user and multi-hand interactions. SmartSkin can be embedded in various objects and offers low-cost and scalable solutions.

ecannady
Download Presentation

SmartSkin: Interactive Surfaces for Freehand Manipulation

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript


  1. SmartSkin: An Infrastructure for Freehand Manipulation on Interactive Surfaces Jun Rekimoto Interaction Laboratory SONY Computer Science Laboratories, Inc.

  2. Background • Various types of “realworld” surfaces become interactive media • Ex:DigitalDesk[Wellner] • Support collaborative work • Fusion of virtual & real • Camera-based input technologies • Sensitive to lighting conditions, occlusion • Camera cannot be integrated in the surface • Possibility of other principle?

  3. Lev Theremin1896-1993

  4. Lev Theremin1896-1993

  5. SmartSkin: sensing principle transmitter transmitter receiver receiver 2πfCV

  6. SmartSkin: sensing principle Conductive & Grounded Object (Human Body) transmitter receiver transmitter receiver

  7. To host PC wave signal reference signal Analog-Digital converter receiver receiver receiver receiver receiver receiver reference signal analog switch low-pass filter signal from electrode amp to ADC amp

  8. Prototype I:Interactive Table • An wooden table covered by 8×9 electrodes. • 30fps

  9. Prototype I:Interactive Table • An wooden table covered by 8×9 electrodes. • 30fps

  10. Multiuser, Multihand interactions

  11. Distance measurement

  12. Input by hand(arm) shape

  13. Peak position estimation a potential field created by bicubic interpolation sensor values peak position

  14. Potential Driven Movement

  15. PrototypeII: GesturePad 24 (transmitters)× 32 (receivers) (1cm pitch)

  16. Multiple finger detection Various image processing algorithm can be applied. • Connected region labeling • Pattern matching • Object tracking • Etc.

  17. Interactions by Multi-fingers

  18. Interaction by physical objects As a platform of tangible interfaces. electrodes

  19. SmartSkin • Capacitive sensing (c.f., Thermin) • Mesh-shaped electrodes • Multiple object tracking • 2.5D (2D position, distance)+shape • Fingertip detection by interpolating • Can be embedded in various objects • Low-cost, scalable

  20. Discussions: analogy between biological “Skin” and artificial surfaces • form • Sensors on the surface • Input(outside→skin) • Touch, pressure, temperature • Output(skin→outside) • image (e.g., Chameleon) • Tactile • communication • Artificial surface -> Skin

  21. Future Directions • Interaction techniques featuring multi hands/fingers, shapes • Non planar surface • Integration with a flat-panel display • Data communication • Ex: table becomes a communication medium • Special Thanks to … • Takaaki Ishizawa、Asako Toda(Keio University) • Kentaro Fukuchi (Tokyo Institute of Technology)

  22. Smart Keyboard • Two hand input →Text Input • Single Hand →Command

  23. fabric shield layer receiver transmitter body Interactive Clothing

  24. DiamondTouch [MERL2001] • Identifies individual users • Requires external electrodes (chairs)

  25. Near-Field data transmission

  26. Hand tracking without camera

  27. 1-10μA 100-500KHz (5Vp-p) 動作原理(2) amp I-V amp A/D Converter LPF analog switch Transmitter (AVR)

  28. Wireless .11, BT etc. ID

  29. 電極 物体を介した操作

  30. Application Domains • Where to install? • Furniture, Floor, Wall • Wearables -- Clothing, Bag, Shoes • Tablet, Keyboard, Mouse, Gamepad • Mobile Devices • Robot • How to use • as a primary input device • to augment existing interaction

  31. Multi-Hand/Finger Input

  32. 複数の指による入力

  33. 距離の判定

  34. The Concept • Beyond The GUI dogma (Mouse+Display) • Inspired by analogies between biological skin & artificial surfaces • As An Input Device • Touch, Proximity, Digital Data (Electrostatic/magnetic coupling), energy • As An Output Device • Pixel Spatial Pattern, Pixel Temporal Pattern (beacon), Digital Data, energy, tactile, sound? • As A Communication Device • Information, Motion, Gesture, Emotion, Intimacy

  35. なぜSkin? • 生物の「皮膚」の機能 • 保護、形態保持 • 入力(触覚) • 出力(表示)

More Related