440 likes | 453 Views
SmartSkin is an infrastructure that allows for freehand manipulation on interactive surfaces. It supports collaborative work and fusion of virtual and real elements, using camera-based input technologies that are sensitive to lighting conditions and occlusion. The system utilizes a sensing principle based on conductive and grounded objects, enabling multi-user and multi-hand interactions. SmartSkin can be embedded in various objects and offers low-cost and scalable solutions.
E N D
SmartSkin: An Infrastructure for Freehand Manipulation on Interactive Surfaces Jun Rekimoto Interaction Laboratory SONY Computer Science Laboratories, Inc.
Background • Various types of “realworld” surfaces become interactive media • Ex:DigitalDesk[Wellner] • Support collaborative work • Fusion of virtual & real • Camera-based input technologies • Sensitive to lighting conditions, occlusion • Camera cannot be integrated in the surface • Possibility of other principle?
SmartSkin: sensing principle transmitter transmitter receiver receiver 2πfCV
SmartSkin: sensing principle Conductive & Grounded Object (Human Body) transmitter receiver transmitter receiver
To host PC wave signal reference signal Analog-Digital converter receiver receiver receiver receiver receiver receiver reference signal analog switch low-pass filter signal from electrode amp to ADC amp
Prototype I:Interactive Table • An wooden table covered by 8×9 electrodes. • 30fps
Prototype I:Interactive Table • An wooden table covered by 8×9 electrodes. • 30fps
Peak position estimation a potential field created by bicubic interpolation sensor values peak position
PrototypeII: GesturePad 24 (transmitters)× 32 (receivers) (1cm pitch)
Multiple finger detection Various image processing algorithm can be applied. • Connected region labeling • Pattern matching • Object tracking • Etc.
Interaction by physical objects As a platform of tangible interfaces. electrodes
SmartSkin • Capacitive sensing (c.f., Thermin) • Mesh-shaped electrodes • Multiple object tracking • 2.5D (2D position, distance)+shape • Fingertip detection by interpolating • Can be embedded in various objects • Low-cost, scalable
Discussions: analogy between biological “Skin” and artificial surfaces • form • Sensors on the surface • Input(outside→skin) • Touch, pressure, temperature • Output(skin→outside) • image (e.g., Chameleon) • Tactile • communication • Artificial surface -> Skin
Future Directions • Interaction techniques featuring multi hands/fingers, shapes • Non planar surface • Integration with a flat-panel display • Data communication • Ex: table becomes a communication medium • Special Thanks to … • Takaaki Ishizawa、Asako Toda(Keio University) • Kentaro Fukuchi (Tokyo Institute of Technology)
Smart Keyboard • Two hand input →Text Input • Single Hand →Command
fabric shield layer receiver transmitter body Interactive Clothing
DiamondTouch [MERL2001] • Identifies individual users • Requires external electrodes (chairs)
1-10μA 100-500KHz (5Vp-p) 動作原理(2) amp I-V amp A/D Converter LPF analog switch Transmitter (AVR)
Wireless .11, BT etc. ID
電極 物体を介した操作
Application Domains • Where to install? • Furniture, Floor, Wall • Wearables -- Clothing, Bag, Shoes • Tablet, Keyboard, Mouse, Gamepad • Mobile Devices • Robot • How to use • as a primary input device • to augment existing interaction
The Concept • Beyond The GUI dogma (Mouse+Display) • Inspired by analogies between biological skin & artificial surfaces • As An Input Device • Touch, Proximity, Digital Data (Electrostatic/magnetic coupling), energy • As An Output Device • Pixel Spatial Pattern, Pixel Temporal Pattern (beacon), Digital Data, energy, tactile, sound? • As A Communication Device • Information, Motion, Gesture, Emotion, Intimacy
なぜSkin? • 生物の「皮膚」の機能 • 保護、形態保持 • 入力(触覚) • 出力(表示)