1 / 2

Hand Gesture Based User Interface For Generic Windows Applications

Left Image. Marker Segmentation. 3D Kalman Filter. Application. 2D Kalman Filter. Vector Quantizer. Right Image. 3D Reconstruction. Gesture Spotter. Hand Gesture Based User Interface For Generic Windows Applications. Computer Interface

lin
Download Presentation

Hand Gesture Based User Interface For Generic Windows Applications

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Left Image MarkerSegmentation 3D Kalman Filter Application 2D Kalman Filter Vector Quantizer Right Image 3D Reconstruction Gesture Spotter Hand Gesture Based User InterfaceFor Generic Windows Applications • Computer Interface • A 2D/3D input device based on real time hand tracking • Translation of gestures to Windows commands • More natural interface for 3D design applications • Aid for disabled and deaf people • Sign language analysis, translation • Sign language teaching • Using multimodality to enable communication between disabled people • Entertainment • Applications involving hand gesture recognition, from computer games to sound and image design applications Capabilities • Camera calibration and gesture training tools • Registration of new markers through the interface • Recognition of 2D and 3D gestures in real time, modeled with HMMs • Real time 2D and 3D Kalman filtering of the trajectories • Support for two hands wearing different colored gloves • Real time mouse simulation based on hand tracking • Capability of triggering windows input device events – controlling third party applications • Generic interface that can be linked to any application through configuration

  2. Requirements Hand Gesture Interface is specifically designed to not require any special hardware Hardware Requirements • Smooth colored hand glove as the marker • Simple WDM or VFW based camera(s) • Good lighting conditions • Mainboard should be able to handle two cameras for the 3D mode Software Requirements • Windows Operating System (Tested on XP and Me) Execution • The user registers the marker by waving the hand to the camera(s) • The user trains the system any 2D or 3D gesture (2D uses only x-y) • The user modifies or replaces the configuration file to link it to any application and mouse or keyboard events • The user starts controlling the interface Remarks • Gestures are only recognized when the hand is held vertically • Keeping the hand horizontal simulates the left click of the mouse • The ends of a gesture are automatically found by the system. • The system comes with 8 pre-trained gestures, which can be changed anytime • The system comes with a pair of calibration matrices, which should work with most camera setups. If they don’t, the calibration tool needs to be used

More Related