140 likes | 286 Views
Vibro-Tactile feedback during Pen Manipulation in Space. Fareed Ahmed Fareed.Ahmed@uta.fi. Project for the course New Interaction Techniques Fall 2003. Overview. What is Tactile Feedback Project Overview Apparatus Applications / Conclusion Future Investigation References Questions.
E N D
Vibro-Tactile feedback during Pen Manipulation in Space Fareed Ahmed Fareed.Ahmed@uta.fi Project for the course New Interaction TechniquesFall 2003
Overview • What is Tactile Feedback • Project Overview • Apparatus • Applications / Conclusion • Future Investigation • References • Questions
Tactile Feedback Tactile Means • Perceptible by touch: TANGIBLE • Relating to the sense of touch • Referring to the sense of contact with the object, mediated by the responses of low-threshold mechanoreceptors innervating the skin, within and around the contact region. • Mechanoreceptors • Human being and other animals have several types of receptors of mechanical stimuli. Each initiates nerve impulses in sensory neurons when it is physically deformed by an outside force such as: • touch, pressure, stretching, sound waves, motion
Project Overview • Three Main Parts • Capture Video • Process Image • Produce Tactile Feedback
Apparatus Used • WebCam • Logitech Tactile Feedback Mouse • Tactile Pen
Timer1 Vibro-Tactile feedback Form Load WebCam: Connect and initialize GetData ClipBoard CapEditCopy to copy single frame to clipboard CaptureImage PSet StartEffect Picture Control: Display green pixel if RGB value in green range Col.R < 80 And Col.B < 180 And Col.G > 190 ImmersionControl PicFrame_MouseMove()
Video Capture • Capture Videos using Logitech webcam Private Sub Form_Load() Retrieves driver info capGetDriverDescriptionA 0, lpszName, 100, lpszVer, 100 lwndC = capCreateCaptureWindowA(lpszName, WS_CHILD Or WS_VISIBLE, 0, 0, 160, 120, picVideo.hwnd, 0) capSetCallbackOnVideoStream lwndC, AddressOf MyFrameCallback End Sub Public Sub captureImage() capEditCopy lwndC picFrame.Picture = Clipboard.GetData End Sub
Video Processing • Capture Video as Frames • Process each Frame as Image • Detect green colour in Image • Highlight One of Nine sectors on Screen
Produce Tactile Feedback • Generate Tactile Feedback Using • Tacticons created by Immersion Soft • Tactile impact redirected from Mouse to Pen/Stick
Applications Applications for the disabled people • for example, presenting information or models with a tactile display when the user does not see well Tactile feedback as a part of graphical user interface • for example, to be used to give feedback on specific events Games, virtual reality • the simulated world feels more real when the user can really touch it
Future Investigations [3, 4] • Study Subjects behavior with Application • Addition of Sound with tactile feedback • Creation of a Game with Tactile Feedback • Application Integration with mobile Devices
References • [1] Corde Lane and Jerry Smith: Force and Tactile Feedback http://www.hitl.washington.edu/scivw/EVE/I.C.ForceTactile.html • [2] Cao, X., Balakrishnan, R. VisionWand: Interaction Techniques for Large Displays using a Passive Wand Tracked in 3D. http://www.cs.toronto.edu/~caox/uist2003_visionwand.pdf • [3] Zack Rosen: Creating a Web Browser For The Blind Using Tactile Feedback http://www.darktide.nu/nwa/zack/flash/PJAS10.ppt • [4] Roope Raisamo: Tactile User Interfaces http://www.cs.uta.fi/kurssit/Interact/interact5-2001.ppt • [5] Jeonghun Ku, Richard Mraz: Implementing a Data Glove withTactile Feedback http://www.swchsc.on.ca/~virtualreality/downloads/IWVR%202003%20Abstract.pdf