A Low Cost Bidirectional Human-Computer Interface

1. A Low Cost Bidirectional Human-Computer Interface Authors: Alexey Borisenko, Lukash Monczak, Ikvir S Samra, Ovidiu Draghici, Daniel Shapiro, Voicu Groza

2. CARG 2010 Overview • Objectives • Motivation • Neuroplasticity • HCI state-of-art • Approach • Results • Conclusion & Future work carg.site.uottawa.ca

3. CARG 2010 Objectives • Non-invasive bidirectional human-computer interface • Low-cost (< $20) • Faster training time carg.site.uottawa.ca

4. CARG 2010 Motivation • HCI devices used by hospitals to alleviate suffering of patients that have lost vision, balance, or mobility. • HCI devices very expensive • Neuroplasticity mclasen.com carg.site.uottawa.ca

5. CARG 2010 Neuroplasticity Property of the brain to reorganize itself • Phantom limbs • Treatment of brain damage • Treatment of learning difficulties brainline.org carg.site.uottawa.ca

6. CARG 2010 HCI State-of-art • Brainport [Danilov05] • BCI 2000 [Schalk08] • BCCI[Walter09] • Oral Tactile Interface[Tang06] gtec.at periodistadigital.com met.usc.edu carg.site.uottawa.ca

7. CARG 2010 Approach taken Designed Prototype (BHCI): VGA Serial Data Human FPGA TDU Balance Data* Pushbuttons *Wicab has applied for provisional patents for the use of balance data for TDUs. carg.site.uottawa.ca

8. CARG 2010 Tongue Display Unit (TDU) • A TDU actuates signals onto the tongue using an electrode array • Data is received by the brain and interpreted • Signals such as balance [Danilov05] and tactile information [Tang06] are observed carg.site.uottawa.ca

9. CARG 2010 Advantages • Low cost • Simple architecture • Flexible software carg.site.uottawa.ca

10. CARG 2010 Safety Issues and Considerations Murphy and His Law • We naturally assume that any system plugged into the wall should not be connected to a person. • No Human Testing, Not Yet • For now we are doing testing with a digital oscilloscope and a multimeter. • Wireless is the Future • [Danilov05] and [Tang06], started with wired designs and left wireless as future work. carg.site.uottawa.ca

11. CARG 2010 Computer-Human Interface Sensory Perception • What humans feel carg.site.uottawa.ca

12. CARG 2010 Computer-Human Interface Actuating Signals Onto the Tongue • 12th cranial nerve [Lin09]. • Resistance of tongue [Faes99]. • Approaches to signal actuation: • Capacitive conductor (grayscale) • Time multiplexing (row, column) • Roof of the mouth [Tang06] • Surface of tongue (BHCI, Brainport) carg.site.uottawa.ca

13. CARG 2010 Results Low Cost and Proper Operation The design does not go near the current limit and was designed with very low cost components. * *http://www.youtube.com/user/uottawaBHCI#p/a/u/0/Sm0DINKrUHg carg.site.uottawa.ca

14. CARG 2010 Conclusion & Future work A low cost HCI was designed, implemented, and tested in the lab. • Human testing may follow, eventually. • Open collector ICs are required to fix fluctuating output voltage. • An upgrade to wireless is needed to approval for human testing. • Cleaning protocol • Plastic sealant carg.site.uottawa.ca

15. References • [Danilov05] Y. Danilov and M. Tyler, “Brainport: an alternative input to the brain.” Journal of integrative neuroscience, vol. 4, no. 4, p. 537, 2005. • [Tang06] H. Tang and D. Beebe, “An oral tactile interface for blind navigation,” Neural Systems and Rehabilitation Engineering, IEEE Transactions on, vol. 14, no. 1, pp. 116 –123, march 2006. • [Lin09] H. Lin, P. Barkhaus, “Cranial Nerve XII: The Hypoglossal Nerve”, Seminars in Neurology, vol. 29, no. 1, p.45-52. • [Faes99] T. J. C. Faes, H. A. van der Meij, J. C. de Munck, and R. M. Heethaar, “The electric resistivity of human tissues (100 hz-10 mhz): a meta-analysis of review studies,” Physiological Measurement, vol. 20, no. 4, p. R1, 1999. • [Borisenko10] A.Borisenko, L. Monczak, I. S. Samra, O. Draghici, D. Shapiro, V. Groza, “A Low Cost Bidirectional Human-Computer Interface,” Medical Measurements and Applications (MeMeA), Apr. 2010.