40 likes | 177 Views
Part-financed by the European Regional Development Fund. Steering Committee meeting Interreg SYSIASS project Activity 3 Huosheng Hu. June 20 th 2012 ISEN. Activity 3. Sub-action 1: Definition of the spec & functionalities of multi-modal HMI This has been done and achieved.
E N D
Part-financed by the European Regional Development Fund Steering Committee meetingInterreg SYSIASS projectActivity 3Huosheng Hu June 20th 2012 ISEN
Activity 3 • Sub-action 1: Definition of the spec & functionalities of multi-modal HMI • This has been done and achieved. • Sub-action 2: Head gesture based HMI and EMG based HMI • At Essex, we have deployed a webcam and a Brain-fingers EMG sensor to build a hands-free control interface for the intelligent wheelchair. More details can be seen from the papers listed below. • Sub-action 3: Integration of head gesture, EMG and BCI data • At Essex, we have integrated the information gathered from head gestures, EMG signals and brainwaves to construct a multimodal human-machine interface for hands-free control of the intelligent wheelchair. More details can be seen from the papers listed below.
Activity 3 L. Wai and H. Hu, A multi-modal human machine interface for controlling an intelligent wheelchair using face movements, Proc. of IEEE Int. Conf. on Robotics and Biomimetics, Phuket, Thailand, 7-11 December 2011, pages 2850-2855. L. Wei and H. Hu, Towards Multimodal Human-Machine Interface for Hands-free Control: A survey, Technical Report CES-510, University of Essex, ISSN 1744-8050, January 2011. E.J. Rechy-Ramirez and H. Hu, Head movements based control of an intelligent wheelchair in an indoor environment, submitted to IEEE Int. Conference on Robotics and Biomimetics, Guangzhou, China, 7-8 December 2012.
Activity 3 • Sub-action 4: Integration of all the algorithms developed in activities 1, 2, 3. • This is to be done next, especially algorithms from Activity 2. • Sub-action 5: Test the integrated algorithms on the real wheelchair • This will be done soon. • Sub-action 6: collect data from extensive field tests • This will be done next year.