290 likes | 479 Views
Non Invasive Brain Computer Interfaces for Communication and Control. Non Invasive Brain Computer Interfaces for Communication and Control. Fabio Babiloni Department of Physiology and Pharmacology, University of Rome “La Sapienza”. Fabio Babiloni
E N D
Non Invasive Brain Computer Interfaces for Communication and Control Non Invasive Brain Computer Interfaces for Communication and Control Fabio Babiloni Department of Physiology and Pharmacology, University of Rome “La Sapienza” Fabio Babiloni Department of Physiology and Pharmacology, University of Rome “La Sapienza”
Technologies for the study of brain functions Epilepticus sic curabitur ('The way to cure an epileptic') Sloane Manuscript, collection of medical manuscripts, end of the 12th century - British Museum, London
Technologies for the study of brain functions Cauterisation (15th century) Image taken from the first medical textbook "Cerrahiyyet'ül Haniyye", written in Ottoman language by the Turkish surgeon Serafettin Sabuncuoglu.
Jan Sanders Van Hemessen (1500-1566), The surgeon 1550, El Prado, Madrid
8-12 Hertz, alpha EEG waves Variations of EEG waves are correlated with some mental states 8-12 Hertz, mu EEG waves
“To move things is all that mankind can do; … for such the sole executant is muscle, whether in whispering a syllabe or in felling a forest.” Sir Charles Sherrington, 1924
What a BCI is • “Brain–computer interfaces (BCI’s) give their users communication and control channels that do not depend on the brain’s normal output channels of peripheral nerves and muscles.” • “A BCI changes the electrophysiological signals from mere reflections of CNS activity into the intended product of the activity: messages and commands that act on the world” Wolpaw, 2002
BCI: logical scheme Increase of performance appropriate feature extraction Modification ofBrain Signals Signal Features computer training user training Psychological Effort(Intention) Classification Of Intent Environment appropriate feedback strategy
Movement-related thoughts elicited specific cortical patterns • Several EEG studies have also demonstrated that imagined movements elicited desynchronization patterns different for right and left movement imaginations • Neuroscientific studies with fMRI have demonstrated that motor and parietal areas are involved in the imagination of the limb movements Imagined left movement Executed left movement
EEG features for BCIs Detection of mu rhythm modulation Detection of P300 Detection of Slow Cortical Potentials Detection of steady-state VEPs SINC 2007 11
Sensory motor rhythms • SMR is a 8-12 Hz oscillatory rhythm of the brain’s electrical activity. • It is detected on the central electrode sites (over the sensorimotor cortex) • It is associated with inhibition of motor activity From Wolpaw et al. 2002, Clinph 12
EEG features for BCIs Detection of mu rhythm modulation Detection of P300 Detection of Slow Cortical Potentials Detection of steady-state VEPs SINC 2007 13
P300 Potential P300 potentials • The P300 is an event-related potential, dominating at parietal electrode sites. • P300 follows unexpected sensory stimuli or stimuli that provide task related information • P300 speller From Selllers & Donchin 2006, clinph
Research Applications • Speller • “Symbolic” Communication • Game • Environment Control • “Virtual” Mobility • Mobility • Neuroprosthesis
Ministero degli Affari Esteri Progetto “Brain Computer Interfaces Between China and Italy (BCI2)” Speller Credits: F. Aloise F. Babiloni U. Sapienza, Roma S. Gao Tsinghua Univ., RPC B. Hong Tsinghua Univ., RPC
Fondazione Banca Nazionale della Comunicazione Progetto “Inclusione nella ICT di soggetti affetti da grave disabilità motoria tramite…” Game Credits: F. Aloise F. Babiloni U. Sapienza, Roma
Fondazione Telethon Progetto “ASPICE” “Virtual” Mobility Credits: F. Aloise G. Oriolo U. Sapienza, Roma A. Cherubini U. Sapienza, Roma
European Commission – 6th Framework Programme Progetto “MAIA” FP6 Mobility Credits: J. Millàn IDIAP, CH M. Nuttin KU Leuven. B F. Cincotti FSL
Neuroprosthesis Credits: F. Babiloni F.Aloise F. Cincotti FSL M.C. Carrozza SSSA, Pisa
Future trends • “It’s always hard to make prediction, especially about the future” • “640 KB RAM will be adequate for everybody in the future” • Bill Gates, 1981 IBM • “Computers are interesting, but the mondial market for them is limited in the future to not more of 5 pieces per year” • Thomas Watson, IBM president, 1949 • “People will not wear scalp electrodes during normal daylife” • Chief of Research and Development of a mobile phone company