130 likes | 218 Views
TJ Strzelecki Matt Waldersen Rick Schuman (Presenting) Krishna Jharjaria. Mind Readers. What We’re Doing. The proposed project will be a mobile brain-computer interface. Computer applications will be presented to the user through commercially available video glasses.
E N D
TJ Strzelecki Matt Waldersen Rick Schuman (Presenting) Krishna Jharjaria Mind Readers
What We’re Doing • The proposed project will be a mobile brain-computer interface. • Computer applications will be presented to the user through commercially available video glasses. • An EOG and commercially available EEG will be mounted inside of a common enclosure and will enable the user to navigate and select various applications. • A dsPIC microcontroller will be used to acquire the EOG and EEG signals, the EEG signals will be analyzed by an FPGA and a BeagleBoard XM will control the virtual reality environment as well as execute all of the computer applications
Project-SpecificSuccess Criteria • An ability to encode/decode data packets from a NeuroSky EEG. • An ability for a user to select applications based on signals from a NeuroSky EEG. • An ability for a user to navigate between different applications on a display using EOG signals. • An ability for the system to interactively train the user to effectively operate the device. • An ability to display a live video stream from an external camera module, and integrate applications into the video system.
BeagleBoard – Software Considerations SPI Micro communication 16-bit SPI USB Webcam 640 x 480 resolution 30 – 60 Hz S-Video out Ubuntu Linux dist. Software Modules OpenCV Frame capture Possible Image Processing ~ Posix Threads Gtk or OpenGL
MicroController – Software Considerations SPI EOG (2) BeagleBoard-xM 8 word Fifo Timer for Interrupts UART EEG dongle DSP library FFT function Derivative of EOG signals GPIO pins for FPGA External ADC
FPGA – Software Considerations GPIO I/O Vertical input EOG (5) Horizontal input EOG (5) Direction output signal (4) N_Reset Clock on the board 5 Hidden Layers Out to 4 binary outputs Each Neuron Multiplier Lookup Table Non-linear sigmoid function Muxed Inputs 10-bit Floating Point generated