330 likes | 479 Views
Computation Sensory Motor-Systems Lab - Prof. Ralph Etienne-Cummings. Modeling life in silicon. The Big Picture: Lab Motivation. Developing Biomorphic Robotics. Adaptive Biomorphic Circuits & Systems. Restoring function after limb amputation.
E N D
Computation Sensory Motor-Systems Lab- Prof. Ralph Etienne-Cummings Modeling life in silicon
The Big Picture: Lab Motivation Developing Biomorphic Robotics Adaptive Biomorphic Circuits & Systems Restoring function after limb amputation Restoring locomotion after severe spinal cord injury
Computation Sensory Motor-Systems LabRalph Etienne-Cummings’ Lab • Towards a Spinal Neural Prosthesis Device • Decoding Individual Finger Movements Using Surface EMG Electrodes • Normal Optical Flow Imager • Integrate-and-Fire Array Transceiver • Optimization of Neural Networks • Design of Ultrasonic Imaging Arrays for Detection ofMacular Degeneration • Precision Control Microsystems
Towards a Spinal Neural Prosthesis Device Jacob Vogelstein Francesco Tenore
Our Approach • RS • Muscles • SLP • Source: Grillner, Nat Rev Neurosci, 2003 Previous approaches ignore CPG and focus on controlling muscles to generate locomotion We propose to directly control the CPG and use it to generate locomotion Basic idea is to recreate natural neural control loop in an external artificial device (i.e. replace tonic and phasic descending inputs to the CPG with electrical stimulation)
The Big Picture: Lab Motivation Developing Biomorphic Robotics • Adaptive • Biomorphic Circuits & • Systems Restoring locomotion after severe spinal cord injury Restoring function after limb amputation
Responsibilities of Locomotion Controller 1. Select Gait+ specify desired motor output - phase relationships - joint angles 2. Activate CPG + tonic stimulation initiates locomotion - epidural spinal cord stimulation (ESCS) - intraspinal microstimulation (ISMS) 4. Control Output of CPG + phasic stimulation (efferent copy required for precisely-timed stimuli) - convert baseline CPG activityinto functional motor output - correct deviations - adjust individual components - adapt output to environment Select gait ~ brain Activate CPG ~ brainstem (MLR) Efferent copy ~ efferent copy Enforce/adapt output ~ phasic RS 3. Generate “Efferent Copy” + monitor sensorimotor state - external sensors on limbs - internal afferent recordings
Gait Control System Analog signal processing front-end Spike processing back-end Source: Vogelstein et al., IEEE TBioCAS, (submitted) 12 pairs of IM electrodes: 3 each for left/right hip, knee, and ankle extensors/flexors Two types of sensory data were collected for each leg Hip angle (HA) Ground reaction force (GRF)
Results: SiCPG Chip Controls Locomotion in a Paralyzed Cat Source: Vogelstein et al., IEEE TBioCAS (submitted)
Decoding Individual Finger Movements Using Surface EMG Electrodes Francesco Tenore
Problem Fast pace of development of upper-limb prostheses requires a paradigm shift in EMG-based controls Traditional control schemes typically provide 2 degrees of freedom (DoF): Insufficient for dexterous control of individual fingers Surface ElectroMyoGraphy (s-EMG) electrodes placed on the forearm and upper arm of an able bodied subject and a transradial amputee
Implemented Solution Neural network based approach Number of electrodes (inputs) amputation level (I-V) Level I: 32 electrodes, Level V: 12 electrodes
Results High decoding accuracy: Trained able-bodied subject, ~99% Untrained transradial amputee, ~ 90% No s.s. difference in decoding accuracy between able-bodied subjects and transradial amputee No s.s. difference in decoding accuracy between networks that used different number of electrodes (12-32)
Current/Future Work Towards real-time control: training on rest states and movements Implementation on Virtual Integration Environment (VIE) Independent Component Analysis (ICA) to minimize number of electrodes by choosing the ones that most contribute to the accuracy results
Normal Optical Flow Imager Andre Harrison
Normal Optical Flow Imager Computer Vision Neuromorphic ADC
Normal Optical Flow Imager • Imager that computes 2-D dense Normal Optical Flow estimates using spatio-temporal image gradients, without interfering with the imaging process • Optical Flow is the apparent motion of the image intensity
Integrate-and-Fire Array Transceiver Fopefolu Folowosele
Motivation The brain is capable of processing sensory information in real time, to analyze its surroundings and prescribe appropriate action Software models run slower than real time and are unable to interact with the environment Silicon designs take a few months to be fabricated, after which they are constrained by limited flexibility
IFAT The IFAT combines the speed of dedicated hardware with the programmability of software for studying real-time operations of cortical, large-scale neural networks
Optimization of Neural Networks Alex Russel and Garrick Orchard
Design of Ultrasonic Imaging Arrays the Detection ofMacular Degeneration Clyde Clarke
Design of Ultrasonic Imaging Arrays the Detection of Macular Degeneration www.seewithlasik.com/.../CO0077.jpg
L L W W Tool-tip Mounted Ultrasonic Micro-Array • Create Models of Transducer array operating in Homogeneous Media B. Derive Equations for Wave Propagation in Vitreous and Retina • Scattering • Absorption [Yakub,IEEE Trans 02] C. Numerical Modeling • Finite Element Method • Finite Difference Method • Modify Design Parameters of Array to perform optimally in Surgical Environment
Adaptive and Reconfigurable Microsystems for High Precision Control Ndubuisi Ekewe
Adaptive and Reconfigurable Microsystems for High Precision Control Simaan, 2004 Ekekwe et al, US Patent (Pending)