1 / 29

3-D Visualization of Functional Brain Map Data

3-D Visualization of Functional Brain Map Data. A.V. Poliakov; E.B. Moore; J.F. Brinkley, Structural Informatics Group Department of Biological Structure University of Washington. UW Human Brain Project Structural Informatics Group, Dr. Brinkley. Collaborators Neurosurgery, Dr. Ojemann

kennan
Download Presentation

3-D Visualization of Functional Brain Map Data

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. 3-D Visualization of Functional Brain Map Data A.V. Poliakov; E.B. Moore; J.F. Brinkley, Structural Informatics Group Department of Biological Structure University of Washington

  2. UW Human Brain ProjectStructural Informatics Group, Dr. Brinkley Collaborators Neurosurgery, Dr. Ojemann Psychiatry, Dr. Corina Radiology, Dr. Maravilla Medical Procedure Neurosurgery for intractable epilepsy Objective Remove epileptic foci while sparing the patient’s language function Method Language mapping using electrical stimulation Information System Help researches organize and analyze the data Unique data Study language Evaluate non-invasive imaging techniques for surgical planning

  3. Information System for Language Mapping Primary Sources of Data • Data acquired prior to surgery • MR scans ofcortical anatomy, veins, arteries • Functional MRI • Data acquired during surgery • Electrical stimulation map • Phonograms

  4. Information System for Language Mapping Primary Sources of Data • Data acquired prior to surgery • MR scans ofcortical anatomy, veins, arteries • Functional MRI EEG in grid patients • Data acquired during surgery • Electrical stimulation map • Phonograms Single unit recording

  5. Information System for Language Mapping Brain Mapper • Alignment • Masking • Reconstructing 3D models • Mapping CSM Sites

  6. Information System for Language Mapping

  7. Information System for Language Mapping Data Management Talairach Daemon Query Query the Brain Mapping Repository using XQuery • In development • fMRI DB and Automated Data Analysis • Single Unit DB SPM

  8. Web Interface

  9. Web Interface

  10. Web Interface

  11. Web Interface

  12. Web Interface

  13. Web Interface

  14. Web Interface

  15. Web Interface

  16. Web Interface

  17. 3D Visualization System Architecture • Client-server • Server-based rendering and data storage • Web-based client (e.g. Java or forms-based) Experiment Management System Client Web Interface Client #1 CGI script Client #2 Java Applet Client #3 . . . Internet Graphics Server snapshot Server snapshot Relational Database Data 3-D Image Volumes 3-D Models Stimulation Sites 2-D Images Brain Mapper

  18. 3D Visualization Requests New Users Different data modalities Various software packages Spectroscopy ERP Source Signal fMRI Collaborators New features Remote collaboration Transcranial Magnetic Stimulation

  19. 3D Visualization Limitations of current system Relatively slow software rendering Non-portable architecture SGI Irix and Linux only Large code base Needs to be maintained and developed Reliance on outdated software tools

  20. 3D Visualization Other possible approaches OpenGL, DirectX (Windows) VTK, Java3D Higher level toolkits Java3D Cross Platform Supports hardware acceleration Off-screen rendering Java Pilot studies • Performance • Off-screen rendering • Client-server Proof of concept BrainJ3D – Next Generation

  21. Live DemoBrainJ3D

  22. BrainJ3D Features Seen in Demo • Cutaway • Mapping • fMRI Overlays • Workspace

  23. BrainJ3DOther Features • Supports common formats and data types (Analyze, Minc, data created with SPM, FSL, etc.) • Leverages functionality of other programs • Increases user base • Use Java utilities • 3D model loaders • NetCDF library • 2D image API • Configuration and internal files in XML • More portable • Easy to customize

  24. BrainJ3DOther Features • Client/Server • Client/Server mode looks and behaves exactly like standalone mode • Reduced performance • Sending the image is a bottleneck • Takes advantage of built in Java security • Thin client only requires installation of Java • Java3D and accelerated graphics card not required

  25. BrainJ3DArchitecture

  26. BrainJ3D Java and Java3D provide viable development environment for scientific visualization applications + Cross Platform ( Linux, Windows and Solaris) + Supports hardware acceleration and scene optimization + Supports hardware accelerated off-screen rendering + Mature software package that provides needed functionality + Java Modern object-oriented language Numerous libraries and utilities Web-based and remote technologies are well supported

  27. BrainJ3D Future Development Different way to access program Java Web Start HTML GUI Advanced Visualization Techniques Time series (movie) mode for Volumes Show functional activation on Surface model Other Features Analysis and visualization features requested by users

  28. Current and Future Work Integration with Information System for Language Mapping Improving Interoperability Support for other data modalities Spectroscopy, ERP source signal, Transcranial Magnetic Stimulation Importing data from other Brain Imaging software packages FreeSurfer and SureFit * Interoperability is a fast moving target, often beyond our control Refining Client/Server mode Security Performance

  29. UW Human Brain ProjectStructural Informatics Grouphttp://sig.biostr.washington.edu/AcknowledgementsHuman Brain Project grant DC02310National Institute of Deafness and Other Communication Disorders and National Institute for Mental Health

More Related