160 likes | 178 Views
Med-LIFE is an application under development to use computer processing techniques for medical imagery exploration, reducing workload for medical personnel. It involves learning image attributes, image fusion, and exploring results. The GUI is designed using Qt with image processing in C and VTK library. The system allows for the combination of multiple image modalities into one colored image without data loss, reducing radiologists' workload. SFAM system for incremental learning is utilized. Users can define examples and counterexamples to teach the computer. Display various results and functionalities, including 3D skull generation for contextual navigation. Med-LIFE aims to reduce physician workload, streamline image analysis, and provide data immersion for surgery planning.
E N D
Med-LIFE:A System for Medical Imagery Exploration Joshua New Erion Hasanbelliu
Introduction • What is Med-LIFE? • What is image fusion? • How do I teach the computer? • How can I view the results?
What is Med-LIFE? • Med-LIFE is an application currently under development to use computer processing techniques to reduce medical personnel workload • GUI designed with Qt • Image Processing with C (and VTK library)
What is Med-LIFE? • Consists of three processes (LIFE): • Learning of image attributes by the computer using SFAM • Image Fusion of many image modalities into one color image • Exploration of learning and fusion results
What is Image Fusion? • Allows the combination of multiple image modalities into one colored image with no information loss • Reduces workload by eliminating the number of images a radiologist must analyze • Images used from “The Whole Brain Atlas” • http://www.med.harvard.edu/AANLIB/home.html
What is image fusion? • Technique similar to primate vision
GAD PD Color Fuse Result SPECT T2 Image Fusion Example
How do I teach the computer? • SFAM – Simplified Fuzzy ARTMAP • SFAM is a computer-based system capable of online, incremental learning • Two “vectors” are sent to this system for learning: • Input feature vector tells what data is available from which to learn • Supervisory signal tells whether that vector is an example or counterexample
Main Window Zoom Window How do I teach the computer? • Left-click to define examples (green) • Right-click to define counterexamples (red)
How do I teach the computer? • Supervisory signal from red/green marks • Feature vector from slice pixel values for original, single, and double opponent images
Main Window Results Zoom Window Results Learning Results
Main Window Results T2 Learning Results
How can I view results? • Display a plethora of information • Skull generated for patient from PD modality for contextual slice navigation • Explore tab provides several functions: • Original images • Fusion results imbedded within 3D, patient-generated skull • Learning results
Demo Presentation • Erion will now demo the Med-LIFE system
Conclusion • Med-LIFE offers reduced workload to physicians who scan multiple images • Image processing and fusion reduces the number of images to be analyzed • Learning system allows the computer to perform prescreening or background analysis • Exploration allows immersion within the data for surgery planning