160 likes | 528 Views
Med-LIFE: A System for Medical Imagery Exploration Joshua New Erion Hasanbelliu Introduction What is Med-LIFE? What is image fusion? How do I teach the computer? How can I view the results? What is Med-LIFE?
E N D
Med-LIFE:A System for Medical Imagery Exploration Joshua New Erion Hasanbelliu
Introduction • What is Med-LIFE? • What is image fusion? • How do I teach the computer? • How can I view the results?
What is Med-LIFE? • Med-LIFE is an application currently under development to use computer processing techniques to reduce medical personnel workload • GUI designed with QT • Image Processing with C (and VTK library)
What is Med-LIFE? • Consists of Three Processes (LIFE): • Learning of image attributes by the computer using SFAM • Image Fusion of many image modalities into one color image • Exploration of learning and fusion results
What is image fusion? • Allows the combination of multiple image modalities into one colored image with no information loss • Reduces workload by eliminating the number of images a radiologist must analyze • Images used from “The Whole Brain Atlas” • http://www.med.harvard.edu/AANLIB/home.html
What is image fusion? • Technique similar to primate vision
GAD PD Color Fuse Result SPECT T2 Image Fusion Example
How do I teach the computer? • SFAM – Simplified Fuzzy ARTMAP • SFAM is a computer-based system capable of online, incremental learning • Two “vectors” are sent to this system for learning: • Input feature vector tells what data is available from which to learn • Supervisory signal tells whether that vector is an example or counterexample
Main Window Zoom Window How do I teach the computer? • Left-click to define examples (green) • Right-click to define counterexamples (red)
How do I teach the computer? • Supervisory signal from red/green marks • Feature vector from slice pixel values for original, single, and double opponent images
Main Window Results Zoom Window Results Learning Results
Main Window Results T2 Learning Results
How can I view results? • Display a plethora of information • Skull generated for patient from PD modality for contextual slice navigation • Explore tab provides several functions: • Original images • Fusion results imbedded within 3D, patient-generated skull • Learning results
Demo Presentation • Erion will now demo the Med-LIFE system
Conclusion • Med-LIFE offers reduced workload to physicians who scan multiple images • Image processing and fusion reduces the number of images to be analyzed • Learning system allows the computer to perform prescreening or background analysis • Exploration allows immersion within the data for operational planning