1 / 19

TEXTURE-BASED 3D IMAGE RETRIEVAL FOR MEDICAL APPLICATIONS

TEXTURE-BASED 3D IMAGE RETRIEVAL FOR MEDICAL APPLICATIONS. X. Gao, Y. Qian, M. Loomes, R. Comley, B. Barn , A. Chapman , J. Rix Middlesex University, UK R. Hui Department of Neurosurgery, General Navy Hospital, P.R.China.

july
Download Presentation

TEXTURE-BASED 3D IMAGE RETRIEVAL FOR MEDICAL APPLICATIONS

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. TEXTURE-BASED 3D IMAGE RETRIEVAL FOR MEDICAL APPLICATIONS X. Gao, Y. Qian, M. Loomes, R. Comley, B. Barn , A. Chapman , J. Rix Middlesex University, UK R. Hui Department of Neurosurgery, General Navy Hospital, P.R.China

  2. MIRAGE(Middlesex medical Image Repository with a CBIR ArchivinGEnvironment) Aim: To develop a repository of medical images benefiting MSc and research students in the immediate term and serve a wider community in the long term in providing a rich supply of medical images for data mining, to complement MU current online e-learning system. http://image.mdx.ac.uk/ JSIC Innovation in the use of ICT for education and research. http://www.jisc.ac.uk/

  3. Proposed Framework for MRIAGE

  4. GIFT(GNU Image Finding Tool) GIFT is open framework for content-based image retrieval and is developed by University of Geneva. • Query by example and multiple query • Relevance Feedback • Distributed architecture (Client - Server) • MRML---C-S communication protocol Demo:

  5. GIFT Framework

  6. Framework of Content-Based Image Retrieval

  7. Texture-based 3D Brain Image Retrieval

  8. Current Content-Based Image Retrieval (CBIR) Content-based image retrieval system • QBIC, Nectar, Viper, etc. • Visual feature extraction from 2D image Content-based 3D Brain Image Retrieval • Shape-based

  9. Proposed framework for 3D image retrieval

  10. 3D Texture Feature Extraction • 3D Grey Level Co-occurrence Matrices (3D GLCM) • 3D Wavelet Transform (3D WT) • 3D Gabor Transform (3D GT) • 3D Local Binary Pattern (3D LBP)

  11. 1) 3D Grey Level Co-occurrence Matrices (3D GLCM) 3D GLCM is two dimensional matrices of the joint probability of occurrence of a pair of gray values separated by a displacement d = (dx,dy,dz). • 52 Displacement vectors: 4 distance * 13 direction = 52 • 4 Haralick texture features: energy, entropy, contrast and homogeneity • Feature vector: 208 components (=4 (features) * 52 (matrices)).

  12. 2) 3D Wavelet Transform (3D WT) 3D WT provides a spatial and frequency representation of a volumetric image. • 2 scales of 3D WT • Mean and Standard deviation • Feature vector: 30 components (2 (features) +15 (sub-bands))

  13. 3) 3D Gabor Transform (3D GT) 3D GT generates a set of 3D Gabor filters Gabor filters Gabor Transform: • 144 Gabor filters 4 (F) *6(θ)*6(Φ) =144 • Mean and Standard deviation • Feature vector: 288 components (2 (features) +144(filters))

  14. 4) 3D Local Binary Pattern (3D LBP) Local binary pattern(LBP) is a set of binary code to define texture in a local neighbourhood. A histogram is then generated to calculate the occurrences of different binary patterns. • 59 binary patterns • Feature vector: 177 components (=59(patterns)*3(planes)

  15. Similarity Measurement • Histogram Intersection(3D LBP) • Normalized Euclidean distance (3D GLCM,3D WT,3D GT)

  16. Experiment Results

  17. Processing and Query time

  18. Conclusion and Future work Four 3D texture methods are exploited and evaluated in 3D MR image retrieval. Future work: • Test on the larger dataset • Find the best 3D texture representations • Feature dimension reduction • Combinations of some texture descriptors • Plug 3D image retrieval into GIFT framework.

  19. Thank You.

More Related