E N D
1. CY4E2 BIONICS Medical Image Processing and Analysis
Dr Virginie F. Ruiz
v.f.ruiz@reading.ac.uk
Cybernetics, room 184
2. Dr V.F. Ruiz CY4E2: Bionics 2
3. Dr V.F. Ruiz CY4E2: Bionics 3 Books Some in the Library:
Digital Image Processing Algorithms and Applications, I. Pitas, Wiley
Digital Image Processing, Castleman, Prentice Hall.
Digital Image Processing, Gonzales and Woods, Addison Wesley
Foundations of Medical Imaging, Z.H. Cho, Joie P.Jones, Manbir Singh, Wiley
An Introduction to the principles of medical imaging, Chris C.N. Guy, Dominic Ffytche, Imperial College Press.
The essential physics of medical imaging, Jerrod T. Bushberg et al., Williams & Wilkins.
IEEE Transactions on Medical Imaging.
some more:
Handbook of Medical Imaging, M. Sanka and J. M. Fitzpatrick eds, SPIE Press 2000
Vol. 1: Medical physics and psychophysics.
Vol. 2: Medical image processing and analysis.
Vol. 3: Display and PACs
4. Dr V.F. Ruiz CY4E2: Bionics 4 Medical Image Systems The last few decades of the 20th century has seen the development of:
Computed Tomography (CT)
Magnetic Resonance Imaging (MRI)
Digital Subtraction Angiography
Doppler Ultrasound Imaging
Other techniques based on nuclear emission e.g:
PET: Positron Emission Tomography
SPECT: Single Photon Emission Computed Tomography
Provide a valuable addition to radiologists imaging tools towards ever more reliable detection and diagnosis of diseases.
More recently conventional x-ray imaging is challenged by the emerging flat panel x-ray detectors. Medical imaging has experienced, during the last few decades, the development and commercialisation of a pletiora of new imaging technologies:
computed tomography,
MR Imaging,
digital subtraction angiography,
Doppler ultrasound imaging and
various imaging techniques based on nuclear emission (PET,SPECT…).
They all have been valuable addition to the radiologists arsenal of imaging tools towards ever more reliable detection and diagnosis of disease.
More recently, conventional x-ray imaging technology itself is being challenged by the emerging possibilities offered by flat panel x-ray detectors.
This course is to give some ideas and methods of image processing and analysis that are to work in the field of medical imaging.
Medical imaging has experienced, during the last few decades, the development and commercialisation of a pletiora of new imaging technologies:
computed tomography,
MR Imaging,
digital subtraction angiography,
Doppler ultrasound imaging and
various imaging techniques based on nuclear emission (PET,SPECT…).
They all have been valuable addition to the radiologists arsenal of imaging tools towards ever more reliable detection and diagnosis of disease.
More recently, conventional x-ray imaging technology itself is being challenged by the emerging possibilities offered by flat panel x-ray detectors.
This course is to give some ideas and methods of image processing and analysis that are to work in the field of medical imaging.
5. Dr V.F. Ruiz CY4E2: Bionics 5 General image processing whether it is applied to:
Robotics
Computer vision
Medicine
etc.
will treat:
imaging geometry
linear transforms
shift invariance
frequency domain
digital vs continuous domains
segmentation
histogram analysis
etc
that apply to any image modality and any application
6. Dr V.F. Ruiz CY4E2: Bionics 6 General image analysis regardless of its application area encompasses:
incorporation of prior knowledge
classification of features
matching of model to sub-images
description of shape
many other problems and approaches of AI...
While these classic approaches to general images and to general applications are important, the special nature of medical images and medical applications requires special treatments.
7. Dr V.F. Ruiz CY4E2: Bionics 7 Special nature of medical images Derived from
method of acquisition
the subject whose images are being acquired
Ability to provide information about the volume beneath the surface
though surface imaging is used in some applications
Image obtained for medical purposes almost exclusively probe the otherwise invisible anatomy below the skin.
Information may be from:
2D projection acquired by conventional radiography
2D slices of B-mode ultrasound
full 3D mapping from CT, MRI, SPECT, PET and 3D ultrasound. The special nature of medical images derives as much from their method of acquisition as it does from the subjects whose images are being acquired.
While surface imaging is used in some applications (e.g. examination of properties of the skin), medical imaging has been distinguished primarily by its ability to provide information about the volumes beneath the surface (from the discovery of x-ray some 100 years ago).
Image are obtained for medical purposes almost exclusively to probe the otherwise invisible anatomy below the skin.
This information may be in the form of:
2 dimensional projection acquired by traditional radiography
2D slices of B-mode ultrasound
or full 3D mappings such as those provided by CT, RMI, SPECT, PET and 3D ultrasound.The special nature of medical images derives as much from their method of acquisition as it does from the subjects whose images are being acquired.
While surface imaging is used in some applications (e.g. examination of properties of the skin), medical imaging has been distinguished primarily by its ability to provide information about the volumes beneath the surface (from the discovery of x-ray some 100 years ago).
Image are obtained for medical purposes almost exclusively to probe the otherwise invisible anatomy below the skin.
This information may be in the form of:
2 dimensional projection acquired by traditional radiography
2D slices of B-mode ultrasound
or full 3D mappings such as those provided by CT, RMI, SPECT, PET and 3D ultrasound.
8. Dr V.F. Ruiz CY4E2: Bionics 8 difficulties/specificities Radiology: perspective projection maps physical points into image space
but, detection and classification of objects is confounded to over- and underlying tissue (not the case in general image processing).
Tomography: 3D images bring both complication and simplifications
3D topography is more complex than 2D one.
problem associated with perspective and occlusion are gone.
Additional limitation to image quality:
distortion and burring associated with relatively long acquisition time (due to anatomical motion).
reconstruction errors associated with noise, beam hardening etc.
All these and others account for the differences between medical and non medical approaches to processing and analysis. In the case of radiology, perspective projection maps physical points into image space in the same way as photography, but the detection and classification of objects is confounded by the presence of overlying or underlying tissue, a problem rarely considered in general image analysis.
In the case of tomography, 3D images bring both complications and simplifications to the processing and analysis relative to two dimensional ones:
topology of 3D is more complex than 2D ones
problems associated with perspective projection and occlusion are gone
In addition to these geometrical differences, medical images typically suffer more from the problems of discretisation, where larger pixels (voxels in 3D) and lower resolution combine to reduce fidelity.
Additional limitations to image quality arise from
the distortions and burring associated with relatively long acquisition times in the face
of inevitable anatomical motion – primarily cardiac and pulmonary.
reconstruction errors associated with noise, beam hardening, etc.
These and other differences between medical and non medical techniques of image acquisition account for many of the differences between medical and non-medical approaches to processing and analysis.In the case of radiology, perspective projection maps physical points into image space in the same way as photography, but the detection and classification of objects is confounded by the presence of overlying or underlying tissue, a problem rarely considered in general image analysis.
In the case of tomography, 3D images bring both complications and simplifications to the processing and analysis relative to two dimensional ones:
topology of 3D is more complex than 2D ones
problems associated with perspective projection and occlusion are gone
In addition to these geometrical differences, medical images typically suffer more from the problems of discretisation, where larger pixels (voxels in 3D) and lower resolution combine to reduce fidelity.
Additional limitations to image quality arise from
the distortions and burring associated with relatively long acquisition times in the face
of inevitable anatomical motion – primarily cardiac and pulmonary.
reconstruction errors associated with noise, beam hardening, etc.
These and other differences between medical and non medical techniques of image acquisition account for many of the differences between medical and non-medical approaches to processing and analysis.
9. Dr V.F. Ruiz CY4E2: Bionics 9 Advantage of dealing with medical images:
knowledge of what is and what is not normal human anatomy.
selective enhancement of specific organs or objects via injection of contrast-enhancing material.
All these differences affect the way in which images are processed and analysed.
Validation of medical image processing and analysis techniques is also a major part of medical application
validating results is always important
the scarcity of accurate and reliable independent standards create another challenge for medical imaging field. The fact the medical image processing deal mostly with living body bring other major differences in comparison to computer or robot vision. The object of interest are soft and deformable with 3D shapes whose surfaces are rarely rectangular, cylindrical or spherical and whose features rarely include planes or straight lines that are so frequent in technical vision applications
There are however major advantages in dealing with medical images that contribute in a substantial way to the analysis design.
The available knowledge of what is and what is not normal human anatomy is one of them. Recent advances in selective enhancement of specific organs or other objects of interest via the injection of contrast-enhancing material represent other advances.
All these differences affect the way in which images are effectively processed and analysed.
Validation of developed medical image processing and analysis techniques is a major part of any medical application. While validating the results of any methodology is always important, the scarcity of accurate and reliable independent standards creates yet another challenge for medical imaging field.The fact the medical image processing deal mostly with living body bring other major differences in comparison to computer or robot vision. The object of interest are soft and deformable with 3D shapes whose surfaces are rarely rectangular, cylindrical or spherical and whose features rarely include planes or straight lines that are so frequent in technical vision applications
There are however major advantages in dealing with medical images that contribute in a substantial way to the analysis design.
The available knowledge of what is and what is not normal human anatomy is one of them. Recent advances in selective enhancement of specific organs or other objects of interest via the injection of contrast-enhancing material represent other advances.
All these differences affect the way in which images are effectively processed and analysed.
Validation of developed medical image processing and analysis techniques is a major part of any medical application. While validating the results of any methodology is always important, the scarcity of accurate and reliable independent standards creates yet another challenge for medical imaging field.
10. Dr V.F. Ruiz CY4E2: Bionics 10 Processing and Analysis Medical image processing
Deals with the development of problem specific approaches to enhancement of raw medical data for the purposes of selective visualisation as well as further analysis.
Medical image analysis
Concentrates on the development of techniques to supplement the mostly qualitative and frequently subjective assessment of medical images by human experts.
Provides a variety of new information that is quantitative, objective and reproducible Medical image processing deals with the development of problem specific approaches to enhancement of raw medical data for the purposes of selective visualisation as well as further analysis.
Medical image analysis then concentrates on the development of techniques to supplement the mostly qualitative and frequently subjective assessment of medical images by human experts with a variety of new information that is quantitative, objective and reproducibleMedical image processing deals with the development of problem specific approaches to enhancement of raw medical data for the purposes of selective visualisation as well as further analysis.
Medical image analysis then concentrates on the development of techniques to supplement the mostly qualitative and frequently subjective assessment of medical images by human experts with a variety of new information that is quantitative, objective and reproducible
11. Dr V.F. Ruiz CY4E2: Bionics 11
12. Dr V.F. Ruiz CY4E2: Bionics 12
13. Dr V.F. Ruiz CY4E2: Bionics 13
14. Dr V.F. Ruiz CY4E2: Bionics 14
15. Dr V.F. Ruiz CY4E2: Bionics 15 fMRI
16. Dr V.F. Ruiz CY4E2: Bionics 16 Virtual sinus endoscopy of chronic sinusitis.
The red structure means inflammatory portion.
The trip starts from right nasal cavity and goes through right maxillary sinus and ends at right frontal sinus.
Virtual sinus endoscopy of chronic sinusitis.
The red structure means inflammatory portion.
The trip starts from right nasal cavity and goes through right maxillary sinus and ends at right frontal sinus.
17. Dr V.F. Ruiz CY4E2: Bionics 17
This animation is derived from MRI data of a patient with a glioma
1. This demonstrates planning of a stereotactic procedure using computerized simulation
2. This shows three alternative approaches for a surgical removal of the tumour.
3. This demonstrates registration of vessels derived from a phase contrast angiogram and anatomy derived from double-echo MR scans.
This animation is derived from MRI data of a patient with a glioma
1. This demonstrates planning of a stereotactic procedure using computerized simulation
2. This shows three alternative approaches for a surgical removal of the tumour.
3. This demonstrates registration of vessels derived from a phase contrast angiogram and anatomy derived from double-echo MR scans.
18. Dr V.F. Ruiz CY4E2: Bionics 18
19. Dr V.F. Ruiz CY4E2: Bionics 19