1 / 18

A Computationally Efficient Approach for 2D-3D Image Registration

A Computationally Efficient Approach for 2D-3D Image Registration. Juri Minxha Medical Image Analysis Professor Benjamin Kimia Spring 2011. Brown University. Brown University. Review of Registration. Similarity Metric Optimization 1. Similarity Metric

valmai
Download Presentation

A Computationally Efficient Approach for 2D-3D Image Registration

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. A Computationally Efficient Approach for 2D-3D Image Registration Juri Minxha Medical Image Analysis Professor Benjamin Kimia Spring 2011 Brown University

  2. Brown University Review of Registration Similarity Metric Optimization 1. Similarity Metric Mutual Information, Cross-Correlation, Correlation Ratio, Cross Correlation Residual Entropy 2. Optimization, Non-gradient vs. Gradient Gauss-Newton, steepest descent, Levenberg-Larquardt, simplex method etc. The main challenge is: Minimize computation time

  3. Brown University Review of the SoCV similarity metric • Similarity Measure: Sum of Conditional Variances • Optimization Algorithm: Gauss-Newton • Requires computation of gradient • Fast convergence

  4. Similarity Metric: SoCV I0 Ro R0 =100·ln(256-I0)-300 Quantize images to 64 possible values Each pixel in the image on the left corresponds to a bin in the histogram (64 x 64 bins) Notice the non-linear relationship between I and R

  5. Similarity Metric: SoCV What happens if I0 is translated to the right? For each value of R, we have a range of values in I’

  6. Similarity Metric: SoCV Compute the conditional expectation/mean of this distribution

  7. Similarity Metric: SoCV Replace each value in R with the conditional mean

  8. Optimization: Gauss-Newton Goal: Find values of 3D rigid-body transform that minimize S

  9. Registration with CT, Fluoroscopy I) Last time: registration of MRI-MRI 2) This time: registration of CT and fluoroscopy 1. CT volume (512x512x369) of alligator bone 2. A fluroroscopy video (30 seconds, 30 FPS)

  10. 3D-visualization of CT data (Slicer) The big bone must be removed before projection!

  11. Fluoroscopy video 1. ~30 seconds at 30 frames per second 2. The location of the bone is unknown throughout the video 3. Bone is being translated and Rotated 4. All artifacts must be removed before registration

  12. Segmentation of smaller bone from CT Individual frames Stacking the layers Thresholding to remove background and only Taking the frames that correspond to top bone

  13. Ray-Casting: Generating the DRR Projecting the volume data onto the Three main axes.

  14. Preparing the fluoroscopy image

  15. Measure of Fit Optimization over three parameters: Rotation in x Rotation in y Rotation in z Manually adjusted three parameters: Translation in x Translation in y Translation in z

  16. Shortcomings • There is no ground truth • Optimization was over a subset of the 6 parameters required for rigid body motion • The initial conditions are extremely important • The initial position has to be very close the final position • I manually translated the image, a procedure that should be automated • Speed optimization • Computational needs are excessive

  17. Brown University References • A computationally efficient approach for 2D-3D image registration Haque, M.N.; Pickering, M.R.; Biswas, M.; Frater, M.R.; Scarvell, J.M.; Smith, P.N.; 2010 Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), Issue Date: Aug. 31 2010-Sept. 4 2010, On page(s): 6268 – 6271 • M. Pickering, A. Muhit, J. Scarvell, and P. Smith, "A new multimodal similarity measure for fast gradient-based 2D-3D image registration," in Proc. IEEE Int. Conf. on Engineering in Medicine and Biology (EMBC), Minneapolis, USA, 2009, pp. 5821-5824.

More Related