Intra-operative Imaging & Visualization

1. Intra-operative Imaging & Visualization Chair for Computer Aided Medical Procedures (I-16) Prof. Nassir Navab Lab Course SS 2004 Implementation of an Augmented Reality Visualization Component Chair for Computer Aided Medical Procedures (I-16)

2. Supervised by - Marco Feuerstein Participants – • Imran Shafiq • Mohan Singh • Franziska Bayer • Zaheer Akhtar Chair for Computer Aided Medical Procedures (I-16)

3. Endoscopic Surgery Endoscopic surgery – endo : meaning the end of, and scopic : meaning to look at -- is an instrument that looks at the end of a closed space. The indirect access to the operation area causes a lot of disadvantages for the surgeon: restricted vision, difficult hand-eye coordination and handling of instruments with limited mobility. Chair for Computer Aided Medical Procedures (I-16)

4. AIM In endoscopic surgery, the surgeon inserts the instruments through very small incision points. Thus, the view onto the region of interest is very limited. In order to provide enhanced visualization to the surgeon the endoscopic images need to be augmented by pre-operatively acquired data such as CT slices or rendered volumes and models of the instruments. To do so, the surgical instruments and the endoscopic camera will be tracked to dynamically update their poses (positions and orientations). A viewer will be implemented to display the pre-operative data and all models at the correct poses. Chair for Computer Aided Medical Procedures (I-16)

5. The DICOM Standard Digital Imaging and COmmunications in Medicine • Created by the National Electrical Manufacturers Association (NEMA) to • aid the distribution and viewing of medical images, such as CT scans, MRIs, • and ultrasound. • Part 10 of the standard describes a file format for the distribution of images. • A single DICOM file contains both a header as well as all of the image data. • header - stores information about the patient's name, the type of scan, • image dimensions, etc • image data - contain information in three dimensions Chair for Computer Aided Medical Procedures (I-16)

6. General DICOM Standard format Chair for Computer Aided Medical Procedures (I-16)

7. The DICOM Header • The first 794 bytes are used for a DICOM format header, which • describes the image dimensions and retains other text information • about the scan. • The image data follows the header information (the header and • the image data are stored in the same file). • Here, the header defines an image which has the dimensions • 109x91x2 voxels, with a data resolution of 1 byte per voxel (so • the total image size will be 19838). • Transfer Syntax Unique Identification (UID) – • reports the structure of the image data, • also reports the byte order for raw data. • And it has lot of other information…. Chair for Computer Aided Medical Procedures (I-16)

8. Chair for Computer Aided Medical Procedures (I-16)

9. Chair for Computer Aided Medical Procedures (I-16)

10. Class Diagram Chair for Computer Aided Medical Procedures (I-16)

11. Chair for Computer Aided Medical Procedures (I-16)

12. Chair for Computer Aided Medical Procedures (I-16)