210 likes | 360 Views
The Evolution of a VR-based IGT Environment . Terry Peters, Robarts Research Institute David Gobbi, CEO, Atamai Inc. Motivation. Why AtamaiViewer? IGT research requires software! There was nothing out there in 1997 All IGT projects require similar components Leverage VTK, MINC
E N D
The Evolution of a VR-based IGT Environment Terry Peters, Robarts Research Institute David Gobbi, CEO, Atamai Inc.
Motivation • Why AtamaiViewer? • IGT research requires software! • There was nothing out there in 1997 • All IGT projects require similar components • Leverage VTK, MINC • Our own Tracking code IGT Workshop
History • 1997 – New lab, new possibilities • Evolution: MINC • 1998-1999 • Adopt VTK, add Yves Starreveld (Surgeon-Programmer) • 2000 – company formed • Strong support from Robarts Institute • 2004 – funding from CFI, SGI • VASST project begins • AtamaiViewer is christened IGT Workshop
Software Development Philosophy • Power to the students! • Most students are not programmers • Python scripting to complement C++ core • Students should use each other’s software! • Contribute to larger community • vtkImageReslice to vtkImageMapToColors (and everything in between) • VTK Python wrapping • VTK on OSX IGT Workshop
AtamaiViewer plugin modules Tkinter GUI AtamaiViewer “core” Python Atamai Python Classes AtamaiVTK VTK C++ ITK Architecture IGT Workshop
Expandability AtamaiViewer API Packages “Core” VASST EpilepsyViewer MPR Tracking Electrodes Volume Rendering Ultrasound SkullStripper Data IO Cine fMRI Modules IGT Workshop
Features • Tracking • Polaris, Aurora, XarTraX, Flock of Birds • Data Types • Images, meshes, point lists, transform files • Visualization • Stereo (monitor, HMD or workbench) • Polygons, volume rendering, image slices • Time-varying data • Cine cardiac viewing IGT Workshop
Features • Multiple file formats • MINC, DICOM, VFF, Analyze, PNG, JPEG • Expandability • Modules • Packages (collections of modules) • customize front-end, change look and feel IGT Workshop
Applications • Epilepsy Viewer • Atamai product (3 sites) • Stereotaxy Viewer • Frame-based (Parkinson’s) • VASST • Augmented Reality • AtamaiViewer “core” • Powerful in its own right IGT Workshop
111 4 50uA R Starreveld et al, 2000 112 0.22 PE 0.04 0.2 300 EP Atlas Database IGT Workshop
Deep brain surgery Planning IGT Workshop
Guidance for Cardiac Interventions IGT Workshop
AR for port placement for Robotic CABG IGT Workshop
VR tools US image US Transducer Track the tools with magnetic tracking systems IGT Workshop
TEE image with virtual valve tool IGT Workshop
..with clipping device and “pre-op image” IGT Workshop
Delineating the dynamic target • Target identified solely from pre-op images is unreliable • Interactively define target from US image IGT Workshop
Clinical study IGT Workshop
Challenges facing engineering of IGT systems • (non) availability of ubiquitous tracking environments • Non uniform software development environment • Closed real-time systems (particularly US) IGT Workshop
How can NCIGT help? • Coordinate setting of standards for collaborative software development. • Provide management role • Stimulate coordinated multi-institutional research in new tracking technologies • Act as lobby group to pressure industry to make streaming 3D (esp US) more accessible from imaging systems IGT Workshop