1 / 16

NOMAD: Camera-Projector System for Medical Applications

NOMAD: Camera-Projector System for Medical Applications. Group Members: Budirijanto Purnomo Paul Alan Roberts Nicholas Lord. Goals. To design a system that permits medical display information to be projected onto a planar surface anywhere in the surgical field.

lucita
Download Presentation

NOMAD: Camera-Projector System for Medical Applications

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. NOMAD: Camera-Projector System for Medical Applications Group Members: Budirijanto Purnomo Paul Alan Roberts Nicholas Lord

  2. Goals • To design a system that permits medical display information to be projected onto a planar surface anywhere in the surgical field. • To provide surgeons with lightweight, portable and sterile displays in the operating room.

  3. camera mirror Projector NOMAD screen System Setup

  4. Advantages • Convenient placement of the presentation of information. • Improve the quality of surgery. • Decrease cost for sterilizing displays. • Reduce surgery time. • Increase space in the operating field.

  5. Usage Instructions [The projector with pan-and-tilt mirror, camera and computer are assumed to be already installed in the room]. 1. The surgeon adjusts the NOMAD screen into a convenient place. 2. Start the calibration program. 3. After the calibration is complete, the surgeon switches to the medical application.

  6. Usage Instructions (continued) 4. The surgeon can interact with the NOMAD screen with virtual buttons on the screen. 5. Go back to step 1 if the surgeon needs to readjust the NOMAD screen’s placement.

  7. Proposed Work • Build a system prototype. • Develop an automatic calibration for NOMAD screen. This involves two steps: • Direct pan-and-tilt mirror such that the projected image lies on the NOMAD screen. This can be done by applying an object detection algorithm to the observed camera’s image to obtain an initial guess for directing the pan-and-tilt mirror.

  8. Proposed Work (continued) Then, an iterative process is performed to match the position of the actual projected image with the observed image. • Compute the pose of NOMAD screen from an image captured by the camera. Supply this information to the ED-Projector system developed by IBM to correct oblique projection.

  9. Proposed Work (continued) • Add a touch screen capability. This involves developing a simple GUI and using IBM’s software to track fingertips movement.

  10. Schedule Feb 15th : Email IBM’s contact (Rick). Feb 19-21st : Work on proposal. Feb 26th : Set up a simple camera system and use matlab for camera calibration. Feb 28th : Build and design a NOMAD screen. March 5-14th : Develop pose estimation algorithm. March 15th : Receive IBM hardware and software. March 26-28th: Build mounting structure, interface and register projector, camera and mirror.

  11. Schedule (continued) March 29th : Receive full XML interfaces from IBM. April 2-4th : Be able to project image onto the NOMAD screen. April 9-11th : Calibrate vision system for touch screen capabilities. April 16-18th: Develop final report.

  12. Deliverables • Minimum: A system that projects an image accurately onto the NOMAD screen. • Expected: Automatic calibration and dewarping are performed on top of the minimum. The NOMAD screen has a touch screen capability. • Maximum: Allows pan-and-tilt camera and live videos to be projected onto the screen.

  13. Dependencies • Hardware: • Projector (ERC lab). • Pan-and-tilt mirror, PC and a camera (IBM). • Video card that supports dual-display (???). • Frame grabber or firewire card (???). • Mounting structure (Build). • Cables + converters + connectors (IBM, ERC).

  14. Dependencies (continued) • Software: • ED-software (IBM). • XML interfaces (IBM). • Matlab (ERC). • XVision (CIRL). • C/C++, Java compiler (ERC). • Other: • XML book (???).

  15. Background Readings • EDML, VIML, CAML Reference Manual by IBM. • Claudio Pinhanez, The Everywhere Displays Projector: A Device to Create Ubiquitous Graphical Interfaces. • Rahul Sukthankar et al., Smarter Presentations: Exploiting Homography in Camera-Projector Systems.

  16. Background Readings (continued) • Ying Wu et al., Visual Panel: From an Ordinary Paper to a Wireless and Mobile Input Device. • Trucco and Verri, Introductory Techniques for 3-D Computer Vision. • XML Reference materials.

More Related