1 / 11

Mousing Around…

Mousing Around…. Michael Feldman, MD, PhD feldmanm@mail.med.upenn.edu. Goal. Is there a better UI than mouse for WSI ?. Microscope. Retain ergonomics of microscope Small motions that move mountains of data Other hand is useful…  Focusing Changing magnification Fast

roden
Download Presentation

Mousing Around…

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Mousing Around… Michael Feldman, MD, PhD feldmanm@mail.med.upenn.edu

  2. Goal • Is there a better UI than mouse for WSI ?

  3. Microscope • Retain ergonomics of microscope • Small motions that move mountains of data • Other hand is useful… • Focusing • Changing magnification • Fast • 400 slides per day in 10 hr day • Eyes on diagnosis field

  4. Challenge • WSI systems today ≠ microscope • Limitations to full clinical use WSI • Total system throughput too slow • One component is UI • Validation image quality • Workflow challenges • IT integration • Storage • Streaming pixels

  5. Multitouch screen… • DLP display • Interface - Frustrated Total Internal Reflection (FTIR) • Software • Aperio image library • Interface code (C++) • Tracking code (C++)

  6. Multi-touch Technology • Users can directly interact with objects through touch and simple gestures. • Gestures can be used to pan and scale an image. • This creates a highly intuitive and interactive image environment.

  7. Multi-touch Application Framework Tracking Component Interface Component Application Component (x1,y1) (x2,y2) (x3,y3) (X,Y) (L,W) (Zoom) Image Libraries

  8. Testing • Create basic platform • Test (not rigorous) • Image quality • UI • How does it feel • Ergonomics • Simple Gestures: Pan, zoom, tap box, locate small, load work • Show movies

  9. Results • Image quality – biggest limitation DLP • At 40-50 inches, DLP is too low resolution • UI – a lot to like • Using both your hands feels “correct” • Gestures easy to get used to • Sensitivity not there yet in our models • No haptic feedback • No variable ratio viewing yet

  10. Next Steps • Other touch interfaces • One or two touch pads (conductive technology) • Gaming haptics • Display • Look into HD DLP but likely still not adequte • One or two large LCD’s • Software • More gestures will be needed • Variable ratio movement • More fluid touch sensitivity

  11. Team • Drexel • Dr. Youngmoo E. Kim • Matthew Prockup • Aperio • Ole Eichorn • Pathologists • Mike Feldman – Penn • Alex Judkins – CHOP

More Related