1 / 14

Mitsuyoshi Tashiro ( tashiro.m.ac@m.titech.ac.jp ) 1 ,

Multispectral Whole Slide Imaging system. Mitsuyoshi Tashiro ( tashiro.m.ac@m.titech.ac.jp ) 1 , Noriaki Hashimoto 1 , Yuri Murakami 2 , Takashi Obi 1 , Masahiro Yamaguchi 2 , Nagaaki Ohyama 2 , Yukako Yagi 3. 1.Dept. Information Processing, Tokyo Institute of Technology

odeda
Download Presentation

Mitsuyoshi Tashiro ( tashiro.m.ac@m.titech.ac.jp ) 1 ,

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Multispectral Whole Slide Imaging system Mitsuyoshi Tashiro (tashiro.m.ac@m.titech.ac.jp)1, Noriaki Hashimoto1, Yuri Murakami2, Takashi Obi1, Masahiro Yamaguchi2, Nagaaki Ohyama2, Yukako Yagi3 1.Dept. Information Processing, Tokyo Institute of Technology 2. Imaging Science & Engineering Laboratory, Tokyo Institute of Technology 3.Dept. Pathology, Harvard Medical School

  2. Background • Whole Slide Imaging (WSI) • Whole Slide can be viewed over the network. • WSI is suitable for diagnostic pathology, second opinions, expert opinions, clinical trials and research. • Multispectral Imaging (MSI) • Spectral information enables quantitative color image analysis. • High-fidelity color reproduction, Tissue classification, Color unmixing, Dye amount quantification, Standardization of staining condition, Color enhancement, ... • It is expected to combine WSI and MSI. • Since WSI can be considered as a digital archive, it is important to save quantitative spectral information. • Multispectral WSI scanner • Multiple LEDs, or filter wheel, tunable filter, ... • Multispectral WSI viewer λ G B R

  3. Basic Concepts • Issues • Huge computation is needed if we apply spectral image analysis to Whole Slide. • It is expected to reproduce natural color images for observation. • RGB images with natural color can be obtained by the color conversion from MSIs • A model for multispectral WSI viewer • Specify the region of interest by RGB-color WSI viewer • Apply spectral analysis to the specified the region.

  4. How do we apply MSIsto WSI ? Server Side RGB based Whole Slide Imaging Client Side ×5 Location magnification ×10 GUI Compressed RGB transmit ×40 Image pyramid ×5 Coded MSI ×10 Function for visualization Decode Decode Display ×40 transmit Color Conversion Compressed MSIs buffer Coded RGB Encode

  5. Proposed Multispectral WSI scheme RGB and spectral information are saved separately WSI viewer Natural color observation Natural color RGB Color conversion MSIs + Spectral information Spectral Image Analysis MSIs Plus or

  6. What is Plus ? • Plus images are the difference between the MSIs and the corresponding RGB images. It reduces the redundancy of storing and sending MSIs. • Compressed RGB and Plus images are saved on the server separately. ＝ + MSIs RGB Plus N > 3 3 N-3 Number of band server MSIs Plus ― Compressed RGB Compression Predicted MSI Compressed RGB Compressed Plus

  7. Server side processing RGB + Plus Server Side Client Side Compressed RGB Location & magnification GUI transmit Coded RGB Function for visualization Display Decode transmit buffer Compressed Plus Spectral images analysis Decode Information Spectral analysis transmit Coding Coded Plus Coded Color image Decode transmit

  8. Client side processing RGB + Plus Server Side Client Side Compressed RGB location magnification GUI transmit Coded RGB-Image Decode Function for visualization Display transmit buffer Compressed Plus Information Spectral analysis transmit Coded Plus SpectralAnalysis Decode transmit

  9. Experiment • Which is more efficient performance as additional information ? • MSI • Plus • We evaluate PSNR between reconstructed MSIs and original MSIs. • Liver tissue, Hematoxylin & Eosin Stained • ×40 magnification • RGB Compression Ratio is 3.7% (16band =100%) • Multispectral Microscopy System • 2000 ×2000 • 16 bands image 16-band rotation filter Multispectral Microscope System in Titech

  10. PSNR RGB + MSI RGB + Plus Plus MSI 3 % 5 % Additional information Compression Ratio(16bands = 100%)

  11. Discussion 3.7 % 5 % 3.7 % 3 % • Data amount can be saved by Plus format • Compression efficiency depends on compression ratio of RGB data • High compression rate -> advantage of Plus is small • Low compression rate -> advantage of Plus is large • When the number of bands >> 3 –> the merit of Plus decreases RGB MSI RGB Plus 6.7 % 8.7 % 16 bands MSI

  12. Conclusion • We proposed a system framework for Multispectral WSI viewer that enables both interactive browsing and spectral analysis based on MSIs. • Storage data format • RGB + MSIs • RGB + Plus • System configuration • Client Side Processing • Sever Side Processing • Preliminary experimental result using a 16 bands multispectral image was demonstrated, through it was not WSI. • RGB + Plus realizes more efficient performance in the aspect of the data sizes for storages and transmission. • Future work • Implementation of multispectral image analysis to WSI viewer

  13. Basic Concept • なぜMSIs→RGBで保存するのか • 色再現をした • RGBが必要な理由 • RGB + MSIs • RGB + Plus

More Related