1 / 15

Preclinical-Bench Testing of Whole-Slide Imaging Systems

Preclinical-Bench Testing of Whole-Slide Imaging Systems. Anant Agrawal, MSE Max Robinowitz, MD FDA Center for Devices and Radiological Health October 22, 2009. Motivation. Obtain quantitative, detailed performance data under well-controlled conditions

ace
Download Presentation

Preclinical-Bench Testing of Whole-Slide Imaging Systems

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Preclinical-Bench Testing of Whole-Slide Imaging Systems Anant Agrawal, MSE Max Robinowitz, MD FDA Center for Devices and Radiological Health October 22, 2009

  2. Motivation • Obtain quantitative, detailed performance data under well-controlled conditions • Consistent evaluation and comparison of device performance • Reduce burden of acquiring and analyzing clinical data • Provide a straightforward means of postmarket quality control

  3. Two Categories ofPreclinical-Bench Testing 1.Physical testing of imaging performance characteristics • Quantitative measurements of key hardware and software properties • Can isolate effects of individual components 2.Pathologist-based assessment of image quality • Using artificial phantoms and/or biological specimens (e.g., diatoms, ideal histological preparations) • To answer the question: are all critical featuresvisualized by both optical and digital microscopy systems? • Serves as a bridge to clinical studies

  4. Preclinical-Bench Testing 1: Physical testing of imaging performance characteristics

  5. Basic block diagram ofWhole-Slide Imaging (WSI) Conventional optical microscope SLIDE Digital image sensor Image Processing software Mechanical scanner Light source Imaging optics Display PATHOLOGIST IMAGE DATA FILES

  6. Some imaging performance characteristics to consider:COMPONENT-LEVEL Digital image sensor Image Processing software Mechanical scanner Light source Imaging optics Display 3D Positioning accuracy Enhancement Compression Temporal stability Spatial uniformity Spectral output Color gamut Color accuracy Luminance Resolution/contrast Spatial uniformity Noise Linearity Dynamic range Spatial resolution Spatial uniformity Magnification Resolution/contrast Distortion Depth of field

  7. Some imaging performance characteristics to consider:SYSTEM-LEVEL Digital image sensor Image Processing software Mechanical scanner Light source Imaging optics Display • Resolution and contrast • Color gamut/accuracy • Dynamic range • Spatial uniformity

  8. Analysis software Typical paradigms forphysical system testing TEST TARGET Digital image sensor Image Processing software Mechanical scanner Light source Imaging optics Display IMAGE DATA FILES FIGURE OF MERIT (quantitative measure of performance)

  9. Typical paradigms forphysical system testing TEST TARGET Digital image sensor Image Processing software Mechanical scanner Light source Imaging optics Display LIGHT MEASUREMENT INSTRUMENT FIGURE OF MERIT

  10. Obtaining statistics during physical system testing • WITHIN-SYSTEM VARIABILITY • Insert test target x times into same WSI unit • BETWEEN-SYSTEM VARIABILITY • Insert test target into x different WSI units of the same model

  11. Examples of readily-available test targets USAF 1951 resolution target Distortion and scanning accuracy grid target Modulation/ Contrast transfer function

  12. Quantitative characterization of a typical slide image From Kayser et al, Diagnostic Pathology, July 2008.

  13. Information needed with each measured characteristic • Test target and procedure • Quantitative figure of merit • Benchmark or specification • Compare to conventional optical microscope • Quality control schedule • Certain components (light source, mechanical scanners) may require frequent QC checks/calibration

  14. Potential resources for testing methodology: standards • Microscope-specific • DIN 58959 (1997) – Quality management in medical microbiology - Part 4: Requirements for investigations using light microscopes • ISO 8039:1997 – Optics and optical instruments – Microscopes – Magnification • Digital image sensor • ISO 15739:2003 – Photography – Electronic still-picture imaging – Noise measurements • ISO 12233:2000 – Photography – Electronic still-picture imaging – Camera resolution • IEEE Std 208-1995 (R2005) – Measurement of Resolution of Camera Systems • Display • AAPM TG#18 “Assessment of Display Performance for Medical Imaging Systems” • IEC 62B WG36 “Image display devices” approved as of Sept 2009 • VESA “Flat Panel Display Measurements Standard”

  15. How to Establish Physical Testing Guidelines? • Existing standards provide some testing methodology relevant to whole-slide imaging systems for histopathology • Which physical tests are the most useful to validate device performance without excessive burden to the sponsor? • System-level tests are most straightforward • Component-level testing permits easier replacement of components as system configurations evolve • Need to consider physical testing for variability within and between systems

More Related