Maura Bidinost User Experience Designer Omnyx LLC

1. Usability: A Critical Factor in the Successful Adoption of Digital Pathology for Routine Sign-out Maura Bidinost User Experience Designer Omnyx LLC

2. Primary Uses of Digital Pathology Today Routine Sign-out Education Digital Pathology Rarely used Research Volume LOW HIGH 2nd Opinions Frozen Sections NON-CRITICAL CRITICAL Turn Around Time

3. FDA CE Mark • Provincial Regulations • CAP Regulatory What Hinders Adoption for Routine Sign-out?

4. FDA CE Mark • Provincial Regulations • CAP Regulatory Technology Image Quality Time to Image Scalability Quality Team What Hinders Adoption for Routine Sign-out?

5. FDA CE Mark • Provincial Regulations • CAP Regulatory Technology Image Quality Time to Image Scalability “I don’t have time to learn a new system.” “Computers make things complicated.” “It doesn’t accommodate my workflow.” “I can’t afford to be slowed down.” “I like my microscope.” “I need to be able to trust the system.” System Interaction Engineering Quality Team What Hinders Adoption for Routine Sign-out?

6. User-Centered Design (UCD) • UCD is a philosophy in which the end user is placed at the center of the process and given extensive attention at each stage. Analysis & Research Evaluation Design Development

7. User-Centered Design (UCD) • UCD is a philosophy in which the end user is placed at the center of the process and given extensive attention at each stage. Analysis & Research Evaluation Design Development

8. User-Centered Design (UCD) • UCD is a philosophy in which the end user is placed at the center of the process and given extensive attention at each stage. Analysis & Research • Site Visits • Contextual Inquiry & Design • Competitive Analysis • Heuristic Evaluation • Affinity Diagramming Evaluation Design Development

9. User-Centered Design (UCD) • UCD is a philosophy in which the end user is placed at the center of the process and given extensive attention at each stage. Analysis & Research Evaluation Design Development

10. User-Centered Design (UCD) • UCD is a philosophy in which the end user is placed at the center of the process and given extensive attention at each stage. Analysis & Research Design • Persona’s • Storyboarding • Needs Validation • Wireframes • Participatory Design Evaluation Design Development

11. User-Centered Design (UCD) • UCD is a philosophy in which the end user is placed at the center of the process and given extensive attention at each stage. Analysis & Research Evaluation Design Development

12. User-Centered Design (UCD) • UCD is a philosophy in which the end user is placed at the center of the process and given extensive attention at each stage. Analysis & Research Evaluation Design Development

13. User-Centered Design (UCD) • UCD is a philosophy in which the end user is placed at the center of the process and given extensive attention at each stage. Analysis & Research Evaluation • Heuristic Evaluation • Performance Testing • Think-Aloud Usability Testing Evaluation Design Development

14. What is Think-Aloud Usability Testing? • Participants are presented with a realisticset of tasks • Participants are asked to say whatever they are seeing, thinking, doing, and feeling, as they go about their task. • Participant’s actions on the screen and facial expressions are generally recorded as well as observed first hand by a usability specialists. • Upon completion of each task, participants are generally presentedwith a brief questionnaire thatprovides more quantitative feedback.

15. Think-Aloud Testing Conducted (so far) * Same institutions and many of the same pathologists used in both studies.

16. Date Collected • Participant Demographics • Task completion rates • Time on Task • User subjective difficulty ratings • Verbal and written feedback • Professional observations

17. How Did We Ensure Data Accuracy? Every pathologist is unique from the way they navigate within a case and between slides to how they organize their day and the tools they use. Creating a realistic environment in order to obtain accurate data is much more difficult than imagined. • Everything was set up to be as realistic as possible • Datasets included participants real cases • Testing was conducted in participants normal working environment • Testing was customized for each participant to match their individual workflow – including other software and devices typically used.

18. Analyzing the Findings • Persistence • Frequency • Difficulty to Overcome • Market Impact

19. The Results

20. “I don’t have time to learn a new system.” “Computers make things complicated.” “It doesn’t accommodate my workflow.” “I can’t afford to be slowed down.” “I like my microscope.” “I need to be able to trust the system.” Before UCD • “I went through a series of prostate cores and found that using the this system was faster than with a microscope.” • “Faster, workflow is smoother than with glass.  Toggling back and forth between slides is much easier.” • “Capturing images for the tumor board is much more efficient than using a camera connected to the microscope.” • “If I was trying to do the same case digital with another system, it would have been frustrating.” • “Thrilled with the way this works, it’s fantastic.” • “I think it’s brilliant to be quite honest.” After UCD What are they saying now?

21. Q&A