130 likes | 286 Views
by M.W.M. Jaspers Univ. of Amsterdam. A comparison of usability methods for testing interactive health technologies. The Story. Why to evaluate usability of systems?. To improve the effectiveness of the decision making process (accurate judgements);
E N D
by M.W.M. Jaspers Univ. of Amsterdam A comparison of usability methods for testing interactive health technologies
Why to evaluate usability of systems? • To improve the effectiveness of the decision making process (accurate judgements); • To develop systems that are easy to learn (even by novice users); • To increase the efficiency of the systems in terms of the time needed to complete a task and errors made; • To increase user satisfaction (as a result of the above).
Typical model of the evaluation process in healthcare systems Design Classification of problems Selection of method Identification of Usability problems
Main methods • Heuristic inspection • Cognitive Walkthrough • Usability tests (Think Aloud protocol)
Heuristic inspection • Visibility of system status • Match between system and the real world • User control and freedom • Consistency and standards • Error prevention • Recognition rather than recall • Flexibility and efficiency of use • Aesthetic and minimalist design • Help users recognize, diagnose, and recover from errors • Help and documentation
Cognitive Walkthrough • Tasks • A cognitive map of the steps involved in order to complete each task • For each step the evaluator tries to address a set of questions: • will the user try to achieve the correct effect ? • will the user notice that the correct action is available? • will the user associate the correct action with the desired effect, and, if the user performed the right action? • will the user notice that progress is being made toward accomplishment of his goal?
Usability test (Think Aloud) • Real users (representative of the target group) • A set of tasks • Concurrent Think Aloud protocol • Screen recording, Eye tracking • Satisfaction Questionnaire • Design of experimental or quasi-experimental protocols
Pros & Cons Cons: Expensive and time Consuming Pros: Experimentation Real Usability problems Cons: Time Consuming Good knowledge of Cognitive science and Human reasoning Expert evaluators Pros: Cheaper than Usability Tests More severe problems than Heuristic evaluation Cons: False alarms Less severe problems Not appropriate heuristics Pros: The cheapest method Usability test 1 Cognitive Walkthrough 2 Heuristic 3
by M.W.M. Jaspers Univ. of Amsterdam A comparison of usability methods for testing interactive health technologies