170 likes | 343 Views
Usability Testing. Jakub Franc User Researcher Software eXperience Design Group Sun Microsystems. Presentation Outline. What is Usability testing? What is it good for? How to do it?. Introductory Information (1/2). Data collection method Direct identification of usability problems
E N D
Usability Testing • Jakub Franc • User Researcher • Software eXperience Design Group • Sun Microsystems
Presentation Outline What is Usability testing? What is it good for? How to do it?
Introductory Information (1/2) Data collection method Direct identification of usability problems Provides information about real usage of the product Chance to see real user performing tasks in her/his own way
Introductory Information (2/2) Various levels of elaboration Various purposes Evaluating single version of product Comparing two versions of product (even against competitor's products) Significantly reduces development and service cost
When to test? Whenever! In the beginning of PLC – prototypes Before release (alpha/beta versions) Disaster check After release Input for planning following versions
Advantages and Disadvantages Advantages Provides information about real usage of the product Effective Relatively cheap Disadvantages UI should be testable It does not provide solutions to problems Requires a lot of input from development team
Qualitative vs. Quantitative Approach Qualitative 6 – 8 participants Less time consuming, reveals 90% of problems Common in commercial environment Quantitative 20+ participants Statistical evaluation - metrics Government contracts, universities
What Do We Need for Testing? Participants Observers Product Optional: lab, recording equipment Thorough preparation Patience
Participants Target audience Screener Recruiter Schedule Incentive
Instructions Explain the purpose of testing Inform participants about recording of the study “Think aloud” We test the product, not the participant Describe test process
Tasks Model real usage of product Based on real motivation (task focused) Expressed in words of user Do not describe in-between steps Incorrect: Go to left menu and find soap in 14 CZK to 16 CZK price range. Correct: Buy lavender soap in this eshop.
Report Delivers findings Helps to incorporate findings into production process Structure Goals Setting (tasks, participants) Results (recommendations) Conclusions Screenshots
Literature Mike Kuniawsky: Observing The User Experience Jacob Nielsen: Usability Engineering
Thank you for your attention • Jakub Franc Jakub.Franc@sun.com