220 likes | 457 Views
Quick and Dirty Usability Tests. (One week, no budget and no usability facility). Overview. What is Usability & Usability Testing Remote user tests vs. traditional methods: - quality - costs How to carry out remote tests. What is Usability & Usability Testing.
E N D
Quick and Dirty Usability Tests (One week, no budget and no usability facility)
Overview • What is Usability & Usability Testing • Remote user tests vs. traditional methods:- quality- costs • How to carry out remote tests
What is Usability & Usability Testing Usability: a measure for the • ease of use • efficiency • satisfaction
Why is it important? • increases sales • decreases development costs • increased user satisfaction improves brand image • improved productivity example
Remote testing vs. Traditional methods • Traditional methods: testers sit in your office, you physically observe & record • Remote testing: testers sit in their office/home, you observe their screen online & record.
Compare quality • Selvaraj & Houck-Whitaker studies: remote tests have at least the same effectiveness as traditional • Benefits: realistic context of use, geographic representation, access to professionals • Limitations: lack of nonverbal signs
Remote Testing Overview • Define Objectives & Target Audience • Set up Test Scenario • Recruit Test Users • Carry out Tests • Analyze Findings • Design Report & Brief Stakeholders
Define Objectives & Target Audience What: • What are you testing? • Who are you testing? How: • Ask your company - meet marketing & devs • Ask your users - surveys, interviews
Define Objectives & Target Audience Outcome: • Informal test mission & objectives • Common understanding for test direction & scope
Set up Test Scenario - Technology Case 1 - online meeting + screen capture + phone • GoToMeeting, WebEx • Camtasia, ZDSoft • Case 2 - single software • Uservue/Morae • ethnio.com • clicktale.com
Set up Test Scenario What: • Representative Tasks • Within time-limits & user capabilities • In line with test objectives
Set up Test Scenario How: • Consult with project stakeholders & objectives • Develop sample app & html instructions • Run dry test with home users • Apply changes
Set up Test Scenario Outcome: • sample application/prototype/site • online test instructions (integrated in sample if possible) • technical set-up for online meeting & recording
Recruit Test Users • Define user profile & recruitment criteria • Decide on incentives • Set up recruitment survey • select recruitment channels • Online - craigslist, communities, job portals • Traditional - newspapers, ads • Recruitment agency
Recruit Test Users • Contact all shortlisted users - provide survey with available timeslots • Select actual users & notify in advance • Provide instructions for online meetings & prepare to re-schedule
Carry out Tests • Set up all software & phone conference • Send invitations to project stakeholders in advance • Be punctual
Carry out Tests During the test: • confirm user profile eligibility • ask for permission to record session • limit moderator intrusion • encourage thinking aloud • take notes • Deliver incentive/payment • have fun
Analysis & Reports • During tests: track all usability issues • After each test: compare notes & analyze • After all tests: summarize patterns & major problems • Set up report & sample videos • Communicate to all stakeholders
Conclusion • Importance of usability & User Testing • Remote testing - cheaper, efficient alternative to traditional methods • Remote tests: set up objectives & test scenario, recruit users, perform online tests, analyze findings.
Useful links • http://www.remoteusability.com/ • http://www.usability.gov/ • http://www.useit.com/
Questions &Answers Zhivko Dimitrov zhivko@telerik.com