Usability Tests and Reports

1. Usability Tests and Reports Brian Gastle Western Carolina University

2. What is a Usability Test • Examines How Effective a Document or Device Is: • Finding Information • Performing Tasks • Answering Questions • Solving Problems

3. How is it performed/conducted? • Experiments with “real” users • Study users as they use the document or device • Observed by development team or testing agency • Should be viewed by a variety of “specialists”

4. Goals of the Test • Safety • Economic • Reduce clarification inquiries • Highlight “best” parts of product in marketing • Future product development • Customer Satisfaction

5. Stages of the Test • Preparation of the Test • Administration of the Test • Interpreting and Reporting Test Info

6. Preparation of the Test • Define important needs of users • Goals of the document or device • Define purpose of the test based upon needs • Define Test Team • Write Test Plan (proposal – resources) • Prepare materials • Activities, questions, etc. • Select Participants • Establish Testing Environment • Pilot Test

7. Administering Test • Develop Clear Checklist and/or Schedule for each test • Conduct each test the same way • Including interaction with participant • Watch leading questions / statements • Debrief / Interview after test

8. Reporting Data • Tabulate and graph numerical data • Group data into appropriate categories for revision of document • Follow Formal Report Format and Layout.

9. Some Sample Online Tests • http://zing.ncsl.nist.gov/iusr/documents/cifv1.1b.htm • Common Industry Format for Usability Test Reports • A gov. document outlining standard formats for UT’s • If you do all this you’ll be in good shape ;-) • http://www.macromedia.com/software/flash/productinfo/usability/usability_test/ • A very clear UT comparing usability of two web sites • http://www.gooddocuments.com/samples/usabilitytest.htm • A complete report from inception to administration to recommendations