1 / 27

M23CDE: Usability evaluation

<RECAP>. Usability. ISO 9241 (part 11) defines usability as: ?The extent to which a product can be used by specified users to achieve specified goals with effectiveness, efficiency, and satisfaction in a specified context of use"?we could add ?learnability' to this list.. Effectiveness: Can you

sakina
Download Presentation

M23CDE: Usability evaluation

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

    1. M23CDE: Usability evaluation Benyon, Turner and Turner. Designing Interactive Systems. Chapter 12. All of: Jeffrey Rubin. Handbook of Usability Testing.

    3. Usability ISO 9241 (part 11) defines usability as: “The extent to which a product can be used by specified users to achieve specified goals with effectiveness, efficiency, and satisfaction in a specified context of use” …we could add ‘learnability’ to this list.

    4. Effectiveness: Can you actually do a specified task? Efficiency: Can you do it quickly, without getting bored or frustrated? Satisfaction: Is it fun, or at least pleasant to use? Learnability: Can you use it without constantly reaching for the manual or asking for help.

    7. Pick some important tasks and watch as people try to do them That means that usability testing is not: link or load or code testing having friends view your pages on their computers online surveys or focus groups

    12. How to Test Usability Plan Do Follow-up

    13. How: Plan Be aware of: Purpose and audience of site/application (likely user goals) Usability goals for this site / application (effectiveness, efficiency, satisfaction, learnability) Tasks – what are users most likely attempting to do on the site. (planning for short duration tests / time issues) Participants, scheduling, payment.

    14. How: Do Introduction for participant – explanation of the test, setting the participant at ease. Expectations questionnaire: explain purpose of interface (application / website) elicit a set of expectations about what the site should ‘do’ and not do. Introduce list of tasks (on paper? One at a time?) Watch quietly (or use co-discovery) Record behavior (take notes, tape, screen recording) Interact with participant if necessary Debriefing, questionnaire, payment

    15. How: Follow-up Write up: Tabulate data Findings Recommendations Actions Usability testing is a bit like ‘debugging code’. So think: what went wrong, where precisely did it go wrong, what’s the fix Write ups – should be complete enough for the test to be reproducible – so include everything (participants profile – age experience – tasks used – protocol for the test – equipment used – recording method)

    17. How formal should the test be? 1: Quick and dirty Shortcuts on the planning: get convenient participants, not ideal ones Schedule an hour worth of tasks Convenient locations, realistic tasks Debriefing very important: ask why Shortcuts on the write-up

    18. How formal should the test be? 2: Multipurpose lab space Use available space as laboratory-for-a-day Bring in portable equipment Convert an empty office into a full-time lab Use a lab for other things to help justify cost

    20. How formal should the test be? 3: Full usability labs Build rooms just for this purpose Adjoining, sound-proofed rooms Video cameras, scan converters, twoway mirrors, microphones, etc Cost: Up to Ł100,000 Do it all of the time to recoup investment

    25. Tips: Note-taking Use screen printouts to scribble on (try this in the tutorials) Words and body language as important as what users are doing on screen – you need to develop observational skills.

    26. Tips: Participants think they are dumb, so: Play dumb too: “I do not know how to do it either, I am confused too” Join the club: “Everyone else has had trouble too, so it is not just you” Blame the designer: “If you are having trouble, then it must be the designer who is dumb”

    27. Tips: Uses for video/audio tapes Support note-taking and remind you what happened (audio and cheap video) Review session with people who could not be there (video) High-lights tape (quality video) Sits on a shelf gathering dust

    28. Tips: Recruiting users Broadcasting does not work Friends of friends Return participants Find an organized group for a special audience (e.g., students from other schools, parents)

More Related