1 / 10

HF750: Usability Testing & Assessment Kodak EASYSHARE ONE

HF750: Usability Testing & Assessment Kodak EASYSHARE ONE. Usability Test Results. Usability Test Team 5: Kevin Berni Vanessa Brown Mike Ledoux Pat Sorenson Hanna Yehuda. Why the Kodak EasyShare One camera was chosen for testing.

jessenia-kianoush
Download Presentation

HF750: Usability Testing & Assessment Kodak EASYSHARE ONE

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. HF750: Usability Testing & AssessmentKodak EASYSHARE ONE Usability Test Results Usability Test Team 5: Kevin Berni Vanessa Brown Mike Ledoux Pat Sorenson Hanna Yehuda

  2. Why the Kodak EasyShare One camera was chosen for testing We were fortunate to have access to a product that was soon to be released to the general public. The product offered some advancements in digital photography. Our team expressed an interest in testing a non-software based application. It would offer an enjoyable test experience for our testing team and our participants.

  3. Test Design • Recruitment • 3 Males & 5 Females • Ages early 20’s to early 40’s • Professionals, categorized as “tech savvy” • Familiar with wireless internet technology • Tasks • Basic operational tasks to test key features • Probing usability tasks to test some of the concerns of Kodak and the Bentley test team • Testing environment • The Bentley usability lab (video & auditory recording capabilities) • One Bentley Graduate school moderator with each participant • One Bentley Graduate school team member managing the video & audio • One Bentley Graduate school team member taking notes • Remote testing out of the home (3 participants)

  4. Test Design • Testing protocols • Participants were instructed to “Think aloud” during testing • Survey questions • After each task – 7 point Likert scale (1=Easy… 7=Difficult) • After all tasks • Semantic Differential for Measuring Hedonic Quality • Post Ease of Use Survey • Post Test Satisfaction Survey • Assistance • Product overview reference card • Moderator could give an assist

  5. Measurement of Results • Participant tasks were measured by • Time • Successful completion of the task • Number of assists • Importance of the task

  6. Test Execution • The test consisted of 14 tasks that would test the product’s • Features & Functionality • Feature workflow • User conceptual understanding • The physicality of operation • The camera’s operational abilities (performance, speed, user manipulation). • The participant was instructed to read each task aloud and to carry out the instructions. No break times were given during testing, although they were offered. • All 8 participants completed (or attempted) all tasks without rest breaks or without an early departure from testing.

  7. Test ExecutionIssues • WI-FI connectivity with the printer • Handling the technological dependencies, e.g. the Bentley labs network goes down, or performance is degraded • Initial Kodak EasyShare One camera broke during pilot test • The male vs female ratio of participants • Half of the participants watched the Kodak EasyShare One training video • The type and number of assists that could be given • Handling the dependency factor, e.g. the successful completion of one task needed for the subsequent task

  8. Test Results How we categorized the issues found • Positive finding: A camera feature or process that should be preserved or developed more. • Good Idea: The participant and or test team found a feature or approach that worked well, or received input that should be considered. • Minor Problem: Caused the participant to hesitate for a few seconds. • Moderate Problem: Delayed participants in their use of the camera, but didn’t cause any catastrophic problems. • Serious Problem: Delayed participants in their use of the camera for 1 to 5 minutes, but eventually were able to continue. • Critical Problem: Caused frequent catastrophes. • Bug: Camera is not working as designed. Molich, R. & Dumas, J. (2005). Comparative usability evaluation (CUE-4), Behavior and Information Technology, In press, p. 11-12

  9. Test Results The category break-down of issues found.

  10. Test Recommendations • Consider a menu option like Create or New, which could be used for creating a new album. • Add affordance to pictures that are favorites, versus having the user clicking a picture to see if it’s a favourite. • Add a graphic of the camera with the WIFI card extended on the “extend WIFI card” error message. • The edit/album screen icon name is confusing, especially if you want to add a photo to the album. Consider modifying the screen name. • Submit icons for user testing. Better resemblance icons are needed. • Consider a built-in WIFI adapter. • The camera uses some wizards in carrying out certain functionality, consider the use of more wizards. • Add an envelope button for email.

More Related