110 likes | 232 Views
HF750: Usability Testing & Assessment Kodak EASYSHARE ONE. Usability Test Results. Usability Test Team 5: Kevin Berni Vanessa Brown Mike Ledoux Pat Sorenson Hanna Yehuda. Why the Kodak EasyShare One camera was chosen for testing.
E N D
HF750: Usability Testing & AssessmentKodak EASYSHARE ONE Usability Test Results Usability Test Team 5: Kevin Berni Vanessa Brown Mike Ledoux Pat Sorenson Hanna Yehuda
Why the Kodak EasyShare One camera was chosen for testing We were fortunate to have access to a product that was soon to be released to the general public. The product offered some advancements in digital photography. Our team expressed an interest in testing a non-software based application. It would offer an enjoyable test experience for our testing team and our participants.
Test Design • Recruitment • 3 Males & 5 Females • Ages early 20’s to early 40’s • Professionals, categorized as “tech savvy” • Familiar with wireless internet technology • Tasks • Basic operational tasks to test key features • Probing usability tasks to test some of the concerns of Kodak and the Bentley test team • Testing environment • The Bentley usability lab (video & auditory recording capabilities) • One Bentley Graduate school moderator with each participant • One Bentley Graduate school team member managing the video & audio • One Bentley Graduate school team member taking notes • Remote testing out of the home (3 participants)
Test Design • Testing protocols • Participants were instructed to “Think aloud” during testing • Survey questions • After each task – 7 point Likert scale (1=Easy… 7=Difficult) • After all tasks • Semantic Differential for Measuring Hedonic Quality • Post Ease of Use Survey • Post Test Satisfaction Survey • Assistance • Product overview reference card • Moderator could give an assist
Measurement of Results • Participant tasks were measured by • Time • Successful completion of the task • Number of assists • Importance of the task
Test Execution • The test consisted of 14 tasks that would test the product’s • Features & Functionality • Feature workflow • User conceptual understanding • The physicality of operation • The camera’s operational abilities (performance, speed, user manipulation). • The participant was instructed to read each task aloud and to carry out the instructions. No break times were given during testing, although they were offered. • All 8 participants completed (or attempted) all tasks without rest breaks or without an early departure from testing.
Test ExecutionIssues • WI-FI connectivity with the printer • Handling the technological dependencies, e.g. the Bentley labs network goes down, or performance is degraded • Initial Kodak EasyShare One camera broke during pilot test • The male vs female ratio of participants • Half of the participants watched the Kodak EasyShare One training video • The type and number of assists that could be given • Handling the dependency factor, e.g. the successful completion of one task needed for the subsequent task
Test Results How we categorized the issues found • Positive finding: A camera feature or process that should be preserved or developed more. • Good Idea: The participant and or test team found a feature or approach that worked well, or received input that should be considered. • Minor Problem: Caused the participant to hesitate for a few seconds. • Moderate Problem: Delayed participants in their use of the camera, but didn’t cause any catastrophic problems. • Serious Problem: Delayed participants in their use of the camera for 1 to 5 minutes, but eventually were able to continue. • Critical Problem: Caused frequent catastrophes. • Bug: Camera is not working as designed. Molich, R. & Dumas, J. (2005). Comparative usability evaluation (CUE-4), Behavior and Information Technology, In press, p. 11-12
Test Results The category break-down of issues found.
Test Recommendations • Consider a menu option like Create or New, which could be used for creating a new album. • Add affordance to pictures that are favorites, versus having the user clicking a picture to see if it’s a favourite. • Add a graphic of the camera with the WIFI card extended on the “extend WIFI card” error message. • The edit/album screen icon name is confusing, especially if you want to add a photo to the album. Consider modifying the screen name. • Submit icons for user testing. Better resemblance icons are needed. • Consider a built-in WIFI adapter. • The camera uses some wizards in carrying out certain functionality, consider the use of more wizards. • Add an envelope button for email.