1 / 50

Usability Findings: GUI Toolkit Recommendations

Usability Findings: GUI Toolkit Recommendations. October 7 th , 2009. Presentation Overview . Study Overview Usability Test Methods Participant Tasks Executive Summary Priority Scale Findings/Recommendations Next Steps. GUI Toolkit Usability Test : Study Overview.

nubia
Download Presentation

Usability Findings: GUI Toolkit Recommendations

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript


  1. Usability Findings: GUI Toolkit Recommendations October 7th, 2009

  2. Presentation Overview • Study Overview • Usability Test Methods • Participant Tasks • Executive Summary • Priority Scale • Findings/Recommendations • Next Steps

  3. GUI Toolkit Usability Test : Study Overview

  4. Study Overview - Testing Methods • Testing Tools • High Fidelity Prototypes • Data Loss Prevention • EXTJS Prototype • Netvibes dashboard • Morae Recording Software • Goals • Asses the usability of key interaction design elements/concept using the Netvibes (Dashboard), RSA Data Loss Prevention prototype, Extjs prototype as a baseline for informing the design of the next generation GUI Toolkit • Testing session length = approximately 1 hour • 10 External Participants • Recruitment centered on administrators who were familiar with managing users, passwords and security policies.

  5. EXTJS Prototype

  6. EXTJS Prototype

  7. Data Loss Prevention

  8. Data Loss Prevention

  9. Netvibes (Dashboard)

  10. GUI Toolkit Functionality Tasks EXTJS features • Task 1 Take a look at only the Open Incidents. Design element: Filters • Task2 Edit the severity and assignee for a particular Incident ID. Design elements: In-line editing, Auto complete dropdown • Task 3 Review just the High severity incidents? Design elements: Accordions, Grouping, summary headers.

  11. GUI Toolkit Functionality Tasks • Task 4 Go ahead and review the Low Severity incidents Design element: Expanding and collapsing of groups • Task 5 Close all the low severity incidents. Design element: Split Button

  12. GUI Toolkit Functionality Tasks Data Loss Prevention (DLP) Features • Task 6 Find the attachment details for the incident ID 18690 Design Elements: Data Binding • Task 7 Arrange the policies order Design elements: Drag and Drop • Task 8a Set the Event Severity scale for Critical and Low severity Design Elements: Slider/ Slide bars

  13. GUI Toolkit Functionality Tasks • Task 8b Set the severity action for Policy Violation rules Design element: Drop down Layer • Task 8c Delete the first Severity action defined Design element: ‘X’ button to delete

  14. GUI Toolkit Functionality Tasks Netvibes (Dashboard) • Task 9 Resize the dashboard column Design element: Column resizing • Task 10 Add a widget to the dashboard Design element: Adding elements/modules to the dashboard • Task 11 Arrange the layout and move the widgets in the dashboard page Design elements: Layout, Drag and Drop • Task 12 Edit an individual widget to see more articles. Design element: Edit functionalities for the individual widgets

  15. GUI Toolkit Usability Test : Findings Summary • Strengths • Areas of Improvement

  16. Executive Summary - Strengths • EXTJS features • After discovering grouping and filter view features, the participants were successful in using them • Users successfully used the in-line editing feature in the list view • Data Loss Prevention • Most of the users thought that the drag and drop feature was intuitive • Netvibes (Dashboard) • Most of the users found the dashboard approach useful • Most of the participants were able to easily edit the number of items viewed in the widget

  17. Executive Summary - Areas of Improvement • EXTJS Features • Many users did not remember the state/view they were in while performing other functions • A lot of users expected right click functionalities • Most of the users did not notice the Grouping accordion • Some participants did not understand the default function of the split button and were confused by the ‘Close All’ option • Data Loss prevention • Most users did not notice the lower pane in the data binding feature using DLP, they expected a pop-up • Some users wanted to reorder policies by typing, rather than Drag and Drop • The slider overlap caused some difficulty -

  18. Executive Summary - Areas of Improvement • Data Loss prevention (Cont) • Some of the users wanted to change the severity event scale by typing into the severity key fields, instead of using the slider • Some users did not understand ‘Any’ and ‘+’ buttons functionality • Most of the users got confused while deleting the default severity action and ended up deleting the whole rule. • Netvibes (Dashboard) • Most users could not figure out the column resizing in the dashboard • Most users had trouble adding the widget to the dashboard • Most users had trouble choosing a layout due to the number of boxes option • Some users had problems performing drag and drop while scrolling -

  19. Severity Scale Finding Severity Scale • Major = Blocking, results in inability to complete tasks and user frustration – addressing may be necessary to avoid customer dissatisfaction. • Moderate = Major Irritation; results in extra clicks, long pauses and uncertainty – should be addressed; addressing would greatly improve user experience. • Minor = Minor irritation, results in short pauses and momentary uncertainty – nice to have; addressing would improve user experience.

  20. Findings/Recommendations – EXTJS Prototype

  21. Findings/Recommendations - EXTJS Finding: • Some users did not notice the View options on the left column • Most participants did not remember which state/view (Open Incidents) they are in while performing grouping Severity: Major Recommendation: • Make the state/filter of the current view clear to the user • Make filter and grouping controls more noticeable and provide a strong visual connection to the data

  22. Findings/Recommendations - EXTJS Finding: Some participants were not able to figure out that they needed to click twice to perform in-line editing. Some were able to perform in-line editing by mistake while checking and unchecking checkboxes Severity: Moderate Recommendation: • Provide a tool tip to make the user aware of the in-line edit function • Provide an alternate way for the user to perform edit functionality • Unchecking should not open in-line editing

  23. Findings/Recommendations - EXTJS Finding: Most of the users did not notice the Grouping accordion at the bottom Severity: Moderate Recommendation: • Minimize white space between accordion panels • Visual design should make sure the accordion buttons look more clickable

  24. Findings/Recommendations – EXTJS Finding: Some of the participants used the column header to perform the grouping function instead of the accordion Severity: Minor Recommendation: • Keep the grouping option in the column header • Indicate applied filters (view) in the column headers

  25. Findings/Recommendations - EXTJS Finding: Some participants would have liked the groups to be collapsed on default Severity: Minor Recommendation: • Have all the groups collapsed when the user initially performs grouping functionality

  26. Findings/Recommendations - EXTJS Finding: Some participants were confused about the default function of the split button and close all functionality when they selected multiple items Severity: Major Recommendation: • Add the default function to the list (In this scenario add Close Selected to the split button options)

  27. Findings/Recommendations - EXTJS Finding: Some participants were confused when the multi-select function did not check the check boxes Severity: Minor Recommendation: • When multi-select is performed the check boxes should be checked

  28. Findings/Recommendations - EXTJS Finding: Some participants multi-selected and right clicked to perform close function Severity: Minor Recommendation: • Right click should provide application-specific actions appropriate to the items selected

  29. Findings/Recommendations – Data Loss Prevention

  30. Findings/Recommendations - DLP Finding: • Most of the users did not notice the lower pane for the matched content • Many users did not see any relation between the list view and the content Severity: Major Recommendation: • More investigation about how to best present the information to the user • Make the lower pane more visible by visual design and layout techniques • Provide some relation between the list view and the lower content pane

  31. Findings/Recommendations - DLP Finding: Many users did not think that the drop position for the drag and drop functionality was obvious. Severity: Moderate Recommendation: • Make the user aware of the drop position by providing a drop boundary

  32. Findings/Recommendations - DLP Finding: Some users linked out to the edit page while performing drag and drop to reorder policies Severity: Moderate Recommendation: • Deactivate the link while performing drag and drop function

  33. Findings/Recommendations - DLP Finding: Some users wanted to reorder the items with a field to type in the order number Severity: Moderate Recommendation: • Have a list ordering column as an alternative to the drag and drop functionality (Improves accessibility)

  34. Findings/Recommendations - DLP Finding: There were mixed reactions towards the drag and drop icon Severity: Minor Recommendation: • Improve the icon to have more meaning to the users (e.g. textured)

  35. Findings/Recommendations - DLP Finding: Some participants did not initially realize that they could slide the bars to set the risk factor. Severity: Moderate Recommendation: • The slider should provide better affordance for sliding.

  36. Findings/Recommendations - DLP Finding: Some participants wanted to type the numbers in the severity key boxes rather than using the slider. Severity: Moderate Recommendation: • Allow the users to type the number in the severity key boxes providing an alternative to the sliders (improve accessibility)

  37. Findings/Recommendations - DLP Finding: Many participants tried to slide one slider past another. This caused confusion since the sliders would overlap each other. Severity: Moderate Recommendation: • The sliders should stop once adjacent to another rather than overlap

  38. Findings/Recommendations - DLP Finding: Some participants were confused about the actual value the slider was on while sliding. Severity:Moderate Recommendation: • Have a tool tip showing exact value of the slider while sliding

  39. Findings/Recommendations - DLP Finding: Some participants did not realize that the Any button was a drop down layer Severity:Moderate Recommendation: • MakeAny button look more clickable still maintaining the color coding

  40. Findings/Recommendations - DLP Finding: Many participants did not understand what function the ‘+’ button performs Severity:Moderate Recommendation: • The ‘+’ button needs more investigation with actual DLP users

  41. Findings/Recommendations – DLP Finding: Many users were confused and clicked on the delete row option when asked to delete the first (Critical) severity action Severity:Major Recommendation: • If there are multiple severity action have an ‘X’ besides all severity actions, but if there’s only one do not show ‘X’ • Have more descriptive text for the row delete (‘Delete Rule’) • Have a tool tip for the individual severity ‘x’ button which says ‘Delete item’ • Move the X closer to the item to be deleted

  42. Findings/Recommendations – Netvibes (Dashboard)

  43. Findings/Recommendations - Netvibes Finding: None of the participants were able to resize the column. Many participants tried resizing the individual widgets by their borders Severity:Moderate Recommendation: • Have a cursor change throughout the gutter for resizing the column

  44. Findings/Recommendations - Netvibes Finding: Some users weren’t sure if they had succeeded in adding the widget or not since the indicator reverts to ‘add’ again after a few seconds to allow multiple widgets to be added Severity: Moderate Recommendation: • Show what is added by persistent visual indicators while still allowing for duplicate widgets to be added

  45. Findings/Recommendations - Netvibes Finding: Most participants had trouble finding the ‘Add content’ button to add a new widget Severity: Major Recommendation: • Have the Add button more prominent and closer to the dashboard • Have more than one way of adding widgets to the dashboard (example right click)

  46. Findings/Recommendations - Netvibes Finding: Most of the participants were confused while selecting a layout due to the number of boxes functionality Severity: Moderate Recommendation: • Do not have the user choose the number of boxes, have all the layouts in one list

  47. Findings/Recommendations - Netvibes Finding: Some of the participants clicked on the links and the options on the widget header while performing drag and drop, which took them to another page. Severity: Moderate Recommendation: • Provide a grabber whenever the drag and drop functionality is present • Do not link the widget header text

  48. Next Steps

  49. Next Steps Next Steps • Hand off to the GUI and UXD team • Apply recommendations to the Saleen Toolkit • Asses if retest for any feature is required • Enter recommendations into JIRA

  50. Thank you!

More Related