500 likes | 663 Views
Usability Findings: GUI Toolkit Recommendations. October 7 th , 2009. Presentation Overview . Study Overview Usability Test Methods Participant Tasks Executive Summary Priority Scale Findings/Recommendations Next Steps. GUI Toolkit Usability Test : Study Overview.
E N D
Usability Findings: GUI Toolkit Recommendations October 7th, 2009
Presentation Overview • Study Overview • Usability Test Methods • Participant Tasks • Executive Summary • Priority Scale • Findings/Recommendations • Next Steps
Study Overview - Testing Methods • Testing Tools • High Fidelity Prototypes • Data Loss Prevention • EXTJS Prototype • Netvibes dashboard • Morae Recording Software • Goals • Asses the usability of key interaction design elements/concept using the Netvibes (Dashboard), RSA Data Loss Prevention prototype, Extjs prototype as a baseline for informing the design of the next generation GUI Toolkit • Testing session length = approximately 1 hour • 10 External Participants • Recruitment centered on administrators who were familiar with managing users, passwords and security policies.
GUI Toolkit Functionality Tasks EXTJS features • Task 1 Take a look at only the Open Incidents. Design element: Filters • Task2 Edit the severity and assignee for a particular Incident ID. Design elements: In-line editing, Auto complete dropdown • Task 3 Review just the High severity incidents? Design elements: Accordions, Grouping, summary headers.
GUI Toolkit Functionality Tasks • Task 4 Go ahead and review the Low Severity incidents Design element: Expanding and collapsing of groups • Task 5 Close all the low severity incidents. Design element: Split Button
GUI Toolkit Functionality Tasks Data Loss Prevention (DLP) Features • Task 6 Find the attachment details for the incident ID 18690 Design Elements: Data Binding • Task 7 Arrange the policies order Design elements: Drag and Drop • Task 8a Set the Event Severity scale for Critical and Low severity Design Elements: Slider/ Slide bars
GUI Toolkit Functionality Tasks • Task 8b Set the severity action for Policy Violation rules Design element: Drop down Layer • Task 8c Delete the first Severity action defined Design element: ‘X’ button to delete
GUI Toolkit Functionality Tasks Netvibes (Dashboard) • Task 9 Resize the dashboard column Design element: Column resizing • Task 10 Add a widget to the dashboard Design element: Adding elements/modules to the dashboard • Task 11 Arrange the layout and move the widgets in the dashboard page Design elements: Layout, Drag and Drop • Task 12 Edit an individual widget to see more articles. Design element: Edit functionalities for the individual widgets
GUI Toolkit Usability Test : Findings Summary • Strengths • Areas of Improvement
Executive Summary - Strengths • EXTJS features • After discovering grouping and filter view features, the participants were successful in using them • Users successfully used the in-line editing feature in the list view • Data Loss Prevention • Most of the users thought that the drag and drop feature was intuitive • Netvibes (Dashboard) • Most of the users found the dashboard approach useful • Most of the participants were able to easily edit the number of items viewed in the widget
Executive Summary - Areas of Improvement • EXTJS Features • Many users did not remember the state/view they were in while performing other functions • A lot of users expected right click functionalities • Most of the users did not notice the Grouping accordion • Some participants did not understand the default function of the split button and were confused by the ‘Close All’ option • Data Loss prevention • Most users did not notice the lower pane in the data binding feature using DLP, they expected a pop-up • Some users wanted to reorder policies by typing, rather than Drag and Drop • The slider overlap caused some difficulty -
Executive Summary - Areas of Improvement • Data Loss prevention (Cont) • Some of the users wanted to change the severity event scale by typing into the severity key fields, instead of using the slider • Some users did not understand ‘Any’ and ‘+’ buttons functionality • Most of the users got confused while deleting the default severity action and ended up deleting the whole rule. • Netvibes (Dashboard) • Most users could not figure out the column resizing in the dashboard • Most users had trouble adding the widget to the dashboard • Most users had trouble choosing a layout due to the number of boxes option • Some users had problems performing drag and drop while scrolling -
Severity Scale Finding Severity Scale • Major = Blocking, results in inability to complete tasks and user frustration – addressing may be necessary to avoid customer dissatisfaction. • Moderate = Major Irritation; results in extra clicks, long pauses and uncertainty – should be addressed; addressing would greatly improve user experience. • Minor = Minor irritation, results in short pauses and momentary uncertainty – nice to have; addressing would improve user experience.
Findings/Recommendations – EXTJS Prototype
Findings/Recommendations - EXTJS Finding: • Some users did not notice the View options on the left column • Most participants did not remember which state/view (Open Incidents) they are in while performing grouping Severity: Major Recommendation: • Make the state/filter of the current view clear to the user • Make filter and grouping controls more noticeable and provide a strong visual connection to the data
Findings/Recommendations - EXTJS Finding: Some participants were not able to figure out that they needed to click twice to perform in-line editing. Some were able to perform in-line editing by mistake while checking and unchecking checkboxes Severity: Moderate Recommendation: • Provide a tool tip to make the user aware of the in-line edit function • Provide an alternate way for the user to perform edit functionality • Unchecking should not open in-line editing
Findings/Recommendations - EXTJS Finding: Most of the users did not notice the Grouping accordion at the bottom Severity: Moderate Recommendation: • Minimize white space between accordion panels • Visual design should make sure the accordion buttons look more clickable
Findings/Recommendations – EXTJS Finding: Some of the participants used the column header to perform the grouping function instead of the accordion Severity: Minor Recommendation: • Keep the grouping option in the column header • Indicate applied filters (view) in the column headers
Findings/Recommendations - EXTJS Finding: Some participants would have liked the groups to be collapsed on default Severity: Minor Recommendation: • Have all the groups collapsed when the user initially performs grouping functionality
Findings/Recommendations - EXTJS Finding: Some participants were confused about the default function of the split button and close all functionality when they selected multiple items Severity: Major Recommendation: • Add the default function to the list (In this scenario add Close Selected to the split button options)
Findings/Recommendations - EXTJS Finding: Some participants were confused when the multi-select function did not check the check boxes Severity: Minor Recommendation: • When multi-select is performed the check boxes should be checked
Findings/Recommendations - EXTJS Finding: Some participants multi-selected and right clicked to perform close function Severity: Minor Recommendation: • Right click should provide application-specific actions appropriate to the items selected
Findings/Recommendations – Data Loss Prevention
Findings/Recommendations - DLP Finding: • Most of the users did not notice the lower pane for the matched content • Many users did not see any relation between the list view and the content Severity: Major Recommendation: • More investigation about how to best present the information to the user • Make the lower pane more visible by visual design and layout techniques • Provide some relation between the list view and the lower content pane
Findings/Recommendations - DLP Finding: Many users did not think that the drop position for the drag and drop functionality was obvious. Severity: Moderate Recommendation: • Make the user aware of the drop position by providing a drop boundary
Findings/Recommendations - DLP Finding: Some users linked out to the edit page while performing drag and drop to reorder policies Severity: Moderate Recommendation: • Deactivate the link while performing drag and drop function
Findings/Recommendations - DLP Finding: Some users wanted to reorder the items with a field to type in the order number Severity: Moderate Recommendation: • Have a list ordering column as an alternative to the drag and drop functionality (Improves accessibility)
Findings/Recommendations - DLP Finding: There were mixed reactions towards the drag and drop icon Severity: Minor Recommendation: • Improve the icon to have more meaning to the users (e.g. textured)
Findings/Recommendations - DLP Finding: Some participants did not initially realize that they could slide the bars to set the risk factor. Severity: Moderate Recommendation: • The slider should provide better affordance for sliding.
Findings/Recommendations - DLP Finding: Some participants wanted to type the numbers in the severity key boxes rather than using the slider. Severity: Moderate Recommendation: • Allow the users to type the number in the severity key boxes providing an alternative to the sliders (improve accessibility)
Findings/Recommendations - DLP Finding: Many participants tried to slide one slider past another. This caused confusion since the sliders would overlap each other. Severity: Moderate Recommendation: • The sliders should stop once adjacent to another rather than overlap
Findings/Recommendations - DLP Finding: Some participants were confused about the actual value the slider was on while sliding. Severity:Moderate Recommendation: • Have a tool tip showing exact value of the slider while sliding
Findings/Recommendations - DLP Finding: Some participants did not realize that the Any button was a drop down layer Severity:Moderate Recommendation: • MakeAny button look more clickable still maintaining the color coding
Findings/Recommendations - DLP Finding: Many participants did not understand what function the ‘+’ button performs Severity:Moderate Recommendation: • The ‘+’ button needs more investigation with actual DLP users
Findings/Recommendations – DLP Finding: Many users were confused and clicked on the delete row option when asked to delete the first (Critical) severity action Severity:Major Recommendation: • If there are multiple severity action have an ‘X’ besides all severity actions, but if there’s only one do not show ‘X’ • Have more descriptive text for the row delete (‘Delete Rule’) • Have a tool tip for the individual severity ‘x’ button which says ‘Delete item’ • Move the X closer to the item to be deleted
Findings/Recommendations – Netvibes (Dashboard)
Findings/Recommendations - Netvibes Finding: None of the participants were able to resize the column. Many participants tried resizing the individual widgets by their borders Severity:Moderate Recommendation: • Have a cursor change throughout the gutter for resizing the column
Findings/Recommendations - Netvibes Finding: Some users weren’t sure if they had succeeded in adding the widget or not since the indicator reverts to ‘add’ again after a few seconds to allow multiple widgets to be added Severity: Moderate Recommendation: • Show what is added by persistent visual indicators while still allowing for duplicate widgets to be added
Findings/Recommendations - Netvibes Finding: Most participants had trouble finding the ‘Add content’ button to add a new widget Severity: Major Recommendation: • Have the Add button more prominent and closer to the dashboard • Have more than one way of adding widgets to the dashboard (example right click)
Findings/Recommendations - Netvibes Finding: Most of the participants were confused while selecting a layout due to the number of boxes functionality Severity: Moderate Recommendation: • Do not have the user choose the number of boxes, have all the layouts in one list
Findings/Recommendations - Netvibes Finding: Some of the participants clicked on the links and the options on the widget header while performing drag and drop, which took them to another page. Severity: Moderate Recommendation: • Provide a grabber whenever the drag and drop functionality is present • Do not link the widget header text
Next Steps Next Steps • Hand off to the GUI and UXD team • Apply recommendations to the Saleen Toolkit • Asses if retest for any feature is required • Enter recommendations into JIRA