290 likes | 409 Views
MEASURING THE EFFECT OF USABILITY MECHANISM ON USER EFFICIENCY, EFFECTIVENESS AND SATISFACTION. Marianella Aveledo Diego Mauricio Curtino Agustín De la Rosa Ana María Moreno Universidad Politécnica de Madrid Facultad de Informática Madrid, España. AGENDA. Motivation Objetive Why?
E N D
MEASURING THE EFFECT OF USABILITY MECHANISM ON USER EFFICIENCY, EFFECTIVENESS AND SATISFACTION Marianella Aveledo Diego Mauricio Curtino Agustín De la Rosa Ana María Moreno Universidad Politécnica de Madrid Facultad de Informática Madrid, España
AGENDA Motivation Objetive Why? Data collected Pilot test using EasyTheatre tool Experimental test using EasyFlight tool Conclusions Future work
MOTIVATION Authors from SE and HCI sustain that a high degree of usability can be attained if the highly impacting mechanisms are implemented in a software application.
STARTING FROM Usability as the extent to which a product can be use by specified users to achieve specified goals with EFFECTIVENESS, EFFICIENCY and SATISFACTION in a specified context of use
OBJETIVE Our aim is to study the effect of incorporating some usability mechanism. In particular usability attributes like EFFECTIVENESS, EFFICIENCY and SATISFACTION
THERE IS NO EMPIRICAL EVIDENCE OF THE IMPACT OF THE USABILITY MECHANISMS: • Help • Global Undo • System Status Feedback • ProgressFeedback • Warning • Abort • StructuredText Entry • Go back • IN THE USABILITY ATTRIBUTES.
QUANTITATIVE DATA: Time to complete a task EFFICIENCY Number of clicksorequivalentnavigationalactions RELATIVE EFFICIENCY
QUALITATIVE DATA: Answersprovidedbytheusersto post test questionnaries SATISFACTION Answertothequestion: Wereyouableto complete thetask? EFFECTIVENESS
A total of 24 subjectsparticipated in theexperiment. Theyweredivided en twogroups: • Control Group (CG) didnot use usabilitymechanisms • Test Group (TG) thatusedbuilt-in usabilitymechanisms
MEAN INCREASE IN SATISFACTION * STATISTICALLY SIGNIFICANT
A total of 46 subjectsparticipated in theexperiment. Theyweredivided en twogroups: • Control Group (CG) didnot use usabilitymechanisms • Test Group (TG) thatusedbuilt-in usabilitymechanisms
IMPACT ON THE EFFICIENCY ATTRIBUTE * STATISTICALLY SIGNIFICANT
IMPACT ON THE RELATIVE EFFICIENCY ATTRIBUTE *STATISTICALLY SIGNIFICANT
IMPACT ON THE EFFECTIVENESS ATTRIBUTE *STATISTICALLY SIGNIFICANT
IMPACT ON THE SATISFACTION ATTRIBUTE * STATISTICALLY SIGNIFICANT
Thestucturedtextentrymechanismhad a highimpactover 60% in allusabilityattributes. • Theprogressfeedbackmechanismdidnothavestatisticallysignificanceoneffectivenessattributebecauseusersalways can complete thetask. • WewillcontinueusingEasyFlighttooltoruntestsinvolvingothermechanisms.
To generalize the results with other software application types we developed an even-driven home automation application. We will run a similar experiment with this tool in a very near future.