160 likes | 288 Views
Helsinki University of Technology 11.12.2008 S-72.2530 Acceptability and Quality of Service. Olli Kulkki Markus Lappalainen Ville Lehtinen Reijo Lindroos Ilari Pulkkinen. Collaborative Document Editing: Quality and Improvement. Agenda. Comparison of competitive services Framework
E N D
Helsinki University of Technology11.12.2008 S-72.2530 Acceptability and Quality of Service Olli Kulkki Markus Lappalainen Ville Lehtinen Reijo Lindroos Ilari Pulkkinen Collaborative Document Editing: Quality and Improvement
Agenda • Comparison of competitive services • Framework • Comparison • Improving acceptability for a service • Usability evolution process • Methods for process execution • Evolution continuity • Using measured data
User base growth and duplexity Use Base Growth Duplexity
Phase 2 Assessing and developingacceptability and quality for one of the previousapplications
UsabilityEvolutionProcess Applied from Theofanos et al, A Practical Guide to the CIF: UsabilityMeasurements, 2006
Measure Usability Now and After • Measure effectiveness, efficiency and satisfaction • Carry out participative usability tests • Focus on teamwork and document co-editing • Group tests with Think Aloud • Use representative tasks • Measure completeness, errors, time on task • Questionnaires to measure satisfaction
Target Usability • How much we want (and how we measure) • Effectiveness • Efficiency • Satisfaction with intended users, tasks and context? Google Docs Users: Students doing course exercises together Tasks: Co-editing text, using source material etc. Context: Computer classrooms, home computers
Measurementmethods Applied from the Usability method toolbox (http://jthom.best.vwh.net/usability/index.htm)
Heuristicevaluation • Simplistic user interface • Two separate views for document management and text editing • Problems • Limited formatting tools • Access inconsistency with other Google apps • Tools for collaboration support are missing • Benefits • Easy to learn
Monitoring Google docs • Record and analyze user behavior and preferences • Improve service quality and acceptability • Non-interactive, non-functional