1 / 30

I need to do an evaluation

This slide deck is part of a presentation given by Saul Greenberg at a UIST 2007 panel on Evaluating user interface systems research (see paper by Dan Olson in ACM DL) Its content was based on a paper written by Saul Greenberg and Bill Buxton, available at:

lane-walter
Download Presentation

I need to do an evaluation

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. This slide deck is part of a presentation given by Saul Greenberg at a UIST 2007 panel on Evaluating user interface systems research (see paper by Dan Olson in ACM DL) Its content was based on a paper written by Saul Greenberg and Bill Buxton, available at: http://grouplab.cpsc.ucalgary.ca/papers/2007/07-UsabilityHarmful-Greenberg-Report/07-usabilityHarmful-report2007-879-31.pdf

  2. I need to do an evaluation

  3. What’s the problem?

  4. It won’t get accepted if I don’t. Duh!

  5. Dogma

  6. Good HCI

  7. Time Learning Breakthrough major creative advances Replication ideas mimicked and altered; increasing experience Empiricism lessons formulated as empirical design rules Theory underlying causal systems Automation accepted Maturity used routinely Brian Gaines

  8. Evaluation sweet spot Breakthrough Replication Empiricism Theory Automation Maturity Interface validation and refinement* *70% quantitative, 30% qualitative

  9. Breakthrough Replication Empiricism Theory Automation Maturity Concepts,Sketches

  10. Memex Bush Concept

  11. Unimplemented and untested design. Microfilm is impractical. The work is premature. Resubmit after you build and evaluate this design.

  12. Sketchpad Sutherland Workingidea

  13. Complex controls,overly simplistic drawingsRecommend you evaluate a trained draftsman using Sketchpad vs. paper and pencil with real drafting tasks

  14. Augment Engelbart Deployed idea

  15. While ‘tested’ by your team, this is not an objective validation.

  16. What to do?

  17. Reflection Bill Buxton, Sketching the User Experience

  18. Breakthrough Replication Empiricism Theory Automation Maturity Cultural Appropriation

  19. Hypertext

  20. What to do?

  21. Case / field studiesCultural probesReflectionExtreme uses…

  22. Evaluation

  23. MoreAppropriate Evaluation

  24. We decide what is good research

  25. Time Learning Breakthrough Breakthrough Replication Replication Empiricism Empiricism Theory Theory Automation Automation Maturity Maturity Sketches Interface validation Cultural appropriation Brian Gaines

  26. grouplab.cpsc.ucalgary.ca/~papers/

More Related