1 / 39

Application Monitor: Adding games to crowd-sourced testing

Application Monitor: Adding games to crowd-sourced testing. Vivek Venkatachalam Microsoft. In today’s world, delivering quality is getting harder. . You are at this conference to learn new ways to tackle this. Crowdsourced testing is a promising approach BUT ….

shayna
Download Presentation

Application Monitor: Adding games to crowd-sourced testing

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Application Monitor: Adding games to crowd-sourced testing Vivek Venkatachalam Microsoft

  2. In today’s world, deliveringquality is getting harder.

  3. You are at this conference to learn new ways to tackle this.

  4. Crowdsourced testing is a promising approach BUT …

  5. You need a remote control

  6. This talk covers our attempt to build this remote control mechanism

  7. But first, lets go over some basics

  8. Productivity games?

  9. The idea is to introduce game elements into an employee’s workflow

  10. A great example of a productivity game is the Language Quality Game

  11. Dogfooding?

  12. It allows teams to get broad coverage against many configurations.

  13. Participants are volunteers that like to try out new products and help out.

  14. How it all started

  15. We had figured out how to measure performance in a lab setting.

  16. But it was unclear what performance was outside the lab.

  17. We needed to remove the fogaround this data.

  18. EnterApplication Monitor

  19. It measures performance on a user’s machine.

  20. And then sends it back to us

  21. This enabled tracking performanceon real user’s machines.

  22. Lets talk about the games now

  23. We started with Easter eggs

  24. These display on a user’s screen when they complete scenarios.

  25. This encouraged deepexploration of features.

  26. Here’s an example.

  27. Here’s another.

  28. Then we moved on to a richer set of themed games

  29. Users self-selected into teams.

  30. The goal was to collect achievements and to get on the leaderboard.

  31. Here’s an example of a leaderboard

  32. Onward to the“Spell Communicator” game

  33. The goal was to get all the letters to light up by exercising scenarios.

  34. And we’re now at the finish line

  35. We were successful ...............to an extent

  36. Even when people tried to “cheat/ game the system "

  37. We also encountered inevitable roadblocks along the way

  38. Credits My co-authors Marcelo and Harry. Our reviewers Ganesh and Ian. Mike Jackson for the original design. Ross Smith for his support and evangelization. Josh Williams for his game master role. The dogfood users who made this possible. Microsoft Clip Art for the images.

  39. Thanks for listening!

More Related