1 / 7

Using for In Situ Information Retrieval System Evaluation

Using for In Situ Information Retrieval System Evaluation. Henry Feild—Endicott College James Allan—UMass Amherst November 1, 2013 Living Labs Workshop @ CIKM. CrowdLogger instance server (e.g., http:// crowdlogger.org ). App. App. App Repository. App Repository. Log.

brent
Download Presentation

Using for In Situ Information Retrieval System Evaluation

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Using for In Situ Information Retrieval System Evaluation Henry Feild—Endicott College James Allan—UMass Amherst November 1, 2013 Living Labs Workshop @ CIKM

  2. CrowdLogger instance server (e.g., http://crowdlogger.org) App App App Repository App Repository Log App Repository App App App Log App Log

  3. Advantages User Base = Participant Pool Rich API Allows apps to access current and historical browsing behavior, store data, interact with the user, upload data privately, and more! App CrowdLogger instance server Log Apps can be developed by anyone Open Source And distributed from a private repository, or a CrowdLogger server instance. The entire code base is available from our Google Project page: https://code.google.com/p/crowdlogger/ App Repository App App Users’ data logged locally Multiple apps at the same time If an app wants to upload data somewhere else, they need permission from the user. CrowdLogger is somewhat akin to a smart phone or tablet—it’s an extensible, general-purpose platform with a convenient API. App App Log

  4. Challenges/Future work Amassing a large user base Complete/Extend API There are still a few API classes that we have yet to implement, such as global aggregation of data. There are also many things we can and probably should add to improve utility. How do we attract and retain users? App CrowdLogger instance server Log Simplifying app development Attracting developers We’d like to make it easy for research groups with minimal programming skills to build and deploy apps It’s good for the development process to be overseen by more than one pair of eyes. This will make the code more maintainable and also more secure. App Repository App App Logging across more browsers Handling multi-apps environments Right now we only support two of the leading browsers. It would be nice to extend CrowdLogger to IE, Safari, Opera, and others. What happens if two studies are running concurrently, and both modify the browsing UI? App App Log

More Related