1 / 19

Tabin Hasan Dept. of Computer Science University of Trento

1st Workshop on Incentives for the Semantic Web ISWC 2008, Karlsruhe, October 26th, 2008. Bridging the Motivation Gap for Individual Annotators: What Can We Learn From Photo Annotation Systems?. Anthony Jameson FBK-irst Trento. Tabin Hasan Dept. of Computer Science University of Trento.

colleen-liddane
Download Presentation

Tabin Hasan Dept. of Computer Science University of Trento

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. 1st Workshop on Incentives for the Semantic Web ISWC 2008, Karlsruhe, October 26th, 2008 Bridging the Motivation Gap for Individual Annotators: What Can We Learn From Photo Annotation Systems? Anthony Jameson FBK-irst Trento Tabin Hasan Dept. of Computer Science University of Trento • Contents: • The Two Motivation Gaps • Bridging the … [See the title] • Implications for the Other Workshop Papers • (With audience participation)

  2. The Community Motivation Gap(common view) Creating metadata for yourself Creating metadata for a community Common strategies: • Spread the work around • Provide individual as well as community benefit • Provide quick confirmation and benefit • Make incremental contributions usable • Show what contributions are needed • Show what the current user is especially qualified to provide • Provide a fun game • Minimize privacy concerns • Publicize contributions

  3. The Individual Motivation Gap Creating metadata for yourself Creating metadata for a community Creating metadata for yourself Exploiting your own metadata

  4. A Photo Annotation Interface "Sri Lanka dusk photos” detected by PhotoCompas using contextual metadata. From Naaman et al. (2004)

  5. External Resources "Sri Lanka dusk photos” detected by PhotoCompas using contextual metadata. From Naaman et al. (2004)

  6. Algorithms, User Interface SAPHARI, from Suh and Bederson (2007)

  7. User Input, Affordances of Situations ARIA: cf. Lieberman, Rosenzweig, and Singh (2001)

  8. Tag Learning Suggesting annotations of new photos Learning tags from examples Correcting incorrect suggested annotations Geographic and event data sources Best when user is uploading many photos related to a given place / event

  9. SOMNet Better support for choice of terms Enable “scratching own itch” while browsing Intelligently use relevant data in doctors’ own computers Encourage case entry when doctor has been dealing with the relevant information Use KB of previous cases to support autocompletion

  10. Collaborative IR Augmentation Suggest mapping on basis of previous learning Support testing and debugging to require minimal user effort Use machine learning to exploit KB of existing keyword queries and formal representations Facilitate contribution after noticing of gap

  11. Constitution-Based Game Make sure that the game is actually fun!

  12. Inverse Search Support batch export of subsets of private data Algorithms for recommending information to be made public Facilitate export when private data is originally added KB of aggregated information needs

  13. Community Motivation Gap • Spread the work around so that each person needs to do only a bit • Collaborative IR augmentation • "collaborative" • Provide individual benefit as well as community benefit • Collaborative IR augmentation • "immediate"

  14. Community Motivation Gap • Provide quick confirmation of contribution and quick benefit • Collaborative IR augmentation • "immediate" • SOMNet • People want to know their contributions are being taken seriously

  15. Community Motivation Gap • Ensure that even incremental contributions can be utilized • Collaborative IR augmentation • "incremental", "partial" • Show what contributions are needed (and which ones the current user is especially qualified to provide) • Inverse search

  16. Community Motivation Gap • Provide a fun game in which people do the desired work • Constitution-based game • Protect privacy • SOMNet • People wanted to avoid revealing gaps in knowledge • Inverse search • Encourage people to move knowledge from private to public when it's needed • Publicize (and maybe publicly evaluate) contributions

More Related