170 likes | 353 Views
Social People-Tagging vs. Social Bookmark-Tagging. Peyman Nasirifard, Sheila Kinsella , Krystian Samp, Stefan Decker. Bookmark-tagging and People-tagging. todo. nlp. friendly. music. research. technician. Motivation. Understand better how people tag each other
E N D
Social People-Tagging vs.Social Bookmark-Tagging Peyman Nasirifard, Sheila Kinsella, Krystian Samp, Stefan Decker
Bookmark-tagging and People-tagging todo nlp friendly music research technician
Motivation • Understand better how people tag each other • A starting point for tag recommendation in frameworks based on people-tagging • Access control mechanisms • Information filtering mechanisms • We are especially interested in subjectivity of tags
Main questions • How do tags differ for resources of different categories? (person, event, country and city) • How do tags for Wikipedia pages about persons differ from tags for friends? • How do tags differ with age, gender of taggee?
Data collection • Bookmark tags • Wikipedia articles: Person, Event, Country, City
Data collection • People tags • http://blog.* network of blog sites • .ca, .co.uk, .de, .fr • Google Translate to convert non-English to English
Subjectivity of tags • Top 100 tags for each category • 25 annotators each categorised 100 tags • Objective e.g. “london” • Subjective e.g. “jealous” • Uncategorised e.g. “abcxyz” • Average inter-annotator agreement: 86%
subjective objective uncategorized Friend Person Country City Event
Randomly selected tags • Before we looked at top tags, but what about long-tail tags? • We also asked annotators to categorise 100 randomly chosen tags from each group • Much higher rate of uncategorised (~3x) • Lower inter-annotator agreement (76%) • Less clear a meaning than the top tags, so probably less useful for applications like information filtering
Linguistic categories • Automatic classification (WordNet) • Noun/verb/adjective/adverb/uncategorised
Adjective Adverb Verb Noun Uncategorised
Age and gender of taggees • Generated sets of tags corresponding to ages brackets and genders • Removed tags that refer to a specific gender • Asked 10 participants if they could predict age and gender • Results: • Differences between gender were not perceptible • Differences between younger and older were perceptible (and younger were more subjective)
Conclusions • Subjectivity: Articles of different categories are tagged similarly, but friends are assigned subjective tags more frequently • Consequence: frameworks built on person-tags will need to handle more potentially unreliable tags • Controlled vocabularies? • Future work: Twitter Lists as person annotations for information filtering