1 / 1

SheepDog – Group and Tag Recommendation for Flickr Photos by Automatic Search-based Learning

SheepDog – Group and Tag Recommendation for Flickr Photos by Automatic Search-based Learning. Input test image . (c) Model Learning . (d) Concept Detection . SVM training . Feature extraction . concept detector .

abbott
Download Presentation

SheepDog – Group and Tag Recommendation for Flickr Photos by Automatic Search-based Learning

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. SheepDog – Group and Tag Recommendation for Flickr Photos by Automatic Search-based Learning Input test image (c) Model Learning (d) Concept Detection SVM training Feature extraction concept detector Hong-Ming Chen, Ming-Hsiu Chang, Ping-ChiehChang, Ming-Chun Tien, Winston H. Hsu, and Ja-Ling Wu Communications and Multimedia Lab, National Taiwan University {blacksmith,cmhsiu,pingchieh,trimy,winston,wjl}@cmlab.csie.ntu.edu.tw Feature extraction top-n concepts … c1 cn Photo-level data collection Group-level data collection g1,1 g1,p gn,1 gn,p … … Flickr photo Database (e) Group Recommendation (b) Training Data Acquisition Introduction Prediction result T1,1 T1,2 Tn,1 Tn,2 T n,d … … T1,d … (f) Tag Recommendation ● • People who use album on sharing websites always like their photos to be: • Popular : more people view their photos & good appreciation • Easy management : while attach to groups & add tags are big trouble • (about 15000 groups related to “dog” on Flickr) • Our Goal:recommend photo(s) to suitable and popular groups and attach relevant tags to each photo automatically The SVM predictor gives each concept a probability value to indicate the degree that the input photo fits this concept. For the top-n concepts, we recommend users the most popular groups and tags related to these concepts using our ranking algorithm. Subjective test result The score for the top-3 concepts recommendation results [1]: S = (P*1 + R*0.5 +W*0)/Nc (Nc = 15) Concept Detection • Compare two source of pseudo-positive training data from Flickr • Photo-Level data mechanism • Group-Level data mechanism • Provide a new idea of “how to acquire reliable search-based data ” Recommend to user (a) Concept Definition -- “dog”, “tiger”, “flower”, … Recommend to user [1] L. S. Kennedy, S.-F. Chang, and I. V. Kozintsev, "To search or to label?: predicting the performance of search-based automatic image classifiers," in Proc. ACM MIR’06, pp.249 – 258, 2006.

More Related