160 likes | 297 Views
Automatic Photo Annotator. Bryan Klimt May 10, 2005. Photo Annotator. Photos must be labeled with keywords to enable effective search Hand labeling photos is a tedious process Automatic Photo Annotator labels incoming photos based on statistical learning
E N D
Automatic Photo Annotator Bryan Klimt May 10, 2005
Photo Annotator • Photos must be labeled with keywords to enable effective search • Hand labeling photos is a tedious process • Automatic Photo Annotator labels incoming photos based on statistical learning • Annotator then learns from user corrections
Most common keywords • Colors or Patterns • sky, water, trees, cloud, hazy • People • bryan, amy, shyam • Locations • china, italy, pisa, tiantan, florence, firenze, beijing, lucca
Types of Classifiers • Color-based methods • color histograms • cumulative color histograms • Face-based methods • Face detection • Face recognition • Time-based methods • k Nearest Neighbors
Why does “color” fail? • Photos that are mislabeled (because the feature is not the focus of the photo). • Photos with similar color-patterns, but of completely different subjects.
Conclusions • Time-based annotator performed best • Color-based annotator has inherent limits • Face-based annotator may become important with more training data
Future Work • Hybrid Methods • Pattern-based annotators • Improving face recognizer with unlabeled data?