1 / 50

Eyes on the World: Putting Your Photos in Context

Eyes on the World: Putting Your Photos in Context. Mor Naaman Yahoo! Research Berkeley. Attraction Map of Paris. Stanley Milgram, 1976. Psychological Maps of Paris. Attraction Map of London. Jaffe et al, 2006. Outline. Wisdom of the tags mining information from geo-tagged photos

sen
Download Presentation

Eyes on the World: Putting Your Photos in Context

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Eyes on the World:Putting Your Photos in Context Mor Naaman Yahoo! Research Berkeley

  2. Attraction Map of Paris • Stanley Milgram, 1976. • Psychological Maps of Paris http://zonetag.research.yahoo.com

  3. Attraction Map of London • Jaffe et al, 2006. http://zonetag.research.yahoo.com

  4. Outline • Wisdom of the tags • mining information from geo-tagged photos • ZoneTag • your photos in context • Why we tag • a user study of tagging http://zonetag.research.yahoo.com

  5. Alternative Outline How? Why? What? http://zonetag.research.yahoo.com

  6. Information Overload? • Flickr “geotagged” http://zonetag.research.yahoo.com

  7. What can we derive? • Given all photos from a geographic region, • find a “representative” summary set • generate a meaningful visualization • Dataset: (photo_id, user_id, latitude, longitude) (photo_id, tag) http://zonetag.research.yahoo.com

  8. Issues to Tackle • Noisy data • Photographer biases • In locations • In Tags • Wrong data Whatever, color, city, spectrum, santa barbara, california, usa, Lookatme, Herbert Bayer Chromatic Gate http://zonetag.research.yahoo.com

  9. Intuition • More “activity” in a certain location indicates importance of that location • Tag that are unique to a certain location can suggest importance of that location http://zonetag.research.yahoo.com

  10. (Very) Simple Example http://zonetag.research.yahoo.com

  11. Golden Gate Bridge TransAmerica AT&T Baseball Park Golden Gate Twin Peaks Golden Gate Ocean Beach Bay Bridge Chinatown Summary of San Francisco http://zonetag.research.yahoo.com

  12. Tag Maps http://zonetag.research.yahoo.com

  13. Tag Maps http://zonetag.research.yahoo.com

  14. Outline • Wisdom of the tags • mining information from geo-tagged photos • ZoneTag • your photos in context • Why we tag • a user study of tagging http://zonetag.research.yahoo.com

  15. Outline How? Why? What? http://zonetag.research.yahoo.com

  16. Another Look at the Tag Map http://zonetag.research.yahoo.com

  17. ZoneTag(?) How would we: Create/store? Find? Share? Discover? “Everything in the world exists to end up in a photograph”-- Susan Sontag http://zonetag.research.yahoo.com

  18. Why Cameraphones? • Programmable • Context-aware • Network-connected • Quality… it’s getting there • Numbers, numbers… • 500,000,000 (Source: Future Image Inc.) http://zonetag.research.yahoo.com

  19. Current Mobile Experience • Difficult to share (or even save!) • Hard to find • No context • No semantic information http://zonetag.research.yahoo.com

  20. ZoneTag Experience • 2-click upload (same key!) • Photo uploaded with location and time metadata http://zonetag.research.yahoo.com

  21. ZoneTag Experience • Tagging made easy • Tag/annotate your photos from the phone http://zonetag.research.yahoo.com

  22. Where do locations come from? • Bluetooth GPS (when available) • User-contributed cell tower mapping http://zonetag.research.yahoo.com

  23. Where do tags come from? • Tags I used in this context (`home’) • Tags my friends used in this context (`Research Meeting’) • Tags other people used in this context (`PARC’, ‘Mor Naaman’, `This talk sucks’) http://zonetag.research.yahoo.com

  24. Where do tags come from? • Stuff around you: • Yahoo! Local • Upcoming.org (`Mor Naaman @ PARC’, `PARC George E. Pake Auditorium’) • Stuff from you (any RSS 2.0 feed): • Calendar (G, Upcoming.org, Kiko,…) • Favorite hangouts http://zonetag.research.yahoo.com

  25. Suggested Tags “When I went to upload, there were already all these exotic tags like "Bill Graham Civic Auditorium" and "Bob dylan live" available...it sure was convenient to just select and go…” http://zonetag.research.yahoo.com

  26. Where do tags go? • Back to the original RSS items • Upcoming.org • Action Tags • Trigger a call to a web service • With parameters • Command line - from your phone Rotate:right Email:dad Group:zonetag Scanr:document http://zonetag.research.yahoo.com

  27. (?) (?) (?) (Bradley Horowitz, elatable.com) I’m Too Lazy (you’re not alone) • Tagging is the means, not the goal • Benefits even if you never tagged a single image http://zonetag.research.yahoo.com

  28. Things We Learned • “Best” feature: 2-click upload • Even users that often tag • For some, last chance to annotate • Mobile tagging - not just experts, not all experts… http://zonetag.research.yahoo.com

  29. Things We Learned • Tagging behavior: • All over the place • More than Shozu • Connected to privacy http://zonetag.research.yahoo.com

  30. Outline • Wisdom of the tags • mining information from geo-tagged photos • ZoneTag • your photos in context • Why we tag • a user study of tagging http://zonetag.research.yahoo.com

  31. Outline How? Why? What? http://zonetag.research.yahoo.com

  32. Why Tag? • What are tags? http://zonetag.research.yahoo.com

  33. Why Tag? Bay Bridge, Fog, [San Francisco, 94105] http://zonetag.research.yahoo.com

  34. Why Tag? RedSox, Fenway, GreenMonster, [Boston, 02215], … http://zonetag.research.yahoo.com

  35. Why Tag? Liz, sunbathing, sunny, sunglasses, concrete, [Palo Alto, 94306], … http://zonetag.research.yahoo.com

  36. Tag Affordances on Flickr • Displayed next to photo • Can be used to search: • Your own photos • Others’ photos • Public photos http://zonetag.research.yahoo.com

  37. Tags on ZoneTag • By default, tags are kept from one photo to next • Tags used in a location will be suggested in that location • To you • To others • Immediate (i.e., during event) • Place name tags added automatically http://zonetag.research.yahoo.com

  38. User Study • 13 ZoneTag users (23-45, 9m, 4f) • All “taggers” (no use to ask non-taggers why they tag) • Structured interviews http://zonetag.research.yahoo.com

  39. Expected… • Organization/retrieval • Creator/synthesizer • “Tagging for community” http://zonetag.research.yahoo.com

  40. Found… • Motivation taxonomy • No “synthesizers” • Inspired by community • Organization/retrieval • Creator/Synthesizer • “Tagging for community” X http://zonetag.research.yahoo.com

  41. Motivation Taxonomy “If I tagged ahead of time I can go back and get all my pictures of [my children]…” “…I then think “well, maybe I should tag this” so I can find it again later” “I’m obsessive-compulsive” http://zonetag.research.yahoo.com

  42. Motivation Taxonomy “I want at least one hook of association in there that can help me reconstruct…” http://zonetag.research.yahoo.com

  43. Motivation Taxonomy “...at night, by the fires all around the market, ... at each word that one man says -- such as 'wolf', 'sister', 'hidden treasure', 'battle', 'scabies', 'lovers' -- the others tell, each one, his tale of wolves, sisters, treasures, scabies, lovers, battles.” -- Italo Calvino, Invisible Cities “I tag photos with what I think might be interesting to other people, stuff I think people will like” “I know that tagging can connect my photos to activities, and get more interest” “I want to look at all [my neighborhood’s] tags. … That’s definitely a reason I’m putting these tags in ” http://zonetag.research.yahoo.com

  44. Motivation Taxonomy “…so that my friends can see what I am up to” I can tell my mom [with the tag] “look, we went to…” “I left reviews of places – like at the airport, when my flight was delayed, I tagged “Aloha Air sucks.” http://zonetag.research.yahoo.com

  45. Breakdown http://zonetag.research.yahoo.com

  46. Suggested Tags • Useful for entry, when they “work” • Critical mass needed • Better filtering • Inspire and give example • Overtagging may be issue “Tag suggestions were huge for me; they really cut down on typing” “I thought: this is how I want it to work all the time!” “This person was in my phone for a month - who is she???” “I try to use as many suggested tags that apply. … I also use it for auto-completion – I type “s” to get San Francisco” http://zonetag.research.yahoo.com

  47. Open Questions • Those who don’t… • Better filtering, tag suggestions • Longer usage trends • Effect of community on usage • … http://zonetag.research.yahoo.com

  48. Final Notes • All Flickr/ZT photos, Creative Commons or with author permission • http://www.flickr.com/photos/frozenquack/106111967/ • http://www.flickr.com/photos/bryce_edwards/272002447/ • http://www.flickr.com/photos/plasticbag/188818779/ • http://www.flickr.com/photos/groovymother/131591824/ • http://www.flickr.com/photos/deaneckles/220482624/ http://zonetag.research.yahoo.com

  49. ZoneTag For All • Everything we can do, you can do (better?) • Cell ID translation • Suggested Tags • More… • Use ZT-technology with your app! • Email me http://zonetag.research.yahoo.com

  50. Thanks With: Shane Ahern, Simon King, Rahul Nair, Nathan Good, Marc Davis, Morgan Ames, Dean Eckles, Alex Jaffe, Tamir Tassa Download, sign up, get the full scoop: http://zonetag.research.yahoo.com Become an intern, get involved: Email me. Mor Naaman mor@yahoo-inc.com http://zonetag.research.yahoo.com

More Related