1 / 9

Ideixis-Image-Based Deixis for Finding Location-Based Information

Ideixis-Image-Based Deixis for Finding Location-Based Information. Konrad Tollmar, Tom Yeh and Trevor Darrell MIT CASAIL. Scenario. Hsiaowei is visiting campus for the first time ever. She is supposed to meet Lilu at 傅鐘 . She is uncertain if this place is the 傅鐘 .

flynn
Download Presentation

Ideixis-Image-Based Deixis for Finding Location-Based Information

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Ideixis-Image-Based Deixisfor Finding Location-Based Information Konrad Tollmar, Tom Yeh and Trevor Darrell MIT CASAIL

  2. Scenario Hsiaowei is visiting campus for the first time ever. She is supposed to meet Lilu at 傅鐘. She is uncertain if this place is the 傅鐘. She takes an image of the bell in front her and sends it to the server.

  3. Scenario This image is then used to search the web of pages that also contain images of this bell. The server returns the 5 most relevant web pages. By browsing these pages. She identifies the name 傅鐘 and concludes that this is the right place.

  4. System Architecture

  5. First Prototype • User takes an image of the location. • The image is then sent to a server via MMS. • 16 most relevant candidate images will be returned. • Selecting a candidate image brings up the associated web page.

  6. Experiment • The database consists of 12,000 web images collected from the mit.edu domain. • Test query images were obtained by asking student volunteers to take a total of 50 images from three selected locations. • Images were collected on different days and with somewhat different weather conditions.

  7. Results

  8. Second Prototype

  9. Deixis • In pragmatics and linguistics, deixis (Greek: δειξις display, demonstration, or reference, the meaning "point of reference" in contemporary linguistics having been taken over from Chrysippus, Stoica 2,65) is a process whereby words or expressions rely absolutely on context.

More Related