100 likes | 252 Views
Point of Interest (POI) Identification. Alexander Darino Week 3. Overview. The Where Am I? project obtains geolocation of camera from image Objective: Obtain the geolocation and address of POI s in image Assume POI is nearby, eg. < 50m from camera
E N D
Point of Interest (POI) Identification Alexander Darino Week 3
Overview • The Where Am I? project obtains geolocation of camera from image • Objective: Obtain the geolocation and address of POIs in image • Assume POI is nearby, eg. < 50m from camera • Allows for Image-based queries (eg. Google Goggles) • Real World Applications • Business Reviews • Links to Virtual Storefronts
Pipeline • Given: Geolocation of Camera • Reverse Geocoding: obtain addresses in local neighborhood • Several reverse geocoding APIs available • Yelp uses HTTP-based API: Use with any programming language • POI Identification: Use OCR to extract uniquely identifying features, ie. business names • More resilient than SIFT against franchises, mundane buildings • POI Address Extraction: Prune list of addresses based on extracted business names
Example Yelp Query & Response Query: http://api.yelp.com/business_review_search?term=yelp&tl_lat=37.9&tl_long=-122.5&br_lat=37.788022&br_long=-122.399797&limit=3&ywsid=ExP4S3hA-rMoLMtH8O3KTQ
{'businesses': [{'address1': '466 Haight St', 'address2': '', 'address3': '', 'avg_rating': 4.0, 'categories': [{'category_filter': 'danceclubs', 'name': 'Dance Clubs', 'search_url': 'http://yelp.com/search?find_loc=466+Haight+St%2C+San+Francisco%2C+CA&cflt=danceclubs'}, {'category_filter': 'lounges', 'name': 'Lounges', 'search_url': 'http://yelp.com/search?find_loc=466+Haight+St%2C+San+Francisco%2C+CA&cflt=lounges'}, {'category_filter': 'tradamerican', 'name': 'American (Traditional)', 'search_url': 'http://yelp.com/search?find_loc=466+Haight+St%2C+San+Francisco%2C+CA&cflt=tradamerican'}], 'city': 'San Francisco', 'distance': 1.8780401945114136, 'id': 'yyqwqfgn1ZmbQYNbl7s5sQ', 'is_closed': False, 'latitude': 37.772201000000003, 'longitude': -122.42992599999999, 'mobile_url': 'http://mobile.yelp.com/biz/yyqwqfgn1ZmbQYNbl7s5sQ', 'name': 'Nickies', 'nearby_url': 'http://yelp.com/search?find_loc=466+Haight+St%2C+San+Francisco%2C+CA', 'neighborhoods': [{'name': 'Hayes Valley', 'url': 'http://yelp.com/search?find_loc=Hayes+Valley%
Parsing Yelp's Responses • Responses encoded in JSON format • libjson - will allow extraction of relevant fields
Summary of Week's Progress • Yelp API • libcurl - for using Yelp's HTTP-based API • libjson - for parsing Yelp's JSON-based responses • C++ Crash Course • "Accurate Image Localization Based on Google Maps Street View" Paper
Lots of Fun (doing Computer Vision Research) Test POI Identification: Manually identify stores given image and geolocation using Yelp Application Design:Obtain businesses of neighborhood of image geolocation Weekend Objectives