110 likes | 259 Views
Semantic Annotation of Street-level Geospatial Entities. Nate Blaylock Institute for Human and Machine Cognition (IHMC) Ocala, Florida. Geospatial Language Understanding. Natural Language Understanding Ground references to paths, movement, orientation, and entities into lat/lon coordinates
E N D
Semantic Annotation of Street-level Geospatial Entities • Nate Blaylock • Institute for Human and Machine Cognition (IHMC) • Ocala, Florida
Geospatial Language Understanding • Natural Language Understanding • Ground references to paths, movement, orientation, and entities into lat/lon coordinates • Granularity • Most previous work at the city/state/country level (e.g., city names) • Our work at sub-city level (e.g., streets, businesses, parks)
The PURSUIT Corpus • Recordings of on-the-road path descriptions • GPS tracks for ground truth • All references to geospatial entities (e.g., streets, intersections, businesses, bodies of water, etc.) hand annotated to GIS entity • Available at • http://www.cs.rochester.edu/research/cisd/resources/pursuit/
The TESLA Annotation Tool • Tool for human annotation of geospatial corpora • Synchronized playback of audio and GPS track in Google Earth • Search for entities in GIS databases
GIS Resources • Google Local • API for search based on keyword and center point • TerraFly • Spatial Keyword Search (SKS) • Finer control of search based on keyword match, structured data • Recently released as open source • Data sets • Intersections, Street segments • Point data combined from a number of sources
PURSUIT Corpus Data • 13 audio recordings (with GPS tracks) with almost 4 hours of audio • 1649 annotated geospatial entities
Street-level geospatial semantics Needs (1) • Ontology needs • Streets as objects (not segments, overlapping names, orientation on street) • Intersections of various streets • General ontology of business types, buildings, etc.
Street-level geospatial semantics Needs (2) • Knowledge base needs (instances) • Unavailable types: fire hydrants, water towers, fields, neighborhoods, parking lots, ... • Historical info: “old Courthouse”
Street-level geospatial semantics Needs (3) • Qualitative reasoning/queries • Entities on a street: “all restaurants on left side of street X” • Street network: “all intersections allowing left turns on street Y” • Mixing of cardinal directions: substitute “north” for “left” above • Visibility: “I see a water tower in the distance”
Ongoing Work • Information extraction • Path recovery • Entity geolocation • Dialog-based geolocation • “Tell me what you see and I’ll tell you where you are”