420 likes | 447 Views
This comprehensive review covers Voyager's activities, functionalities, and exciting opportunities. Explore topics like licensing, catalog creation, content enrichment, search services, UI, data extraction, transformation, and more. Discover why Voyager is the best-of-breed search engine with spatial data expertise.
E N D
Voyager & NGA Activities and functionality review
Agenda • Licensing • Functional Overview • Opportunities • Questions
Licensing Proposal • Unlimited Voyager license to cover development, TIDE, production and COOP for Enterprise Search • $3 million in 2015; $2 million a year for 4 subsequent years • Payment covers maintenance on all previous purchases • At the end of the 5 years, you keep the licenses you have
In the beginning… • Voyager independently assessed by the ES&IS and used by CASi • Voyager meets 100% of the requirements outlined in the statement of work • Voyager has extended the product at no cost to the government
But, there is still a lot of confusion • Custom code • Misinformation about our functionality • Lots of opportunities for quick wins
Reporting Connectors & Extractors Catalog Creation Exposing Catalog Extraction and Transformation Content Enrichment Search Services UI
Connectors & Extractors • Built-in tools for connecting to and “ingesting” content • Connectors to servers, Web services, databases, catalogs, CMS, other search engines. • Extractors “read” 1,770 file formats • Understanding of complex GIS formats — Shapefiles, for example
Catalog Creation • Voyager creates a catalog as the index is created • Content update = catalog updates • The catalog is a set of “library cards” for everything — Web services, spatial or non-spatial content, content with or without metadata • The Lucene index is a great Metadata Catalog
Content Enrichment • Transformation and augmentation of existing metadata during the indexing process • Creation of thumbnails • Duplicate content detection • Metadata normalization or adding fields to the metadata • 3d-party rules service (content type and form taxonomy)
Search Services & Index Management • Keyword, place name and spatial query search • Tagging, rating, nomination (GOLD, Crisis) • Integration with enterprise security • Index Management, tuning, federation, query elevation and more
User Interfaces • Classic Voyager UI for index management and configuration • Voyager Navigator for end users • Voyager widget for ArcGIS Online/Portal — aka Map of the World or GeoWhereHouse • Voyager’s ArcGIS desktop toolbar
Content Extraction and Transformation • Delivery and transformation tools • Clip and ship • Transform • Data management tools • Clean up content • Facilitate data consolidation • Fix Metadata • Remove duplicates • Modeling tools • JEMA integration
Expose, Publish and Use • Exposed through industry standards • APIs • RSS/Atom Feeds (notification services) • Open Search (search engine & Globe integration ) • CDR brokered search (DNI content discovery and retrieval standard) • Solr/Lucene (best of breed, open source search) • Integration with other systems • Voyager Collect Service • Voyager-to-Voyager federation • Voyager-to-Autonomy federation
Reporting • Business analytics • Logging of user activity (search queries and content access) • Visualization of content catalog • What’s in the these catalogs? • Metrics by content type • Graphs and chats of content composition • Field usage reports
Voyager handles spatial data expertly • Voyager knows spatial • Creates and maintains the relationship of data to layers and layers to maps or maps to services • Adds spatial context to non-spatial documents • Handles the spatial nature of vector, raster, lidar, video and more • And… it can read all of the other formats too
Voyager is Best of Breed Search • Voyager is built on the Lucene — so are Amazon, Kayak, Twitter, Netflix and Apple and every other thing you search on the web • High-performance, full-featured search engine • We’ve extended it to support spatial • We’ve made it accessible to the non-developers for query management, tuning etc. • We’ve given it a UI so you can search, sort and filter right away • We’ve extended it to support data discovery • We’ve added tools for enriching your content
Custom code Access to content
Win-Loss Records and Opportunities for Improvements TFDM Gateway STIL Service Registry CASi
Voyager for TFDM Reporting Connectors & Extractors Catalog Creation Exposing Catalog Extraction and Transformation Content Enrichment Search Services UI
TFDM Win-Loss Record • WIN: Indexed all of the features and web services • WIN: Proved efficiency of indexing without system impact — 200 million records a day • LOSS: How to present all of this information in a useful way to the user?
TFDM Opportunities • Opportunity: Configure the Voyager UI to best show content • Opportunity: Use Voyager to translate coded values in the data for a better search experience and clear understanding • Support the Analyst with RST=2 • Support the Casual User with Road Surface Type = Hard Paved Road • Opportunity: Use Voyager to deliver data as SHP, CSV, PDF or whatever spatial format you need • Opportunity: Visualize the data using existing web services
Quick Wins — TFDM Reporting Connectors & Extractors Catalog Creation Exposing Catalog Extraction and Transformation Extraction and Transformation Content Enrichment Content Enrichment Search Services UI
Voyager for Gateway Connectors & Extractors Reporting Publishing Catalog Creation Extraction and Transformation Content Enrichment User Interfaces Search Services
Gateway Win-Loss Record • WIN: Indexed all of the content • WIN: Enhanced the content through a custom rules service • LOSS: Content is only as good as whatever is indexed • LOSS: Links take you to the GDP, instead of delivery • LOSS: Presentation of “folder” structure for the content types
Gateway Opportunities • Opportunity: Add folder structure to group the types of content • Opportunity: Connect Voyager to the content • Opportunity: Deliver the content to the people searching for it • Opportunity: Eliminate need to maintain a custom solution
Quick Wins — Gateway and GDP Connectors & Extractors Connectors & Extractors Reporting Exposing Catalog Catalog Creation Extraction and Transformation Extraction and Transformation Content Enrichment Search Services User Interface User Interface
Voyager for STIL Connectors & Extractors Reporting Publishing Catalog Creation Extraction and Transformation Content Enrichment User Interfaces Search Services
STIL / NCL Win-Loss Record • WIN: Indexed all of the content provided in hours • WIN: Retained IDM Metadata
Quick Wins — STIL / NCL Connectors & Extractors Reporting Publishing Catalog Creation Extraction and Transformation Extractionand Transformation Content Enrichment User Interfaces Search Services
Voyager for the Service Registry Connectors & Extractors Reporting Publishing Catalog Creation Extraction and Transformation Content Enrichment User Interfaces Search Services
Service Registry Win-Loss Record • WIN: Provided a COTS solution within months • WIN: Add tagging to Voyager
Voyager for CASi Connectors & Extractors Reporting Publishing: Sending index to UWP Catalog Creation Content Enrichment: Doing extensive metadata normalization Export and Transformation Search Services: Sharing their index with ES User Interfaces: Using the Voyager UI
New UI • End user UI with modern presentation • Place finder • Integrated tagging • Heat map of all content • Featured content • Rating • Collections
Summary • Unlimited use license provides the freedom to deploy software wherever it’s needed • Fixed fee removes uncertainty of future cost increases • Voyager has taught Lucene to understand spatial • Voyager is a COTS product that can be used to solve more of the challenges of Enterprise Search beyond just indexing vector data