1 / 15

Maintaining the momentum of OpenSearch in Earth Science data discovery ++

Maintaining the momentum of OpenSearch in Earth Science data discovery ++. Doug Newman (NASA ECHO) & Dr Chris Lynnes (GES DISC) ESIP Winter 2014. What is OpenSearch?. A ‘refresher’. From www.opensearch.org ‘OpenSearch is a collection of simple formats for the sharing of search results’

adanna
Download Presentation

Maintaining the momentum of OpenSearch in Earth Science data discovery ++

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Maintaining the momentum of OpenSearch in Earth Science data discovery ++ Doug Newman (NASA ECHO) & Dr Chris Lynnes (GES DISC) ESIP Winter 2014

  2. What is OpenSearch?

  3. A ‘refresher’ From www.opensearch.org ‘OpenSearch is a collection of simple formats for the sharing of search results’ The Earth Data discovery use case: OpenSearch Descriptor Document HTTP GET Request HTTP Response keyword = air temperature ID ID bounding_box = 39.1 -96.6 39.1 -96.6 Spatial Extent Spatial Extent start_date = 2013-11-13T00:00:00Z Temporal Extent Temporal Extent Metadata Link Metadata Link Search Link Search Link Data Link Data Link

  4. Earth Data OpenSearch today

  5. Is it successful? • ESA’s ‘Next Generation User Services for Earth Observation’ will be using OpenSearch as an infrastructure standard* • CEOS’s CWIC effort will support OpenSearch in a future iteration that will include ESA data providers** • ESIP Federation continues to champion OpenSearch for earth science data discovery*** • NASA ECHO metrics: average number of queries per week • SOAP API (2011) – 10k (243k queries that year) • REST APIs (2013) – 87 of 115k (5 million queries so far this year) * http://eomag.eu/articles/584/eo-user-service-next-generation-project-eo-usng ** http://www.ceos.org/index.php?option=com_content&view=category&layout=blog&id=348&Itemid=482 *** http://wiki.esipfed.org/index.php/Discovery_OpenSearch_Services

  6. Why is it successful? • Lightweight and simple • Standards-based • RESTful • Low entry cost • ‘Free text + spatial + temporal’ satisfies90% of Earth Data discovery use cases* * Based on Reverb metrics for the last year (80,420 registered users, 700k queries so far this year (11/08/13)

  7. ECHO Reverb Statistics • Caters to 90% of Earth Data discovery use cases* * Based on Reverb metrics for the last year (80,420 registered users, 700k queries so far this year (11/08/13)

  8. Maintaining success

  9. 1. Converge where possible CEOS / CWIC ESIP discovery cluster OGC Attribution: http://imgs.xkcd.com/comics/standards.png

  10. 1. Converge where possible (for real) CEOS / CWIC ESIP discovery cluster OGC free_text bounding_box start_date end_date via relation uid place_name geometry described_by

  11. 2. Free text + spatial+ temporal = success • Pro: 90% !!!* • Con: lack of free text precision compared with controlled vocabularies • Can free text solve this?** • free text = ‘MODIS’ (693 hits) != instrument = ‘MODIS’ (543 hits) • free text = ‘ozone’ (348 hits) != science keyword = ‘ozone’ (81 hits) *Based on Reverb metrics for the last year (80,420 registered users, 700k queries so far this year (11/08/13) ** Based on ECHO Catalog REST API queries and ‘fuzzy’ comparisons for ‘ozone’

  12. 3. Understanding the API OpenSearch parameter extension* is good (once we update it) • Defining expectations of ‘free text’ search. What does ‘air temperature’ mean? • Defining subset of ‘geometry’ capabilities * http://www.opensearch.org/Specifications/OpenSearch/Extensions/Parameter

  13. 4. Additional functionality • Result ordering • Described in OSDD and implemented in results • Result ranking • As per OpenSearch ‘Relevance’ extension* • For free text search results • Added to ECHO in Dec. 2013 • Faceted search * http://www.opensearch.org/Specifications/OpenSearch/Extensions/Relevance/1.0

  14. How do we achieve these goals? CEOS ESIP discovery cluster OGC Doug Newman Jérôme Gaspari* Yves Coene** * CNES - Centre National d'Etudes Spatiales ** ESA

  15. Questions?

More Related