1 / 16

First Insights into the Library Track of the OAEI

First Insights into the Library Track of the OAEI. Dominique Ritze Mannheim University Library. Motivation. Ontology Mapping. Publication x. Search. 0 results. subject (thesaurus 2): ontology alignment. Thesaurus 1. Thesaurus 2. Ontology Mapping. =. Ontology Alignment.

sue
Download Presentation

First Insights into the Library Track of the OAEI

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. First Insights into the Library Track of the OAEI Dominique Ritze Mannheim University Library

  2. Motivation Ontology Mapping Publication x Search 0 results subject (thesaurus 2): ontology alignment Thesaurus 1 Thesaurus 2 Ontology Mapping = Ontology Alignment Ontology Mapping Publication x Search subject (thesaurus 1): ontology alignment

  3. Overview • Ontology Matching • OAEI • Thesaurus vs. Ontology • OAEI Library Track 2012 • Lessons learned and Future Work

  4. Ontology Matching Person People Author Author < Author, Author, =, 0.97 > < Paper, Paper, =, 0.94 > < reviews, reviews, =, 0.91 > < writes, writes, =, 0.7 > < Person, People, =, 0.8 > < Document, Doc, =, 0.7 > < Reviewer, Review, =, 0.6 >… CommitteeMember writes Reviewer PCMember reviews Doc reviews Document Paper Paper writes Review

  5. Ontology Matching Evaluation O1 Tool A Test O2 m R Result

  6. Ontology Alignment Evaluation Initiative (OAEI) • Annual campaign started 2005 • Different tracks/datasets • Benchmark, Anatomy, Conference, Multifarm, Large BioMed, Library, Instance Matching • 21 submitted systems (2012) • Goal: Improving the performances of the ontology matching field • Through comparison of algorithms • New challenges for the systems

  7. Thesaurus = Ontology? Germany Commodities Tropical Fruit Ananas Metal Product -> Metal

  8. OAEI Library Track Are current state-of-the-art ontology matching tools able to match thesauri? Dominique Ritze, Kai Eckert, Benjamin Zapilko, Joachim Neubert

  9. Data Set • Thesaurus for economics (STW) • 6.000 concepts with 19.000 additional keywords (EN, DE) • Thesaurus for the Sociel Sciences (TheSoz) • 8.000 concepts with 4.000 additional keywords (EN, DE, FR) • Reference alignment manually created in 2006 • Both actively used in libraries for keyword indexing

  10. Execution • 7GB Debian machine • Timeframe 1 week • 13 of the 21 submitted systems were able to generate an alignment • No system had a heap space problem • Evaluation: Precision, Recall, F-Measure, Runtime

  11. Results How to evaluate the results? F-Measure of 0.67 good?

  12. Results

  13. Manual Evaluation • Between 38 and 269 new correct correspondences found per matcher • Up to half of the correspondences correct • Many new correspondences are quite simple • Some more “complex” and interesting ones • Automated production = CAM • Several incorrect ones if the labels are quite similar • Difficult to distinguish the names of countries, their inhabitants and the languages

  14. Lessons Learned • Transformation SKOS to OWL causes some problems, especially regarding the labels • Ontology matching systems are nevertheless able to match the thesauri and even discover unknown correct correspondences • Interest of the community in this topic

  15. Future Work • Update reference alignment adapted results • SKOS import for matching systems • Use instance data to match thesauri? • Other thesauri?

  16. Thankyouforyourattention! dominique.ritze@bib.uni-mannheim.de

More Related