190 likes | 304 Views
Project CF1.1.1 Search Image - Status. François Magendie 14/11/2011. Kick-off conference in January 2011: Working Group defined 15 work packages to initiate a feasibility study (Market Study + isolated tasks). 2º conference in September 2011:
E N D
Project CF1.1.1 Search Image - Status François Magendie 14/11/2011
Kick-off conference in January 2011: Working Group defined 15 work packages to initiate a feasibility study (Market Study + isolated tasks). 2º conference in September 2011: Presentation of the results of study (documents available on Wiki). Definition of lines of action: 1. Develop a prototype of Search Image based on the proof of concept presented. 2. Tagging of the dominant elements in the Vienna classification of all E.U. images (from TMview). 3. Test the software and APIs evaluated in the market study. 4. Create discussion groups: particular case of the Designs and 3-D images and Offices with no Vienna codes. Presentation of Proof of Concept Actions so far
The Proof of concept was developed under the supervision of OHIM LAB. The Proof of concept relies on: OHIM Search Algorithm (OSA). OSA is a ranking tool which orders a set of images by implementing the trademarks similarity concept based on the Vienna Codes. OSA provides a ranked list of images according to their similarity with a given input image (1st in the rank is the most similar one). LIRe software: open source tool which orders a set of images based on features such as: colour histogram (% of each colour), colour layout (spatial colour distribution) and edge histogram (texture) filtering. Proof of concept
The validity of the Proof of Concept was assessed by comparing the results to the images selected by the examiners. The Proof of concept was also tested on Designs though we could not apply OSA (based on Vienna codes only). We used Locarno to pre-filter the images and then we applied LIRE software. For the Designs, the intention is to analyse how Locarno classification could be used as an alternative to Vienna in OSA algorithm. Proof of concept
Proof of concept – Trademark case + (search on features) (conceptual classification search) Improved search results
Proof of concept – Trademark case 0 1 • 45 TMs out of 136 • The 1 image selected by the Searcher examiner is on the top (together with other 29) 2 • Original sign for which to find similar images Searcher examiner selected 1 similar images among 136 • OSA List of 45 images found by OSA algorithm • OSA + LIRe Refining OSA results via LIRe component (color histogram, color distribution and texture filtering). LIRe kept 12 images out of the 45 preselected by OSA.
Proof of concept – Trademark case Found by OSA + LIRe component Found by Searcher Searcher FOUND LIRe found the same image selected by the Searcher examiner in the top 1. . . . . . .
Proof of concept – Trademark case Detail of the results obtained by LIRe Component Rank 1. Found by Searcher examiner Rank 2. Rank 3.
Proof of concept – Trademark case Detail of the results obtained by LIRe Component Rank 4. Rank 5. Rank 6.
Proof of concept – Trademark case Detail of the results obtained by LIRe Component . . . . . . Rank 12. 5 images discarded by LIRe
Proof of concept – Trademark case Using OSA combined with LIRE component, we have reduced the number of images among which the Searcher examiner has to search by 136/12 ≈ 11 times • Fully manual examination process • Partially automated examination process • Overall gain
Proof of concept – Design case + Filter by Locarno codes (conceptual classification search) (search on features) Improved search results
Proof of concept – Design case 0 1 2 • Original sign for which to find similar images • List of 58 images of the same Locarno classification (06.xx) • Using LIRe component (color histogram, color distribution and texture filtering) kept 12 images out of the 58 preselected.
Proof of concept – Design case • LIRe selected and gave a rank for these images:
Proof of concept – Design case …. …. … • LIRe discarded these images:
Information: (+ 34) 965 139 100 (switchboard)(+ 34) 965 139 400 (e-business technical incidents)(+ 34) 965 131 344 (main fax)information@oami.europa.eue-businesshelp@oami.europa.eutwitter/oamitweetsyoutube/oamitubes
Presentation Status DRAFT / APPROVED Approved by owner Authors Contributors Revision history Version Date Author Description 0.1 DD/MM/YYYY