1 / 12

2.6 Data Capture and Analysis Tools MET and CAI

2.6 Data Capture and Analysis Tools MET and CAI. 35th Consultative Meeting of INIS Liaison Officers 28 - 29 October 2010, Vienna, Austria. Alexander Nevyjel Head, Content Management Group INIS & NKM Section. Data Capture and Analysis Tools. MET - Metadata Extraction Tool

quinlan-kennedy
Download Presentation

2.6 Data Capture and Analysis Tools MET and CAI

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. 2.6 Data Capture and Analysis ToolsMET and CAI 35th Consultative Meeting of INIS Liaison Officers 28 - 29 October 2010, Vienna, Austria Alexander Nevyjel Head, Content Management Group INIS & NKM Section 35th ILO Meeting

  2. Data Capture and Analysis Tools • MET - Metadata Extraction Tool • CAI – Computer-assisted Indexing • CAI batch • CAI online 35th ILO Meeting

  3. Metadata Extraction Tool - MET Objective: to automate INIS record creation from electronic documents in PDF format • Capture text from original (full) text (PDF) • Reformat content according INIS input rules • Verify against INIS authorities • Produce bibliographic files in TTF and/or XML • Export bibliographic files plus PDFs 35th ILO Meeting

  4. MET - Milestones • Prototype development October 2007 • MET version 1.0 final acceptance December 2007 • Specifications Version 2 December 2007 • MET version 2 final acceptance August 2008 • Specifications Version 3.0, 3.1, 4.0 October 2008 • Development Version 3.0 Aug-Dec 2009 • MET version 3.0 final acceptance December 2009 • Development Version 3.1 Sep-Dec 2010 • Version 4 (for Member States) planned 2011 35th ILO Meeting

  5. MET – implementation planning • MET version 2.0in operation August 2008 • MET version 3.0functionality improvementsin operation December 2009 • MET version 3.1XML compliancein development planned for 2010 • MET version 4.0remote usage for and/or distribution to Member Statessubject to resources available planned for 2011/2012 35th ILO Meeting

  6. Metadata Extraction Tool – MET • Five staff members working with MET since January 2008 • >9000 records produced, entered to the database • Significant handling improvements, data capture facilitated • Validation rules (basic set) implemented; final check by FIBRE and production system • Advanced validation rules (FIBRE level) planned for phase 3 + 4 • Availability for Member states: when version 4 completed and consolidated (expected by end 2012) 35th ILO Meeting

  7. CAI batch(since 2005) MS prepare FIBRE file(without descriptors) MS send file to INIS INIS process CAI batch File sent back to MS Review process FIBRE Send final file to INISto production system CAI online(since 2008) MS prepare FIBRE file(without descriptors) MS send file to INIS INIS load file on CAI online Review process online Export fileto production system CAI for Member States 35th ILO Meeting

  8. CAI ProcessingReviewing Process • Delete all suggested descriptors which are too general • Add relevant descriptors which were not found • numerical values, e.g. pressure ranges, temperature ranges, etc • nuclear reactions • chemical compounds, alloys, etc. • clean up BT/NTs from manual additions • Clean up suggestions from homographic terms 35th ILO Meeting

  9. CAI Batch Processing Statistics2005 – Sep 2010 35th ILO Meeting

  10. CAI Online Processing Statistics2008 – Sep 2010 35th ILO Meeting

  11. CAI Online Processing Statistics2008 – Sep 2010 35th ILO Meeting

  12. CAI batch China Germany Uzbekistan Malaysia Bulgaria Viet Nam ETDE CAI online Argentina Brazil Bulgaria Cuba Czech Republic Iran Japan Mexico Switzerland Uruguay Uzbekistan CAI for Member States CAI online and CAI batch are now regular services for Member States 35th ILO Meeting

More Related