210 likes | 340 Views
AGRIS Multi-Host Search System: Using Dublin Core to homogenise distributed databases. Frehiwot Fisseha FAO/WAICENT AGRIS/CARIS and Documentation Unit. Overview.
E N D
AGRIS Multi-Host Search System: Using Dublin Core to homogenise distributed databases Frehiwot Fisseha FAO/WAICENT AGRIS/CARIS and Documentation Unit
Overview * Background - AGRIS * Motivation for AGRIS -MHS * Vision * Challenges * Way forward * Components and arichtecture of the MHS
Background- AGRIS • AGRIS is the international information system for the agricultural science and technology. • AGRIS is a bibliographic database created by FAO in 1974 to facilitate information exchange and to identify world literature dealing with all aspects of agriculture • AGRIS is a co-operative system. 199 national, international and intergovernmental centres participate and submit about 14.000 records per month • The system collects bibliographic references (to date, about 3 million) to either conventional (journal articles, books) or non-conventional materials (sometimes called "grey literature" e.g. theses, reports, etc.), not available through ordinary commercial channels. • Http://www.fao.org/agris
Motivation for the AGRIS MHS • We have wide range of bibliographic information that should be included into the AGRIS database • Large components of the AGRIS database are existing national bibliographic databases like AGRICOLA and ELFIS. • Some of the databases are searchable on the internet and need not be copied or reprocessed by FAO's AGRIS processing group.
Vision • AGRIS as a focal point of access for agricultural information (bibliographic as well as full text)on distributed databases and information systems • uniform presentation of meta information • easily accessible information content
Challenges • Distributed databases • Databases are heterogeneous • different data structure • different metadata information
Way Forward • Develop a search engine to make a parallel search on distributed databases (Outsource development-ZADI) • develop XML wrapper for each co-operating database • Develop common meta elements to homogenise search result set (In-house)
Way forward (Contd.)Related activities • Develop and propose DC based meta data description for agricultural resources for the purpose of resource discovery and interoperability • organise working group to work on proposing DC based standards (agricultural Dublin Core elements and qualifiers) • draft specification for a DC based standard for describing document-like agricultural resources • crosswalk for the existing databases (AGRIS, CARIS, FAO online Catalogue) • posted on Agstandard mailing list for discussion and feed back • work in progress to encode the standard with an XML framework (DTD, RDF)
The AGRIS MHS System Client Request Search Result AGRIS-Server Requests Search Results Distributed Databases
AGRIS-WWW-Server static pages dynamic pages Distributed Databases Components of the AGRIS MHS Client Transaction Manager Wrapper Manager
Client 2. Transmission of a static search form (HTML) including intelligent checks (Java-Script) 1. Login (AGRIS Homepage) and request for the search form (HTTP) AGRIS-WWW-Server static pages dynamic pages AGRIS-Server Transaction Manager
Client 3. Input of search criteria including the searchable databases and request sending (http) 4. Request transmission to dynamically generate the search result page Transaction Manager AGRIS-Server AGRIS-WWW-Server static pages dynamic pages
5. Kernel activation and request transmission including request syntax and search criteria (databases, fields, search pattern) 8. Compilation of one homogenous result set and delivery 6. Distributed requests on distributed databases through IP (XML) 7. Search result delivery (XML) Distributed Databases AGRIS-Server Using AG-DC Transaction Manager Wrapper Manager
10. Request answering (HTML) 9. Result set conversion (XML->HTML) and transmission Search Result in AG-DC format AGRIS-Server Client AGRIS-WWW-Server static pages dynamic pages Transaction Manager
Distributed Databases AGRIS-Server Client AGRIS-WWW-Server static pages dynamic pages Transaction Manager Wrapper Manager
5. Kernel activation and request transmission including request syntax and search criteria (databases, fields, search pattern) 8. Compilation and Transmission of one homogen result set AGRIS-Kernel 7. Search result delivery (XML) 6. Translation of the http request into a standardised XML query and delivery to the databases Distributed Databases Transaction Manager Knowledge Base (Database - URL) XML Query Generator XML Result Set Composer
Client Request Search Result AGRIS-Server Request Search Result Distributed Databases
6.1. Translation of the XML-Request into the database specific syntax, opening of a retrieval session and activation of the database kernel Distributed Databases 6.2. Database search AGRIS-Server 7. Search result delivery (XML) 6. Translation of the http request into a standardised XML query and delivery to the databases XML-Wrapper Knowledge Base AGRIS-XML <-> local Schemes Database-Kernel With AG-DC elements Data, Indexes
6.4. Conversion into XML 6.3. Search result in database specific syntax Distributed Databases AGRIS-Server 7. Search result delivery (XML) 6. Translation of the http request into a standardised XML query and delivery to the databases XML-Wrapper Knowledge Base AGRIS-XML <-> local Schemes Database-Kernel Data, Indexes
Client Request Search Result AGRIS-Server Request Search Result Distributed Databases http:/cfs.zadi.de