1 / 13

Stefania Bergamasco, Cecilia Colasanti

NTTS 2009. An integrated approach to turn statistics into knowledge combining data warehouse, controlled vocabularies and advanced search engine Authors: Stefania Bergamasco, Cecilia Colasanti, Stefano De Francisci, Paola Giacché, Paolo Giacomi. Stefania Bergamasco, Cecilia Colasanti.

wilmai
Download Presentation

Stefania Bergamasco, Cecilia Colasanti

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. NTTS 2009 An integrated approach to turn statistics into knowledge combining data warehouse, controlled vocabularies and advanced search engine Authors: Stefania Bergamasco, Cecilia Colasanti, Stefano De Francisci, Paola Giacché, Paolo Giacomi Stefania Bergamasco, Cecilia Colasanti Brussel, 18-20 February 2009

  2. An integrated approach to turn statistics into knowledge combining data warehouse, controlled vocabularies and advanced search engine The main issues The aim of this session is to illustrate the main components of the Integrated Output Management System of ISTAT (ISTAR) a. Data Module b. Doc Module c. Glossary Module d. GSA Module in order to show a. the solution adopted to integrate the statistical data warehouse and the new ways to organize and retrieve the information on the Web; b. the use of the principles of controlled vocabularies to manage the glossary of the system; d. the technical solution adopted to optimize the search engine to scan the dynamic Web pages generated by the information system. NTTS 2009 - Brussel, 18-20 February 2009

  3. Doc module Glossary module ISTAR GSA module Data module An integrated approach to turn statistics into knowledge combining data warehouse, controlled vocabularies and advanced search engine ISTAR: the Integrated Output Management System of ISTAT The integrated system is based on the construction of several metadata layers. They cover not only the description, the design and the reference of the contents, but are also oriented towards the management of the navigation, the finding, the interchange and the semantics of the data. NTTS 2009 - Brussel, 18-20 February 2009

  4. Data module An integrated approach to turn statistics into knowledge combining data warehouse, controlled vocabularies and advanced search engine ISTAR: the Integrated Output Management System of ISTAT – Data Module The Data module of Istar is a collection of tools specifically designed to support the statisticians in all the phases required to disseminate statistical aggregate data on the Web. From the functional point of view, the collection is structured in two different kinds of toolkits: modelling tools and analysis and reporting tools. Modelling tools allow to design the semantic layers of the system; analysis and reporting tools provide navigation tools, in-house or publication on the Web, of the data warehouse contents. The application architecture of Data module of Istar is layered as follows: OLAP engine Statistical data warehouse Administration module Metadata layers NTTS 2009 - Brussel, 18-20 February 2009

  5. Doc module SiQual An integrated approach to turn statistics into knowledge combining data warehouse, controlled vocabularies and advanced search engine ISTAR: the Integrated Output Management System of ISTAT – Doc Module The Doc module manages the non-structured reference data and documents linked to the subject matter areas of the system. This module allows the connection and the interchange between Istar and the centralised system for surveys documentation (SIDI) and, in particular, its component dedicated to the Web dissemination (SIQual). The integration is possible through two navigation paths: links to statistical sources which feed the system links to documentation materials of the specific domain of interest statistical sources documents NTTS 2009 - Brussel, 18-20 February 2009

  6. table glossary system glossary consist of Glossary module Definition Category Source of def. Table glossary button Related terms Statistical sources Link to the data source Analysis unit Specification of the statistical kind of the items Link to the glossary items Statistical Classifications An integrated approach to turn statistics into knowledge combining data warehouse, controlled vocabularies and advanced search engine ISTAR: the Integrated Output Management System of ISTAT – Glossary modul NTTS 2009 - Brussel, 18-20 February 2009

  7. An integrated approach to turn statistics into knowledge combining data warehouse, controlled vocabularies and advanced search engine ISTAR: the Integrated Output Management System of ISTAT – GSA modul The search engine ISTAT has chosen Google products and services to match the search needs of both internal and external users. GSA is packaged in an appliance including both hardware and software. NTTS 2009 - Brussel, 18-20 February 2009

  8. An integrated approach to turn statistics into knowledge combining data warehouse, controlled vocabularies and advanced search engine … ISTAR: the Integrated Output Management System of ISTAT – GSA modul GSA provides universal search across many sources (file shares, intranets, databases, applications and content management systems) through a single easy-to-use search box Users can customize the service based on their specific needs and Administrators can configure sets of search profiles Users are able to view search result only if they have access to the original content, so company data are always protected from unauthorized access GSA supports several authentication and Single Sign On NTTS 2009 - Brussel, 18-20 February 2009

  9. An integrated approach to turn statistics into knowledge combining data warehouse, controlled vocabularies and advanced search engine … ISTAR: the Integrated Output Management System of ISTAT – GSA modul The main features We configured the product in considering four disjoint collections: electronic documents, press releases, statistical tables in electronic sheet format and database. It is also possible to show or not the metadata. NTTS 2009 - Brussel, 18-20 February 2009

  10. An integrated approach to turn statistics into knowledge combining data warehouse, controlled vocabularies and advanced search engine … ISTAR: the Integrated Output Management System of ISTAT – GSA modul By choosing “Advanced search” it’s also possible to associate an item among the taxonomies with one or more facets ( thematic area, statistical source, year, territory) NTTS 2009 - Brussel, 18-20 February 2009

  11. An integrated approach to turn statistics into knowledge combining data warehouse, controlled vocabularies and advanced search engine … ISTAR: the Integrated Output Management System of ISTAT – GSA modul • The solution adopted • We faced with the following problems: • 1. how to exploit the indexing of documents by the engine search of GSA through dynamic web pages of a Data Warehouse avoiding the scan database saturation; • 2. how to exploit the concepts of taxonomy and facet enabling the users to retrieve the information, independently from where the information is stored; • how to provide search result with the related metadata within the snippet • We adopted a solution based on three concepts: • 1. we have associated to each “object” stored in the system all the metadata useful for managing the taxonomy, the facets and the snippet; • 2. the potentialities of the search engine have been exploited not in reference of the scanned web pages but for the scanned database; • 3. we tagged as “non crawling “ all the visited Web pages. NTTS 2009 - Brussel, 18-20 February 2009

  12. An integrated approach to turn statistics into knowledge combining data warehouse, controlled vocabularies and advanced search engine … ISTAR: the Integrated Output Management System of ISTAT – GSA modul Going more in details: 1. within each system a relational table, called search_engine, was built. This table is populated through specific procedures invoked by “insert, modify, cancel” events. The table has the following fields structure (Clob): typology / theme / data source / territory / time / title / other (e. g. the modes of the classifications associated to the table / url • 2. a specific functionality to enlist the databases and the tables to be scanned and indexed has been parameterised and the URL of the related objects has been enlisted. • In this way the search engine does not scan each web dynamic page of the system, but it scans the contents of fields in the database; • the search interfaces have been customized using • - the field typology as hierarchical-enumerative classification, • - the fields theme, data source, territory, time for the faceted • classification • - the fields time, title for the snippet. NTTS 2009 - Brussel, 18-20 February 2009

  13. An integrated approach to turn statistics into knowledge combining data warehouse, controlled vocabularies and advanced search engine • Conclusions • The strategy adopted to increase the value of the information is based on a complex scenario of integration: • - data warehouses • - metadata information systems • - descriptive and textual information • The technical solutions include: • - the construction of specific metadata layers • the optimization of search, in order to improve the performances of the scanning operations • the combination of new opportunities offered by the new web technologies with the capability of dynamic Web Warehouses • Two lessons: • it is possible to integrate and to share knowledge also when informations are organized in various ways (from legacy data base or data warehouse to textual documents, volumes, etc.) … paying more and more attention to the information needs of the users. NTTS 2009 - Brussel, 18-20 February 2009

More Related