1 / 16

OPERATIONAL METADATA FOR FEDERATING STATISTICAL REFERENCE SYSTEMS AT EUROSTAT

This talk provides an overview of the operational metadata needed to federate statistical reference systems at Eurostat, including the challenges faced and the solutions offered by the REFIN system.

akilian
Download Presentation

OPERATIONAL METADATA FOR FEDERATING STATISTICAL REFERENCE SYSTEMS AT EUROSTAT

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. OPERATIONAL METADATA FOR FEDERATING STATISTICAL REFERENCE SYSTEMS AT EUROSTAT G. Pongas, F. Vernadat EC Eurostat B2

  2. Overview of the talk • Introduction • CVD (Cycle de Vie des Données) • REFIN: Internal Reference • Eurostat Dissemination Portal (Site 3) • Conclusion

  3. Introduction Metadata in statistical information: • define some of the semantics of data • needed for proper production and usage of data • make data comparable • ensure some level of data quality • required for efficient search

  4. CVD (Cycle de Vie des Données)

  5. Current Situation at Eurostat

  6. EUROSTAT INTERNAL REFERENCEThe problem Two many different systems at EUROSTAT for handling data: • FAME • Oracle Express • Oracle RDBMS • SAM • SAS

  7. REFIN: The problem (Cont’d) • Some of them are general purpose (e.g. Oracle RDBMS) whereas others may include special features (for data validation or computation) but they all have their own access methods and user interfaces (Express Analyser, FAME...) • Major drawbacks: • High complexity for users • Data comparison between different systems is not easy

  8. What is REFIN ? The REFIN system specifically addresses these issues • Gives access to heterogeneous systems • Provides the users with a common interface • Data location and source system is hidden • Data not duplicated, access to the original data. • Uses a unique exchange format (PIVOT) • Implements specific security rules

  9. REFIN architecture SECURITY LAYER REFIN INTERNAL REFERENCE METADATA REFIN ADAPTOR METADATA + LOCALISATION DATA + PROCEDURES HLI SNAPI OCI RPC/DCE or XML DAO/ODA/ODBC ORACLE EXPRESS DATA Bases +METADATA FAME DATA Bases +METADATA ORACLE DBMS DATA bases +METATDATA MICROSOFT ACCESS SAM+METADATA

  10. 1) Generation of REFIN metadata 2) Mapping to Common Metadata REFIN architecture REFIN Particular Metabases Metabase Builder FAME Metabase Converter SAM EXPRESS REFIN Common Metabase ORACLE

  11. REFIN architecture HLI FAME FAME Driver ODBC SAM Driver SAM REFIN API SNAPI EXPRESS EXPRESS Driver OCI ORACLE ORACLE Driver

  12. New possibilities provided by REFIN To build heterogeneous data sets by mixing data from different origins and systems

  13. Business Layer Back-office Layer Presentation Layer Data sets (fixed) XML/XSL JSP ESTAT Portal Platform SUITE NewCronos (Num. Data + metadata) WSDL/SOAP Data sets (open) EVA/EVALight Service call Open Datasets Web services Web Cache Professional user Application Server Comext DB (Ref. Data + statistical metadata) Comext Client Comext Server Quick/Adv. Search Subscription Alert/Info push Content Download Content Import Print E-commerce XML/XSL JSP Portal Web Server Application Integration Internet RAMON CODED Statistical Metadata Internet user CIRCA User Groups . EC . Journalists . Students . Citizens . ... STATPUB DOUCEUR LDAP Publications Datasets Publications EU-Bookshop (OPOCE) API Local DB/ File server EU-DOR EU off. Publi. Dedicated sections + virtual Publi/Datasets (URL’s) + METADATA Eurostat Dissemination Portal (Site 3)

  14. Site 3 Metadata

  15. Site 3 Metadata

  16. Conclusion • Importance of linking data and metadata • Importance of having an integrated metadata environment • Clear distinction between • Statistical metadata • IT metadata • Dissemination metadata

More Related