1 / 25

Metadata Driven Integrated S tatistical D ata M anagement system “ MD ISDMS”

Metadata Driven Integrated S tatistical D ata M anagement system “ MD ISDMS”. Central Statistical Bureau of Latvia October 23 – 24 , 2006 Presentation on IT DG Meeting, EUROSTAT. A bit from Approach A bit from Fuctionality Key Rezults. Content.

dchin
Download Presentation

Metadata Driven Integrated S tatistical D ata M anagement system “ MD ISDMS”

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Metadata Driven Integrated Statistical Data Management system “MD ISDMS” Central Statistical Bureau of Latvia October23 – 24, 2006 Presentation on IT DG Meeting, EUROSTAT

  2. A bit from Approach A bit from Fuctionality Key Rezults Content

  3. Typical data flow through the statistical processes

  4. PROCESSES Covered by MD ISDMS in the Business Statistics Domain

  5. Metadata Driven IntegratedData Management System

  6. Description of Microdata By Bo Sundgren

  7. Description of macrodata by Bo Sundgren Macrodata are the result of estimations(aggregations). The estimations are made on the basis of a set of microdata. Statistical characteristics:Cs = O(t).V(t).f, where: O and V - is an object characteristics; t - is a time parameter, f – is a aggregation function (sum,count,average, etc) summarizing the true values of V(t) for the objects in O(t). The structure for macrodata is referred in metadata base to as box structure or “alfa-beta-gamma-tau” structure ( ). For data interchange alfa refers to the selection property of objects (O), beta – summarized values ofvariables (V), gamma – cross classifying variables, tau – time parameters (t).

  8. DEFINITION of VARIABLES ATTRIBUTES(CLASSIFICATORS) =VARIABLES INDICATOR + Vector of indicators Example: Number of employees no attribute = Number of employees, total + Local kind of activity (NACE) = Number of employees in breakdown by kind of activity + Regional code (ATVK or NUTS) = Number of employees in breakdown by regions

  9. Vektors of objects and indicators(example) Main vectors of respondents(objects O(t) ) NACE REGIONS OWNERSHIP AND ENTERPRENERSHIP EMPLOYEES GROUP TURNOVER GROUP vectors of indicators Number of employees in breakdown by regions

  10. Name of Questionnaire, index, code, corroboration date, Nr. Respondents(object)code, name and address; Period (year, quarter, month) Name of chapter PRODUCTIONAL METADATAStructure of trade statistics questionnaire(data matrix - fixed table) Metadata repository: common table of statistical indicators, table of attributes (classifications)and table of variables INDICATOR 1 + ATTRIBUTE I n d i c a t o r s CELL [2010,1] VARIABLE 1 A t t r i b u t e s

  11. ISDMS architecture - Versions 1 & 2 Integrated statistical data management system Corporative data Warehouse CSB Web Site User adminis- tration data base Dissemi-nation data base Metadata base Macrodata base FIREALL www SERVER ER E R Registers base OLAP data base Microdata base Raw data base FIREALL ISDMS Business application Software Modules Data entry and validation module related with DB: Data aggregation module related with DB: Data analysis module related with DB: Core metadata base module related with DB: Registers module related with DB: METADATA USER ADMINISTRATION REGISTERS USER ADMINISTRATION METADATA MICRODATAREGISTERS USER ADMINISTRATION METADATA MICRODATA REGISTERS USER ADMINISTRATION OLAP METADATA MACRODATA Data dissemination module related with DB: Data WEB entry module related with DB: User administration module related with DB: Data mass entry module related with DB: Missed data imputation module related with DB: METADATA MICRODATA REGISTERS RAW DATABASE USER ADMINISTRATION METADATA MACRODATA REGISTERS USER ADMINISTRATION METADATA MICRODATA REGISTERS USER ADMINISTRATION METADATA MICRODATA REGISTERS DATA IMPUTATION SOFTWARE METADATA MICRODATA MACRODATA USER ADMINISTRATION Windows 2000 Server Advanced MS Internet Information Server SQL server 2000, PC-Axis

  12. Metadata base link with Microdata and Macrodata bases META DATA BASE (REPOSITORY) General description of survey Selecting Indicators Selecting Attributes Description of survey version Creating of Variables Description of chapters (data matrix) Description of rows and columns Linking variables to cells Generation form for data entry (automatically) Data aggregation function (automatically) Defining of data aggregation rules MACRO DATABASE MICRO DATABASE IMPORT EXPORT

  13. Data entry and validation META DATA BASE BUSINESS REGISTER Description of validation rules Data import from files Creating list of Respon- dents Description of data entry forms Full data validation MICRO DATA BASE Standard data entry and validation Data validation RAW DATA BASE Data transfer to Microdata Base Mass data entry F i r e w a l l RAW Web DATA BASE Web data entry and validation Web Data validation

  14. Data aggregation and using Micro and Macrodata META DATA BASE Meta data level Meta data view Defining of data grouping rulesfor data aggregation (classifications) Output Tables design Data level(Micro and Macro data) Micro Data analyse (Filtering+export) MICRO DATABASE OLAP Tools (SQL Server) Output Tables generation and Confidentiality checking Data aggregation function(Including weight coefficients) SUMM COUNT MEAN MAX MIN Macro Data analyse(Filtering+export) Data browsing using XLS Multi- dimensional cubes MACRO DATABASE Output Tables (XLS,PC-AXIS) DATA EXPORT

  15. IMD SDMS - Cooporative Data Warehouse

  16. META DATA BASE

  17. MICRO DATA BASE

  18. MACRO DATA BASE

  19. OLAP DATA BASE

  20. DISSEMINATION DATA BASE

  21. REGISTERS MODULE

  22. System implemented in August 2002 Successful implementation formed bases for the CSB regional restructuring ( 5 Data centres(115) instead of 26 RO(180)) Amount of Surveys described in Metadata base from 2002 102 in active use in 2006 68 Available for electronic submission 38 Classifications For systematic usage in metadata base available 105 Rate of electronically submitted data Maximal for sypliest surways up to 47% Average in 2006 (excluding intrastat) 18,4% KEY INFORMATION of MD ISDMS usage

  23. Thank you for attention ! • Karlis Zeila = Karlis.Zeila@csb.gov.lv • http://www.csb.lv

More Related