1 / 12

Implementation of SDMX standards along the statistical process: Issues and benefits

Explore the implementation of SDMX standards in statistical processes, its benefits, and technical aspects such as data models, tools, and web services. Discover how SDMX enhances data collection, dissemination, and analytics in statistical frameworks.

wwinnie
Download Presentation

Implementation of SDMX standards along the statistical process: Issues and benefits

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Implementation of SDMX standards along the statistical process:Issues and benefits Gérard Salou European Central Bank Statistics - Investment in the future 2 Prague – 14-15 September 2009

  2. Agenda • The SDMX standards • Layers • Data model and technical specifications • Data structure definitions • SDMX based Statistical Infrastructure • Processes • Tools and applications • SDMX web services, towards a web for statistics • Benefits and opportunities of using the SDMX statistical framework

  3. IT technical base • SDMX-ML and variants, data model, web services Statistical Framework Comprehensive framework for statistics, e.g. concepts of data flows, dimensions, code lists, time series, metadata attributes • Statistical Domain Specific • Data Structure Definitions (DSD) by statistical domain SDMX statistical standards: layers

  4. FREQUENCY A REF_AREA DE ADJUSTMENT N TRANSACTION B101 ASSET Z SECTOR 0 Observation 34955 CP_SECTOR 0 USE_RES 2 DENOM N SUFFIX 08 TIME PERIOD 2005 SDMX Information Model ~ Star Schema EAA Key Family Type (star schema)

  5. SDMX SDMX SDMX SDMX Simplified ECB Statistical Standard Processdata collection from national central banks and Eurostat ECB Statistical Production Environment Collect Compile Disseminate Analytics Data feeds Production systems Data warehouse SDMX-ML SDMX flows SDMX Data Model (www.sdmx.org)

  6. FAME Calculations & Methods Oracle Macro economic data SDW Oracle Financial market data External users 27 EU central banks, other institutions Analytical applications Communication Bus (SDMX data flows, XML, web services) High Level Technical Architecture Stat gui SDW gui

  7. Selected SDMX based applications and tools • ECB Statistical Data Warehouse (http://sdw.ecb.europa.eu/) Dissemination data warehouse based on SDMX framework – input, output, model • ECB Inflation Dashboard (http://www.ecb.europa.eu/stats/prices/hicp/html/inflation.en.html Visualisation tool based on the SDMX framework. Code available as open source • The Eurosystem Joint Dissemination Framework (http://www.ecb.europa.eu/stats/services/escb/html/index.en.html Using SDMX to disseminate the same data in multiple languages and different presentations • ECB Checker and the Suite Checking the syntax (syntactic, semantic) of incoming data files and convert between formats (SDMX-EDI, SDMX-ML, etc.)

  8. SDMX-ML and Web Services for data dissemination Using SDMX standard methods to: 1. Browse ECB data sources • Discover ECB data flows with their metadata within the catalogue 2. Retrieve corresponding ECB metadata • Get the concepts, the code lists and the data structure definitions used at the ECB • Also possibility to get the category schemes, dataflow definitions and organisation schemes 3. Retrieve corresponding ECB data • Use ECB structural metadata to identify and locate data • Retrieve statistical data: Possibility to get all data stored in the SDW, using filters such as dataflows, datasets, dimensions, attributes, time range, etc.

  9. Vision for a Web for Statistics Discover SDMX metadata on the web • Browse a registry, a search engine or a data catalogue for SDMX data • Select data source • Parse data source to extract structural metadata Retrieve data within an SDMX data navigator • Use structural metadata to identify and locate data • Retrieve data • Present data in SDMX data navigator or use data in SDMX enabled application (similar to the ECB HICP Dashboard)

  10. Benefits and opportunities The SDMX comprehensive data framework contributes to: • Efficiency and effectiveness of statistical processes • Efficiency and effectiveness of development of statistical applications • Interoperability between statistical systems (within an institution and with other institutions) • Data and metadata management discipline • The complete framework is freely available Web based technologies make it possible to: • Fully automatise data transfers • Make systems using metadata • Make abstraction of the source systems • Change presentation and language (e.g. Eurosystem presentation)

  11. Thank you…

More Related