1 / 9

Recent SDMX IT developments at the OECD

Recent SDMX IT developments at the OECD. SDMX Expert Group Meeting 13 - 14 September 2012 OECD, Paris By Jens Dossé and Jonathan Challener. Current SDMX web service features in .Stat (1). DSD 2.0: soap + rest Generic data 2.0: soap + rest Compact data 2.0: soap MSD 2.1: soap

fathi
Download Presentation

Recent SDMX IT developments at the OECD

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Recent SDMX IT developmentsat the OECD SDMX Expert Group Meeting13 - 14 September 2012OECD, Paris By Jens Dossé and Jonathan Challener

  2. Current SDMX web service features in .Stat (1) • DSD 2.0: soap + rest • Generic data 2.0: soap + rest • Compact data 2.0: soap • MSD 2.1: soap • Generic metadata 2.1: soap

  3. Current SDMX web service features in .Stat (2) • Full streaming (data messages) • SSO authentication + authorization • HTTP compression • Incremental updates • Dynamic generation of DSD, MSD and schema for compact message

  4. Implementation of version 2.1 • So far: • MSD and metadata message: most urgent since 2.0 lacked flexible attachment levels • What’s next: • Full implementation through SDMX-RI integrationJoint effort by SIS-CC especially ISTAT • Mapping from dissemination db to agreed SDMX structures • SDMX 2.1 web service • Local registry

  5. Improving security of SDMX web services • 3-tier architecture within .Stat • SQL injection protection • Denial of service protection: - limitation to non-concurrent requests- limitation in maximum data size

  6. Improving error messages in SDMX web services • SOAP WS returns SDMX-defined SOAP errors • REST WS return SDMX-defined HTTP errors Challenge: • Implementation of SDMX faultcode specification in soap errors <faultcode>sdmxerror:500</faultcode>

  7. Unit and power code information in SDMX data messages • Defined in .Stat at different levels: • Dataset, • specific unit dimension, • codes of 1 dimension, • combination of codes of more than 1 dimension (e.g. country x measure, series), • Represented as attributes at series level, • Internally coded through common dimension, but not yet mandatory.

  8. Technical improvements for voluminous SDMX data messages • SQL code optimisations • SQL and web server timeouts • Performance

  9. Work plan outlook • Further improvements to management of units and other attributes • Contribution to .Net version of SDMX-RI implementation by Eurostat (architecture and testing) and its Integration in .Stat (2.1) • Early implementation of upcoming beta SDMX-JSON output/web service • Implementation of SDMX data collection • Imports of SDMX 2.1 data into .Stat

More Related