1 / 11

S DMX: From Labour Force Department to the Statistical Database

Explore how SDMX revolutionized data management from manual entry to automatic updates, saving time, reducing errors, and improving standardization. Learn about the challenges faced and the solutions implemented. Discover the benefits and considerations for future applications.

sdallas
Download Presentation

S DMX: From Labour Force Department to the Statistical Database

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. 7th SDMX Global Conference 16-19 September Budapest - Hungary SDMX: From Labour Force Department to the Statistical Database Houssam El Ouinkhir Kamel Gaanoun h.elouinkhir@hcp.ma k.gaanoun@hcp.ma

  2. Statistical Database • Created early 80s. • Contains 900 indicators. • Covers various themes: social, demographic and economic. • Published under open data recommendations via this link: bds.hcp.ma (214 indicators published)

  3. SDB updating mode LFS Data • More than 170 LFS indicators, including quarterly and annual results both for urban and rural areas • Generated from SPSS in an Excel format by the LFS department • Sent regularly by email to the SDB unit • All indicators are manually entered in the SDB by the SDB unit technicians • if any update is needed, the same process is then repeated

  4. The challenge Human error Time consuming Manual data entry Non standard input Excel format

  5. The SDMX Solution Enable automatic SDB Update Mapping DSD SPSS Construct DSD Generate SDMX file Mapping DSD SDB 1 2 3 4 5

  6. The SDMX Solution DSD No common LFS DSD was available at the time of the implementation Various sources were used : With respect of SDMX Guidelines (COG,DSD Design, Cross domains CL) SDMX Global Registry IMF SDMX Central EURO SDMX Registry HCP’s Specific code_lists Use of the Eurostat Data Structure Wizard (DSW) for DSD generation.

  7. The SDMX Solution DSD

  8. The SDMX Solution From SPSS to SDMX • First solution : • Generate Excel files from SPSS • Convert to SDMX using Eurostat SDMX Converter • Second solution : • Generate XML file from SPSS • Extract Dimensions from the XML • Map to the DSD

  9. The SDMX Solution SDB automatic update The SDB automatic update is enabled towards the following two steps: • Mapping between SDB and Labor force DSD. • Using mapping file and SDMX file to update the SDB. The SDB update is done by a python batch.

  10. Conclusion SDMX allowed us to : • Reduce human-error rate • Save data-entry time • Standardise the update • Get ready to futur SDMX exchanges Even if : • Learning/training consumes time • DSD construction (especially for LF) isn’t straightforward • Generalisation of the process to other operations should be studied (training, concepts complexity, DSD’s Availability…)

  11. THANKS Houssam El Ouinkhir Kamel Gaanoun h.elouinkhir@hcp.ma k.gaanoun@hcp.ma

More Related