150 likes | 160 Views
Migrating to the .Stat Suite. Different approaches and tools available to assist in the migration. Prepared and presented by Edgardo Greising (ILO) Gyorgy Gyomai (OECD). Agenda. Presentation of scenarios & tools Breakout session: one group per scenario (30 min)
E N D
Migrating to the .Stat Suite Different approaches and tools available to assist in the migration Prepared and presented by Edgardo Greising (ILO) Gyorgy Gyomai (OECD)
Agenda • Presentation of scenarios & tools • Breakout session: one group per scenario (30 min) • Groups’ presentations (5 min each) • Open discussion and conclusions
Migration Scenarios • Existing system is SDMX-capable or the Data Model is “close” to SDMX IM • A Database exists but requires re-modelling • No Database. Diversity of data sources
Existing SDMX capabilities • Cubes may require re-modelling • Load first, transform in DLM • Transform off-line and upload definitive structures • Harmonization • Transitional solution for visualization • Toolkit [Which tools to use in the process for structure design, concepts recoding]
Data Model is “close” to SDMX IM • Add SDMX capabilities Go to previous case • Cubes will require re-modelling: • Transform off-line and upload the new structures • Harmonization • Toolkit [Which tools to use in the process for structure design, concepts recoding]
Non-SDMX database • Questions to ponder • Spacing [How many Dotstat spaces to maintain?] • Timing [Timescale and steps for the migration] when considering timing issues like skills building, data model development, migration planning come to play • Toolkit [Which tools to use in the process for structure design, data-flow (re)-routing?]
No structured database – ‘blank page’ • Similar to the non-SDMX database • Bigger emphasis on knowledge acquisition, steeper learning curve • Fewer spacing dilemmas, and less ‘rugged edge’ • Toolkit [Which tools to use in the process for structure design, data-flow (re)-routing?]
SMART SDMX Registry Structural Metadata SMART DATACONVERSION DATA REPORTING DSD Dataset Dataset Dataset Microdata LMIS UPLOAD LMI ANALYSIS Aggregated Data NRP PROJECT
DSD Constructor Load & Edit a DSD Upload concepts SDMX Registry Codelist DSD DSD Upload Code lists Manual entry
Excel2CSV Add-in Excel2CSV Add-in
All together DSD CONSTRUCTOR DSD SMART Excel2csv DATA REPORTING PROJECT
Excel Domain Modeler – with SDMX generator • https://github.com/OECDSTD/sdmx-matrix-generator
Eurostat Data Structure Wizard • An SDMX artefact editor • Persisting locally or providing a frontend for and SDMX registry • The user needs to have an understanding of the relationship between the different objects • However user-friendly UI, no need to directly manipulate the SDMX syntax
Some powertools to consider • ILO plugin for Dotstat • Eurostat SDMX-RI plugin to Dotstat (with Mapping Assistant) • ISTAT Meta-manager