150 likes | 161 Views
Explore various methods and tools for successful migration presented by experts. Detailed agenda includes scenarios, tools presentation, breakout sessions, and open discussions for conclusions.
E N D
Migrating to the .Stat Suite Different approaches and tools available to assist in the migration Prepared and presented by Edgardo Greising (ILO) Gyorgy Gyomai (OECD)
Agenda • Presentation of scenarios & tools • Breakout session: one group per scenario (30 min) • Groups’ presentations (5 min each) • Open discussion and conclusions
Migration Scenarios • Existing system is SDMX-capable or the Data Model is “close” to SDMX IM • A Database exists but requires re-modelling • No Database. Diversity of data sources
Existing SDMX capabilities • Cubes may require re-modelling • Load first, transform in DLM • Transform off-line and upload definitive structures • Harmonization • Transitional solution for visualization • Toolkit [Which tools to use in the process for structure design, concepts recoding]
Data Model is “close” to SDMX IM • Add SDMX capabilities Go to previous case • Cubes will require re-modelling: • Transform off-line and upload the new structures • Harmonization • Toolkit [Which tools to use in the process for structure design, concepts recoding]
Non-SDMX database • Questions to ponder • Spacing [How many Dotstat spaces to maintain?] • Timing [Timescale and steps for the migration] when considering timing issues like skills building, data model development, migration planning come to play • Toolkit [Which tools to use in the process for structure design, data-flow (re)-routing?]
No structured database – ‘blank page’ • Similar to the non-SDMX database • Bigger emphasis on knowledge acquisition, steeper learning curve • Fewer spacing dilemmas, and less ‘rugged edge’ • Toolkit [Which tools to use in the process for structure design, data-flow (re)-routing?]
SMART SDMX Registry Structural Metadata SMART DATACONVERSION DATA REPORTING DSD Dataset Dataset Dataset Microdata LMIS UPLOAD LMI ANALYSIS Aggregated Data NRP PROJECT
DSD Constructor Load & Edit a DSD Upload concepts SDMX Registry Codelist DSD DSD Upload Code lists Manual entry
Excel2CSV Add-in Excel2CSV Add-in
All together DSD CONSTRUCTOR DSD SMART Excel2csv DATA REPORTING PROJECT
Excel Domain Modeler – with SDMX generator • https://github.com/OECDSTD/sdmx-matrix-generator
Eurostat Data Structure Wizard • An SDMX artefact editor • Persisting locally or providing a frontend for and SDMX registry • The user needs to have an understanding of the relationship between the different objects • However user-friendly UI, no need to directly manipulate the SDMX syntax
Some powertools to consider • ILO plugin for Dotstat • Eurostat SDMX-RI plugin to Dotstat (with Mapping Assistant) • ISTAT Meta-manager