160 likes | 173 Views
This session focuses on SDMX and a re-usable component architecture, emphasizing high cohesion and loose coupling principles. The workshop aims to enhance understanding of exchange protocols, emphasizing the power of the SDMX Information Model for system interoperability. Participants will learn how to find common models to facilitate data exchange and transformations, with a focus on implementing interfaces rather than specific implementations.
E N D
ESCWA SDMX Workshop Session: SDMX and a Re-usable Component Architecture
Goals Language Independent Architecture High Cohesion Loose Coupling Program to Interfaces – Not Implementations
SDMX-ML is for EXCHANGE between systems The SDMX Information Model is where the power is Use the Model
What is Data? Results of Measurements Country: UK Unemployed: 13million Year: 2010 Country: Australia State : Perth Coastline (Km): 12500 Country: France Unemployed: 5million Year: 1982
Modelling Data Country : UK Type : Real Basket : Narrow Country : UK Basket : Narrow Time Period : 2000-01 KEY Time Period : 1999-10 Value : 106.34 Time Period : 2001-02 Value : 101.73 Values Type : Real Value : 107.8 Type : Nominal Value : 104.8
Simple Data Transformation Model Compact 2.0 To 2.1 Transformation Compact 2.0 “Compact” 2.1 “Compact” 2.1 To 2.0 Transformation
Simple Data Transformation Model Compact 1.0 Generic 1.0 Utility 1.0 Compact 2.0 Generic 2.0 Utility 2.0 Structure Specific 2.1 Generic 2.1 EDI CSV ???
Decoupled Data Transformation Model Read Key Read Observation Write Key Write Observation Compact Compact Generic Generic EDI EDI Data Reader Interface Data Writer Interface
Summary so far Good design protects software from change Finding a common model means everything can be reused
Make a Generic Solution Each aspect of a system can be broken down into a sub-system Each sub-system has a specific responsibility
Break down the Problem SDMX breaks down nicely into sub systems Generating a Data Query Data Transformation Data Reading Data Validation Structure Validation Data Writing Structure Transformation Consuming a Structure Query Generating a Structure Query Querying a File Consuming a Data Query Calling a Web Service with a Structure Query
Interfaces can be reused BeanRetrievalManager File Retrieval In Memory Retrieval Web Service Retrieval
Implementing a Web Service for Data User Data QueryWeb Service Request Format? Response Format? Database Administrator Database
Implementing a Web Service for Data Data Parser Data Query Engine ??? SDMX Query User Data QueryWeb Service • Consumes SDMX query, and gets parser to create bean • Passes Query to Database layer, along with Data Writer Build Data Query Bean From Any version of SDMX Query Data Writer What Implements Data Writer? A powerful concept of passing an interface with useful methods such as : startSeries(…), addObservation(…) addAttribute(…) Internally the DataWriter wraps an output stream, and writes SDMX straight to the output stream. Generic Data Writer Compact Data Writer Utility Data Writer EDI Data Writer Database