330 likes | 359 Views
ESCWA SDMX Workshop. Session: SDMX Information Model Introducing the Scope of SDMX. Session Roadmap. High Level View of the Information Model Information Model as a Flow Use Cases – Practical Examples. SDMX Version 2.0/2.1: High Level Overview. Data or Metadata Structure Definition.
E N D
ESCWA SDMX Workshop Session: SDMX Information Model Introducing the Scope of SDMX
Session Roadmap High Level View of the Information Model Information Model as a Flow Use Cases – Practical Examples
SDMX Version 2.0/2.1: High Level Overview Dataor Metadata Structure Definition Structure and Item Scheme Maps Category Scheme Process Categorisation Data or Metadata Source Data or Metadata Flow Category Attachment Constraint Content Constraint Provision Agreement Provision Agreement Data Provider Registered Data Source or Metadata Source
Data Structure Data Structure Definition Measures Data Attributes Dimensions Representation Concept Non-coded Coded Concept Scheme Code List
Reference Metadata: Quality Frameworks • Examples • IMF SDDS • Eurostat • ILO • FAO • Cross Domain Concepts
How to Support Such Different Uses of Metadata SDMX Metadata Structure Definition
Metadata Structure Metadata Structure Definition one or more one or more Metadata Target Metadata Report report for one or more Identification elements of target object Metadata Attribute Concept Target Object Representation Non-coded Representation Coded Non-coded Coded Concept Scheme Code List CategoryScheme Organisation Scheme Code List
SDMX Information Model As a Flow
Data Flows and Data Providers Dataor Metadata Structure Definition Data or Metadata Flow Data Provider Scheme Provision Agreement Data Provider
Dataor Metadata Structure Definition Registered Data and Reference Metadata Data or Metadata Flow Data Provider Scheme Query Provision Agreement Data Provider Register Registered Data Source or Metadata Set Data or Metadata Source references
Dataor Metadata Structure Definition Category Scheme Data or Metadata Flow Structure and Item Scheme Maps Categorisation Category Data Provider Scheme Content Constraint Provision Agreement Data Provider Register Data SourceConstraints Registered Data Set or Metadata Set
SDMX Information Model Bringing it Alive Use Cases
SDMX: Major Use Cases and Processes Data and Reference Metadata Exchange reading, writing, validating SDMX structure and data/metadata set Create and Load Database reading, writing, validating SDMX structure and data/metadata set Data Discovery Query for data sources, reading, validating SDMX structure Data and Reference Dissemination via a Web Service Query structural data, query data, read SDMX data query, write SDMX data set, process constraints, link to reference metadata Data and Reference Metadata Visualisation (tables, graphs, maps, charts) read SDMX structural metadata, create SDMX data query, read SDMX data set, link to reference metadata create tables/graphs/maps/charts
How was this Done with SDMX? SDMX Registry Structural Metadata Web Service create database tables data discovery logicaldata query load database SDMX data query DataWeb Service Data Base query for related metadata visualise data Metadata Repository
Dataor Metadata Structure Definition Category Scheme Data Discovery and Query - flow Data or Metadata Flow Category Categorisation Data Provider Scheme Drill Down Query Provision Agreement Data Provider Discover Register Registered Data Source or Metadata Source Data or Metadata Source references
DataStructure Definition Category Scheme Category Categorisation Data Flow Data Discovery and Query - Demonstration category selection Structural Metadata Source query for structure
DataStructure Definition Category Scheme Category Categorisation Visualise Data Data Flow data selection View query for data Data Source
Data Dissemination via a Web ServiceDemonstration Schematic Architecture
Administration GUI Maintenance GUI Architecture of an SDMX web dissemination system Structural MetadataWeb Service (e.g. Registry) Data Storage Web Service MetadataRepository Web Service sweep Query for metadata SDMXStructureQuery SDMXmetadata set SDMX Data query SDMX Data set SDMXStructure Web Dissemination Web Service SDMX Global Conference 2011 Washington D.C. Presentation Layer (Website)
Data Dissemination: SDMX Structural Metadata Contents currencyexchange rate type (Subject Domain)Category Scheme Structure Definition Code Lists exchange rates Concept Schemes effective exchange rates Constraints exchange rates (Subject Domain)Category categorisation Data Flow Identification of the type of data data structures - dimensionality ProvisionAgreement Constraints contain actual codes present in the data source and actual keys High level categorisation of data e.g. Economic Statistics Identification of the data publisher ECB Data Provider
SDMX Data Visualisation (1) Category Scheme Category Data Flow Categorisation
Data Visualisation (2) constraints Data Flow Dimension values for selection are derived from the codelist