170 likes | 385 Views
SDMX for the people. Erik van Ingen FAO, 20 th of August 2013. Institutes. People. Institutes. People. Government WorldBank Eurostat OECD FAO IMF NSI ILO UN. Decision maker Policy maker Researcher Manager Minister Student NGO. Institutes. People. Have lots of data
E N D
SDMX for the people Erik van Ingen FAO, 20th of August 2013
Institutes People
Institutes People Government WorldBank Eurostat OECD FAO IMF NSI ILO UN .. Decision maker Policy maker Researcher Manager Minister Student NGO ..
Institutes People Have lots of data Generally want their data to be used Know about SDMX Know about: Excel, R, MATLAB, SAS, SPSS, STATA or GAMS Want data Do not want to know about SDMX
Institutes People Data to the people
Let’s do something about that • Bring the data to the people without having the people to know about the api • The api uniform implemented across all institutes But that is what SDMX is supposed to do, what is missing?
SDMX plugins (for Excel, R, MATLAB, SAS, SPSS, STATA or GAMS) Uniform implemented SDMX api (across all institutes)
Institutes People SDMX plugin internet Institute sdmx data server
SDMX Connection (Worldbank) SDMX Connection (FAO) SDMX Connection (OECD, etc)
SDMX Server api • SDMX REST API is an excellent protocol, introduced in SDMX 2.1, based on XML • Promising work has been done on SDMX-JSON, inspired by json-stat.org
Proposed SDMX People Project • Deliver user friendly SDMX plugins for MS-Excel and R • Plugins are open source software, freely available • Publish a paper with advise for institutes on what to minimally implement of the SDMX api in order to serve the plugins correctly but..
Then I spoke with the Bank of Italy • Bank of Italy will release their SDMX client for Matlab, R and MS-Excel in autumn 2013 • Supports only SDMX 2.1 • ECB and BIS publish SDMX 2.1 (ECB supports also SDMX 2.0), OECD has planned support • Bank of Italy would welcome support from FAO in order to contribute to the SDMX client for MS-Excel
Institutes People Excel R Matlab Exel Wrapper R Wrapper Matlab Wrapper SDMX Gateway in Java (Bank of Italy) internet Institute sdmx data server
And with Metadata Technology SdmxSource will be published before the SDMX global conference (11-13 September 2013)
Proposal Server • The proposal is to • migrate the SDMX 2.0 implementation of data.fao.org to SDMX 2.0/2.1 • position OpenSDMX as an extension of SdmxSource (SdmxSource lacks support for the data part of the SDMX REST API) • migrate OpenSDMX to SdmxSource • add support for the SDMX-JSON format • Making Fenix SDMX compatible, based on SdmxSource/OpenSDMX
Proposal Client • Contribute to the SDMX Client project, led by the Bank of Italy, by: • Making the MS-Excel plugin more user friendly • Extending the SDMX client with the SDMX-JSON format
Proposal SDMX & Metadata • Design Data Structure Definitions (DSD) for all domains in FAO • Participate in the SDMX Technical Working Group (TWG) • Participate in the SDMX Statistical Working Group (SWG)