200 likes | 328 Views
SDMX Implementation at the Statistics Korea. September 2012. Contents. I. Background. II. KODAPS & SDMX Implementation. Future Plans. III. Background. “Inefficiency resulting from non-standardized data exchanges ” “Problems such as redundancy in work, service delays or mistakes”.
E N D
SDMX Implementation at the Statistics Korea September 2012
Contents I Background II KODAPS &SDMX Implementation Future Plans III
Background • “Inefficiency resulting from non-standardized data exchanges” • “Problems such as redundancy in work, service delays or mistakes” Governmental Agencies Inconvenience of repeated work for each request Data request Download KOSIS into Excel file Data request Organizations Process data in requested format • OECD 40 statistics, 13 organizations • Other Int`l organizations (11) 17 statistics, 8 organizations STATISTICS KOREA
KODAPS (Korean Data Provision system)to-be Model Int’l data collector WEB Service (Pull) DB linkage SDMX KODAPS KOSIS (Push) Data input (e-mail) Transmission SDMX file will be developed
KODAPS Development Plan SDMX Ver 2.1 Phase 1 • Phase 2 WEB Service AUTO SDMX Ver 2.0 Enhancement level Development Period: 20124-12 Enhance the system to make various functions easy to use (KOSIS data link, data entry, manage functions) Basic Level Develop SDMX web service Apply newest version of SDMX (ver2.1) Development Period: 2011 4-12 Automatize data provision to international organizations previously done manually Develop system (manage users and register requests, manage data, data requests) Apply SDMX ver 2.0
KODAPS Work Flow User screen Request Management • Data request • Data services Data Management • E-mail reception • Download/ Direct extraction • Data generation/ management • E-mail Data provision Informationrequestor an informant User & Log Management Information Management • KOSIS DB • linkage • User management • Log/Code management KOSIS DB System manager
KODAPS(1)- Request Management Data Provision Request Management Data Management User & Log Management Information Management Search condition Listof Requests Basic information of the selected request E-mail The list of data sets linked to the selected request 7
KODAPS(2)- Data Management Request Management Data Management Data Provision User & Log Management Information Management - Data management – KOSIS linkage Search conditions List of generated data Statistics Domain Data Code Statistics
KODAPS(2)- KOSIS Linkage Search condition List of statistical tables in KOSIS List of itemsand classifications in a table Data Generation
KODAPS(3)- Dataset List for Transmission Request Management Data Management Data Provision User & Log Management Information Management - Dataset List for Transmission – Data Generation for Transmission – provide management Search Condition Mapping List of Requests and data sets Same requesting ID Information of the selected row in the mapping lists
KODAPS(3)- Dataset List for Transmission Request Management Data Management Data Provision User & Log Management Information Management - Dataset List for Transmission – Data Generation for Transmission – provide management Provided Data Search
KODAPS(4)- Data Provision Request Management Data Management Data Provision User & Log Management Information Management - Dataset List for Transmission – Data Generation for Transmission – provide management Search Condition List of Requests Request ID Request Generation Data Generation (SDMX)
Under Construction(1)-DSD Management Request Management Data Management Data Provision User & Log Management Information Management -Co code– Organization code– SDMX DSD Management– Board management– status of providig
Under Construction(1)-DSD Management Request Management Data Management Data Provision User & Log Management Information Management -Co code– Organization code– SDMX DSD Management– Board management– status of providig SDMX DSD Register & modification
KODAPS DB KOSIS DB Under Construction(2)-Web Service Plan DSD data management process Manage DSD, Compact Schema files Provide data file via REST URI 1 2 3 Register DSD data by organization Send via Email DSD file, Compact schema KOSTAT Data Administrator User (External System) WAS Transmit XML file (SDMX format) 5 WEB-SERVICE RESTful API Create data file (Generic/Compact Data XML) Extract numeric data by period or point of time (DataSet) Manage DSD by organization, data Manage Compact Schema by organization, data Extract data for agency (Agency,KeyFamily) 3 Manage KOSIS DB mapping by data OECD UN etc... STES INFRA_ANNUAL_LABOUR 4 Requested data mapped to KOSIS DB 4 1 Request URI http://stat.kosis.kr/kodaps/ws/data/ OECD,STES,1.0/M.KR.LFACTTFE.ST.PR 2 Interpret requested URI JAX-RS JDK 1.5 or above
KODAPS in Use • Regarding Data Provision to Int’l Organizations (Since May 2012) • MEI(Main Economic Indicator), TCB(The Conference Board) and MBS (Monthly Bulletin Statistics) data are compiled monthly via KODAPS and sent by e-mail manually • Regarding Pilot project on STES (Since the second half of 2011) • Applied separated STES DSDs (labor, STES) to the system (April, 2012) • Generated SDMX data file according to the pre-defined DSD (July, 2012) • Its validation is going on in the OECD
Future Plans • Finish successfully “KODAPS Enhancement Project” by this December • to adopt SDMX version 2.1 • to develop SDMX Web Service (Pull method) • to make it more convenient to use • Participate actively in the OECD Pilot STES • Open this system to other domestic agencies • in order to prevent inefficient use of resources (e.g. development of duplicate system) • hard to make its use mandatory through legislations or regulations • The help of the International Organizations will be crucial for this. • Propose to host “The SDMX Expert Group Meeting” in Korea in 2014
Thank youfor your listening. Kang, Yu-Gyung Director, Statistical Information Portal division E-mail: summaul@korea.kr Phone: 82-42-481-2377 Fax : 82-42-481-2474