1 / 36

MDG DATA AND METADATA EXCHANGE AMONG NATIONAL AGENCIES AND WITH INTERNATIONAL ORGANIZATIONS

MDG DATA AND METADATA EXCHANGE AMONG NATIONAL AGENCIES AND WITH INTERNATIONAL ORGANIZATIONS. The Experience of Mexico. Enrique Ordaz 19- 21 October, 2011 Manila . Statistics and Geographic Information Law. National Institute of Statistics and Geography, INEGI. COORDINATES THE SYSTEM.

brinly
Download Presentation

MDG DATA AND METADATA EXCHANGE AMONG NATIONAL AGENCIES AND WITH INTERNATIONAL ORGANIZATIONS

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. MDG DATA AND METADATA EXCHANGE AMONG NATIONAL AGENCIES ANDWITH INTERNATIONALORGANIZATIONS The Experience of Mexico Enrique Ordaz 19- 21 October, 2011 Manila

  2. Statistics and Geographic Information Law

  3. National Institute of Statistics and Geography, INEGI COORDINATES THE SYSTEM PRODUCES INFORMATION AUTONOMY

  4. The new statistical (and geographic information) system NATIONAL COUNCIL SUBSYSTEM SUBSYSTEM SUBSYSTEM SUBSYSTEM Society Socio Demographic Information Geographic and Enviromental Information Economic Information Goverment, Public Security and Justice Information Specialied Technical Committees Specialized Technical Committee Specialized Technical Committee Specialized Technical Committees State UE UE UE UE Working gropus Working groups Working groups Working gropus UE UE UE UE National Information Programs Norms Coordination INEGI Catalog of National Indicators Data dissemination

  5. MDG Indicators Committee • A Specialized Technical Committee was set up in February 2010 to coordinate the integration of the Millennium Development Goals Indicators.

  6. Mexico’s MDG Indicators

  7. General schedule of the work program

  8. Coordination Working groups • Poverty, income and nutrition 2. Poverty, employment Ministries responsible for reviewing and updating metadata; updating basic data and indicators INEGI: technical assistance; data integration and development and management of the website. 3. Education and gender equality 4. Maternal and child mortality, rep. health 5. VIH/AIDS, malaria, other diseases 6. Environment and natural resources 7. Improved water access, and sanitation 8. Global partnerships for development General Coordination: Chrístel Rosales (DGPAE) Agreements follow up: César Garcés (CONAPO)

  9. Process for updating the MDG systemoceso de actualización Sistema ODM

  10. Activities Activities for the operation of the project by INEGI • Prepare manuals of procedure and rules. • Create an FTP site for data exchange. • Backing up time series and metadata from the FTP site. • Classify, analyze and assess the data and metadata to identify possible inconsistencies. • Ask for clarifications from each responsible agency when problems are found in the data. • Update the MDG system.

  11. Form to incorporate data and indicators in the MDG system

  12. Metadata form

  13. Procedure to compile and disseminate the information • The ftp://200.23.8.226/ site contains the following information: • Formal the creation of the MDG Technical Committee. • MDG 2006 Manual; draft of the 2009 manual; Report from de Secretary General. • Mexico’s reports from 2005, 2006. • Relationship of responsible agencies, indicators and data sources. • Terms of reference of the MDG Technical Committee. • Dossiers for each one of the working groups. Each dossier contains: • Indicators’ metadata and the rules for updating it on line. • Raw statistics produced or integrated by INEGI for updating the indicators. • A document with the method of calculation for each indicator

  14. Procedure to compile and disseminate the information Within each working group a person is designated to calculate the indicator. INEGI provides access to FTP://200.23.8.226, with different rights.

  15. Procedure to compile and disseminate the information • Once the work has been finished and authorized, the designated person will up load on the FTP site all the statistical series of raw data to calculate the indicator, as well as the series of the indicator itself, with the corresponding metadata. • INEGI reviews and assesses the data and the indicators, and asks for clarifications. • Once the data are cleared they are put on an internal server for final review by the Technical Committee. • Data are published on the website.

  16. Weekly report

  17. Observations Typology of comments made by INEGI on the data produced bay other agencies • Differences in name of indicators: system vs. working groups. • Differences or missing metadata. • Lack of URL links in the metadata. • Acronyms not explained. • Inconsistencies in the raw data • Differences between the data produced by INEGI and the data published by the government agencies. • Unexplained breaks in time series of indicators or the raw data.

  18. Moving MDG to SDMX • We used a preliminary version of the DSD for MDGand we made the following changes and we finally have aNEW DSD for MDG • It was very useful, but we had to make the following changes in order to adapt it to our information and tools. So we have a NEW DSD for MDG: • We changed the encoding XML ISO-8859-1 per utf-8 because our tools use encoding = "utf-8“ • The XML namespaces are generated directly from our Web Service for each type of message. So it can be seen that some namespaces (i.e. the required for data messages as "compact", "generic", etc.) do not appear in the DSD proposed by INEGI, but on the other side, it is a new one that is the xmlns: registry that is required in a DSD.

  19. Moving MDG to SDMX • 34 MDG indicators. • We have adjusted some code lists: 9 were used, of which 6 are consistent with the UNSD and 3 were included by the INEGI. • The codes are alphabetically sorted in Spanish. • Two age groups were added because of the particularities of the indicators presented by Mexico. • One class added: ND Not determined

  20. Progress in the conversion of MDGs to SDMX The names of the catalogs were changed, removing _SDMX or _ODM, because by recommendation the identification should be as generic as possible so they can be used by other flows.

  21. Progress in the conversion of MDG to SDMX • Added ConceptScheme CS_MDG • This component (is required for SDMX 2.0), it contains a list of concepts applicable to the DSD • Key Family MDG was changed to DSD_MDG because it is recommended that the nomenclature of the id is based on the first initials of the type of device (DSD DataStructure, Codelist CL, Scheme Concept CS, etc) followed by the identifier. • The following 3 attributes changed from observation to sets level, because for Mexico, in the retrieval systems and original databases, these features are specified for each series. This change produces smaller SDMX files . • UNIT_MULT • TIME_DETAIL • FOOTNOTES • The next three code lists were updated because the INEGI information could not be classified with the original code lists: • CL_FREQUENCY, • CL_AGE_GROUP   • CL_UNIT_MEASURE

  22. UnitedNations Statistics Division DSD for the MDG

  23. Note: Two age groups were added because of the particularities of the indicators presented by Mexico.

  24. Note: Added one class to characterize the statistics that have no clearly defined periodicity: ND: Not determined

  25. SDMX – MDGConsulta del DSD desde el Web Service de INEGI DataFlows de INEGI (Para saber qué flujos disponibles hay y sus correspondientes DSD se hace primero una consulta dinámica de todos los DataFlows publicados por INEGI) http://www.sdmx.snieg.mx/sistemas/sdmx/restsdmx/Dataflow/ALL/ALL/ALL (o si ya se sabe el nombre del DataFlow se puede acotar por ejemplo a DF_MDG) http://www.sdmx.snieg.mx/sistemas/sdmx/restsdmx/Dataflow/ALL/DF_MDG/ALL El nombre del DSD de MDG se puede ver en el resultado de la consulta anterior. Por ejemplo, para el caso de los MDG el nombre es DSD_MDG. Para consultarlo se construye la URL como sigue: DataStructure http://www.sdmx.snieg.mx/sistemas/sdmx/restsdmx/DataStructure/ALL/DSD_MDG/ALL DataStructure con artefactos de referencias (codelist, consept scheme) http://www.sdmx.snieg.mx/sistemas/sdmx/restsdmx/DataStructure/ALL/DSD_MDG/ALL?references=shallow CODELISTS (Ejemplo para consultar dinámicamente el código CL_FREQ, los nombres de los códigos los sabemos en el DSD de la consulta anterior) http://www.sdmx.snieg.mx/sistemas/sdmx/restsdmx/Codelist/IAEG/CL_FREQ/ALL

  26. SDMX – MDGConsulta de Datos desde el Web Service de INEGI en diferentes formatos DATOS del Flujo ODM INEGI Datos xml (Se pueden visualizar en el Explorer o en cualquier visualizador como XML-Marker) http://www.sdmx.snieg.mx/sistemas/sdmx/restsdmx/Data/DF_MDG/INEGI?Key=ALL&format=compact Datos xml filtrados, Ejemplo (Trae exclusivamente el indicador de MEXICO cuya SERIE es SL_EMP_TOTL) KEY =  [FREQ].[REF_AREA].[SERIES].[SEX].[AGE_GROUP].[LOCATION].[SOURCE_TYPE].[UNIT] http://www.sdmx.snieg.mx/sistemas/sdmx/restsdmx/Data/DF_MDG/INEGI?Key=.MEX.SL_EMP_TOTL.....&format=compact Datos csv (Archivo separado por comas, reduciendo mas del 50% de su tamaño xml, y se puede visualizar en varias herramientas como Excel, ó llenar directamente una tabla de BD) http://www.sdmx.snieg.mx/sistemas/sdmx/restsdmx/Data/DF_MDG/INEGI?Key=ALL&alt=csv Datos chart (Trae una imagen, este es el mismo ejemplo anterior de datos filtrados, que trae sólo el indicador de MEXICO cuya SERIE es SL_EMP_TOTL, para Total, Hombres y Mujeres, en una imagen) http://www.sdmx.snieg.mx/sistemas/sdmx/restsdmx/Data/DF_MDG/INEGI?Key=.MEX.SL_EMP_TOTL.....&format=compact&alt=chart Datos json y jsonp (Para utilizar los datos del flujo en aplicaciones WEB de terceros como Facebook, Twitter, etc. -OPEN DATA-) http://www.sdmx.snieg.mx/sistemas/sdmx/restsdmx/Data/DF_MDG/INEGI?Key=ALL&format=compact&alt=json http://www.sdmx.snieg.mx/sistemas/sdmx/restsdmx/Data/DF_MDG/INEGI?Key=ALL&format=compact&alt=json&callback=jsonp

  27. SDMX – MDGCAMBIOS EN EL DSD • Dynamic chart sourced by a SDMX flow

  28. Proposed Timeline for Conversion to SDMX the MDG indicators

  29. Proposed Timeline for Conversion to SDMX the MDG indicators

  30. MDG DATA EXCHANGE AMONG NATIONAL AGENCIES ANDWITH INTERNATIONALORGANIZATIONS The Experience of Mexico Enrique Ordaz 19- 21 October, 2011 Manila

More Related