1 / 32

Evaluation of socioeconomic data collected from censuses

Evaluation of socioeconomic data collected from censuses. United Nations Statistics Division. What can be done to check data quality?. Check the internal consistency of the data Whether plausible when tabulated or cross-tabulated with other characteristics

pearcer
Download Presentation

Evaluation of socioeconomic data collected from censuses

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Evaluation of socioeconomic data collected from censuses United Nations Statistics Division United Nations Workshop on Revision 3 of Principles and Recommendations for Population and Housing Censuses and Evaluation of Census Data, Amman 19 – 23 October 2014

  2. What can be done to check data quality? • Check the internal consistency of the data • Whether plausible when tabulated or cross-tabulated with other characteristics • Compare with other sources -indirect comparison • Graph the derived indicators • Cohort analysis of certain indicators • Disaggregate by sex and age • Compare with other sources- direct comparison • Post enumeration surveys, where people were re-interviewed and content of the census responses is verified • Matching records with other sources United Nations Workshop on Revision 3 of Principles and Recommendations for Population and Housing Censuses and Evaluation of Census Data, Amman 19 – 23 October 2014

  3. Main types of socioeconomic characteristics from censuses • Demographic and social characteristics • Age • Sex • Marital status • Educational characteristics • Literacy • School attendance • Educational attainment • Economic characteristics • Economic activity status (labor force participation) • Occupation • Industry • Status in employment Core topics from the Principles and Recommendations for Population and Housing Censuses, Rev. 2 United Nations Workshop on Revision 3 of Principles and Recommendations for Population and Housing Censuses and Evaluation of Census Data, Amman 19 – 23 October 2014

  4. Education • Three core concepts; • Literacy – ability to read and write a short, simple statement • School attendance – current, regular attendance at an accredited educational institution or program • Distinguished from enrollment, which means that the student is officially registered at school, not necessarily that s/he actually goes to class • Educational attainment – highest grade completed within the most advanced level reached in the educational system United Nations Workshop on Revision 3 of Principles and Recommendations for Population and Housing Censuses and Evaluation of Census Data, Amman 19 – 23 October 2014

  5. Education • How to evaluate the quality of data: • Cohort analysis • Comparison of education indicators calculated from the census and other sources of data –household surveys, administrative registers • Plausibility in the distribution of data United Nations Workshop on Revision 3 of Principles and Recommendations for Population and Housing Censuses and Evaluation of Census Data, Amman 19 – 23 October 2014

  6. Cohort approach • Use the demographic concept of birth cohort to generate time series data for people who were born in the same year/period by their completed level of education and literacy • Analyze successive census data by cohorts - if they show similar level for certain level of education while age increases • Assumption: • People do not continue education after reaching certain age - based on educational system in a country United Nations Workshop on Revision 3 of Principles and Recommendations for Population and Housing Censuses and Evaluation of Census Data, Amman 19 – 23 October 2014

  7. Cohort approach • Data requirement :Consecutive population censuses by age groups, sex and literacy status and completed level of education • Example for two successive censuses conducted in 1994 and 2004 United Nations Workshop on Revision 3 of Principles and Recommendations for Population and Housing Censuses and Evaluation of Census Data, Amman 19 – 23 October 2014

  8. Cohort approach Re- organization of data by birth cohorts United Nations Workshop on Revision 3 of Principles and Recommendations for Population and Housing Censuses and Evaluation of Census Data, Amman 19 – 23 October 2014

  9. Cohort approach Impact of out-migration among literate population ? United Nations Workshop on Revision 3 of Principles and Recommendations for Population and Housing Censuses and Evaluation of Census Data, Amman 19 – 23 October 2014

  10. Cohort approach Age misreporting? Impact of international out-migration ? Expected pattern at older ages because of the effect of high mortality risk United Nations Workshop on Revision 3 of Principles and Recommendations for Population and Housing Censuses and Evaluation of Census Data, Amman 19 – 23 October 2014

  11. Cohort approach Educationalattainment, Republic of Korea, 2000, 2005 and 2010 censuses United Nations Workshop on Revision 3 of Principles and Recommendations for Population and Housing Censuses and Evaluation of Census Data, Amman 19 – 23 October 2014

  12. Cohort approach Educationalattainment, Republic of Korea, 2000, 2005 and 2010 censuses United Nations Workshop on Revision 3 of Principles and Recommendations for Population and Housing Censuses and Evaluation of Census Data, Amman 19 – 23 October 2014

  13. Internal consistency Egypt, 2006 census Age 11 Age 11 Age14 Age 14 United Nations Workshop on Revision 3 of Principles and Recommendations for Population and Housing Censuses and Evaluation of Census Data, Amman 19 – 23 October 2014

  14. Comparison with other sources • The possible sources of data for comparisons are: • Population registers, • Vital registration systems, • School enrollment data, • Citizen identification systems, • Social security/health systems • Existing household surveys • Serious discrepancies between census and survey/administrative distributions for census topics are indicative of error in one or both sets of data - cause(s) should be investigated United Nations Workshop on Revision 3 of Principles and Recommendations for Population and Housing Censuses and Evaluation of Census Data, Amman 19 – 23 October 2014

  15. Comparison with other sources • Close investigation on the followings: • The definitions used for socioeconomic data can have a significant impact on results – make sure that definitions used are consistent or investigate how differences in definitions would affect • Consistency in how the question(s) is phrased - the terms used for the questions can be key factor in comparison with other sources • Consistency in reference time-investigate how the differences in reference time would affect the results of evaluation United Nations Workshop on Revision 3 of Principles and Recommendations for Population and Housing Censuses and Evaluation of Census Data, Amman 19 – 23 October 2014

  16. Comparisons with existing household surveys • The rationale for using existing household surveys to evaluate a census on a non-matching basis lies in the fact that • sample surveys are often less affected by nonsampling error than censuses due to the better operational control, qualified field staff with intensive tranning programme • therefore, survey data on population characteristics also measured by a census often are considered to be more accurate than the census results United Nations Workshop on Revision 3 of Principles and Recommendations for Population and Housing Censuses and Evaluation of Census Data, Amman 19 – 23 October 2014

  17. Comparison with other sources • Census results indicate slightly lower level than the DHS • Census results are highly consistent with the results of DHS United Nations Workshop on Revision 3 of Principles and Recommendations for Population and Housing Censuses and Evaluation of Census Data, Amman 19 – 23 October 2014

  18. Economic activity • Activity status – a person’s relationship to economic activity during a short reference period (typically a week) • Employed – a person who worked a defined, minimum amount of time over the reference period (may be as little as an hour) • Unemployed – a person who did not work the minimum amount of time during the reference period but was willing and able to work and looking for a job • Inactive (out of labor force)– a person who did not work the minimum amount of time during the reference period and did not want to work/was not looking for work • Both the employed and the unemployed are economically active! • Employed + unemployed = labor force United Nations Workshop on Revision 3 of Principles and Recommendations for Population and Housing Censuses and Evaluation of Census Data, Amman 19 – 23 October 2014

  19. Economic activity • Difficulties: • What does “work” mean? • Goods and services produced for the market • Goods produced for own-use (replacing need to buy on market) • In practice, this is quite difficult to measure, especially in areas with large agricultural or informal economies • Women’s home-based production in particular is often undercounted in surveys • What does “looking for a job” mean? • E.g. some persons may have registered at a government labor office months ago, but done nothing else. Are they looking for a job? United Nations Workshop on Revision 3 of Principles and Recommendations for Population and Housing Censuses and Evaluation of Census Data, Amman 19 – 23 October 2014

  20. Additional economic characteristics • Occupation – type of work that the person performs (most recent ISCO classification) • Industry – kind of production that the establishment in which the person works engages in (most recent ISIC classification) • Status in employment – type of contract the person has with his place of work (ICSE from the ILO) • Recommended categories: Employee; Employer; Own-account worker; Contributing family worker; Members of producer cooperatives; Persons not classifiable by status Source: Principles and Recommendations for Population and Housing Censuses, Rev.2, United Nations, 2008 United Nations Workshop on Revision 3 of Principles and Recommendations for Population and Housing Censuses and Evaluation of Census Data, Amman 19 – 23 October 2014

  21. Example: Egypt labor force measurement (2006) Egypt Labor Market Panel Survey (ELMPS) 2006 vs. Egypt Census 2006 United Nations Workshop on Revision 3 of Principles and Recommendations for Population and Housing Censuses and Evaluation of Census Data, Amman 19 – 23 October 2014

  22. Comparison with survey data Egypt Labor Market Panel Surveys and Censuses Data source: Minnesota Population Center. Integrated Public Use Microdata Series, International: Version 6.1 (IPUMS International, with CAPMAS Egypt) and Egypt Labor Market Panel Survey (ELMPS, Economic Research Forum, Egypt) United Nations Workshop on Revision 3 of Principles and Recommendations for Population and Housing Censuses and Evaluation of Census Data, Amman 19 – 23 October 2014

  23. Comparison with survey data Census result is consistent with ELMPS-market, but not with ELMPS-extended –reasons? United Nations Workshop on Revision 3 of Principles and Recommendations for Population and Housing Censuses and Evaluation of Census Data, Amman 19 – 23 October 2014

  24. Comparison with survey data • Two definitions of the labor force: • The market labor force includes all those who are either engaged in economic activity for purposes of market exchange or seeking such work • The extended labor force includes those engaged in “the production and processing of primary products, whether for the market, for barter, or for their own consumption; the production of all other goods and services for the market; and, in the case of households that produce such goods and services for the market, the corresponding production for their own consumption.” (ILO, 1982) • The distinction between the two definitions is particularly salient for women in Egypt, many of whom engage in animal husbandry and the processing of dairy products for purposes of household consumption and are thus counted as employed in the extended definition of the labor force Source: Economic Research Forum, 2007, Labor Supply, Employment and Unemployment in the Egyptian Economy, 1988-2006, Ragui Assaad, working paper no. 0701 United Nations Workshop on Revision 3 of Principles and Recommendations for Population and Housing Censuses and Evaluation of Census Data, Amman 19 – 23 October 2014

  25. Marital status • Marital status is the personal status of each individual in relation to the marriage laws or customs of the country. The categories of marital status should at least include the following: • Single (never married) • Married • Married but separated-comprise both legally and de facto separated • Widowed and not married • Divorced and not married United Nations Workshop on Revision 3 of Principles and Recommendations for Population and Housing Censuses and Evaluation of Census Data, Amman 19 – 23 October 2014

  26. Internal consistency control Expected pattern • smooth declining with ages • females are getting married in younger ages than males • males are getting married slightly younger ages in rural areas compared to urban areas United Nations Workshop on Revision 3 of Principles and Recommendations for Population and Housing Censuses and Evaluation of Census Data, Amman 19 – 23 October 2014

  27. Internal consistency control 1994 Population and Housing Census of Tunisia Proportion of widowed men United Nations Workshop on Revision 3 of Principles and Recommendations for Population and Housing Censuses and Evaluation of Census Data, Amman 19 – 23 October 2014

  28. Comparison with survey data • Very similar patter between the census and DHS • Slight difference in the last age group United Nations Workshop on Revision 3 of Principles and Recommendations for Population and Housing Censuses and Evaluation of Census Data, Amman 19 – 23 October 2014

  29. Singulate Mean Age at First Marriage (SMAFM) • Technique for estimating the mean age at first marriage when actual dates of marriage are not available • Is a period measure (uses a synthetic cohort) • Very simple data requirements: • Total number of women by 5-year age groups • Total number of ever-married women by 5-year age groups United Nations Workshop on Revision 3 of Principles and Recommendations for Population and Housing Censuses and Evaluation of Census Data, Amman 19 – 23 October 2014

  30. SMAFM calculation (1) Source: Wachter, Ken, Essential Demographic Methods, Data from United Nations Demographic Yearbook PEMult United Nations Workshop on Revision 3 of Principles and Recommendations for Population and Housing Censuses and Evaluation of Census Data, Amman 19 – 23 October 2014

  31. SMAFM calculation (2) United Nations Workshop on Revision 3 of Principles and Recommendations for Population and Housing Censuses and Evaluation of Census Data, Amman 19 – 23 October 2014

  32. Some remarks • Census results are closely connected with other areas of statistical activities, therefore supplementary information about the census should be provided to the users for clarification of comparability of census data with previous censuses and other data sources • Further analysis for interpreting the findings United Nations Workshop on Revision 3 of Principles and Recommendations for Population and Housing Censuses and Evaluation of Census Data, Amman 19 – 23 October 2014

More Related