130 likes | 431 Views
What makes a good survey?. RelevanceAnswer the policy questionQualityMethodologyAccuracy and reliabilityAdherence to international statistical guidelines TimelinessPunctualityProduction timeComparability over timeSustainabilityPublic disseminationDocumentation. What makes a good survey?.
E N D
1. Living Standard Measurement Study Surveys Diane Steele
World Bank
1 July 2008
2. What makes a good survey? Relevance
Answer the policy question
Quality
Methodology
Accuracy and reliability
Adherence to international statistical guidelines
Timeliness
Punctuality
Production time
Comparability over time
Sustainability
Public dissemination
Documentation
3. What makes a good survey? Questionnaires
Sample design
Field work
Data management
4. What’s in a name: the “typical” LSMS Survey LSMS survey is not standard survey, but each survey shares important common characteristics
There are other multi-topic household surveys
Integrated Survey
Priority Survey
Core Welfare Indicator Questionnaire (CWIQ)
Household Income and Expenditure Survey/ Household Budget Survey
Multiple Indicator Cluster Survey (MICS)
Demographic and Health Survey (DHS)
5. What’s in a name: the “typical” LSMS Survey An integrated survey: Multi-topic and multi-level
1) Household questionnaire
collected at the household level : Household roster, consumption, housing, agriculture, household enterprises, misc. income, savings, credit
information collected directly from individuals rather than proxy respondents: Education, health, employment, migration, anthropometry, fertility
6. What’s in a name: the “typical” LSMS Survey
An integrated survey: Multi-topic and multi-level (cont):
2) Community questionnaire
3) Price questionnaire (food/non-food at community markets)
4) Facility questionnaires (schools, health facilities)
7. What’s in a name: the “typical” LSMS Survey
Sample: Nationally representative, but relatively small samples.
Survey instruments: Quantitative questionnaires (few open-ended questions)
Data Entry: concurrent DE (done quickly following interview; in many cases, where feasible, in the local field office or in the field itself)
Documentation: Basic Information Document as well as other appropriate documentation
8. What’s in a name: the “typical” LSMS Survey
Rigorous quality control
Direct informants
Precoded, close-ended questions
Explicit skip patterns
Extensive piloting of draft questionnaires
Extensive training
Well-defined field procedures (manuals)
High level of supervision
Concurrent data entry
Small sample size
Revisits to households to correct errors
Emphasis on capacity building and public access
9. TLSS and MICS TLSS
1999
2,000 households
14,142 individuals
2003
4,156 households
26,141 individuals
2007
4,860 households
30,139 individuals MICS
2000
3,720 households
6,206 women
3,535 children
2005
6,684 households
10,626 women
4,370 children
10. TLSS and MICS Complementary objectives
Demographics, education, health, employment, etc
To contribute to the improvement of data and monitoring systems and to strengthen technical expertise in the design, implementation and analysis of such systems
TLSS – measure of household welfare
Poverty analyses
Monitoring of programs
MICS – children and women’s issues
To provide up-to-date information for assessing the situation of children and women in Tajikistan
To furnish data needed for monitoring progress toward goals established in the Millennium Declaration and WFFC as well as other internationally agreed-upon goals
11. System of Household Surveys Census
Single Topic
Agricultural Surveys (FAO)
Labor Force Surveys (ILO)
Income and Expenditure Surveys (IES)
Multi-topic
Demographic and Health (DHS)
Multiple Indicator Cluster Surveys (MICS)
Living Standards Measurement Study Surveys (LSMS)
Priority Surveys (PS)
Core Welfare Indicator Surveys (CWIQ)
12. System of Household Surveys Strong coordination between government and donors
Maintain methodology
Comparability
Capacity building
Link users and producers
Provide adequate resources
Continuous survey program
13. System of Household Surveys Benefits
Avoid loss of capacity
Create greater levels of capacity (building on existing)
Economies of scale
Policy makers know when data will be available
Protects Goskomstat from pressures for ad hoc surveys
Ongoing system actually allows more flexibility and responsiveness