Part 2

1. Labor Market Information Part 2 Produced in Collaboration between World Bank Institute and the Development Data Group (DECDG)

2. Labor Market Information Survey production cycle 1. Survey design 2. Sample design 3. Questionnaire content and design 4. Data collection and training 5. Data processing and tabulation 6. Data estimation 7. Data analysis and dissemination

3. Labor Market Information 1. Survey design • Several decisions need to be made to define survey such as: what to be measured, when and where etc. • More details in learning module 2. 2. Sample design • Whom, specifically, to collect data from • More details in learning module 4.

4. Labor Market Information 3. Questionnaire content and design • Critical step • Collection of reliable, accurate data • More details in learning module 5 4. Data collection and training • Gathering specific data from specific sources (units) • Training of enumerators critical to accurate collection • More details in learning module 6.

5. Labor Market Information 5. Data processing and tabulation • Validation, editing and estimation • Indicators, tables • More details in learning module 9 6. Data estimation • Sample survey • Data weighted to reflect total population • Internationally sound methods • More details in learning module 8

6. Labor Market Information 7. Data analysis and dissemination • Explain what is happening with the data • Clearly identified dissemination practices • More details in learning module 10

7. Labor Market Information Guidelines What data should be included in a LMIS? • Data should be: • Relevant • Timely • Well defined • Accurate • Objective • Consistent with international standards

8. Labor Market Information Organization and Scheduling • Key to development of labor market information system • Project planning • Data release schedule • When are the most important tasks to start? • When are they to be completed? • Who is responsible? • Identify key personnel responsible for each activity

9. Labor Market Information Agency protocols • Establish rules/procedures • Confidentiality rules • Identify embargoed and other sensitive data products • Develop data integrity procedures • Develop editing protocols • Develop requirements for tables under different modes of release • Identify documentation requirements

10. Labor Market Information Agency protocols (continued) • Establish rules/procedures • Develop procedures for data verification • Develop procedures for approval of various actions • Identify statistical requirements for surveys on response rates, disclosure avoidance, variance methods, etc.\ • Protect respondent confidentiality and prevent the premature release of any data • Constant review of questionnaires

11. Labor Market Information Agency protocols (continued) Begin simple and become more detailed and complex as experience grows • Simple: tables must be professional-looking • Complex: standardized titles, templates, fonts, rounding rules, decimal places, etc.

12. Labor Market Information Framework for labor statistics Data Quality Assessment Framework (DQAF) • Useable framework for assessment and improvement of data • Focus on inputs contributing to overall quality

13. Labor Market Information Themes of DQAF 1. Prerequisites of quality • Does the agency facilitate statistical quality? 2. Integrity • Can organization be trusted to produce accurate, reliable statistics 3. Methodological soundness • Are methods sound, reliable and well-documented?

14. Labor Market Information Themes of DQAF (continued) 4. Accuracy and reliability • How accurate are the data? • Non-response issues? • Sampling and non-sampling errors? 5. Serviceability • How are data offered? • What is the relationship with user groups? 6. Accessibility • Are data releases complete? • Are detailed metadata available?