Sue Westerman , May Offermans

1. Coding job titles from the Labour Force Survey in the Netherlands Sue Westerman, May Offermans

2. Contents The Labour Force Survey and internet data collection The Measuring Occupation Why is CBS using CASCOT ? How CASCOT works in Practice Recommendations

3. The national Labour Force Survey (1) - National unemployment rates - Mixed mode (Internet, Phone and Face to face)

5. Year t-1 Year t Year t+1 Q1 Q2 Q3 Q4 Q1 Q2 Q3 Q4 Q1 Q2 Q3 Q4 WAVES Web/Ph/F2F/ 1 A B C D E F G H I J K L 2 Phone × a b c d e f g h i j k 3 Phone × × a b c d e f g h i j 4 Phone × × × a b c d e f g h i 5 Phone × × × × a b c d e f g h The national Labour Force Survey (2)

6. The national Labour Force Survey (4) Implementing web-questionnaire • Hier komt een recente grafiek met werkloosheid misschien • Meet customers’ demands; • Meet respondents’ expectations; • Budget cuts. It’s all about the money; • Increase response rates, reach more groups. 6 6

7. The national Labour Force Survey (5) • Questionnaire (16 minutes) • The old situation: Computer assisted data collection process By phone (Cati) questionnaire Coded results CATI and CAPI Face to face (Capi) Interactive coding module Non coded Code clerks

8. Measuring Occupations (1) • Redesigning questionnaire • Options for coding a) Open question -> process by hand and software pro-> easy implement con -> no output control, too less information b) Closed question -> Use a Tree or ‘IPod menu’ Pro-> easy to process Con-> bias effects, difficult to fill in ->non-response c) Search engine Pro-> highest yield Con-> bias effects, difficult to implement

9. Measuring Occupations (open questions) Pleasebespecificbynaming specialisation or level (a list of 6 examples is shown) Pleasebespecific (a list of 6 examples is shown) What is yourwork or occupation? What are yourmaintasks or duties in that job? Sonotonly Sonotonly Teacher (farmer, nurse, manager…) Advicing (caring, administration…) But rather But rather Teacher primary school Teacher English secundary level Guitar teacher Givingcompanies legaladvice Advicingstudents in transition Advicing on implementation of CRM-system

10. Measuring Occupations (closed questions) What are yourmaintasks? Do you manage in youroccupation? No Yes How manypeople? Do youonlyspend time on managerial tasks, or do youalsoperform the sametasks as the personellyou manage? Besides management, alsotasks of the persons I manage Exclusively management What do youspend most time on? Exclusively management management Othertasks or duties Yes/No Are youresponsiblefortakingdecisions on personellmatterssuch as… Yes/No Are youresponsiblefortakingdecisions on financial andstrategicmatterssuch as…

11. Measuring Occupations (4) • The new situation (afterredesign) Data collectionprocess Data processing process Code clerk (one or two) ‘Unimode’ questionnaire foroccupations Ancillaryvariables NACE Codingrules ≈ 9 % Closed questions(managerial tasks) ≈ 29 % 2-stage CASCOT process ≈ 38 % Open questions 100%non coded 70% autom. ISCO 30% manual ≈ 60 % ≈ 2 % Tasks Job title

12. Code clerk Coding rules Data processing process (summary) Step 1 Step 2 Step 3 Step 4 Codingbased on jobtitles Codingbased on jobtitlesandmaintasks Codingbased on closedquestionsandNACE-code ISCO determined(>90% codedcorrectly) ISCO notdetermined (< 1%)

13. Cascot features • Classification independent • Uses a classificationfile • Classification (e.g. ISCO-08) • Index (search phrases) • Codingrules • Inputfile -> coding per record -> Outputfile • Result: code + score • Batch version + interactiveversion

14. Cascot - design: Structure en Index Typeren beroep

15. Cascot – design: Rules - abbreviations Minimalize number of index entries Improve correspondence score Typerenberoep

16. Cascot – design: Rules - replacement Minimalize number of index entries Improve correspondence score Typeren beroep

17. Cascot – design: Rules - alternatives Minimalize number of index entries Improvecorrespondence score Typeren beroep

18. Cascot – design: Rules - conclusions Avoid code assignmentto job titles that are too vague Input for step 2 (combine withtasks) Input for step 4 (manual coding) Typeren beroep

19. Cascot – Inrichten: Rules - defaults Select jobtitles that are input for step 3:coding rules Codes are assigned based on a specific combination of economic activity and/or managerial tasks Typeren beroep

20. ConclusionandRecommendations (1) The yield of this system is high and error rate is low because: • The search index is large (approx 5000 entries) and based on historical data. Optimised for answers with highest frequency (rules) • Combination of information about tasks and occupation in the process • Questionnaire with routing for special cases (managers) • Economic activity used to differentiate vague responses • Well formulated instructions (motivates to fill in more information in field).

21. ConclusionandRecommendations(2) Disadvantages: • Manual coding is still necessary • No feedback to respondent is given  search engine? • Implementing Cascot in database production facility is difficult Advantages: • Less interviewing time; coding does not effect interview time • No training needed for interviewers; no divergence of interviewer interpretations • Same questions and coding process for cawi, cati, capi and also for all surveys • Cascot is cheap, fast, efficient and user-friendly.

22. Questions?