1 / 60

Data Entry Overview and Changes from the Field Trial

Data Entry Overview and Changes from the Field Trial. The ICCS MS Data Entry Process. Data Entry Part 1 Entering School Data Entering Teacher Data Entering Student Regional Module Data. Data Entry Part 2 Entering Student Questionaire Data. Data Entry Part 3

ali-gentry
Download Presentation

Data Entry Overview and Changes from the Field Trial

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Data Entry Overviewand Changes from the Field Trial

  2. The ICCS MS Data Entry Process • Data Entry Part 1 • Entering School Data • Entering Teacher Data • Entering Student Regional Module Data • Data Entry Part 2 • Entering Student Questionaire Data • Data Entry Part 3 • Entering Student Achievement Data

  3. 1. Changes in Data Entry Process since Field Trial 2. Organizing the Data Entry Process 3. Data Manager’s Responsibilities 4. Necessary Material for Data Entry 5. Control Receipts of Survey Material 6. Organize Material for Data Entry 7. Organize Material for Scoring 8. The Process of (Reliability) Scoring Table of Content

  4. Changes in Hierarchical ID System Field trial Main Survey • School level • 8001, 8002, 8003... • School level • 1001, 1002, 1003... • Teacher level • 800101, 800102... 805201, 805202... • Teacher level • 100101, 100102... 105201, 105202... • Student level • 80010101, 80010102... 80520101, 80520102... • Student level • 10010101, 10010102... 10520101, 10520102...

  5. One form of Student Questionnaire Student Questionnaire Form A Student Questionnaire Form B Student Questionnaire Form C Field trial Student Questionnaire Main Survey

  6. One form of Student Questionnaire Codebook has: • One form of Student Questionnaire inside • No IDQUEST variable Thus...

  7. Introduction of Coding Module (ISG) Field trial

  8. Introduction of Coding Module (ISG) Main Survey

  9. Introduction of Coding Module (ISG) • Advantages • Entering the Occupational Data using WinDEM • More convenient for the Data Entry Staff • Better coordination between the Puncher and the Coder • Higher Data Entry speed • Less errors

  10. Number of Achievement Booklets Field trial • 6 booklets • Reliability booklets – only 1, 2, and 3 Main Survey • 7 booklets • Reliability booklets –1 through 7

  11. 1. Changes in Data Entry Process since Field Trial 2. Organizing the Data Entry Process 3. Data Manager’s Responsibilities 4. Necessary Material for Data Entry 5. Control Receipts of Survey Material 6. Organize Material for Data Entry 7. Organize Material for Scoring 8. The Process of (Reliability) Scoring Table of Content 11

  12. Data Entry Rules Data Instruments/ Forms Data Documentation WinW3S File International Codebooks Organizing the Data Entry Process DataManager ... ... DE Unit 12

  13. 1. Changes in Data Entry Process since Field Trial 2. Organizing the Data Entry Process 3. Data Manager’s Responsibilities 4. Necessary Material for Data Entry 5. Control Receipts of Survey Material 6. Organize Material for Data Entry 7. Organize Material for Scoring 8. The Process of (Reliability) Scoring Table of Content 13

  14. Materials Data Entry Staff Equipment Data Files Data Manager’s Responsibilities DataManager Organize: Training in: Perform: Organize: Instruments Data Entry Software Hardware Adaptation of Codebooks Tracking Forms Source of Information Software Verification Scoring Material Documentation Send Out 14

  15. 1. Changes in Data Entry Process since Field Trial 2. Organizing the Data Entry Process 3. Data Manager’s Responsibilities 4. Necessary Material for Data Entry 5. Control Receipts of Survey Material 6. Organize Material for Data Entry 7. Organize Material for Scoring 8. The Process of (Reliability) Scoring Table of Content 15

  16. Necessary Material for Data Entry • From ICCS International Study Centre http://iccs.acer.edu.au/ • International codebooks- Questionnaire codebooks - Achievement and reliability codebooks • Survey Operations Procedures (Unit 3) • Windows Within-School Sampling Software (WinW3S) • Windows Data Entry Manager (WinDEM) program • IEA Survey System 16

  17. Prepare Key Punchers for Data Entry • Important documents for data entry • Survey Operations Procedures (Unit 3) • Copy relevant parts of documents for key punchers • Copies of survey tracking forms should be available for key punchers 17

  18. Planning for Required Resources • Staff for scoring and data entry depends on… • How much material? • How much time? • How much experience? • How much money? • How many persons available? • Computer requirements • IBM-compatible (Pentium processor or higher) • OS: Windows XP/Vista • Office 97 or higher Ask countries that participated in previous IEA studies for their experiences! 18

  19. Amount of Materials • Scoring: Scorer 7 Achievement Booklets = ~ 3750 Student Achievement Test Booklets ~ 700 Student Achievement Test Booklets for Reliability Scoring • Data Entry: Key Punchers ~ 150 School Questionnaires ~2250Teacher Questionnaires ~ 3750 Student Questionnaires ~ 3750Regional Module Questionnaires ~ 3750 Student Achievement Test Booklets ~ 700 Reliability Scoring Sheets 19

  20. Instrument Preparation Codebook Adaptation Data Entry and Verification Test Administration Data Submission Receiving Material Receiving Material Sampling and Preparing Test Administration Scoring 20

  21. Receiving Material 21

  22. 1. Changes in Data Entry Process since Field Trial 2. Organizing the Data Entry Process 3. Data Manager’s Responsibilities 4. Necessary Material for Data Entry 5. Control Receipts of Survey Material 6. Organize Material for Data Entry 7. Organize Material for Scoring 8. The Process of (Reliability) Scoring Table of Content 22

  23. Control Receipts of Test Material • Record return date on ICCS MS School Sampling Form Contact schools that have not returned testing material or where the material is incomplete! 23

  24. Control Receipts of Test Material • Check that all survey tracking forms have been returned and completed correctly ... ... Check participation status on tracking forms! Contact schools that have not returned tracking forms or returned incomplete! 24

  25. Control Receipts of Test Material • Check that all booklets/ questionnaires have been returned Verify identification codes on instruments! Contact schools that have not returned all testing instruments! 25

  26. 1. Changes in Data Entry Process since Field Trial 2. Organizing the Data Entry Process 3. Data Manager’s Responsibilities 4. Necessary Material for Data Entry 5. Control Receipts of Survey Material 6. Organize Material for Data Entry 7. Organize Material for Scoring 8. The Process of (Reliability) Scoring Table of Content 26

  27. Organize Material for Data Entry Receiving Material 27

  28. Organize Material for Data Entry and Scoring • Separate questionnaires and tracking forms from booklets! Sort and forward… Forms + Questionnaires to Data Entry Staff Booklets to Scorers ... ... 28

  29. Sorting Forms and Questionnaires Forms + Questionnaires to Data Entry Staff ... 29

  30. Hierarchical ID System IDSCHOOL: 4 digitsschool 1 0 0 1 Unique identifier in ICG file 1 0 0 1 IDCLASS: 6 digits school + class 1 0 0 10 1 0 1 1 0 0 1 IDSTUD: 8 digits school + class +student 0 1 1 0 0 1 1 0 0 1 0 1 0 1 0 1 Unique identifier in xSG, xSE/xSL, xSA, xSR file IDTEACH: 6 digits school + teacher Unique identifier in ITG file 1 0 0 1 0 1 0 1 1 0 0 1 30

  31. 1004 1003 1002 1001 Arrange Instruments for Data Entry Sort by IDSCHOOL School Questionnaires ... 31

  32. 100102 100202 100101 100201 School 1001 School 1002 Arrange Instruments for Data Entry Sort by IDTEACH Teacher Questionnaires ... 32

  33. 10010202 10020102 10010201 10020201 10010203 10010101 10020103 10010103 10020101 10020203 10020202 10010102 IDSCHOOL 1001 IDCLASS 100101 IDSCHOOL 1001 IDCLASS 100102 IDSCHOOL 1002 IDCLASS 100201 IDSCHOOL 1002 IDCLASS 100202 Arrange Instruments for Data Entry Sort by IDSTUD Student Questionnaires ... 33

  34. 10010202 10020102 10010201 10020201 10010203 10010101 10020103 10010103 10020101 10020203 10020202 10010102 IDSCHOOL 1001 IDCLASS 100101 IDSCHOOL 1001 IDCLASS 100102 IDSCHOOL 1002 IDCLASS 100201 IDSCHOOL 1002 IDCLASS 100202 Arrange Instruments for Data Entry Sort by IDSTUD Regional Module Student Questionnaires ... 34

  35. 1. Changes in Data Entry Process since Field Trial 2. Organizing the Data Entry Process 3. Data Manager’s Responsibilities 4. Necessary Material for Data Entry 5. Control Receipts of Survey Material 6. Organize Material for Data Entry 7. Organize Material for Scoring 8. The Process of (Reliability) Scoring Table of Content 35

  36. Organize Material for Data Entry Receiving Material Organize Material for Scoring 36

  37. Sorting Booklets for ScoringTwo Teams for Scoring:AandB Booklets to Scorers Scoring Team A Scoring Team B 37

  38. Steps for Booklet Arrangement Step 1: Sort by Booklet Type 1,2,...,6,7 ... 38

  39. Booklet 2 Booklet 5 Booklet 6 Booklet 2 Booklet 5 Booklet 6 Booklet 2 Booklet 5 Booklet 6 Booklet 2 Booklet 6 Booklet 7 Arrange Test Booklets for Scoring Step 1: Sort by Booklet Type Booklet 1 Booklet 1 Booklet 1 Booklet 1 ... ... ... ~536 ~536 ~536 ~536 ~3750

  40. Steps for Booklet Arrangement Step 1: Sort by Booklet Type ... SetA, SetB Step 2: Divide into Two Sets Note: From now on the example in this presentation will focus on booklet 1 only!

  41. Booklet 1 Booklet 1 Booklet 1 Booklet 1 Booklet 1 Set B Booklet 1 Set B Booklet 1 Set B Booklet 1 Set B Arrange Test Booklets for Scoring Step 2: Divide into Two Sets Booklet 1 Set A Booklet 1 Set A Booklet 1 Set A Booklet 1 Set A ~50% Scoring Team A ~268 ~50% ~536 Scoring Team B ~268

  42. Steps for Booklet Arrangement Step 1: Sort by Booklet Type Step 2: Divide into Two Sets ... Step 3: Divide into Batches Batch 1, Batch 2, ...

  43. Booklet 1R Set A Booklet 1R Set A Booklet 1R Set A Booklet 1R Set B Booklet 1R Set B Booklet 1R Set B Booklet 1 Set A Booklet 1 Set A Booklet 1 Set A Booklet 1 Set B Booklet 1 Set B Booklet 1 Set B Booklet 1R Set A Booklet 1R Set B Booklet 1 Set A Booklet 1 Set B ~ 25 ~ 25 ~ 25 ~ 25 ~268 ~268 Booklet 1R Set A Booklet 1R Set B Booklet 1 Set A Booklet 1 Set B ~ 25 ~ 25 Arrange Test Booklets for Scoring Step 3: Divide into Batches ... ... Scoring Team A Scoring Team B

  44. Steps for Booklet Arrangement Step 1: Sort by Booklet Type Step 2: Divide into Two Sets Step 3: Divide into Batches Step 4: Separate “R” Booklets

  45. Booklet 1R Set A Booklet 1 Set A Booklet 1R Set A Booklet 1 Set A ~25 Booklet 1R Set A Booklet 1 Set A ... Booklet 1R Set A Booklet 1 Set A ~ 5 ~20 Arrange Test Booklets for Scoring Step 4: Separate “R” Booklets Scoring Team A Scoring Team B

  46. Booklet 1R Set A Booklet 1R Set A Booklet 1 Set A Booklet 1R Set A Booklet 2R Set A Booklet 2R Set A Booklet 2 Set A ~ 5 ~ 5 Booklet 1 Set A Booklet 1 Set A Booklet 1 Set A ~5 ~5 ~20 Booklet 1R Set A Booklet 1R Set A Booklet 1R Set A Booklet 1 Set A Booklet 2 Set A Booklet 1 Set A ~20 ~20 ~20 Arrange Test Booklets for Scoring Step 4: Separate “R” Booklets ... ... ... ... ... ... As Main Scorers As Reliability Scorers Scoring Team A Scoring Team B

  47. 1. Changes in Data Entry Process since Field Trial 2. Organizing the Data Entry Process 3. Data Manager’s Responsibilities 4. Necessary Material for Data Entry 5. Control Receipts of Survey Material 6. Organize Material for Data Entry 7. Organize Material for Scoring 8. The Process of (Reliability) Scoring Table of Content 47

  48. Instrument Preparation Codebook Adaptation Data Entry and Verification Test Administration Data Submission Receiving Material Sampling and Preparing Test Administration Scoring Scoring

  49. Reliability Scoring Scoring Main Scoring

  50. Steps for Booklet Arrangement Step 1: Sort by Booklet Type Step 2: Divide into Two Sets Step 3: Divide into Batches Step 4: Separate “R” Booklets Step 5: Main Scoring (I) Reliability Scoring Sheet Step 6: Reliability Scoring Step 7: Return “R” Booklets Step 8: Main Scoring (II)

More Related