Entering Data Part 3

1. Entering Data Part 3

2. 1 Introduction 2 Sequence of Variables 3 Entering Data 4 Material Needed for Data Entry 5 Example: Entering Achievement & Reliability Data 6 Hands-On Training: Entering Test & Reliability Data Table of Content 2

3. Complete Student Information Data Entry and Verification Enter Background Data Enter Achievement and Reliability Data Enter Achievement and Reliability Data 3

4. Table of Content 1 Introduction 2 Sequence of Variables 3 Entering Data 4 Material for Data Entry 5 Example: Entering Student Achievement Data 6 Hands-On Training: Entering Achievement and Reliability Data 4

5. Score Constructed-Response Items • Scorers evaluate students responses to constructed-response items • Interpretation is based on Scoring Guides provided by the International Study Center • Up to 2 points are assigned • Code 2 is worth 2 points • Code 1 is worth 1 point • Code 0 is worth 0 points (or means invalid) • Code 9 means missing • Code is written at prepared places in the Achievement Booklets or Constructed-Response Items Scoring Sheets, so key puncher can enter them later 5

6. Reliability Scoring • ~700 booklets (~100 booklets per booklet type) • Reliability scorers will be recorded on separate Constructed-Response Items Scoring Sheet for Double Scoringand later entered in the Reliability Data File 4R 6

7. Student Test Data File • Contain student responses to multiple-choice and constructed-response items • Should contain one record for each COMPLETED Student Test Booklet 7

8. Reliability Scoring Data File • Contain reliability codes for constructed-response items • Should contain one record for each COMPLETED scoring sheet 8

9. File Naming Convention

10. Identification Variables – I • Identification variables IDPUNCH – 3 digits, identifies the key puncher IDSTUD – 8 digits IDCHECK – 3 digits, in combination with unique ID 10

11. Identification Variables – II • Identification variables IDBOOK – 1 digit – Applies to Student Achievement and Reliability Data File only – Identifies the booklet that was administered to the student – Used to filter the set of questions to be displayed to the key puncher 11

12. Identification Variables – III • Identification variables Test Data Files: IDSCORA – 3 digits, identifies marker for the main scoring (Student Achievement Data File) IDSCORR – 3 digits, identifies marker for the reliability scoring (Student Reliability Data File) – Usage of those variable permits identification of systematical scoring errors for individual scorers – Assigning procedure suggested is: - Codes for Scoring Team A (Set A) start with 1xx - Codes for Scoring Team B (Set B) start with 2xx – Codes for both variables must be different for one and the same student 12

13. Identification Variables – III 101 201 13

14. Indicator Variables – I • Identification variables • Indicator variables CHECK01, CHECK02,…, CHECKn – 1 digit, avoid column shifts – Only entering blank space is allowed – Appear when • Transition is made between ID- and TOKEN-variables • End of each odd page of the booklet • The booklet ends 14

15. Indicator Variables – II • Identification variables • Indicator variables Student Achievement and Reliability Data File: TOKEN01 to TOKEN07 – 1 digit, indicates availability of data, 3 codes 1 – Instrument available, but empty 2 – Instrument not available or lost 3 – Instrument available with responses – TOKENxx appears after CHECKn variable and before survey instrument variables of the corresponding booklet 15

16. Test Instrument Variables • Identification variables • Indicator variables • Test instrument variables 16

17. Sequence in Student Achievement File 10010104 5 721 Booklet 5 5 111 201 10010104 721 3 1 201 17

18. Table of Content 1 Introduction 2 Sequence of Variables 3 Entering Data 4 Material for Data Entry 5 Example: Entering Student Achievement Data 6 Hands-On Training: Entering Achievement and Reliability Data 18

19. Coding of Multiple-Choice Items Enter 1 Enter 2 Enter 3 Enter 4 • Key punchers shall be able to enter the data the easiest way possible: • For multiple-choice items – enter checked category • First option  Enter 1 • Second option  Enter 2 • … 19

20. Coding Constructed-Response Items Enter 0 0 • Key punchers shall be able to enter the data the easiest way possible: • For constructed-response items – enter value indicated by scorer 20

21. Missing Codes Omitted 9, 99, 999, ... Not Administered 8, 98, 998, ... Invalid 7,97,997,... Default 6, 96, 996, ... 21

22. Omitted Codes – I • Omitted response (9, 99) • Non-response Enter 9 22

23. Omitted Codes – II • Omitted response (9, 99) • Non-response • Booklet not completed at all Do not enter record in WinDEM. 23

24. Invalid Codes - I Enter 7 • Invalid response (7, 97) • Invalid response 24

25. Invalid Codes - II Enter 7 • Invalid response (7, 97) • Invalid response 25

26. Not Administered Codes – I • Not administered (8, 98) • Respondent was not administered a section of the booklet Booklet 5 Questions in all other booklets are coded to Not Administered later at the IEA DPC! Booklet 1 Booklet 2 Booklet 3 Booklet 4 Booklet 6 Booklet 7 26

27. Not Administered Codes – II • Not administered (8, 98) • Respondent was not administered a section of the booklet • Question (or page) was misprinted (or missing) in the booklet Enter 8 27

28. Required Information • Required information for entering test data  Student Tracking Form (column 9 or 12) • Student Achievement Test Booklet • Required information for entering reliability marking data  Student Tracking Form (column 9 or 12) • Constructed-Response Items Scoring Sheet for Double Scoring (Reliability Scoring Sheets) 29

29. Table of Content 1 Introduction 2 Sequence of Variables 3 Entering Data 4 Material for Data Entry 5 Example: Entering Student Achievement Data 6 Hands-On Training: Entering Achievement and Reliability Data 30

30. Show WinDEM Example – I • Start WinDEM • Create Student Test Data File from codebook file ISADEUF2.sdb D:\Seminar Examples\4_Work_WinDem\ISADEUF2.sdb 31

31. Show WinDEM Example – II • Enter... 1. Student label information 2. Booklet data 32

32. Table of Content 1 Introduction 2 Sequence of Variables 3 Entering Data 4 Material for Data Entry 5 Example: Entering Student AchievementData 6 Hands-On Training: Entering Achievement and Reliability Data 33

33. 20 min Hands-On TrainingSchools 8001 and 8502 • What you will need: • Student Tracking Forms • Student Achievement Test Booklets (Tab6) • Reliability Scoring Sheets (Tab7) • Codebooks in • What you will have to do: • Start WinDEM (Start  All Programs  IEA  WinDEM_ICCS09_MS  WinDEM_ICCS09_MS) • Create a data file from corresponding codebook (WinDEM menu FILE  NEW DATA FILE) • Enter data from booklet labels, booklets and Reliability Marking Sheets D:\Seminar Examples\4_Work_WinDem Login: user / bird

34. Hands-On TrainingEntering ACH Data for both Schools • What you will need: • Student Tracking Forms (Tab6) • Student Achievement Test Booklets (Tab6) • Codebook in • What you will have to do: • Start WinDEM (Start  All Programs  IEA  WinDEM_ICCS09_MS  WinDEM_ICCS09_MS ) • Create a data file from corresponding codebook (WinDEM menu FILE  NEW DATA FILE: ISADEUM2.dbf) • Enter data from booklet labels and booklets D:\Seminar Examples\4_Work_WinDem\ISADEUF2.sdb 35

35. Hands-On TrainingEntering REL Data for both Schools • What you will need:  Student Tracking Forms (Tab7) • Reliability Scoring Sheets (Tab7) • Codebook in • What you will have to do: • Start WinDEM (Start  All Programs  IEA  WinDEM_ICCS09_MS  WinDEM_ICCS09_MS) • Create a data file from corresponding codebook (WinDEM menu FILE  NEW DATA FILE: ISRDEUM2.dbf) • Enter data from booklet labels and Reliability Scoring Sheets D:\Seminar Examples\4_Work_WinDem\ISRDEUF2.sdb