1 / 19

Reporting International Test Data Ch. 3 Measuring Civic Knowledge and Understanding

Reporting International Test Data Ch. 3 Measuring Civic Knowledge and Understanding. ICCS NRC meeting Madrid, Feb 2010. Measuring Civic and Citizenship Knowledge. Instrument Described scale Results. Measuring Civic and Citizenship Knowledge - Instrument.

kacia
Download Presentation

Reporting International Test Data Ch. 3 Measuring Civic Knowledge and Understanding

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Reporting International Test DataCh. 3 Measuring Civic Knowledge and Understanding ICCS NRC meeting Madrid, Feb 2010

  2. Measuring Civic and Citizenship Knowledge • Instrument • Described scale • Results

  3. Measuring Civic and Citizenship Knowledge - Instrument • 80 item (reduced to 79 - CI2HRM2 removed) • 73 MCQ, 6 constructed response • 62 new, 17 CIVED trend • Items showing extreme item by country interaction (>1.5 logits) removed from scaling for estimates of test scores in individual countries • Report to include example release items illustrating range of item types and content (including % correct by country and scale location)

  4. Measuring Civic and Citizenship Knowledge – Described Scale • rp = 0.62 (relative shift item difficulties = ln(0.62/0.36) ≈0.49 logits

  5. Measuring Civic and Citizenship Knowledge – Described Scale • Item map (ordered item descriptors)

  6. Measuring Civic and Citizenship Knowledge – Described Scale • Item map (ordered item descriptors) L3 563 0.8 logits L2 479 L1 395 B1

  7. Measuring Civic and Citizenship Knowledge – Described Scale 16 Items 39 Items 22 Items 2 Items

  8. Measuring Civic and Citizenship Knowledge – Described Scale

  9. Measuring Civic and Citizenship Knowledge – Described Scale

  10. Measuring Civic and Citizenship Knowledge – Described Scale

  11. Measuring Civic and Citizenship Knowledge – Described Scale Level 3: holistic; strategic Evaluation Level 2: interconnectedness of systems; wider sphere of citizen influence Specificity Level 1: broad concepts; “big ideas”; mechanistic

  12. Measuring Civic and Citizenship Knowledge – Results Comparison of means • Means range from 380 to 576 • Levels 1 to 3

  13. Measuring Civic and Citizenship Knowledge – Results Comparison of means Multiple comparison

  14. Measuring Civic and Citizenship Knowledge – Results • Comparison of levels

  15. Measuring Civic and Citizenship Knowledge – Results • Comparison of levels

  16. Measuring Civic and Citizenship Knowledge – Results • Comparison of levels

  17. Measuring Civic and Citizenship Knowledge – Results Gender differences in achievement • International means • Girls 511 • Boys 489 • Difference is statistically significant • Mean for girls higher in all countries • Statistically significantly higher in 32 countries • Range of mean differences 2 to 48 (median =22)

  18. Measuring Civic and Citizenship Knowledge – Results Trend Comparisons • Calculated only on the basis of 17 trend items (different metric to ICCS) • Dimensionality conflating results for complete scaling from both ends • CIVED through representativeness of trend items • ICCS through broadening of framework and constructs

  19. Measuring Civic and Citizenship Knowledge – Results Comparisons over time • 17 countries used same translations of CIVED items for comparison • CIVED population mean = 500 • ICCS population mean = 484 • Difference is statistically significant 5 countries (stat sig one country) 11 countries (stat sig six countries)

More Related