250 likes | 502 Views
Test Specification. Purposes, structure, nature and use. Contents:. Purposes Structure Nature Use. Test parameters. 1. Purpose. 1. Purpose. 1. Purpose. 2. Spec structure:. General Description (GD) Prompt Attribute (PA) Response Attribute (RA) Sample Item (SI). 3. Nature: Essence.
E N D
Test Specification Purposes, structure, nature and use
Contents: • Purposes • Structure • Nature • Use
2. Spec structure: • General Description (GD) • Prompt Attribute (PA) • Response Attribute (RA) • Sample Item (SI)
3. Nature: mix of ingredients • Test essence • Proficiency (psychological, cultural skills) • Criterion-referenced • Validity and consistency ………………………………. • Takes time (reiterative process) • Context dependent • Mandated • Takes team effort
4. Use: calibration • Internal • External
4. Internal calibration • Prompt Attribute (PA): general enough • Response Attribute (RA): observable
4. External calibration • Context & Mandate • Knowledge / skills selection • Spec writing • Item writing • Assemble test • Finalize, operationalize, measure
Spec structure: • General Description (GD) • Prompt Attribute (PA) • Response Attribute (RA) • Sample Item (SI)
Review: • Purposes • Structure • Nature • Use
Today’s tasks • Matching line numbers: spec features with their reflections in the SI • Identification of deviations from a spec in its SI • Generating (writing) a SI from a spec
Task 1 Match the following line numbers of the spec with lines of its Sample Item in which spec characteristics are reflected. Make collective decisions.
Task 2 Identify deviations from the spec in its Sample Item. In your worksheet, write down the SI line number in which a deviations is identified and explain it. Make group decisions.
Task 3 Generate (write) a Sample Item from the spec. Discuss your decisions with your partners.