130 likes | 727 Views
Validity. Validity is an overall evaluation that supports the intended interpretations, use, in consequences of the obtained scores. (McMillan 17). Characteristics of Validity. Validity is a matter of overall professional judgement.
E N D
Validity Validity is an overall evaluation that supports the intended interpretations, use, in consequences of the obtained scores. (McMillan 17)
Characteristics of Validity • Validity is a matter of overall professional judgement. • Validity refers to the accuracy of inferences, not to the test or procedure itself. • Validity is specific to particular uses in particular contents. • Validity is not an “all or none” judgement but a matter of degree.
Characteristics of Validity Cont. • Validity is a singular concept. • Validity is established with different types of evidence. • Validity is the joint responsibility of test developer and test user. (McMillan 19)
Sources of Validity Evidence Evidence Based On: • Test content or construct • Relations to other variables • Internal structure • Response processes and results • Consequences of assessment
Test Content or Construct • Domain • Professional Judgement • Design of Test Blueprint • Theoretical Models • Instructional Validity
Relations to Other Variables • Test-Criterion Relationships • Convergent and Discriminant Evidence
Internal Structure Extent to which items measuring the same thing are correlated.
Response Processes and Results • Check that the targeted processes or skills are being engaged. • Implement an intervention study.
Consequences of Assessments Could be both planned and unintended: • Does the assessment have the effect that the examiner wants? • Does the assessment result in negative outcomes in the school?
Suggestions for Enhancing Classroom Assessment Validity • Determine if different ways of assessing the same thing give similar results. • Ask other teachers to review your assessment for clarity and purpose. • Make sure to sample the performance or behavior several times. Don’t rely on a single measure. • Prepare a blueprint, and, prior to testing, share it with your students. • Ask other teachers to judge the match between the assessment and learning objectives.
Suggestions for Enhancing Classroom Assessment Validity Cont. • Compare one group of students who should obtain high scores with students of another group who should obtain low scores. • Compare scores obtained before instructions with scores obtained after instruction. • Compare predicted, intended consequences with actual consequences. • Use different methods to measure the same learning objective.
Works Cited • James H. McMillan, Essential Assessment Concepts for Teachers and Administrators. California: Thousand Oaks, 2001.