190 likes | 214 Views
Learn about the concepts of reliability and validity in measurement, including precision, accuracy, and influencing factors. Discover how to assess and ensure the consistency and appropriateness of test scores and interpretations. Differentiate between high reliability and high validity and understand the importance of precision for accuracy.
E N D
RELIABILTY AND VALIDITY FOR DUMMIES By: Jeremy Starkey Lijia Zhang November 4, 2002
RELIABILTY • Reliability is the consistency of measurement from one test to another.
PRECISION • Precision is defined as sharply or exactly defined; exact; particular.
VALIDITY • Validity is the appropriateness of the interpretations made from test scores (measurements) and other evaluation results.
ACCURACY • Accuracy is defined as done with care; exact; without error.
RELIABILITY • Factors that influence reliability are: • Length of test • Spread of scores • Difficulty of test • Objectivity of test
RELIABILITY • Longer the test, then usually the higher the reliability. • More questions on a test, then more reliable the test is.
RELIABILITY • Larger the spread of scores, then usually the higher the reliability.
RELIABILITY • Too easy or too hard tests results in low reliability because they restrict the spread of scores.
RELIABILITY • Multiple-choice questions are highly objective and can not be influenced by the scorer, thus should have a high reliability.
VALIDITY • Factors that influence validity: • unclear directions • reading vocabulary too difficult • ambiguity • inadequate time limits
VALIDITY • Three categories for accumulating evidence of validity: • Content Validity • Criterion-related validity • Construct Validity
VALIDITY • Content Validity determines the extent to which a set of tasks provide both a relevant and representative sample of the domain of tasks about which the tests score are made.
VALIDITY • Criterion-related evidence is the extent to which test performance is related to some other valued measure of performance.
VALIDITY • Construct Validity interprets test performance in terms of some psychological quality.
RELIABILITY VS. VALIDITY • If low reliability, then you can not have high validity. • High reliability can either have high validity or low validity. • You must have reliability of some sort before you have validity.
PRECISION VS. ACCURACY • If you have poor precision, then you can not have good accuracy. • If you have great precision, then you can either have good or poor accuracy. • You must have some sort of precision before you can be accurate.