190 likes | 213 Views
RELIABILTY AND VALIDITY FOR. DUMMIES. By: Jeremy Starkey Lijia Zhang November 4, 2002. RELIABILTY. Reliability is the consistency of measurement from one test to another. PRECISION. Precision is defined as sharply or exactly defined; exact; particular. VALIDITY.
E N D
RELIABILTY AND VALIDITY FOR DUMMIES By: Jeremy Starkey Lijia Zhang November 4, 2002
RELIABILTY • Reliability is the consistency of measurement from one test to another.
PRECISION • Precision is defined as sharply or exactly defined; exact; particular.
VALIDITY • Validity is the appropriateness of the interpretations made from test scores (measurements) and other evaluation results.
ACCURACY • Accuracy is defined as done with care; exact; without error.
RELIABILITY • Factors that influence reliability are: • Length of test • Spread of scores • Difficulty of test • Objectivity of test
RELIABILITY • Longer the test, then usually the higher the reliability. • More questions on a test, then more reliable the test is.
RELIABILITY • Larger the spread of scores, then usually the higher the reliability.
RELIABILITY • Too easy or too hard tests results in low reliability because they restrict the spread of scores.
RELIABILITY • Multiple-choice questions are highly objective and can not be influenced by the scorer, thus should have a high reliability.
VALIDITY • Factors that influence validity: • unclear directions • reading vocabulary too difficult • ambiguity • inadequate time limits
VALIDITY • Three categories for accumulating evidence of validity: • Content Validity • Criterion-related validity • Construct Validity
VALIDITY • Content Validity determines the extent to which a set of tasks provide both a relevant and representative sample of the domain of tasks about which the tests score are made.
VALIDITY • Criterion-related evidence is the extent to which test performance is related to some other valued measure of performance.
VALIDITY • Construct Validity interprets test performance in terms of some psychological quality.
RELIABILITY VS. VALIDITY • If low reliability, then you can not have high validity. • High reliability can either have high validity or low validity. • You must have reliability of some sort before you have validity.
PRECISION VS. ACCURACY • If you have poor precision, then you can not have good accuracy. • If you have great precision, then you can either have good or poor accuracy. • You must have some sort of precision before you can be accurate.