130 likes | 342 Views
Reliability. Consistent Dependable Replicable Stable. Threats to reliability. Construction Administration (tester, testee, environment) Scoring Interpretation. Two Administrations. Test/retest same test - same group Parallel/Alternate forms different tests - same group.
E N D
Reliability • Consistent • Dependable • Replicable • Stable
Threats to reliability • Construction • Administration (tester, testee, environment) • Scoring • Interpretation
Two Administrations • Test/retest same test - same group • Parallel/Alternate forms different tests - same group
One Administration Internal consistency One test - one group - one administration • Split Half first/second or odd/even halves???? Spearman-Brown formula • Statistical estimation Kuder-Richardson Formula 20 (KR20) Cronbach alpha (alpha coefficient) • (factor analysis)
Reliability coefficient • 0.00 - 1.00 • higher is better • score is relative, not absolute
Inter-rater reliability • Consensus • Percentage of agreement • Kappa statistic (2 or many raters)
Project homework • Which approach (and why) would you use to determine the reliability of your measure?