50 likes | 211 Views
Small Scale Clinical Trials. Alternate Form. Internal Consistency. Test-Retest. Short Length. Reliability. Reliability. 60. 60. 60. 60. 40. 40. 40. 40. # of Experts. # of Experts. # of Experts. 20. 20. 20. 20. 0. 0. 0. 0. 0. 1. 2. 3. 4. 0. 1. 2. 3. 4. 0. 1. 2.
E N D
Small Scale Clinical Trials Alternate Form Internal Consistency Test-Retest Short Length Reliability Reliability 60 60 60 60 40 40 40 40 # of Experts # of Experts # of Experts 20 20 20 20 0 0 0 0 0 1 2 3 4 0 1 2 3 4 0 1 2 3 4 0 1 2 3 4 Very Helpful but not Essential Very Helpful but not Essential Very Helpful but not Essential Very Helpful but not Essential Very Helpful but not Essential Very Helpful but not Essential Very Helpful but not Essential Very Helpful but not Essential Somewhat Essential Somewhat Essential Somewhat Essential Somewhat Essential Somewhat Essential Somewhat Essential Somewhat Essential Somewhat Essential Somewhat Helpful Somewhat Helpful Somewhat Helpful Somewhat Helpful Somewhat Helpful Somewhat Helpful Somewhat Helpful Somewhat Helpful Very Essential Very Essential Very Essential Very Essential Very Essential Very Essential Very Essential Very Essential Not Helpful Not Helpful Not Helpful Not Helpful Not Helpful Not Helpful Not Helpful Not Helpful Mean: 2.9 Median: 3.0 Mean: 3.5 Median: 4.0 Mean: 2.4 Median: 2.0 Mean: 2.2 Median: 2.0 # of Experts Adequate Number of Trials Construct Validity Lack of Practice Lack of Ceiling/Floor for Robust Estimate Effects Effects 60 60 60 60 Mean: 2.9 Median: 3.0 Mean: 3.3 Median: 3.5 Mean: 2.4 Median: 2.0 Mean: 3.2 Median: 3.0 40 40 40 40 # of Experts # of Experts # of Experts # of Experts 20 20 20 20 0 0 0 0 0 1 2 3 4 0 1 2 3 4 0 1 2 3 4 0 1 2 3 4
Large Scale Clinical Trials Internal Consistency Test-Retest Alternate Form Short Length Reliability Reliability 60 60 60 60 40 40 40 40 # of Experts # of Experts # of Experts # of Experts 20 20 20 20 0 0 0 0 0 1 2 3 4 0 1 2 3 4 0 1 2 3 4 0 1 2 3 4 Very Helpful but not Essential Very Helpful but not Essential Very Helpful but not Essential Very Helpful but not Essential Very Helpful but not Essential Very Helpful but not Essential Very Helpful but not Essential Very Helpful but not Essential Somewhat Essential Somewhat Essential Somewhat Essential Somewhat Essential Somewhat Essential Somewhat Essential Somewhat Essential Somewhat Essential Somewhat Helpful Somewhat Helpful Somewhat Helpful Somewhat Helpful Somewhat Helpful Somewhat Helpful Somewhat Helpful Somewhat Helpful Very Essential Very Essential Very Essential Very Essential Very Essential Very Essential Very Essential Very Essential Not Helpful Not Helpful Not Helpful Not Helpful Not Helpful Not Helpful Not Helpful Not Helpful Lack of Practice Construct Validity Adequate Number of Trials Lack of Ceiling/Floor Effects for Robust Estimate Effects 60 60 60 40 40 40 # of Experts # of Experts # of Experts 20 20 20 0 0 0 0 0 1 2 3 4 0 1 2 3 4 0 1 2 3 4 0 1 2 3 4 Mean: 3.0 Median: 3.0 Mean: 3.3 Median: 4.0 Mean: 2.6 Median: 3.0 Mean: 2.8 Median: 3.0 60 Mean: 2.9 Median: 3.0 Mean: 3.2 Median: 3.0 Mean: 2.5 Median: 2.0 Mean: 3.2 Median: 3.0 40 # of Experts 20
Small Scale - Top Two By Area • Clinical Trials in Schizophrenia • Test-Retest Reliability • Lack of Ceiling/Floor Effects • Cognitive Neuroscience of Schizophrenia • Construct Validity • Test-Retest Reliability • Cognitive Rehab of Schizophrenia • Construct Validity • Test-Retest Reliability • Human Cognitive Neuroscience • Construct Validity • Lack of Ceiling/Floor Effects • Animal Cognitive Neuroscience • Test-Retest Reliability • Construct Validity
Large Scale - Top Two By Area • Clinical Trials in Schizophrenia • Test-Retest Reliability • Lack of Ceiling/Floor Effects • Cognitive Neuroscience of Schizophrenia • Test-Retest Reliability • Lack of Ceiling/Floor Effects • Cognitive Rehab of Schizophrenia • Construct Validity • Test-Retest Reliability • Human Cognitive Neuroscience • Construct Validity • Lack of Ceiling/Floor Effects • Animal Cognitive Neuroscience • Internal Consistency • Lack of Ceiling/Floor Effects
Benchmark Values - Entire Sample Characteristic Optimal “Worst Acceptable” Internal Consistency .85 .60 Test-Retest .90 .70 Alternate Form .90 .65 Length (in minutes) 15 min 30 min Minimum # of Trials 30 trials 15 trials Practice Effect (in SD units) .20 SD .50 SD Floor Effect (% diff from 0) 20% 10% Ceiling Effect (% diff from 100) 25% 15% Benchmark Values - Higher Confidence Characteristic Optimal “Worst Acceptable” Internal Consistency .875 .60 Test-Retest .90 .70 Alternate Form .90 .70 Length (in minutes) 10 min 30 min Minimum # of Trials 25 trials 10 trials Practice Effect (in SD units) .20 SD .50 SD Floor Effect (% diff from 0) 25% 10% Ceiling Effect (% diff from 100) 37.5% 12.5%