Download
1 / 21
210 likes | 397 Views
Sample Size & Power Estimation: Software Issues. Paul J Nietert, PhD April 25, 2011 Computing for Research. Intermission. General Comments. Can consume much of a collaborative biostatistician’s time Really only relevant in the context of hypothesis testing and in estimation precision
E N D
Sample Size & Power Estimation: Software Issues Paul J Nietert, PhD April 25, 2011 Computing for Research
General Comments • Can consume much of a collaborative biostatistician’s time • Really only relevant in the context of hypothesis testing and in estimation precision • If there are multiple Aims within a proposal, make sure that each is properly powered. • It can be helpful to perform computations in 2 or more different software programs.
More General Comments • Can be somewhat of an art form • Before proposing a sample size, get a sense from the other investigators what sample sizes are even feasible (know resource limitations). • Make sure you understand the hypotheses that are to be tested. • Make sure you understand the study design.
More General Comments • A well-written sample size estimation section in a grant can convince the reviewers that you know what you’re doing. • A poorly-written sample size estimation section in a grant can convince the reviewers that you don’t know what you’re doing. • Sometimes PIs will calculate a sample size on their own. Double check these, and make sure their rationale is sound. Don’t be afraid to ask how they arrived at their estimate.
Understanding the Term “Effect Size” • In a very general sense, this is the magnitude of the summary statistic you plan to use for your hypothesis test • Difference in means • Difference in proportions • Odds ratio, Risk ratio • Correlation
Understanding the Term “Effect Size” • Often this refers to Cohen’s D: • Small: 0.2 • Medium: 0.5 • Large: >0.8 • An effect size of 1 is equivalent of a 1 standard deviation unit difference between groups. • Can be helpful when trying to justify a sample size when little pilot data exist. • Ex. “With 20 subjects per group, we’ll be able to detect an effect size of 0.9 (i.e. a large effect) with 80% power, assuming 2-sided hypothesis testing and an alpha level of 0.05.”
Software • Free (online, downloadable) – careful! • Moderately priced • Expensive
Sample Size Survey Results • 14 Faculty – PhD • 7 Faculty – RA • 9 Students
Intermission #2 • Copy & Paste a column
Examples • nQuery • PASS • SAS Power & Sample Size • Simulation (simple independent sample T-test example)
Example • An investigator wishes to investigate a 2-way interaction between 2 risk factors (RF) for a disease. • The prevalence of RF1 and RF2 is 20% and 30%, respectively. 5% have both RF1 and RF2. • The baseline rate of developing disease within a year is know to be 10% (no RFs). • The RR of developing disease within 1 year associated with each of the RFs is 1.5, but the hypothesis is that if both RF1 and RF2 are present, the RR is 5.0. • How many subjects are needed to detect this interaction effect?
