160 likes | 289 Views
FDA Anti-Infective Drugs Advisory Committee. Issues Regarding Choice of the Margin in Non-Inferiority Trials February 19, 2002 Thomas R. Fleming, Ph.D. Professor and Chair of Biostatistics University of Washington. Dual Goal of Non-Inferiority Trials. • To enable a direct evaluation
E N D
FDA Anti-Infective Drugs Advisory Committee Issues Regarding Choice of the Margin in Non-Inferiority Trials February 19, 2002 Thomas R. Fleming, Ph.D. Professor and Chair of Biostatistics University of Washington
Dual Goal of Non-Inferiority Trials • To enable a direct evaluation of the clinical efficacy of EXP relative to A.C. • To contribute evidence to the evaluation of efficacy of EXP relative to PLA
Factors Influencing the Choice of Margin and Interpretation of NI Trial Results • Clinical Relevance of Changes in: Benefits, Risks/Tolerance, Convenience, Resistance, etc. • Active Control Effect • Quality of the Design & Conduct of the NI Trial
Factors Influencing Choice of Margin •Clinical Relevance of Changes in: Benefits, Risks/Tolerance, Convenience, Resistance, etc. Clinical importance of: - reduction in efficacy by - altered safety/tolerance profile - altered convenience of administration - altered resistance or drug/drug interactions
•Active Control Effect ICH E9: “A suitable active comparator… could be a widely used therapy whose efficacy in the relevant indicator has been clearly established& quantified in well-designed & well documented superiority trials & which can be reliably expected to have similar efficacy in the contemplated AC trial.” Factors Influencing Choice of Margin
Factors Influencing Choice of Margin • Active Control Effect ~magnitude of Active Control effect Eg: = 45% – 80% = –35% ~precision of estimate Eg: 2 s.e. = 10% ( 175/arm ) ~estimates relevant to setting of NI trial •Population •Supportive care •Endpoint assessment PLA – AC Cure Rate * ( ) –45% –35%–25% –12.5% 0%
Factors Influencing Interpretation of Trial Results • • Quality of the Design & Conduct • of the NI Trial • ICH E9: “Many flaws in the design or conduct • of the trial will tend to bias the results • toward a conclusion of equivalence” • … it is especially important to minimize • incidence of violations in the entry criteria, • non compliance, withdrawals, • losses to follow-up, missing data • and other deviations in the protocol.”
Factors Influencing Interpretation of Trial Results • •ICH E9: … it is especially important to minimize... • losses to follow-up, missing data • “ITT” vs “Evaluable” ( variability & bias ) • •Absence of targeted microbial at baseline • •Not assessed due to: • ~ termination due to adverse clinical events • ~ termination due to perceived drug ineffectiveness • ~ treatment with prohibited concomitant interventions • ~ “missing” evaluations
Sample Sizes in Non-inferiority trials Non-inferiority trials having scientifically rigorous margins always require very large sample sizes... … fact or myth?
Illustration: AC Antibiotic having 80% Cure Rate Relative in Non-Cure Rate ( for EXP – AC Cure Rate ) 75% 50% 25% ~ 25% 50% – 15 – 10– 5 0 5 10
Probability of a Positive Trial as a function of true EXP–ACCure Rate Scenario #1 (Superiority) 2N = 340 Evaluable pts .025 .90 * –15 –10 –5 0 5 7.3 10 12
Probability of a Positive Trial as a function of true EXP–ACCure Rate Scenario #1 (Superiority) 2N = 340 Evaluable pts .025 .90 * –15 –10 –5 0 5 7.3 10 12 Scenario #2 (Non-Inferiority) 2N = 300 Evaluable pts .025 .18 .58 .90 * –15–10 –5.90 5 10
Probability of a Positive Trial as a function of true EXP–ACCure Rate Scenario #1 (Superiority) 2N = 340 Evaluable pts .025 .90 * –15 –10 –5 0 5 7.3 10 12 Scenario #2 (Non-Inferiority) 2N = 300 Evaluable pts .025 .18 .58 .90 * –15–10 –5.90 5 10 Scenario #3 (Non-Inferiority) 2N = 672 Evaluable pts .025 .367 .90 * –10–3.90 5 10
Probability of a Positive Trial as a function of true EXP–ACCure Rate Scenario #1 (Superiority) 2N = 340 Evaluable pts .025 .90 * –15 –10 –5 0 5 7.3 10 12 Scenario #2 (Non-Inferiority) 2N = 300 Evaluable pts .025 .18 .58 .90 * –15–10 –5.90 5 10 Scenario #3 (Non-Inferiority) 2N = 672 Evaluable pts .025 .367 .90 * –10–3.90 5 10 Scenario #4 (Non-Inferiority) 2N = 374 Evaluable pts .025 .238 .703 .90 * –15 –10–5 –2.1 0 3 5 10
“Bio-creep” with Repeated NI Trials Eg: Anti-viral Drugs Advisory Comm (10/4/01) Empiric Anti-fungal therapy of febrile neutropenic patients •Amphotericin B Deoxycholate •Ambisome vs Amphotericin B 49.9% v 49.1% Mucosis Study Gp #32 •Voriconazole vs Ambisome 23.7% v 30.1% 95% CI: (– 12, – 0.1)
Conclusions •ICH E10: “The determination of the margin in a non-inferiority trial is based on both statistical reasoning & clinical judgment, should reflect uncertainties in the evidence on which the choice is based, and should be suitably conservative.” • Non-inferiority trials having scientifically rigorous margins do not necessarily require very large sample sizes.