150 likes | 378 Views
Randomized Clinical Trials : The Versatility, and Malleability of the “Gold Standard”. “Get your facts first, then you can distort them as you please.” (Mark Twain). Wing Institute Jack States Ronnie Detrich Randy Keyworth. Randomized Clinical Trials (RCT) History.
E N D
Randomized Clinical Trials: The Versatility, and Malleability of the “Gold Standard” “Get your facts first, then you can distort them as you please.”(Mark Twain) Wing Institute Jack States Ronnie Detrich Randy Keyworth
Randomized Clinical Trials (RCT)History • The use of RCT in agricultural experiments was pioneered by R. A. Fisher in the 1920’s. • The Tuberculosis Trials evaluating the effectiveness of streptomycin, is generally accepted as the first RCT - Post World War II
Randomized Clinical TrialDefinition A research study in which the participants are assigned groups to objectively compare different interventions. • The use of chance to assign groups results in groups being similar • The effects of the intervention can be calculated based upon the statistical assumption that any error (a). can be calculated; and (b) can be made very small
Why Use Randomized Clinical Trial? “To make statements of cause and effect regarding an intervention” • A sound scientific method • Established track record as an accepted methodology
How Does Randomized Clinical Trial Achieve It’s Designed Purpose? Control for Bias • Subject Selection Bias • Increases the internal validity by minimizing subject differences. • Study Evaluation Bias • Avoidance of inadvertent tampering with results
Strengths of RCT Design • Statements of internal validity • Statements of external validity (limited by selection of study participants) • Demonstrates strong social validity as most commonly accepted method for evaluating research • Governmental entities - World Health Organization and US Department of Education • Professional associations - AMA and APA • Advocacy organizations - Cochrane and Campbell Collaborations
Benefits of Randomized Clinical Control Design • Valuable tool for making policy decisions in the selection of universal interventions • When combined in a public health model RCT offers a cost effective strategy to influence behavior on a broad scale • A way to avoid politically motivated, fad-of-the-month educational practices
Limitations Philosophical Issues • Ethical Issues - “RCT creates a moral dilemma” • Practitioner has an obligation to chose an intervention in the best interest of subjects • Formal process employed to protect subjects • Cultural acceptability within the field of education
Limitations Strategic Issues • Single studies are not sufficient to establish causation • Difficult with low incident populations • Requires specialized expertise to implement, analyze data, set-up “If you torture data sufficiently, it will confess to almost anything” Dr.Fred Menger
Limitations Strategic Issues • Limited ability for use making conclusions for individuals • Substantial time required to complete studies • Limited number of data points per condition (you can’t see how independent variable “works” only that it works)
Limitations Tactical Issues • Issues of treatment integrity • Timely response to proliferation of new practices Logistical Issues • Challenges finding adequate numbers of subjects • Expensive requiring substantial resources • Limited number of studies currently available
Issues for Behavior Analysis (BA) • RCT is considered a social science methodology vs. the natural science methodology preferred by BA • BA’s focus is on the individual and the methodology of choice is Single Subject Design Question “Should BA become an active participant in the use of RCT?”
Recommendations BA needs to participate in use of RCT • To remain a player in discussion and policy making • Increase the use of RCT when appropriate “To make the general contributions of which our science is capable, behavior analysts will have to use methods of wider generality, in the sense they affect many people at the same time.” Murray Sidman The Behavior Analyst - Fall 2006
Recommendations • Increase the number of studies • Increase education and training of consumers and practitioners in strength and weakness of RCT • Integrate RCT into an effective “Hierarchy of Evidence” model that takes advantage of different methodologies.
Recommendations • Expand the value of clearinghouses • Easier access clearinghouses information • More timely delivery of results to stakeholders • Improve the accessibility of the results for stakeholders • Increase and improve research synthesis