440 likes | 826 Views
META-ANALYSIS. Dr. Ken Kavale. META-ANALYSIS. Quantitative Research Synthesis “What the research says” Knowledge Accumulation Usable Knowledge. METHODS OF RESEARCH SYNTHESIS. Narrative Review Serial Presentation No Accumulation Findings remain independent and isolated If Accumulated
E N D
META-ANALYSIS Dr. Ken Kavale
META-ANALYSIS Quantitative Research Synthesis “What the research says” Knowledge Accumulation Usable Knowledge
METHODS OF RESEARCH SYNTHESIS Narrative Review Serial Presentation No Accumulation Findings remain independent and isolated If Accumulated SUBJECTIVE
QUANTITATIVE REVIEWS Voting Method Box-Score Analysis Studies classified by statistical significance or non-significance What is statistical significance? Publication Bias (“File Drawer Problem”)
META-ANALYSIS Advantages • Uses quantitative (statistical) methods for organizing and extracting information • Eliminates study selection bias – no prejudgments about research quality are made • Makes use of all information – findings are transformed to commensurate expressions of effect magnitude
META-ANALYSIS (con’t) • Detects interactions – study characteristics that may mediate findings are defined and measured, and their covariation is investigated • Seeks general conclusions – practical simplicity OBJECTIVITY VERIFIABILITY REPRODUCABILITY
METHODS OF META-ANALYSIS Scientific Method Formulating Problems Broadly defined “Is Method x effective?” Sampling Literature search - Comprehensive - Published and unpublished
METHODS OF META-ANALYSIS (con’t) Classifying and Coding Studies Study features Data Analysis Effect Size – z score (standard deviation units) __ __ ES =XE– XC SDC
METHODS OF META-ANALYSIS (con’t) Effect Size Interpretation • Overlapping distributions and comparable percentiles • Comparative context • Statistical power – small (.20), medium (.50), large (.80>) • Binomial effect size display (BESD) – practical significance • Common language effect size – research significance
PERCEPTUAL-MOTOR TRAINING EFFECT SIZE .08
MODALITY-MATCHED INSTRUCTION(Learning Styles) EFFECT SIZE .14
STIMULANT MEDICATION EFFECT SIZE .58 .67
FEINGOLD DIET EFFECT SIZE .12
INTERVENTIONS FOR ADHD Stimulant Medication Feingold Diet Effect SizeEffect Size .63 .12 Treatment Duration Stimulant MedicationFeingold Diet 10 weeks 39 weeks Comparison Stimulant medication better than 5X more effective than the Feingold diet in ¼ the time
SPECIAL CLASS PLACEMENT EFFECT SIZE -.12
SOCIAL SKILLS TRAINING EFFECT SIZE .21 .20