1 / 18

What to learn and How to teach it: Critical appraisal of the Literature

What to learn and How to teach it: Critical appraisal of the Literature . Michele T. Pato, MD AAP-9/2011 (no conflicts of interest –funding, data or otherwise). Research Literacy and Scholarly Activity.

alena
Download Presentation

What to learn and How to teach it: Critical appraisal of the Literature

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. What to learn and How to teach it:Critical appraisal of the Literature Michele T. Pato, MD AAP-9/2011 (no conflicts of interest –funding, data or otherwise)

  2. Research Literacy andScholarly Activity Research literacy is the ability to critically appraise and understand the relevant research literature, and to apply research findings to clinical practice.

  3. Scholarly Activity = EBM “In a broader sense, Evidence Based Medicine’s goal is to regulate the way in which physicians gather, analyze, and use clinical information in their treatment of patients” Fauman MA, Psychiatric Times Feb 2002

  4. Scholarly activity • What is it- Scholarly Activity is an RRC requirement of residency training programs and includes promoting an environment of scholarship and inquiry within every training program.

  5. “Teaching Scholarly Activity in Residency Training” IoM in 2003 addresses 3 overarching issues important for the Future of Psychiatric Training. • The importance of having better and more data regarding the research workforce and society’s need for psychiatrist-researchers. • The need for more outcome data in ongoing and novel patient- oriented research training efforts. • The need for a national effort to promote, implement, and monitorthe training of psychiatrist-researchers

  6. The Endgame- in 5 minutes • In the end the real issue in any reading you do will be to judge the applicability to the population YOU are treating. • So at first look judge an articles by: • Title • Authors • References • The “Pictures”-(tables and figures) • The Abstract If you’re still interested READ ON!

  7. Critical Appraisal • Does the INTRO tell me WHY they are doing it? • Does the METHODS tell be WHATthey are doing in enough detail for GENERALIZABILITY & REPRODUCABILITY • Do I understand the RESULTS? • ARE their DISCUSSIONS/CONCLUSIONS clear?And Do I AGREE or DISAGREE? Why? • Will it change my Practice?-Should this be the FIRST question? DV Cone, EB. Lerner, DM Yealy, Prehospital Emergency Care 2002

  8. Critical Appraisal form for Journal ClubAdapted MT Pato from (E. Brooke Lerner 1999-version1.1) Name:_________________________Journal Club Date:____________ 1st Author, Title, Pub Date____________________________________________ Introduction: Hypothesis:______________________ Are objectives clearly stated? No Yes Methods: Study Design: Correlational Case Report Case Series Cross -Section Cohort Case control Experimental Meta-Analysis RCT Review –if yes-Where selection criteria specified? Yes/No Other_________ Time Frame: Prospective Retrospective Not Applicable Randomized: Random Nonrandom Not Applicable Blinded: Unblinded Single Blinded Double Blinded Not Applicable Enrollment: Convenience Consecutive Other________________________

  9. Methods continued SUBJECT+PROCEDURES: Subject Source (population)_________________________________________ Inclusion Criteria:_________________________________________________ Exclusion Criteria:_______________________________________________ How are controls different from cases?__________________Not applicable_____ Descriptive Variables:_________________________________________________ _________________________________________________ Outcome Variables: _________________________________________________ _________________________________________________________________ Main Dependent Variable______________________ Parametric Non-Parametric Main Independent Variable:_____________________Parametric Non-Parametric Statistical TestT-test ANOVA Kruskal-Wallis Mann Whitney (check all that Chi Square Fishers Exact Logistic Reg. Linear Reg. apply): Survial Analysis Other_____________ Not applicable Correlations Is There a Power Calculation? No Yes Alpha:_____ Beta:_____ Smallest Detectable Difference___________

  10. Results+ Discussion Results: Is there a difference between Groups: No Yes Not applicable Magnitude of the difference between groups?_______ 95%CI________ P Value____ List any other relevant findings?____________________________________________ ___________________________________________________________________ Percent of subjects lost to follow-up or non-response:_____% Are participants different from non-participants? No Yes If they are different: How are they different?___________________________ Discussion: Was there bias in the study? No Yes Where:_____________________________________ Who can the results be generalized to ?_______________________________________ Conclusion: So What??? Did the results support the hypothesis? No Yes Will you change you practice from this study? No Yes

  11. Statistics to Define (So they aren’t afraid to read the methods section) • Reliability = Reproducability • Validity= truly measuring the concept • Power= will you detect the difference if it exists • Kappa- can two people agree: >.7 • T-tests-as simple 2 group ANOVA • Correlations- If one changes does another: same direction (+) or different direction(-) • ANOVA-Analysis of Variance- Is the change due to what I did or just do to randomness of population? • Parametric vs Non-parametric- Nominal vs Ordinal/categorical • Chi squared- expected versus observed • Relative Risk and Odds Ratios- predictor to outcome

  12. Looking at any type of Article • Therapy-SO WHAT? IS THE OUTCOME IMPORTANT? • Diagnosis- WAS THERE A GOLDSTANDARD? • Screening- IS THE TEST SENSITIVE AND SPECIFIC? • Prognosis- SO WHAT? IS THE OUTCOME IMPORTANT? • Causation- DID THE CAUSEPRECEDE THE EFFECT? • Quality of care-ISCAREREALLY PROVIDED LIKETHIS? • Economic analysis- IS THE PROGRAM EFFECTIVE? • Review-WHAT WERE CRITERIA ARTICLE SELECTION? Sackett et al,Clinical Epidemiology: 1991, Little Brown and Co

  13. Keeping Track-Know your Gaps • Keep it simple • Decide ahead what types of articles and statistical methods you want covered • Use Critical Review Forms to ID Types of research and Types of statistics 4. Review what has been covered periodically • Biannually, Annually, Quarterly • Pick articles accordingly

  14. Tracking articles week to week

  15. Article Types# read Case report Case series RCT I Experimental I Cohort Case-control I Cross Sectional Correlational Meta-Analysis Statistical Methods #noted T-test I ANOVA I Chi-squared II Linear regression Logistic regression I Kruskal-Wallis Mann-Whitney Fishers-exact Survival Analysis Correlation coeff II Journal Club Master Sheet(topics you want covered-YEARLY)

  16. You can promote reading the literature as a life-long Pursuit rather than a chore. But REMEMBER: YOU CAN’T WIN THE LOTTERY IF YOU DON’T BUY A TICKET!!!

  17. Scholarly activity • What is it- Scholarly Activity is an RRC requirement of residency training programs and includes promoting an environment of scholarship and inquiry within every training program. • Scholarly Activity includes a broad range of activities from being able to critically appraise the scientific literature to participating in research that actually contributes to the literature.

More Related