70 likes | 84 Views
IOM workshop: finding and assessing individual studies. David Tovey Editor in Chief, The Cochrane Library. Agenda. General Comments Search and identifying studies Appraising individual studies What challenges?. General comments. Fantastic piece of work Good timing......almost
E N D
IOM workshop: finding and assessing individual studies David ToveyEditor in Chief, The Cochrane Library
Agenda • General Comments • Search and identifying studies • Appraising individual studies • What challenges?
General comments • Fantastic piece of work • Good timing......almost • Moves systematic reviews to the next stage • Sets the bar high, but appropriate • Can’t cut corners....we agree!
Search and identifying studies • Very close to Cochrane model • Importance of protocol and utilising appropriate expertise; should include search strategy - and line-by-line search strings • Peer review of search • Unpublished studies and missing data • Importance of registries, conference abstracts, contacts with triallists, industry etc • No RCT filters...surprising? • Observational studies for harms (and benefits?) • Large administrative databases • Studies in LOE & updating searches prior to publication
Appraising individual studies • Importance of pre-specification of criteria in protocol • Dual appraisal/screening and dual data extraction • Importance of selective outcome reporting bias • Implies need to access trial protocol • Risk of bias: critical step • Per-outcome or per-study • Concept of intervention “fidelity” • What is the intervention and how reproducible is it? • How was it delivered
Challenges and major themes • Cost – quality – timeliness triad • Reporting bias & unpublished studies • Importance of licensing agency data • Observational studies • “Extended”, complex and different types of review • Knowledge translation and implementation • Relevance, applicability and timeliness
Summary • A major step forward • Some differences, but • Some minor and bridgeable • Some reflect different purpose and structures • Agreement on major challenges • Strong arguments for increasing co-operation between agencies • Reduce duplication, improve efficiency and quality