1 / 27

The reporting of diagnostic accuracy in obstetrics and gynecology literature

The reporting of diagnostic accuracy in obstetrics and gynecology literature. an overview on the report quality between 1980 and 2005.

pravat
Download Presentation

The reporting of diagnostic accuracy in obstetrics and gynecology literature

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. The reporting of diagnostic accuracy in obstetrics and gynecology literature an overview on the report quality between 1980 and 2005 Class1 :Ana Costa, André Sena, Duarte Pinto, Inês Brandão, João Silva, Lídia Sousa, Luís Barros, Márcia Marinho, Maria Rocha, Pedro Falcão, Rafael Silva, Sara Tapa, Susana Franco. Supervisors:Altamiro da Costa Pereira, MD, PhD; Cristina Santos, MD, PhD Introduction to Medicine; Porto Faculty of Medicine 2006/2007

  2. Introduction Objectives Methods Results Acknowledgments The reporting of diagnostic accuracy in obstetrics and gynecology literature: an overview on the report quality between 1980 and 2005 2006/2007

  3. Introduction Objectives Methods Results Acknowledgments Obstetrics and Gynecology are branches of medicine (Cunningham, 2005 and Berek, 1996) These areas depend on diagnostic tests (Bossuyt, 2003) Studies of new diagnostic tests, and their improvements, are reported in scientific articles This studies, and their reporting, are not always well design and this may lead to unwanted consequences (Bossuyt, 2003) Cunningham, F.Gary. Williams obstetrics, 26 edição (2005) Berek, Jonathan S. Novak’s gynecology 12 edição (1996) Bossuyt PM, Reitsma JB, Bruns DE, et al. Towards complete and accurate reporting of studies of diagnostic accuracy: the STARD initiative. Annuals of internal Medicine. 2003 The reporting of diagnostic accuracy in obstetrics and gynecology literature: an overview on the report quality between 1980 and 2005 2006/2007

  4. Introduction Objectives Methods Results Acknowledgments Studies to determinate the diagnostic accuracy are a vital part in the rigorous evaluation process of diagnostic tests (Bossuyt, 2003 and Deeks, 2001) The diagnostic accuracy can be expressed in many ways, including sensitivity and specificity, likelihood ratios and diagnostic odds ratio (Bossuyt, 2003 and Deeks, 2001) STARD was created to guideline the reporting of studies of diagnostic accuracy (Smidt, 2006) Bossuyt PM, Reitsma JB, Bruns DE, et al. The STARD statement for reporting studies of diagnostic accuracy: explanation and elaboration. Clin Chem 2003 Deeks J. Systematic reviews in health care: systematic reviews of diagnostic tests. BMJ 2001 Smidt N, Rutjes A WS, et al. Reproducibility of the STARD checklist: an instrument to assess the quality of reporting of diagnostic accuracy studies. BMC 2006 The reporting of diagnostic accuracy in obstetrics and gynecology literature: an overview on the report quality between 1980 and 2005 2006/2007

  5. Introduction Objectives Methods Results Acknowledgments To analyze the evolution of the reporting of diagnostic accuracy in obstetrics and gynecology literature (according to STARD parameters), between 1980 and 2005 To check the improvements that have being made and what still needs to be improved. The reporting of diagnostic accuracy in obstetrics and gynecology literature: an overview on the report quality between 1980 and 2005 2006/2007

  6. Introduction Objectives Methods Results Acknowledgments Articles’ search Articles’ selection Articles’ evaluation Statistical analyze The reporting of diagnostic accuracy in obstetrics and gynecology literature: an overview on the report quality between 1980 and 2005 2006/2007

  7. Introduction Objectives Methods Results Acknowledgments Standard query to find articles that report studies of diagnostic accuracy (in PubMed) Articles’ search Articles’ selection Articles’ evaluation Statistical analyze (((((((("sensitivity and specificity"[All Fields] OR "sensitivity and specificity/standards"[All Fields]) OR "specificity"[All Fields]) OR "screening"[All Fields]) OR "false positive"[All Fields]) OR "false negative"[All Fields]) OR "accuracy"[All Fields]) OR (((("predictive value"[All Fields] OR "predictive value of tests"[All Fields]) OR "predictive value of tests/standards"[All Fields]) OR "predictive values"[All Fields]) OR "predictive values of tests"[All Fields])) OR (("reference value"[All Fields] OR "reference values"[All Fields]) OR "reference values/standards"[All Fields]) OR ((((((((((("roc"[All Fields] OR "roc analyses"[All Fields]) OR "roc analysis"[All Fields]) OR "roc and"[All Fields]) OR "roc area"[All Fields]) OR "roc auc"[All Fields]) OR "roc characteristics"[All Fields]) OR "roc curve"[All Fields]) OR "roc curve method"[All Fields]) OR "roc curves"[All Fields]) OR "roc estimated"[All Fields]) OR "roc evaluation"[All Fields]) OR "likelihood ratio"[All Fields]) Devillé, W. L. et. al., Conducting systematic reviews of diagnostic studies: didactic guidelines. BMC Medical Research Methodology 2002 The reporting of diagnostic accuracy in obstetrics and gynecology literature: an overview on the report quality between 1980 and 2005 2006/2007

  8. Introduction Objectives Methods Results Acknowledgments Search for the journals Articles’ search Articles’ selection Articles’ evaluation Statistical analyze query: gynecology[Subject Terms] OR obstetrics[Subject Terms] The reporting of diagnostic accuracy in obstetrics and gynecology literature: an overview on the report quality between 1980 and 2005 2006/2007

  9. Introduction Objectives Methods Results Acknowledgments Final query (after addition of terms to specify the search to the journals) (((((((("sensitivity and specificity"[All Fields] OR "sensitivity and specificity/standards"[All Fields]) OR "specificity"[All Fields]) OR "screening"[All Fields]) OR "false positive"[All Fields]) OR "false negative"[All Fields]) OR "accuracy"[All Fields]) OR (((("predictive value"[All Fields] OR "predictive value of tests"[All Fields]) OR "predictive value of tests/standards"[All Fields]) OR "predictive values"[All Fields]) OR "predictive values of tests"[All Fields])) OR (("reference value"[All Fields] OR "reference values"[All Fields]) OR "reference values/standards"[All Fields]) OR ((((((((((("roc"[All Fields] OR "roc analyses"[All Fields]) OR "roc analysis"[All Fields]) OR "roc and"[All Fields]) OR "roc area"[All Fields]) OR "roc auc"[All Fields]) OR "roc characteristics"[All Fields]) OR "roc curve"[All Fields]) OR "roc curve method"[All Fields]) OR "roc curves"[All Fields]) OR "roc estimated"[All Fields]) OR "roc evaluation"[All Fields]) OR "likelihood ratio"[All Fields]) AND ("Acta Ginecol (Madr)"[Journal] OR "Acta Gynaecol Obstet Hisp Lusit"[Journal] OR "Acta Obstet Ginecol Hisp Lusit"[Journal] OR "Acta Obstet Ginecol Hisp Lusit Suppl"[Journal] OR "Acta Obstet Gynaecol Jpn"[Journal] OR "Acta Obstet Gynecol Scand"[Journal] OR "Acta Obstet Gynecol Scand Suppl"[Journal] OR "Akush Ginekol (Mosk)"[Journal] OR "Akush Ginekol (Sofiia)"[Journal] OR "Am J Obstet Gynecol"[Journal] OR "An Bras Ginecol"[Journal] OR "Ann Chir Gynaecol"[Journal] OR "Ann Chir Gynaecol Fenn"[Journal] OR "Ann Chir Gynaecol Fenn Suppl"[Journal] OR "Ann Chir Gynaecol Suppl"[Journal] OR "Ann Ostet Ginecol Med Perinat"[Journal] OR "Arch Gynakol"[Journal] OR "Arch Gynecol"[Journal] OR "Arch Gynecol Obstet"[Journal] OR "Arch Ostet Ginecol"[Journal] OR "Asia Oceania J Obstet Gynaecol"[Journal] OR "Attual Ostet Ginecol"[Journal] OR "Aust Coll Midwives Inc J"[Journal] OR "Aust J Midwifery"[Journal] OR "Aust N Z J Obstet Gynaecol"[Journal] OR "Aust N Z J Obstet Gynaecol Suppl"[Journal] OR "AWHONN Lifelines"[Journal] OR "AWHONN Voice"[Journal] OR "AWHONNS Clin Issues Perinat Womens Health Nurs"[Journal] OR "Baillieres Best Pract Res Clin Obstet Gynaecol"[Journal] OR "Baillieres Clin Obstet Gynaecol"[Journal] OR "Best Pract Res Clin Obstet Gynaecol"[Journal] OR "Bibl Gynaecol"[Journal] OR "Biol Res Pregnancy Perinatol"[Journal] OR "Birth"[Journal] OR "Birth Gaz"[Journal] OR "BJOG"[Journal] OR "Br J Obstet Gynaecol"[Journal] OR "Breast Dis"[Journal] OR "Bull Am Coll Nurse Midwifery"[Journal] OR "Bull Am Coll Nurse Midwives"[Journal] OR "Bull Fed Soc Gynecol Obstet Lang Fr"[Journal] OR "Bull Soc R Belge Gynecol Obstet"[Journal] OR "Cesk Gynekol"[Journal] OR "Ceska Gynekol"[Journal] OR "Climacteric"[Journal] OR "Clin Exp Hypertens B"[Journal] OR "Clin Exp Obstet Gynecol"[Journal] OR "Clin Ginecol"[Journal] OR "Clin Obstet Gynaecol"[Journal] OR "Clin Obstet Gynecol"[Journal] OR "Complement Ther Clin Pract"[Journal] OR "Complement Ther Nurs Midwifery"[Journal] OR "Contracept Fertil Sex"[Journal] OR "Contrib Gynecol Obstet"[Journal] OR "Curr Opin Obstet Gynecol"[Journal] OR "Curr Pract Obstet Gynecol Nurs"[Journal] OR "Diagn Gynecol Obstet"[Journal] OR "Early Pregnancy"[Journal] OR "Early Pregnancy"[Journal] OR "Eur J Gynaecol Oncol"[Journal] OR "Eur J Obstet Gynecol Reprod Biol"[Journal] OR "Fetal Diagn Ther"[Journal] OR "Fetal Ther"[Journal] OR "Fortschr Geburtshilfe Gynakol"[Journal] OR "Geburtshilfe Frauenheilkd"[Journal] OR "Ginecol Obstet Mex"[Journal] OR "Ginekol Pol"[Journal] OR "Gynaecologia"[Journal] OR "Gynakol Geburtshilfliche Rundsch"[Journal] OR "Gynakol Rundsch"[Journal] OR "Gynakologe"[Journal] OR "Gynecol Endocrinol"[Journal] OR "Gynecol Invest"[Journal] OR "Gynecol Obstet (Paris)"[Journal] OR "Gynecol Obstet Fertil"[Journal] OR "Gynecol Obstet Invest"[Journal] OR "Gynecol Oncol"[Journal] OR "Gynecol Prat"[Journal] OR "Gynecologie"[Journal] OR "Hypertens Pregnancy"[Journal] OR "Infect Dis Obstet Gynecol"[Journal] OR "Int J Biol Res Pregnancy"[Journal] OR "Int J Fertil"[Journal] OR "Int J Fertil Menopausal Stud"[Journal] OR "Int J Fertil Womens Med"[Journal] OR "Int J Gynaecol Obstet"[Journal] OR "Int J Gynecol Cancer"[Journal] OR "Int J Gynecol Pathol"[Journal] OR "Int J Obstet Anesth"[Journal] OR "Int Urogynecol J Pelvic Floor Dysfunct"[Journal] OR "J Am Assoc Gynecol Laparosc"[Journal] OR "J Am Coll Surg"[Journal] OR "J Br Menopause Soc"[Journal] OR "J Gynecol Obstet Biol Reprod (Paris)"[Journal] OR "J Gynecol Surg"[Journal] OR "J Hum Lact"[Journal] OR "J Jpn Obstet Gynecol Soc"[Journal] OR "J Low Genit Tract Dis"[Journal] OR "J Matern Fetal Med"[Journal] OR "J Matern Fetal Neonatal Med"[Journal] OR "J Midwifery Womens Health"[Journal] OR "J Minim Invasive Gynecol"[Journal] OR "J Obstet Gynaecol"[Journal] OR "J Obstet Gynaecol"[Journal] OR "J Obstet Gynaecol Br Commonw"[Journal] OR "J Obstet Gynaecol Can"[Journal] OR "J Obstet Gynaecol India"[Journal] OR "J Obstet Gynaecol Res"[Journal] OR "J Obstet Gynecol Neonatal Nurs"[Journal] OR "J Pediatr Adolesc Gynecol"[Journal] OR "J Psychosom Obstet Gynaecol"[Journal] OR "J Sex Med"[Journal] OR "J Soc Gynecol Investig"[Journal] OR "J SOGC"[Journal] OR "J Womens Health"[Journal] OR "J Womens Health (Larchmt)"[Journal] OR "J Womens Health Gend Based Med"[Journal] OR "Josanpu Zasshi"[Journal] OR "Jugosl Ginekol Opstet"[Journal] OR "Jugosl Ginekol Perinatol"[Journal] OR "Major Probl Obstet Gynecol"[Journal] OR "Med Gynaecol Androl Sociol"[Journal] OR "Menopause"[Journal] OR "Midwife Health Visit"[Journal] OR "Midwifery"[Journal] OR "Midwifery Today Childbirth Educ"[Journal] OR "Midwifery Today Int Midwife"[Journal] OR "Midwives"[Journal] OR "Midwives Chron"[Journal] OR "Minerva Ginecol"[Journal] OR "Mod Midwife"[Journal] OR "NAACOG Tech Bull"[Journal] OR "Ned Tijdschr Verloskd Gynaecol"[Journal] OR "Nippon Sanka Fujinka Gakkai Zasshi"[Journal] OR "Nurs Mirror Midwives J"[Journal] OR "Obstet Ginecol (Bucur)"[Journal] OR "Obstet Ginecol Lat Am"[Journal] OR "Obstet Gynecol"[Journal] OR "Obstet Gynecol Annu"[Journal] OR "Obstet Gynecol Clin North Am"[Journal] OR "Obstet Gynecol Surv"[Journal] OR "Pak J Surg Gynaecol Obstet"[Journal] OR "Patol Clin Ostet Ginecol"[Journal] OR "Pediatr Akus Ginekol"[Journal] OR "Placenta"[Journal] OR "Placenta Suppl"[Journal] OR "Pract Midwife"[Journal] OR "Prenat Diagn"[Journal] OR "Prim Care Update Ob Gyns"[Journal] OR "Prof Care Mother Child"[Journal] OR "Quad Clin Ostet Ginecol"[Journal] OR "RCM Midwives"[Journal] OR "RCM Midwives J"[Journal] OR "Ref Gynecol Obstet"[Journal] OR "Rev Chil Obstet Ginecol"[Journal] OR "Rev Clin Inst Matern Lisb"[Journal] OR "Rev Colomb Obstet Ginecol"[Journal] OR "Rev Esp Obstet Ginecol"[Journal] OR "Rev Fr Gynecol Obstet"[Journal] OR "Rev Ginecol Obstet (Sao Paulo)"[Journal] OR "Rev Mex Cir Ginecol Cancer"[Journal] OR "Rev Obstet Ginecol Venez"[Journal] OR "Rev Pediatr Obstet Ginecol Obstet Ginecol"[Journal] OR "Riv Ital Ginecol"[Journal] OR "Riv Ostet Ginecol"[Journal] OR "Riv Ostet Ginecol Prat"[Journal] OR "Riv Ostet Ginecol Prat Med Perinat"[Journal] OR "Rozhl Chir"[Journal] OR "Sanfujinka No Jissai"[Journal] OR "Soins Gynecol Obstet Pueric"[Journal] OR "Soins Gynecol Obstet Pueric Pediatr"[Journal] OR "Suppl Int J Gynecol Obstet"[Journal] OR "Surg Gynecol Obstet"[Journal] OR "Taiwan J Obstet Gynecol"[Journal] OR "TeLindes Oper Gynecol Updates"[Journal] OR "Trans N Engl Obstet Gynecol Soc"[Journal] OR "Trans Pac Coast Obstet Gynecol Soc"[Journal] OR "Ultrasound Obstet Gynecol"[Journal] OR "Vopr Okhr Materin Det"[Journal] OR "Women Birth"[Journal] OR "Women Health"[Journal] OR "Womens Health Data Book"[Journal] OR "Womens Health Issues"[Journal] OR "Womens Health J"[Journal] OR "Z Geburtshilfe Perinatol"[Journal] OR "Zentralbl Gynakol"[Journal] OR "Zhonghua Fu Chan Ke Za Zhi"[Journal]) Articles’ search Articles’ selection Articles’ evaluation Statistical analyze The reporting of diagnostic accuracy in obstetrics and gynecology literature: an overview on the report quality between 1980 and 2005 2006/2007

  10. Introduction Objectives Methods Results Acknowledgments Limits to the search Articles’ search Articles’ selection Articles’ evaluation Statistical analyze • Periods (one for each selector): • 2005 to 2005 • 2004 to 2004 • 2000 to 2003 • 1990 to 1999 • 1980 to 1989 Language restriction - English - Portuguese The reporting of diagnostic accuracy in obstetrics and gynecology literature: an overview on the report quality between 1980 and 2005 2006/2007

  11. Introduction Objectives Methods Results Acknowledgments Random selection of articles Articles’ search Articles’ selection Articles’ evaluation Statistical analyze Each selector gets a list of articles (of one of the periods) Guided by a sequence of random numbers (ex: 36, 6, 235,…), he choose and open one article at a time The reporting of diagnostic accuracy in obstetrics and gynecology literature: an overview on the report quality between 1980 and 2005 2006/2007

  12. Introduction Objectives Methods Results Acknowledgments Reading and analyze of the abstract Articles’ search Articles’ selection Articles’ evaluation Statistical analyze The abstract is read and analyzed with the inclusion/exclusion criteria Inclusion - report a study of diagnostic accuracy - the diagnostic test(s) is(are) used in obstetrics and/or gynecology - abstract is available Exclusion - is a clinical trial, a letter, an editorial, a practice guideline, a meta-analyse or a review The reporting of diagnostic accuracy in obstetrics and gynecology literature: an overview on the report quality between 1980 and 2005 2006/2007

  13. Introduction Objectives Methods Results Acknowledgments Decision Articles’ search Articles’ selection Articles’ evaluation Statistical analyze If excluded - the reason of exclusion is registered If included or doubted - the abstract is reanalyzed by other selector When disagreement or doubt, the article was discussed by the two selectors. When no decision could be achieved, a third selector was consulted PMID of each opened article is registered The reporting of diagnostic accuracy in obstetrics and gynecology literature: an overview on the report quality between 1980 and 2005 2006/2007

  14. Introduction Objectives Methods Results Acknowledgments Final samples This is repeated until the getting of a sample of 10 articles for each period 2005 Articles’ search Articles’ selection Articles’ evaluation Statistical analyze 2004 10 articles sample 10 articles sample 2000-2003 Global sample of 50 articles 10 articles sample 10 articlessample 1990-1999 10 articlessample 1980-1989 The reporting of diagnostic accuracy in obstetrics and gynecology literature: an overview on the report quality between 1980 and 2005 2006/2007

  15. Introduction Objectives Methods Results Acknowledgments Articles’ search Articles’ selection Articles’ evaluation Statistical analyze STARD checklist The reporting of diagnostic accuracy in obstetrics and gynecology literature: an overview on the report quality between 1980 and 2005 2006/2007

  16. Introduction Objectives Methods Results Acknowledgments STARD checklist (2nd part) Articles’ search Articles’ selection Articles’ evaluation Statistical analyze Each item value 1 point Items 8, 9, 10, 11, 13 and 24 concern index tests as well as the reference standard, so each one of these components was counted with 0.5 points The reporting of diagnostic accuracy in obstetrics and gynecology literature: an overview on the report quality between 1980 and 2005 2006/2007

  17. Introduction Objectives Methods Results Acknowledgments Groups 3 Groups 2 evaluators (each analyze 50 articles) 4 evaluators (each analyze 25 articles) 4 evaluators (each analyze 25 articles) Article’s components - Title, - Abstract, - Keywords - Introduction - Methods - Results - Discussion Articles’ search Articles’ selection Articles’ evaluation Statistical analyze Each evaluator works independently Mismatch results are analysed by a fourth group The reporting of diagnostic accuracy in obstetrics and gynecology literature: an overview on the report quality between 1980 and 2005 2006/2007

  18. Introduction Objectives Methods Results Acknowledgments Databases Two databases were created Articles’ search Articles’ selection Articles’ evaluation Statistical analyze Database of selection Contain - PMID of the article - Period to which the article belong - Decision of the 1st selector - Cause of exclusion presented by 1st selector (for the excluded articles) - Decision of the 2nd selector about the articles included by the 1st selector - Cause of exclusion presented by 2nd selector (for the excluded articles) The reporting of diagnostic accuracy in obstetrics and gynecology literature: an overview on the report quality between 1980 and 2005 2006/2007

  19. Introduction Objectives Methods Results Acknowledgments Databases Two databases were created Articles’ search Articles’ selection Articles’ evaluation Statistical analyze Database of evaluation Contain - PMID of the article - Name of the article - Name of the journal where the articles was published - Publishing year of the article - Impact Factor of the journal when the article was published - Evaluation points given by one evaluator for each item - Evaluation points given by the other evaluator for each item - Final score for each item The reporting of diagnostic accuracy in obstetrics and gynecology literature: an overview on the report quality between 1980 and 2005 2006/2007

  20. Introduction Objectives Methods Results Acknowledgments Analyses • The frequency of each reason that caused exclusion of articles • The probability of the article not be excluded (included or doubted) by the 2nd selector if it had being also not excluded by the 1st one • Total STARD score for each article • For each item in the STARD-statement, the total number of articles reporting that item • Mean and standard deviation of the total STARD scores for each period • Compare means (One-Way ANOVA method) • Agreement between the evaluators – the reproducibility(Bland and Altman method & Intraclass Correlation Coefficient) • Relation between articles’ STARD scores and impact factor of journals Articles’ search Articles’ selection Articles’ evaluation Statistical analyze The reporting of diagnostic accuracy in obstetrics and gynecology literature: an overview on the report quality between 1980 and 2005 2006/2007

  21. Introduction Objectives Methods Results Acknowledgments From articles’ search From articles’ selection The reporting of diagnostic accuracy in obstetrics and gynecology literature: an overview on the report quality between 1980 and 2005 2006/2007

  22. Introduction Objectives Methods Results Acknowledgments From articles’ search From articles’ search From articles’ selection Total – 15047 The reporting of diagnostic accuracy in obstetrics and gynecology literature: an overview on the report quality between 1980 and 2005 2006/2007

  23. Introduction Objectives Methods Results Acknowledgments Decisions of selectors From articles’ search From articles’ selection The reporting of diagnostic accuracy in obstetrics and gynecology literature: an overview on the report quality between 1980 and 2005 2006/2007

  24. Introduction Objectives Methods Results Acknowledgments Causes of exclusion From the 1st selector 93 (74,7%) 1 (0,8%) 3 (2,4%) 1 (0,8%) 19 (15,2%) 8 (6,4%) From articles’ search From articles’ selection 7 (77,8%) 1 (11,1%) 1 (11,1%) From the 2nd selector The reporting of diagnostic accuracy in obstetrics and gynecology literature: an overview on the report quality between 1980 and 2005 2006/2007

  25. Introduction Objectives Methods Results Acknowledgments Agreement between selectors probability of the article not be excluded by the 2nd selector if it had being also not excluded by the 1st one Number of articles not excluded by both selectors From articles’ search From articles’ selection Number of articles not excluded by the 1st selector 99 0.92 108 92 % The reporting of diagnostic accuracy in obstetrics and gynecology literature: an overview on the report quality between 1980 and 2005 2006/2007

  26. Introduction Objectives Methods Results Acknowledgments Final selection states From articles’ search From articles’ selection The reporting of diagnostic accuracy in obstetrics and gynecology literature: an overview on the report quality between 1980 and 2005 2006/2007

  27. Introduction Objectives Methods Results Acknowledgments Acknowledgments • Altamiro da Costa Pereira, MD,PhD • Cristina Santos, MD, PhD The reporting of diagnostic accuracy in obstetrics and gynecology literature: an overview on the report quality between 1980 and 2005 2006/2007

More Related