280 likes | 633 Views
STROBE Citation Analysis. Bruno da Costa, BScPT, MSc Institute of Social and Preventive Medicine (ISPM) University of Bern, Switzerland www.ispm.ch. Background. STROBE first published in October 2007 Checklist and E&E simultaneously published 7 checklists 3 E&E
E N D
STROBE Citation Analysis STROBE Citation Analysis Bruno da Costa, BScPT, MSc Institute of Social and Preventive Medicine (ISPM) University of Bern, Switzerland www.ispm.ch
STROBE Citation Analysis Background • STROBE first published in October 2007 • Checklist and E&E simultaneously published • 7 checklists • 3 E&E • To date there are around 16 publications in 12 journals • STROBE is endorsed by ICMJE and over 100 journals
STROBE Citation Analysis Objectives • To examine the absolute frequency of STROBE citations and possible determinants • To examine in which circumstances and context the STROBE was cited (when, where, and why) • To illustrate some instances of citations with text examples
STROBE Citation Analysis Methods • Literature search: 2-stage process • Stage 1: Search for STROBE publications • Stage 2: Search for studies which cited STROBE
STROBE Citation Analysis Methods • Stage 1: literature search for STROBE publications • Web of Science • August 12th 2010 • No time or language restriction WoS STROBE
STROBE Citation Analysis Methods • Stage 2: literature search for studies which cited STROBE • Web of Science • List of studies identified in first stage • Web of Science function: “Create citation report” • Random sample of 100 studies WoS STROBE STROBE citation STROBE citation STROBE citation
STROBE Citation Analysis Methods • Data extraction • Pilot of DEF with 40 studies conducted in duplicate • Final items in DEF • Verbatim of citation • Reason for citation • STROBE article cited (e.g. Ann Intern Med E&E) • Type of article which made citation (e.g. Systematic review)
STROBE Citation Analysis Results: Stage 1 IDENTIFICATION potentially eligible reports n=18 SCREENING reports screened n=18 reports excluded n=2 INCLUDED reports included n=16 (12 checklist, 4 E&E)
STROBE Citation Analysis Results: Stage 1
STROBE Citation Analysis Results: Stage 1 STROBE publications per year
STROBE Citation Analysis Results: Stage 2 • Number of articles citing STROBE n = 640 • Number citations per year (Oct 2007-Aug 2010) 219 STROBE citations per year 269 214 148 9
STROBE Citation Analysis Results from random sample (n=100)
STROBE Citation Analysis Results from random sample (n=100)
Results from random sample (n=100) STROBE Citation Analysis 50% with ≥1 author(s) with Epidemiological or PH affiliation
STROBE Citation Analysis Results: Context of STROBE citation Objective of STROBE “Our aim is to ensure clear presentation of what was planned, done, and found in an observational study. We stress that the recommendations are not prescriptions for setting up or conducting studies, nor do they dictate methodology or mandate a uniform presentation” Vandenbroucke 2007
STROBE Citation Analysis Results: Context of STROBE citation “The reporting of this study conforms to the STROBE statement (*)” Mariette 2010, Ann Rheum Dis “The STROBE guidelines were used to ensure the reporting of this observational study (*)” Wakkee 2009, Acta Derm Venereol “We followed STROBE guidelines for the preparation of this manuscript within the constraints of the word count limit(*)” Siassakos 2009, Medical Education
STROBE Citation Analysis Results: Context of STROBE citation “This prospective study was designed following recommendation of the STROBE statement (*)” Onofrj 2010, Neurology “The analysis followed the principles of the Strengthening the Reporting of Observational Studies in Epidemiology initiative (*)” Gratwohl 2009, Cancer
STROBE Citation Analysis Results: Context of STROBE citation “We conducted a systematic search of MEDLINE (2005 to January 2009) and the National Institutes of Health clinical trial databases (up to January 2009) for randomised controlled trials (RCTs) and observational case series with at least 3-month follow-up, both prospective and retrospective, which met the STROBE criteria” Jyothi 2010, Eye
STROBE Citation Analysis Results: Context of STROBE citation “The quality of selected studies was assessed using a modified version of the Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) statement (*). The STROBE is a quality assessment checklist for observational studies that consists of 22 items. The STROBE was modified by adding questions about the serologic method used to confirm dengue diagnosis, use of viral isolation, and whether the study was based on a single dengue outbreak or transmission season. Use of viral isolation increased the score whereas single outbreak studies received no additional points. The quality score was the number of items from the STROBE checklist addressed as a percentage of the total number of items applicable (minimum of 23 and maximum of 25). Studies with a quality assessment below 50% were excluded” Potts 2008, Trop Med Int Health
STROBE Citation Analysis Summary • Citations to STROBE has been steeply increasing since its first publication • STROBE publications in journals with higher IF are usually cited more frequently • Among studies that cited STROBE, 24% used it according to original purpose • 7% of studies that cited STROBE used it inappropriately
STROBE Citation Analysis Scatter plot showing association between number of citations and impact factor
STROBE Citation Analysis Linear regression output of the association between number of citations and impact factor Source | SS df MS Number of obs = 15 -------------+------------------------------ F( 1, 13) = 55.82 Model | 16233.2001 1 16233.2001 Prob > F = 0.0000 Residual | 3780.53324 13 290.810249 R-squared = 0.8111 -------------+------------------------------ Adj R-squared = 0.7966 Total | 20013.7333 14 1429.55238 Root MSE = 17.053 ------------------------------------------------------------------------------ citations | Coef. Std. Err. t P>|t| [95% Conf. Interval] -------------+---------------------------------------------------------------- IF | 4.013205 .5371482 7.47 0.000 2.852767 5.173643 _cons | 7.979858 6.379171 1.25 0.233 -5.801503 21.76122 ------------------------------------------------------------------------------
STROBE Citation Analysis Category “Other” • Flowchart according to STROBE recommendations (n=1) • Design and report adhere to STROBE (n=1) • Methodological comment (n=2) • “Quality” assessment but unclear whether methodological or reporting (n=2) • Guideline to conduct statistical analysis (n=1) • Eligibility screening in systematic review (n=3) • Followed STROBE guidelines, but unclear how (n=1) • Other (n=23) “In spite of the widespread use of metaanalyses to synthesize intervention studies, there has been relatively little discussion on the strengths and weakness of these techniques for summarizing frequency measures such as incidence and prevalence estimates”