Abstract
Abstract
Background
As systematic reviews’ limited coverage of the medical literature necessitates decision-making based on unsystematic review, we investigated a possible advantage of systematic review (aside from dataset size and systematic analysis): does systematic review avoid potential bias in sampling primary studies from high impact factor journals? If randomized controlled trials (RCTs) reported in higher-impact journals present different treatment benefits than RCTs reported in lower-impact journals, readers who focus on higher-impact journals for their rapid literature reviews may introduce bias which could be mitigated by complete, systematic sampling.
Methods
We randomly sampled Cochrane Library (20 July 2005) treatment reviews that measured mortality as a binary outcome, published in English or French, with at least five RCTs with one or more deaths. Our domain-based assessment of risk of bias included funding source, randomness of allocation sequence, blinding, and allocation concealment. The primary analysis employed logistic regression by a generalized linear model with a generalized estimating equation to estimate the association between various factors and publication in a journal with a high journal impact factor (JIF).
Results
From the 29 included systematic reviews, 189 RCTs contributed data. However, in the primary analyses comparing RCT results within meta-analyses, there was no statistically significant association: unadjusted odds of greater than 50% mortality protection in high-JIF (> 5) journals were 1.4 (95% CI 0.42, 4.4) and adjusted, 2.5 (95% CI 0.6, 10). Elements of study quality were weakly, inconsistently, and not statistically significantly correlated with journal impact factor.
Conclusions
Journal impact factor may have little to no association with study results, or methodological quality, but the evidence is very uncertain.
Publisher
Springer Science and Business Media LLC
Reference41 articles.
1. Dickersin K, Rennie D. Registering clinical trials. JAMA. 2003;290(19):516–23.
2. National Health and Medical Research Council. How to use the evidence: assessment and application of scientific evidence. Assessing the evidence. level of evidence. Commonwealth of Australia. 2000. http://www.nhmrc.gov.au/publications/pdf/cp69.pdf. Accessed June 6, 2008.
3. Phillips B, Ball C, Sackett D, Badenoch D, Straus S, Haynes B, Dawes M. Levels of evidence and grades of recommendations. Last revised May 2001. Centre for Evidence-Based Medicine; http://www.cebm.net/levels_of_evidence.asp. Accessed Feb 12, 2017.
4. Atkins D, Best D, Shapiro EN. The third U.S. Preventive Services Task Force: background, methods and first recommendations. Am J Preventive Medicine. 2001;20(3 Suppl 1):1–108.
5. Harbour R, Miller J. A new system for grading recommendations in evidence based guidelines. BMJ. 2001;323(7308):334–6.
Cited by
17 articles.
订阅此论文施引文献
订阅此论文施引文献,注册后可以免费订阅5篇论文的施引文献,订阅后可以查看论文全部施引文献