Author:
Sommer Isolde,Sunder-Plassmann Vincent,Ratajczak Piotr,Emprechtinger Robert,Dobrescu Andreea,Griebler Ursula,Gartlehner Gerald
Abstract
AbstractIntroductionThere is concern that preprint articles will lead to an increase in the amount of scientifically invalid work available. The objectives of this study were 1) to determine the proportion of prevention preprints published within 12 months, 2) to assess the consistency of the effect estimates and conclusions between preprint and published articles, and 3) to explore the reasons for the nonpublication of preprints.MethodsWe developed a web crawler to search the preprint server medRxiv for prevention studies posted from January 1 to September 30, 2020. An update search was conducted 12 months later. We dually screened the results for prevention articles and developed a scheme to classify changes in effect sizes and conclusions. We modeled the effect of a set of predictors on the proportion of preprints published in peer-reviewed journals. We also developed a questionnaire for authors of unpublished preprints.ResultsOf the 329 prevention preprints that met our eligibility criteria, almost half (48.9%) were published in a peer-reviewed journal within 12 months of being posted, with the median time being 5.3 months (range 0.1–11.3 months). While 27 out of 161 (16.8%) published preprints showed some change in the magnitude of the primary outcome effect estimate, 4.4% were classified as having a major change. The style or wording of the conclusion changed in 42.2%, while the content of the conclusion changed in 3.1%. Preprints on chemoprevention, with a cross-sectional design, and with public and noncommercial funding had the highest probabilities of publication. The main reasons for the nonpublication of preprints were journal rejection or lack of time.ConclusionThe reliability of preprint articles for evidence-based decision-making is questionable. Less than half of the preprint articles on prevention research are published in a peer-reviewed journal within 12 months, and significant changes in effect sizes and/or conclusions are still possible during the peer-review process.
Publisher
Cold Spring Harbor Laboratory
Reference47 articles.
1. The prehistory of biology preprints: A forgotten experiment from the 1960s
2. Submissions and Downloads of Preprints in the First Year of medRxiv
3. Article Sharing: Elsevier; 2023 [Available from: https://www.elsevier.com/about/policies/sharing.] Accessed May 11, 2023.
4. Preprint sharing: Springer Nature; 2023 [Available from: https://www.springer.com/gp/open-access/preprint-sharing/16718886.] Accessed May 11, 2023.
5. Preprints: PLOS; 2023 [Available from: https://journals.plos.org/plosone/s/preprints.