Evaluating Research Transparency and Openness in Communication Sciences and Disorders Journals

Abstract

Purpose: To improve the credibility, reproducibility, and clinical utility of research findings, many scientific fields are implementing transparent and open research practices. Such open science practices include researchers making their data publicly available and preregistering their hypotheses and analyses. A way to enhance the adoption of open science practices is for journals to encourage or require submitting authors to participate in such practices. Accordingly, the American Speech-Language-Hearing Association's Journals Program has recently announced their intention to promote open science practices. Here, we quantitatively assess the extent to which several journals in communication sciences and disorders (CSD) encourage or require participation in several open science practices by using the Transparency and Openness Promotion (TOP) Factor metric. Method: TOP Factors were assessed for 34 CSD journals, as well as several journals in related fields. TOP Factors measure the level of implementation across 10 open science–related practices (e.g., data transparency, analysis plan preregistration, and replication) for a total possible score of 29 points. Results: Collectively, CSD journals had very low TOP Factors ( M = 1.4, range: 0–8). The related fields of Psychology ( M = 4.0), Rehabilitation ( M = 3.2), Linguistics ( M = 1.7), and Education ( M = 1.6) also had low scores, though Psychology and Rehabilitation had higher scores than CSD. Conclusion: CSD journals currently have low levels of encouraging or requiring participation in open science practices, which may impede adoption. Open Science Form: https://doi.org/10.23641/asha.21699458