A validation study on the factors affecting the practice modes of open peer review

Abstract

AbstractIn this paper we conduct a validation study on the factors affecting the practice modes of open peer review. Taking the Open Access Journals (OAJ) in Directory of Open Access Journals (DOAJ) as the research objects, we crawled the internet to gather their relevant data. Based on the method of categorical variable assignment, a quantitative analysis was performed on the qualitative factors that affect the practice modes of open peer review. A multi-dimensional analysis chart is used to illustrate the relationships between the factors. Optimal scale regression modeling and discriminant analysis were also employed to reveal the degrees of influences by the factors. The public categories of “type of open peer review” and “reviewer identity” are closely related to each other. “Reviewer identity” has evident positive influence on “type of open peer review”, and the degree of influence is the highest. Therefore, “reviewer identity” is the primary and most crucial factor affecting open peer review practice modes. “Review report” and “order of review report and publication” are the secondary ones. Whether or not the identities of review experts are open has become the most important factor affecting the practice modes of open peer review. Transparent peer review is currently the most effective practice mode of open peer review. Technologies like block chain can be used to address the psychological uneasiness for the peer review experts who are concerned with privacy issues. The fact that most OAJs use “pre-publication review” shows that open peer review still plays the traditional role of “academic goalkeeper”. Publication of peer review reports actually helps peer review experts augment their reputation, which in turn practically promotes the development of open peer review.