Can artificial intelligence replace manual search for systematic literature? Review on cutaneous manifestations in primary Sjögren’s syndrome

Abstract

Abstract Objectives Manual systematic literature reviews are becoming increasingly challenging due to the sharp rise in publications. The primary objective of this literature review was to compare manual and computer software using artificial intelligence retrieval of publications on the cutaneous manifestations of primary SS, but we also evaluated the prevalence of cutaneous manifestations in primary SS. Methods We compared manual searching and searching with the in-house computer software BIbliography BOT (BIBOT) designed for article retrieval and analysis. Both methods were used for a systematic literature review on a complex topic, i.e. the cutaneous manifestations of primary SS. Reproducibility was estimated by computing Cohen’s κ coefficients and was interpreted as follows: slight, 0–0.20; fair, 0.21–0.40; moderate, 0.41–0.60; substantial, 0.61–0.80; and almost perfect, 0.81–1. Results The manual search retrieved 855 articles and BIBOT 1042 articles. In all, 202 articles were then selected by applying exclusion criteria. Among them, 155 were retrieved by both methods, 33 by manual search only, and 14 by BIBOT only. Reliability (κ = 0.84) was almost perfect. Further selection was performed by reading the 202 articles. Cohort sizes and the nature and prevalence of cutaneous manifestations varied across publications. In all, we found 52 cutaneous manifestations reported in primary SS patients. The most described ones were cutaneous vasculitis (561 patients), xerosis (651 patients) and annular erythema (215 patients). Conclusion Among the final selection of 202 articles, 155/202 (77%) were found by the two methods but BIBOT was faster and automatically classified the articles in a chart. Combining the two methods retrieved the largest number of publications.