Performance of a commercially available artificial intelligence software for the detection of confirmed pulmonary nodules and masses in canine thoracic radiography

Abstract

AbstractAdvancements in the field of artificial intelligence (AI) are modest in veterinary medicine relative to their substantial growth in human medicine. However, interest in this field is increasing, and commercially available veterinary AI products are already on the market. In this retrospective, diagnostic accuracy study, the accuracy of a commercially available convolutional neural network AI product (Vetology AI®) is assessed on 56 thoracic radiographic studies of pulmonary nodules and masses, as well as 32 control cases. Positive cases were confirmed to have pulmonary pathology consistent with a nodule/mass either by CT, cytology, or histopathology. The AI software detected pulmonary nodules/masses in 31 of 56 confirmed cases and correctly classified 30 of 32 control cases. The AI model accuracy is 69.3%, balanced accuracy 74.6%, F1‐score 0.7, sensitivity 55.4%, and specificity 93.75%. Building on these results, both the current clinical relevance of AI and how veterinarians can be expected to use available commercial products are discussed.