Analyzing the Predictability of an Artificial Intelligence App (Tibot) in the Diagnosis of Dermatological Conditions: A Cross-sectional Study

Abstract

Background Artificial intelligence (AI) aims to create programs that reproduce human cognition and processes involved in interpreting complex data. Dermatology relies on morphological features and is ideal for applying AI image recognition for assisted diagnosis. Tibot is an AI app that analyzes skin conditions and works on the principle of a convolutional neural network. Appropriate research analyzing the accuracy of such apps is necessary. Objective This study aims to analyze the predictability of the Tibot AI app in the identification of dermatological diseases as compared to a dermatologist. Methods This is a cross-sectional study. After taking informed consent, photographs of lesions of patients with different skin conditions were uploaded to the app. In every condition, the AI predicted three diagnoses based on probability, and these were compared with that by a dermatologist. The ability of the AI app to predict the actual diagnosis in the top one and top three anticipated diagnoses (prediction accuracy) was used to evaluate the app’s effectiveness. Sensitivity, specificity, and positive predictive value were also used to assess the app’s performance. Chi-square test was used to contrast categorical variables. P<.05 was considered statistically significant. Results A total of 600 patients were included. Clinical conditions included alopecia, acne, eczema, immunological disorders, pigmentary disorders, psoriasis, infestation, tumors, and infections. In the anticipated top three diagnoses, the app’s mean prediction accuracy was 96.1% (95% CI 94.3%-97.5%), while for the exact diagnosis, it was 80.6% (95% CI 77.2%-83.7%). The prediction accuracy (top one) for alopecia, acne, pigmentary disorders, and fungal infections was 97.7%, 91.7%, 88.5%, and 82.9%, respectively. Prediction accuracy (top three) for alopecia, eczema, and tumors was 100%. The sensitivity and specificity of the app were 97% (95% CI 95%-98%) and 98% (95% CI 98%-99%), respectively. There is a statistically significant association between clinical and AI-predicted diagnoses in all conditions (P<.001). Conclusions The AI app has shown promising results in diagnosing various dermatological conditions, and there is great potential for practical applicability.