An Analysis of ChatGPT4 to Respond to Glaucoma-Related Questions

Abstract

Précis: In recent years, ChatGPT has been widely used as a source of information. In our study, it was revealed that ChatGPT gives accurate information about glaucoma. Purpose: We examined the knowledge of ChatGPT about glaucoma. Materials and Methods: Frequently asked questions about glaucoma found on websites of ophthalmology associations and hospitals, and social media applications were assessed. Evidence-Based Recommendations in the European Glaucoma Society Terminology and Guidelines for Glaucoma, Fifth Edition were evaluated. Using the ChatGPT-4, each question was asked twice on different computers to assess the reproducibility of answers. The answers provided were recorded and 2 specialist ophthalmologists evaluated them independently, assigning scores ranging from 1 to 4. Results: The answers to all questions about glaucoma resulted in 88.7% completely correct, 7.5% correct but insufficient, and 3.8% misleading information and correct information. No question was answered completely incorrectly. While 85.8% of the general knowledge questions were answered correctly, 91.7%, 86.6%, and 91.7% of questions about diagnosis, treatment, and prevention were answered correctly, respectively. The number of questions prepared based on the European Glaucoma Society Terminology and Guidelines for Glaucoma was 16. The rate of completely correct answers to these questions was 75.0% (12). While 3 (18.8%) answers were correct but insufficient, 1 response (6.3%) contained false information and correct information. Conclusions: Our study revealed that ChatGPT answered 9 out of 10 questions about general information, diagnosis, treatment, and preventive and follow-up about glaucoma with acceptable and satisfactory accuracy rates. In addition, 3 of 4 answers given by ChatGPT were completely correct according to Terminology and Guidelines for Glaucoma.