ChatGPT is capable of providing satisfactory responses to frequently asked questions regarding total shoulder arthroplasty

Abstract

Background The rising prominence of artificial intelligence in healthcare has revolutionized patient access to medical information. This cross-sectional study sought to assess if ChatGPT could satisfactorily address common patient questions about total shoulder arthroplasty (TSA). Methods Ten commonly encountered questions in TSA practice were selected and posed to ChatGPT. Each response was assessed for accuracy and clarity using the Mika et al. scoring system, which ranges from “excellent response not requiring clarification” to “unsatisfactory response requiring substantial clarification,” and a modified DISCERN score. The readability was further evaluated using the Flesch Reading Ease Score and the Flesch-Kincaid Grade Level. Results The mean Mika et al. score was 2.93, corresponding to an overall subjective rating of “satisfactory but requiring moderate clarification.” The mean DISCERN score was 46.60, which is considered “fair.” The readability analysis suggested that the responses were at a college-graduate level, higher than the recommended level for patient educational materials. Discussion Our results suggest that ChatGPT has the potential to supplement the collaborative decision-making process between patients and experienced orthopedic surgeons for TSA-related inquiries. Ultimately, while tools like ChatGPT can enhance traditional patient education methods, they should not replace direct consultations with medical professionals.