Artificial Intelligence in Multilingual Interpretation and Radiology Assessment for Clinical Language Evaluation (AI-MIRACLE)

Abstract

The AI-MIRACLE Study investigates the efficacy of using ChatGPT 4.0, a large language model (LLM), for translating and simplifying radiology reports into multiple languages, aimed at enhancing patient comprehension. The study assesses the model’s performance across the most spoken languages in the U.S., emphasizing the accuracy and clarity of translated and simplified radiology reports for non-medical readers. This study employed ChatGPT 4.0 to translate and simplify selected radiology reports into Vietnamese, Tagalog, Spanish, Mandarin, and Arabic. Hindi was used as a preliminary test language for validation of the questionnaire. Performance was assessed via Google form surveys distributed to bilingual physicians, which assessed the translation accuracy and clarity of simplified texts provided by ChatGPT 4. Responses from 24 participants showed mixed results. The study underscores the model’s varying success across different languages, emphasizing both potential applications and limitations. ChatGPT 4.0 shows promise in breaking down language barriers in healthcare settings, enhancing patient comprehension of complex medical information. However, the performance is inconsistent across languages, indicating a need for further refinement and more inclusive training of AI models to handle diverse medical contexts and languages. The study highlights the role of LLMs in improving healthcare communication and patient comprehension, while indicating the need for continued advancements in AI technology, particularly in the translation of low-resource languages.