Can Large Language Models Help Patients Understand Peer-Reviewed Scientific Articles About Ophthalmology? (Preprint)

Author:

Kianian RezaORCID,Sun Deyu,Rojas-Carabali William,Agrawal Rupesh,Tsui EdmundORCID

Abstract

BACKGROUND

Adequate health literacy has been shown to be important for the general health of a population. To address this, it is recommended that patient-targeted medical information is written at a 6th grade reading level. To make well-informed decisions about their health, patients may want to interact directly with peer-reviewed open-access scientific articles. However, studies have shown that such text is often written with highly complex language above the levels that can be comprehended by the general population. Previously, we have published on the use of LLMs in easing the readability of patient-targeted health information on the internet. No studies, however, have looked at its efficacy in making scientific articles more accessible to the general population.

OBJECTIVE

To explore the utility of large language models (LLMs), specifically ChatGPT, to enhance the readability of peer-reviewed scientific articles in the field of Ophthalmology.

METHODS

Twelve open-access, peer-reviewed manuscripts published by the senior authors of this study (E.T. and R.A.) were selected. Readability was assessed using the Flesch Kincaid Grade Level and Simple Measure of Gobbledygook tests. ChatGPT 4.0 was asked “I will give you the text of a peer-reviewed scientific paper. Considering that the recommended readability of the text is 6th grade, can you simplify the following text so that a layperson reading this text can fully comprehend it? - Insert Manuscript Text -”. Appropriateness was evaluated by the two uveitis-trained ophthalmologists. Statistical analysis was performed in Microsoft Excel.

RESULTS

ChatGPT significantly lowered the readability and length of the selected manuscripts from 15th to 7th grade (p<0.0001) while generating responses that kept the original meaning of the manuscripts and were deemed appropriate.

CONCLUSIONS

LLMs show promise in improving health literacy through enhancing the accessibility of peer-reviewed scientific articles and allowing the general population to interact directly with medical literature.

Publisher

JMIR Publications Inc.

同舟云学术

1.学者识别学者识别

2.学术分析学术分析

3.人才评估人才评估

"同舟云学术"是以全球学者为主线,采集、加工和组织学术论文而形成的新型学术文献查询和分析系统,可以对全球学者进行文献检索和人才价值评估。用户可以通过关注某些学科领域的顶尖人物而持续追踪该领域的学科进展和研究前沿。经过近期的数据扩容,当前同舟云学术共收录了国内外主流学术期刊6万余种,收集的期刊论文及会议论文总量共计约1.5亿篇,并以每天添加12000余篇中外论文的速度递增。我们也可以为用户提供个性化、定制化的学者数据。欢迎来电咨询!咨询电话:010-8811{复制后删除}0370

www.globalauthorid.com

TOP

Copyright © 2019-2024 北京同舟云网络信息技术有限公司
京公网安备11010802033243号  京ICP备18003416号-3