EndoGPT: A Proof-of-concept Large Language Model Based Assistant for the Management of Thyroid Nodules-Reference-Cited by-同舟云学术

EndoGPT: A Proof-of-concept Large Language Model Based Assistant for the Management of Thyroid Nodules

Published:2024-05-31 Issue: Volume: Page:
ISSN:
Container-title:
language:
Short-container-title:

Author:

Shah Meghal^ORCID,Kuo Eric J.^ORCID,Kuo Jennifer H.^ORCID,Hsu Shawn^ORCID,McManus Catherine^ORCID,Liou Rachel^ORCID,Lee James A.^ORCID,Sathe Tejas S.^ORCID

Abstract

AbstractLarge language models (LLMs) are increasingly being explored for their potential to simulate clinical reasoning. Here, we demonstrate our initial experience using the GPT-4o LLM along with prompt engineering and knowledge retrieval to develop EndoGPT, a clinical decision support tool for the management of thyroid nodules. In a pilot study of 50 cases, EndoGPT demonstrated an 83% concordance rate with expert surgeons’ assessments and plans. The highest concordance was in diagnosis (93%), followed by the need for an operation (82%) and type of operation (69%). This work suggests that LLM-based assistants may play a useful role in assisting clinicians in the future.

Publisher

Cold Spring Harbor Laboratory

Reference4 articles.

1. Harsha Nori , Yin Tat Lee , Sheng Zhang , Dean Carignan , Richard Edgar , Nicolo Fusi , Nicholas King , Jonathan Larson , Yuanzhi Li , Weishung Liu , Renqian Luo , Scott Mayer McKinney , Robert Osazuwa Ness , Hoifung Poon , Tao Qin , Naoto Usuyama , Chris White , and Eric Horvitz . Can generalist foundation models outcompete Special-Purpose tuning? case study in medicine. November 2023. URL http://arxiv.org/abs/2311.16452.

2. How I GPT It: Development of Custom Artificial Intelligence (AI) Chatbots for Surgical Education

3. 2015 American Thyroid Association Management Guidelines for Adult Patients with Thyroid Nodules and Differentiated Thyroid Cancer: The American Thyroid Association Guidelines Task Force on Thyroid Nodules and Differentiated Thyroid Cancer

4. Underfitted. Building a RAG application from scratch using python, LangChain, and the OpenAI API, March 2024. URL https://www.youtube.com/watch?v=BrsocJb-fAo.