COMPARATIVE EVALUATION OF ARTIFICIAL INTELLIGENCE AND DRUG INTERACTION TOOLS: A PERSPECTIVE WITH THE EXAMPLE OF CLOPIDOGREL

Abstract

Objective: The study aims to compare the ability of free artificial intelligence (AI) chatbots to detect drug interactions with freely available drug interaction tools, using clopidogrel as an example. Material and Method: The Lexicomp database was used as a reference to determine drug interactions with clopidogrel. ChatGPT-3.5 AI and Bing AI were selected as the free AI chatbots. Medscape Drug Interaction Checker, DrugBank Drug Interaction Checker and Epocrates Interaction Check were selected as free drug interaction tools. Accuracy score and comprehensiveness score were calculated for each drug interaction tool and AI chatbots. The kappa coefficient was calculated to assess inter-source agreement for interaction severity. Result and Discussion: The results most similar to those of Lexicomp were obtained from the DrugBank and the ChatGPT-3.5 AI chatbot. The ChatGPT-3.5 AI chatbot performed best, with 69 correct results and an accuracy score of 307. ChatGPT-3.5 AI has the highest overall score of 387 points for accuracy and comprehensiveness. In addition, the highest kappa coefficient with Lexicomp was found for ChatGPT-3.5 AI chatbot (0.201, fair agreement). However, some of the results obtained by ChatGPT-3.5 AI need to be improved as they are incorrect/inadequate. Therefore, information obtained using AI tools should not be used as a reference for clinical applications by healthcare professionals and patients should not change their treatment without consulting doctor.