Affiliation:
1. Department of Informatics, Plekhanov Russian University of Economics, 36, Stremyanny Lane, Moscow 109992, Russia
2. Department of Information Systems, Ulyanovsk State Technical University, 32, Severny Venetz Street, Ulyanovsk 2432027, Russia
Abstract
One of the new trends in the development of recommendation algorithms is the dissemination of their capabilities to support the population in managing their health, in particular cardiovascular health. Cardiovascular diseases (CVDs) affect people in their prime years and remain the main cause of morbidity and mortality worldwide, and their clinical treatment is expensive and time consuming. At the same time, about 80% of them can be prevented, according to the World Federation of Cardiology. The aim of this study is to develop and investigate a knowledge-based recommender algorithm for the self-management of CVD risk factors in adults at home. The proposed algorithm is based on the original user profile, which includes a predictive assessment of the presence of CVD. To obtain a predictive score for CVD presence, AutoML and LSTM models were studied on the Kaggle dataset, and it was shown that the LSTM model, with an accuracy of 0.88, outperformed the AutoML model. The algorithm recommendations generated contain items of three types: targeted, informational, and explanatory. For the first time, large language models, namely ChatGPT-3.5, ChatGPT-4, and ChatGPT-4.o, were leveraged and studied in creating explanations of the recommendations. The experiments show the following: (1) In explaining recommendations, ChatGPT-3.5, ChatGPT-4, and ChatGPT-4.o demonstrate a high accuracy of 71% to 91% and coherence with modern official guidelines of 84% to 92%. (2) The safety properties of ChatGPT-generated explanations estimated by doctors received the highest score of almost 100%. (3) On average, the stability and correctness of the GPT-4.o responses were more acceptable than those of other models for creating explanations. (4) The degree of user satisfaction with the recommendations obtained using the proposed algorithm was 88%, and the rating of the usefulness of the recommendations was 92%.
Funder
Ministry of Science and Higher Education of the Russian Federation
Reference45 articles.
1. 2021 ESC Guidelines on cardiovascular disease prevention in clinical practice;Visseren;Eur. Heart J.,2021
2. Global Strategy on Digital Health 2020–2025, World Health Organization. Available online: https://www.who.int/publications/i/item/9789240020924.
3. Cai, Y., and Yu, F. (2022). Health Recommender Systems Development, Usage, and Evaluation from 2010 to 2022: A Scoping Review. Int. J. Environ. Res. Public Health, 19.
4. Uta, M., Felfernig, A., Le, V.-M., and Burgstaller, T. (2024). Knowledge-based recommender systems: Overview and research directions. Front. Big Data, 7.
5. Knowledge-based recommender systems;Burke;Encyclopedia of Library and Information Science,2000