Author:
Upadhyay Rishabh,Knoth Petr,Pasi Gabriella,Viviani Marco
Abstract
IntroductionPeople are today increasingly relying on health information they find online to make decisions that may impact both their physical and mental wellbeing. Therefore, there is a growing need for systems that can assess the truthfulness of such health information. Most of the current literature solutions use machine learning or knowledge-based approaches treating the problem as a binary classification task, discriminating between correct information and misinformation. Such solutions present several problems with regard to user decision making, among which: (i) the binary classification task provides users with just two predetermined possibilities with respect to the truthfulness of the information, which users should take for granted; indeed, (ii) the processes by which the results were obtained are often opaque and the results themselves have little or no interpretation.MethodsTo address these issues, we approach the problem as anad hocretrieval task rather than a classification task, with reference, in particular, to the Consumer Health Search task. To do this, a previously proposed Information Retrieval model, which considers information truthfulness as a dimension of relevance, is used to obtain a ranked list of both topically-relevant and truthful documents. The novelty of this work concerns the extension of such a model with a solution for the explainability of the results obtained, by relying on a knowledge base consisting of scientific evidence in the form of medical journal articles.Results and discussionWe evaluate the proposed solution both quantitatively, as a standard classification task, and qualitatively, through a user study to examine the “explained” ranked list of documents. The results obtained illustrate the solution's effectiveness and usefulness in making the retrieved results more interpretable by Consumer Health Searchers, both with respect to topical relevance and truthfulness.
Funder
Horizon 2020 Framework Programme
Reference67 articles.
1. Peeking inside the black-box: a survey on explainable artificial intelligence (XAI);Adadi;IEEE Access,2018
2. Use of the internet as a resource of health information by patients: a clinic-based study in the indian population;Akerkar;J. Postgrad. Med.,2005
3. Explainable information retrieval: A survey;Anand;arXiv preprint arXiv:2211.02405,2022
4. Combat COVID-19 infodemic using explainable natural language processing models;Ayoub;Inform. Process. Manage.,2021
5. On pixel-wise explanations for non-linear classifier decisions by layer-wise relevance propagation;Bach;PLoS ONE,2015