Author:
Fisher Elizabeth,James Christian,Mosca Diana,Currie Bart J.,Ralph Anna P.
Abstract
Abstract
Background
Acute Rheumatic Fever (ARF) is a critically important condition for which there is no diagnostic test. Diagnosis requires the use of a set of criteria comprising clinical, laboratory, electrocardiographic and echocardiographic findings. The complexity of the algorithm and the fact that clinicians lack familiarity with ARF, make ARF diagnosis ideally suited to an electronic decision support tool. The ARF Diagnosis Calculator was developed to assist clinicians in diagnosing ARF and correctly assign categories of ‘possible, ‘probable’ or ‘definite’ ARF. This research aimed to evaluate the acceptability, accuracy, and test performance of the ARF Diagnosis Calculator.
Methods
Three strategies were used to provide triangulation of data. Users of the calculator employed at Top End Health Service, Northern Territory, Australia were invited to participate in an online survey, and clinicians with ARF expertise were invited to participate in semi-structured interviews. Qualitative data were analysed using inductive analysis. Performance of the calculator in correctly diagnosing ARF was assessed using clinical data from 35 patients presenting with suspected ARF. Diagnoses obtained from the calculator were compared using the Kappa statistic with those obtained from a panel of expert clinicians.
Results
Survey responses were available from 23 Top End Health Service medical practitioners, and interview data were available from five expert clinicians. Using a 6-point Likert scale, participants highly recommended the ARF Diagnosis Calculator (median 6, IQR 1), found it easy to use (median 5, IQR 1) and believed the calculator helped them diagnose ARF (median 5, IQR 1). Clinicians with ARF expertise noted that electronic decision making is not a substitute for clinical experience. There was high agreement between the ARF Diagnosis Calculator and the ‘gold standard’ ARF diagnostic process (κ = 0.767, 95% CI: 0.568–0.967). Incorrect assignment of diagnosis occurred in 4/35 (11%) patients highlighting the greater accuracy of expert clinical input for ambiguous presentations. Sixteen changes were incorporated into a revised version of the calculator.
Conclusions
The ARF Diagnosis Calculator is an easy-to-use, accessible tool, but it does not replace clinical expertise. The calculator performed well amongst clinicians and is an acceptable tool for use within the clinical setting with a high level of accuracy in comparison to the gold standard diagnostic process. Effective resources to support clinicians are critically important for improving the quality of care of ARF.
Funder
National Health and Medical Research Council
Publisher
Springer Science and Business Media LLC
Subject
Health Informatics,Health Policy,Computer Science Applications
Reference20 articles.
1. Australian Institute of Health and Welfare. Acute rheumatic fever and rheumatic hart disease in Australia, 2015–2019. Cat.no. CVD 90. Canberra: AIHW; 2021. Available from: https://www.aihw.gov.au/getmedia/ed8003f2-f2d6-41fc-ac7e-7ab5189f56ac/Acute-rheumatic-fever-and-rheumatic-heart-disease-in-Australia-2015-2019.pdf.aspx?inline=true.
2. Ralph AP, Carapetis JR. Group A streptococcal diseases and their global burden. Current topics in microbiology and immunology. 2013;368:1-27.
3. Ralph AP, Noonan S, Wade V, Currie BJ. The 2020 Australian guideline for prevention, diagnosis and management of acute rheumatic fever and rheumatic heart disease. Med J Aust. 2021;214(5):220-7
4. Gewitz MH, Baltimore RS, Tani LY, Sable CA, Shulman ST, Carapetis J, et al. Revision of the Jones Criteria for the diagnosis of acute rheumatic fever in the era of Doppler echocardiography: a scientific statement from the American Heart Association. Circulation. 2015;131(20):1806-18.
5. Jones T. The diagnosis of rheumatic fever. J Am Med Assoc. 1944;126:481-4.
Cited by
3 articles.
订阅此论文施引文献
订阅此论文施引文献,注册后可以免费订阅5篇论文的施引文献,订阅后可以查看论文全部施引文献