Author:
Faviez Carole,Chen Xiaoyi,Garcelon Nicolas,Zaidan Mohamad,Billot Katy,Petzold Friederike,Faour Hassan,Douillet Maxime,Rozet Jean-Michel,Cormier-Daire Valérie,Attié-Bitach Tania,Lyonnet Stanislas,Saunier Sophie,Burgun Anita
Abstract
Abstract
Background
There are approximately 8,000 different rare diseases that affect roughly 400 million people worldwide. Many of them suffer from delayed diagnosis. Ciliopathies are rare monogenic disorders characterized by a significant phenotypic and genetic heterogeneity that raises an important challenge for clinical diagnosis. Diagnosis support systems (DSS) applied to electronic health record (EHR) data may help identify undiagnosed patients, which is of paramount importance to improve patients’ care. Our objective was to evaluate three online-accessible rare disease DSSs using phenotypes derived from EHRs for the diagnosis of ciliopathies.
Methods
Two datasets of ciliopathy cases, either proven or suspected, and two datasets of controls were used to evaluate the DSSs. Patient phenotypes were automatically extracted from their EHRs and converted to Human Phenotype Ontology terms. We tested the ability of the DSSs to diagnose cases in contrast to controls based on Orphanet ontology.
Results
A total of 79 cases and 38 controls were selected. Performances of the DSSs on ciliopathy real world data (best DSS with area under the ROC curve = 0.72) were not as good as published performances on the test set used in the DSS development phase. None of these systems obtained results which could be described as “expert-level”. Patients with multisystemic symptoms were generally easier to diagnose than patients with isolated symptoms. Diseases easily confused with ciliopathy generally affected multiple organs and had overlapping phenotypes. Four challenges need to be considered to improve the performances: to make the DSSs interoperable with EHR systems, to validate the performances in real-life settings, to deal with data quality, and to leverage methods and resources for rare and complex diseases.
Conclusion
Our study provides insights into the complexities of diagnosing highly heterogenous rare diseases and offers lessons derived from evaluation existing DSSs in real-world settings. These insights are not only beneficial for ciliopathy diagnosis but also hold relevance for the enhancement of DSS for various complex rare disorders, by guiding the development of more clinically relevant rare disease DSSs, that could support early diagnosis and finally make more patients eligible for treatment.
Funder
Agence Nationale de la Recherche
Deutsche Forschungsgemeinschaft
Publisher
Springer Science and Business Media LLC
Reference66 articles.
1. RARE Disease Facts. Global Genes. https://globalgenes.org/rare-disease-facts/. Cited 2022 Jul 8.
2. Colbaugh R, Glass K, Rudolf C. Tremblay Volv Global, Lausanne, Switzerland M. Learning to identify rare disease patients from electronic health records. AMIA Annu Symp Proc. 2018;2018:340–7.
3. Neuraz A, Lerner I, Digan W, Paris N, Tsopra R, Rogier A, et al. Natural language processing for rapid response to emergent diseases: case study of calcium channel blockers and hypertension in the COVID-19 pandemic. J Med Internet Res. 2020;22(8):e20773.
4. Escudié JB, Rance B, Malamut G, Khater S, Burgun A, Cellier C, et al. A novel data-driven workflow combining literature and electronic health records to estimate comorbidities burden for a specific disease: a case study on autoimmune comorbidities in patients with celiac disease. BMC Med Inf Decis Mak. 2017;17:140.
5. Yang DD, Rio M, Michot C, Boddaert N, Yacoub W, Garcelon N, et al. Natural history of Myhre syndrome. Orphanet J Rare Dis. 2022;17(1):304.