Abstract
AbstractBackgroundNovel products applying artificial intelligence (AI)-based approaches to digital pathology images have consistently emerged onto the commercial market, touting improvements in diagnostic accuracy, workflow efficiency, and treatment selection. However, publicly available information on these products can be variable, with few sources to obtain independent evidence.MethodsOur objective was to identify and assess the public evidence on AI-based products for digital pathology. We compared key features of products on the European Economic Area/Great Britain (EEA/GB) markets, including their regulatory approval, intended use, and published validation studies. We included products that used haematoxylin and eosin (H&E)-stained tissue images as input, applied an AI-based method to support image interpretation, and received regulatory approval by September 2023.ResultsWe identified 26 AI-based products that met our inclusion criteria. The majority (73%) were focused on breast pathology or uropathology, and their primary function was tumour or feature detection. Of the 26 products, 24 had received regulatory approval via the self-certification route as Generalin vitrodiagnostic (IVD) medical devices, which does not require independent review by a conformity assessment body. Furthermore, only 10 of the products (38%) were associated with peer-reviewed scientific publications describing their development and internal validation, while 11 products (42%) had peer-reviewed publications describing external validation (i.e., testing on data from a source distinct to that used in development).ConclusionsThe availability of public information on new products for digital pathology is struggling to keep up with the rapid pace of development. To support transparency, we gathered available public evidence on regulatory-approved AI products into an online register:https://resources.npic.uk/AI/ProductRegister. We anticipate this will provide an accessible resource on novel devices and support decisions on which products could bring benefit to patients.
Publisher
Cold Spring Harbor Laboratory
Reference57 articles.
1. The NICE Evidence Standards Framework for digital health and care technologies – Developing and maintaining an innovative evidence framework with global impact
2. Evidence standards framework (ESF) for digital health technologies | Our programmes | What we do | About. NICE. Accessed December 4, 2022. https://www.nice.org.uk/about/what-we-do/our-programmes/evidence-standards-framework-for-digital-health-technologies
3. Digital Technology Assessment Criteria (DTAC). NHS Transformation Directorate. Accessed December 4, 2022. https://transform.england.nhs.uk/key-tools-and-info/digital-technology-assessment-criteria-dtac/
4. A guide to good practice for digital and data-driven health technologies. GOV.UK. Accessed December 4, 2022. https://www.gov.uk/government/publications/code-of-conduct-for-data-driven-health-and-care-technology/initial-code-of-conduct-for-data-driven-health-and-care-technology
5. Recommendations on compiling test datasets for evaluating artificial intelligence solutions in pathology