Author:
Schmauch Benoît,Romagnoni Alberto,Pronier Elodie,Saillard Charlie,Maillé Pascale,Calderaro Julien,Sefta Meriem,Toldo Sylvain,Zaslavskiy Mikhail,Clozel Thomas,Moarii Matahi,Courtiol Pierre,Wainrib Gilles
Abstract
Deep learning methods for digital pathology analysis have proved an effective way to address multiple clinical questions, from diagnosis to prognosis and even to prediction of treatment outcomes. They have also recently been used to predict gene mutations from pathology images, but no comprehensive evaluation of their potential for extracting molecular features from histology slides has yet been performed. We propose a novel approach based on the integration of multiple data modes, and show that our deep learning model, HE2RNA, can be trained to systematically predict RNA-Seq profiles from whole-slide images alone, without the need for expert annotation. HE2RNA is interpretable by design, opening up new opportunities for virtual staining. In fact, it provides virtual spatialization of gene expression, as validated by double-staining on an independent dataset. Moreover, the transcriptomic representation learned by HE2RNA can be transferred to improve predictive performance for other tasks, particularly for small datasets. As an example of a task with direct clinical impact, we studied the prediction of microsatellite instability from hematoxylin & eosin stained images and our results show that better performance can be achieved in this setting.
Publisher
Cold Spring Harbor Laboratory
Reference58 articles.
1. A Practical Guide to Whole Slide Imaging: A White Paper From the Digital Pathology Association;Arch. Pathol. Lab. Med.,2019
2. Whole Slide Imaging Versus Microscopy for Primary Diagnosis in Surgical Pathology: A Multicenter Blinded Randomized Noninferiority Study of 1992 Cases (Pivotal Study);Am. J. Surg. Pathol.,2018
3. Mitosis detection in breast cancer pathology images by combining handcrafted and convolutional neural network features;J. Med. Imaging Bellingham Wash,2014
4. Mitosis detection in breast cancer histology images with deep neural networks;Med. Image Comput. Comput.-Assist. Interv. MICCAI Int. Conf. Med. Image Comput. Comput.-Assist. Interv.,2013
5. Antibody-supervised deep learning for quantification of tumor-infiltrating immune cells in hematoxylin and eosin stained breast cancer samples;J. Pathol. Inform.,2016
Cited by
6 articles.
订阅此论文施引文献
订阅此论文施引文献,注册后可以免费订阅5篇论文的施引文献,订阅后可以查看论文全部施引文献