Pitfalls in machine learning‐based assessment of tumor‐infiltrating lymphocytes in breast cancer: A report of the International Immuno‐Oncology Biomarker Working Group on Breast Cancer

Author:

Thagaard Jeppe12,Broeckx Glenn34ORCID,Page David B5ORCID,Jahangir Chowdhury Arif6ORCID,Verbandt Sara7,Kos Zuzana8,Gupta Rajarsi9ORCID,Khiroya Reena10,Abduljabbar Khalid11,Acosta Haab Gabriela12,Acs Balazs1314ORCID,Akturk Guray15,Almeida Jonas S16,Alvarado‐Cabrero Isabel17,Amgad Mohamed18,Azmoudeh‐Ardalan Farid19,Badve Sunil20,Baharun Nurkhairul Bariyah21,Balslev Eva22,Bellolio Enrique R23,Bheemaraju Vydehi24,Blenman Kim RM2526,Botinelly Mendonça Fujimoto Luciana27,Bouchmaa Najat28,Burgues Octavio29,Chardas Alexandros30ORCID,Chon U Cheang Maggie31,Ciompi Francesco32,Cooper Lee AD33,Coosemans An34,Corredor Germán35,Dahl Anders B1,Dantas Portela Flavio Luis36ORCID,Deman Frederik3,Demaria Sandra3738,Doré Hansen Johan2,Dudgeon Sarah N39,Ebstrup Thomas2,Elghazawy Mahmoud4041,Fernandez‐Martín Claudio42,Fox Stephen B43,Gallagher William M6,Giltnane Jennifer M44,Gnjatic Sacha45,Gonzalez‐Ericsson Paula I46ORCID,Grigoriadis Anita4748ORCID,Halama Niels49,Hanna Matthew G50,Harbhajanka Aparna51,Hart Steven N52ORCID,Hartman Johan1314,Hauberg Søren1,Hewitt Stephen53,Hida Akira I54,Horlings Hugo M55,Husain Zaheed56,Hytopoulos Evangelos57,Irshad Sheeba58,Janssen Emiel AM5960,Kahila Mohamed61,Kataoka Tatsuki R62ORCID,Kawaguchi Kosuke63,Kharidehal Durga24,Khramtsov Andrey I64,Kiraz Umay5960,Kirtani Pawan65,Kodach Liudmila L66,Korski Konstanty67,Kovács Anikó6869,Laenkholm Anne‐Vibeke7071,Lang‐Schwarz Corinna72,Larsimont Denis73,Lennerz Jochen K74,Lerousseau Marvin757677,Li Xiaoxian78,Ly Amy79,Madabhushi Anant80,Maley Sai K81,Manur Narasimhamurthy Vidya82,Marks Douglas K83,McDonald Elizabeth S84,Mehrotra Ravi8586,Michiels Stefan87,Minhas Fayyaz ul Amir Afsar88,Mittal Shachi89,Moore David A90,Mushtaq Shamim91,Nighat Hussain92,Papathomas Thomas9394,Penault‐Llorca Frederique95,Perera Rashindrie D9697,Pinard Christopher J9899100101,Pinto‐Cardenas Juan Carlos102,Pruneri Giancarlo103104,Pusztai Lajos105106,Rahman Arman6,Rajpoot Nasir Mahmood107,Rapoport Bernardo Leon108109,Rau Tilman T110ORCID,Reis‐Filho Jorge S111ORCID,Ribeiro Joana M112,Rimm David113114ORCID,Roslind Anne22,Vincent‐Salomon Anne115,Salto‐Tellez Manuel116117,Saltz Joel9,Sayed Shahin118,Scott Ely119,Siziopikou Kalliopi P120,Sotiriou Christos121122,Stenzinger Albrecht123124,Sughayer Maher A125,Sur Daniel126,Fineberg Susan127128,Symmans Fraser129,Tanaka Sunao130,Taxter Timothy131,Tejpar Sabine7,Teuwen Jonas132,Thompson E Aubrey133,Tramm Trine134135,Tran William T136,van der Laak Jeroen137,van Diest Paul J138139,Verghese Gregory E4748ORCID,Viale Giuseppe140141,Vieth Michael72,Wahab Noorul142ORCID,Walter Thomas757677,Waumans Yannick143,Wen Hannah Y50,Yang Wentao144,Yuan Yinyin145,Zin Reena Md146,Adams Sylvia83147,Bartlett John148,Loibl Sibylle149,Denkert Carsten150,Savas Peter97151,Loi Sherene97151,Salgado Roberto397,Specht Stovgaard Elisabeth22152

Affiliation:

1. Technical University of Denmark Kongens Lyngby Denmark

2. Visiopharm A/S Hørsholm Denmark

3. Department of Pathology GZA‐ZNA Hospitals Antwerp Belgium

4. Centre for Oncological Research (CORE), MIPPRO, Faculty of Medicine Antwerp University Antwerp Belgium

5. Earle A Chiles Research Institute Providence Cancer Institute Portland OR USA

6. UCD School of Biomolecular and Biomedical Science, UCD Conway Institute University College Dublin Dublin Ireland

7. Digestive Oncology, Department of Oncology KU Leuven Leuven Belgium

8. Department of Pathology and Laboratory Medicine BC Cancer Vancouver Centre, University of British Columbia Vancouver British Columbia Canada

9. Department of Biomedical Informatics Stony Brook University Stony Brook NY USA

10. Department of Cellular Pathology University College Hospital London London UK

11. Centre for Evolution and Cancer The Institute of Cancer Research London UK

12. Hospital Maria Curie Buenos Aires Argentina

13. Department of Oncology and Pathology Karolinska Institutet Stockholm Sweden

14. Department of Clinical Pathology and Cancer Diagnostics Karolinska University Hospital Stockholm Sweden

15. Translational Molecular Biomarkers, Merck & Co Inc Rahway NJ USA

16. Division of Cancer Epidemiology and Genetics (DCEG) National Cancer Institute (NCI) Rockville, MD USA

17. Oncology Hospital Star Medica Centro Ciudad de México Mexico

18. Department of Pathology Northwestern University Feinberg School of Medicine Chicago IL USA

19. Tehran University of Medical Sciences Tehran Iran

20. Department of Pathology and Laboratory Medicine, Emory University School of Medicine Emory University Winship Cancer Institute Atlanta GA USA

21. The National University of Malaysia Kuala Lumpur Malaysia

22. Department of Pathology Herlev and Gentofte Hospital Herlev Denmark

23. Departamento de Anatomía Patológica, Facultad de Medicina Universidad de La Frontera Temuco Chile

24. Department of Pathology Narayana Medical College Nellore India

25. Department of Internal Medicine Section of Medical Oncology and Yale Cancer Center Yale School of Medicine New Haven CT USA

26. Department of Computer Science Yale School of Engineering and Applied Science New Haven CT USA

27. Department of Pathology and Legal Medicine Amazonas Federal University Manaus Brazil

28. Institute of Biological Sciences, Faculty of Medical Sciences Mohammed VI Polytechnic University (UM6P) Ben‐Guerir Morocco

29. Pathology Department Hospital Cliníco Universitario de Valencia/Incliva Valencia Spain

30. Department of Pathobiology & Population Sciences The Royal Veterinary College London UK

31. Head of Integrative Genomics Analysis in Clinical Trials, ICR‐CTSU, Division of Clinical Studies The Institute of Cancer Research London UK

32. Radboud University Medical Center Department of Pathology Nijmegen The Netherlands

33. Department of Pathology Northwestern Feinberg School of Medicine Chicago IL USA

34. Department of Oncology, Laboratory of Tumor Immunology and Immunotherapy KU Leuven Leuven Belgium

35. Biomedical Engineering Department Emory University Atlanta GA USA

36. Hospital Universitário Getúlio Vargas Manaus Brazil

37. Department of Radiation Oncology Weill Cornell Medicine New York NY USA

38. Department of Pathology and Laboratory Medicine Weill Cornell Medicine New York NY USA

39. Conputational Biology and Bioinformatics Yale University New Haven CT USA

40. University of Surrey Guildford UK

41. Ain Shams University Cairo Egypt

42. Instituto Universitario de Investigación en Tecnología Centrada en el Ser Humano, HUMAN‐tech Universitat Politècnica de València Valencia Spain

43. Pathology, Peter MacCallum Cancer Centre and Sir Peter MacCallum Department of Oncology University of Melbourne Melbourne Victoria Australia

44. Genentech San Francisco CA USA

45. Department of Oncological Sciences, Medicine Hem/Onc, and Pathology, Tisch Cancer Institute – Precision Immunology Institute Icahn School of Medicine at Mount Sinai New York NY USA

46. Department of Medicine Vanderbilt University Medical Center Nashville TN USA

47. Cancer Bioinformatics, School of Cancer & Pharmaceutical Sciences, Faculty of Life Sciences and Medicine King's College London London UK

48. The Breast Cancer Now Research Unit, School of Cancer and Pharmaceutical Sciences, Faculty of Life Sciences and Medicine King's College London London UK

49. Department of Translational Immunotherapy German Cancer Research Center Heidelberg Germany

50. Department of Pathology Memorial Sloan Kettering Cancer Center New York USA

51. Case Western University Cleveland OH USA

52. Department of Laboratory Medicine and Pathology Mayo Clinic Rochester, MN USA

53. Laboratory of Pathology, Center for Cancer Research, National Cancer Institute National Institutes of Health Bethesda MD USA

54. Department of Pathology Matsuyama Shimin Hospital Matsuyama Japan

55. Division of Pathology Netherlands Cancer Institute (NKI) Amsterdam The Netherlands

56. Praava Health Dhaka Bangladesh

57. iRhythm Technologies San Francisco CA USA

58. King's College London & Guy's & St Thomas’ NHS Trust London UK

59. Department of Pathology Stavanger University Hospital Stavanger Norway

60. Department of Chemistry, Bioscience and Environmental Technology University of Stavanger Stavanger Norway

61. Department of Pathology Yale University New Haven CT USA

62. Department of Pathology Iwate Medical University Morioka Japan

63. Department of Breast Surgery Kyoto University Graduate School of Medicine Kyoto Japan

64. Department of Pathology and Laboratory Medicine Ann & Robert H. Lurie Children's Hospital of Chicago Chicago IL USA

65. Department of Histopathology Aakash Healthcare Super Speciality Hospital New Delhi India

66. Department of Pathology Netherlands Cancer Institute – Antoni van Leeuwenhoek Hospital Amsterdam The Netherlands

67. Data, Analytics and Imaging, Product Development F. Hoffmann‐La Roche AG Basel Switzerland

68. Department of Clinical Pathology Sahlgrenska University Hospital Gothenburg Sweden

69. Institute of Biomedicine, Sahlgrenska Academy University of Gothenburg Gothenburg Sweden

70. Department of Surgical Pathology Zealand University Hospital Roskilde Denmark

71. Department of Surgical Pathology University of Copenhagen Copenhagen Denmark

72. Institute of Pathology, Klinikum Bayreuth GmbH Friedrich‐Alexander‐University Erlangen‐Nuremberg Bayreuth Germany

73. Institut Jules Bordet Université Libre de Bruxelles Brussels Belgium

74. Center for Integrated Diagnostics Massachusetts General Hospital/Harvard Medical School Boston MA USA

75. Centre for Computational Biology (CBIO) Mines Paris, PSL University Paris France

76. Institut Curie PSL University Paris France

77. INSERM Paris France

78. Department of Pathology and Laboratory Medicine Emory University Atlanta GA USA

79. Department of Pathology Massachusetts General Hospital Boston MA USA

80. Department of Biomedical Engineering, Radiology and Imaging Sciences, Biomedical Informatics, Pathology Georgia Institute of Technology and Emory University Atlanta GA USA

81. NRG Oncology/NSABP Foundation Pittsburgh PA USA

82. Manipal Hospitals Bangalore India

83. Perlmutter Cancer Center NYU Langone Health New York NY USA

84. Breast Cancer Translational Research Group University of Pennsylvania Philadelphia PA USA

85. Indian Cancer Genomic Atlas Pune India

86. Centre for Health, Innovation and Policy Foundation Noida India

87. Office of Biostatistics and Epidemiology, Gustave Roussy, Oncostat U1018, Inserm University Paris‐Saclay, Ligue Contre le Cancer labeled Team Villejuif France

88. Tissue Image Analytics Centre, Warwick Cancer Research Centre, PathLAKE Consortium, Department of Computer Science University of Warwick Coventry UK

89. Department of Chemical Engineering, Department of Laboratory Medicine and Pathology University of Washington Seattle, WA USA

90. CRUK Lung Cancer Centre of Excellence, UCL and Cellular Pathology Department UCLH London UK

91. Department of Biochemistry Ziauddin University Karachi Pakistan

92. Pathology and Laboratory Medicine All India Institute of Medical sciences Raipur India

93. Institute of Metabolism and Systems Research University of Birmingham Birmingham UK

94. Department of Clinical Pathology Drammen Sykehus, Vestre Viken HF Drammen Norway

95. Centre Jean Perrin, Université Clermont Auvergne, INSERM, U1240 Imagerie Moléculaire et Stratégies Théranostiques Clermont Ferrand France

96. School of Electrical, Mechanical and Infrastructure Engineering University of Melbourne Melbourne Victoria Australia

97. Division of Cancer Research Peter MacCallum Cancer Centre Melbourne Victoria Australia

98. Radiogenomics Laboratory Sunnybrook Health Sciences Centre Toronto Ontario Canada

99. Department of Clinical Studies, Ontario Veterinary College University of Guelph Guelph Ontario Canada

100. Department of Oncology Lakeshore Animal Health Partners Mississauga Ontario Canada

101. Centre for Advancing Responsible and Ethical Artificial Intelligence (CARE‐AI) University of Guelph Guelph Ontario Canada

102. Diagnostico de Salud Animal SA Ciudad de México Mexico

103. Department of Pathology and Laboratory Medicine Fondazione IRCCS Istituto Nazionale dei Tumori Milan Italy

104. Faculty of Medicine and Surgery University of Milan Milan Italy

105. Yale Cancer Center Yale University New Haven CT USA

106. Department of Medical Oncology, Yale School of Medicine Yale University New Haven CT USA

107. University of Warwick Coventry UK

108. The Medical Oncology Centre of Rosebank Johannesburg South Africa

109. Department of Immunology, Faculty of Health Sciences University of Pretoria Pretoria South Africa

110. Institute of Pathology University Hospital Düsseldorf and Heinrich‐Heine‐University Düsseldorf Düsseldorf Germany

111. Department of Pathology and Laboratory Medicine Memorial Sloan Kettering Cancer Center New York NY USA

112. Département de Médecine Oncologique Gustave Roussy Villejuif France

113. Department of Pathology Yale University School of Medicine New Haven CT USA

114. Department of Medicine Yale University School of Medicine New Haven CT USA

115. Department of Diagnostic and Theranostic Medicine, Institut Curie University Paris‐Sciences et Lettres Paris France

116. Integrated Pathology Unit The Institute of Cancer Research London UK

117. Precision Medicine Centre Queen's University Belfast Belfast UK

118. Department of Pathology Aga Khan University Nairobi Kenya

119. Translational Pathology Translational Sciences and Diagnostics/Translational Medicine/R&D, Bristol Myers Squibb Princeton NJ USA

120. Department of Pathology, Section of Breast Pathology Northwestern University Feinberg School of Medicine Chicago IL USA

121. Breast Cancer Translational Research Laboratory J.‐C. Heuson, Institut Jules Bordet, Hôpital Universitaire de Bruxelles (HUB) Université Libre de Bruxelles (ULB) Brussels Belgium

122. Medical Oncology Department, Institut Jules Bordet, Hôpital Universitaire de Bruxelles (HUB) Université Libre de Bruxelles (ULB) Brussels Belgium

123. Institute of Pathology University Hospital Heidelberg Heidelberg Germany

124. Centers for Personalized Medicine (ZPM) Heidelberg Germany

125. King Hussein Cancer Center Amman Jordan

126. Department of Medical Oncology University of Medicine and Pharmacy “Iuliu Hatieganu” Cluj‐Napoca Romania

127. Montefiore Medical Center Bronx NY USA

128. Albert Einstein College of Medicine Bronx NY USA

129. University of Texas MD Anderson Cancer Center Houston TX USA

130. Kyoto University Kyoto Japan

131. Tempus Labs Chicago IL USA

132. AI for Oncology Lab, The Netherlands Cancer Institute Amsterdam The Netherlands

133. Mayo Clinic Florida Jacksonville FL USA

134. Department of Pathology Aarhus University Hospital Aarhus Denmark

135. Institute of Clinical Medicine Aarhus University Aarhus Denmark

136. Department of Radiation Oncology University of Toronto and Sunnybrook Health Sciences Centre Toronto Ontario Canada

137. Department of Pathology Radboud University Medical Center Nijmegen The Netherlands

138. Department of Pathology University Medical Center Utrecht The Netherlands

139. Johns Hopkins Oncology Center Baltimore MD USA

140. Department of Pathology European Institute of Oncology Milan Italy

141. Department of Pathology University of Milan Milan Italy

142. Tissue Image Analytics Centre, Department of Computer Science University of Warwick Coventry UK

143. CellCarta NV Antwerp Belgium

144. Fudan Medical University Shanghai Cancer Center Shanghai PR China

145. Department of Translational Molecular Pathology, Division of Pathology and Laboratory Medicine The University of Texas MD Anderson Cancer Center Houston TX USA

146. Department of Pathology, Faculty of Medicine Universiti Kebangsaan Malaysia Kuala Lumpur Malaysia

147. Department of Medicine NYU Grossman School of Medicine Manhattan NY USA

148. University of Edinburgh Edinburgh UK

149. Department of Medicine and Research German Breast Group Neu‐Isenburg Germany

150. Institut für Pathologie Philipps‐Universität Marburg und Universitätsklinikum Marburg Marburg Germany

151. The Sir Peter MacCallum Department of Medical Oncology University of Melbourne Melbourne Victoria Australia

152. Department of Clinical Medicine University of Copenhagen Copenhagen Denmark

Abstract

AbstractThe clinical significance of the tumor‐immune interaction in breast cancer is now established, and tumor‐infiltrating lymphocytes (TILs) have emerged as predictive and prognostic biomarkers for patients with triple‐negative (estrogen receptor, progesterone receptor, and HER2‐negative) breast cancer and HER2‐positive breast cancer. How computational assessments of TILs might complement manual TIL assessment in trial and daily practices is currently debated. Recent efforts to use machine learning (ML) to automatically evaluate TILs have shown promising results. We review state‐of‐the‐art approaches and identify pitfalls and challenges of automated TIL evaluation by studying the root cause of ML discordances in comparison to manual TIL quantification. We categorize our findings into four main topics: (1) technical slide issues, (2) ML and image analysis aspects, (3) data challenges, and (4) validation issues. The main reason for discordant assessments is the inclusion of false‐positive areas or cells identified by performance on certain tissue patterns or design choices in the computational implementation. To aid the adoption of ML for TIL assessment, we provide an in‐depth discussion of ML and image analysis, including validation issues that need to be considered before reliable computational reporting of TILs can be incorporated into the trial and routine clinical management of patients with triple‐negative breast cancer. © 2023 The Authors. The Journal of Pathology published by John Wiley & Sons Ltd on behalf of The Pathological Society of Great Britain and Ireland.

Funder

Svenska Sällskapet för Medicinsk Forskning

DOD Peer Reviewed Cancer Research Program

U.S. Department of Defense

National Health and Medical Research Council

Irish Cancer Society

National Institutes of Health

Cancer Research UK

Japan Society for the Promotion of Science

National Cancer Institute

National Institute of Biomedical Imaging and Bioengineering

U.S. Department of Veterans Affairs

DOD Prostate Cancer Research Program

Engineering and Physical Sciences Research Council

Peter MacCallum Cancer Centre

Breast Cancer Research Foundation

Breast Cancer Now

Agence Nationale de la Recherche

Publisher

Wiley

Subject

Pathology and Forensic Medicine

同舟云学术

1.学者识别学者识别

2.学术分析学术分析

3.人才评估人才评估

"同舟云学术"是以全球学者为主线,采集、加工和组织学术论文而形成的新型学术文献查询和分析系统,可以对全球学者进行文献检索和人才价值评估。用户可以通过关注某些学科领域的顶尖人物而持续追踪该领域的学科进展和研究前沿。经过近期的数据扩容,当前同舟云学术共收录了国内外主流学术期刊6万余种,收集的期刊论文及会议论文总量共计约1.5亿篇,并以每天添加12000余篇中外论文的速度递增。我们也可以为用户提供个性化、定制化的学者数据。欢迎来电咨询!咨询电话:010-8811{复制后删除}0370

www.globalauthorid.com

TOP

Copyright © 2019-2024 北京同舟云网络信息技术有限公司
京公网安备11010802033243号  京ICP备18003416号-3