The ISMRM Open Science Initiative for Perfusion Imaging (OSIPI): Results from the OSIPI–Dynamic Contrast‐Enhanced challenge

Author:

Shalom Eve S.12ORCID,Kim Harrison3,van der Heijden Rianne A.45ORCID,Ahmed Zaki6ORCID,Patel Reyna7,Hormuth David A.8ORCID,DiCarlo Julie C.9ORCID,Yankeelov Thomas E.1011ORCID,Sisco Nicholas J.12,Dortch Richard D.12ORCID,Stokes Ashley M.12,Inglese Marianna1314,Grech‐Sollars Matthew141516ORCID,Toschi Nicola1317,Sahoo Prativa18,Singh Anup19,Verma Sanjay K.20,Rathore Divya K.21,Kazerouni Anum S.22ORCID,Partridge Savannah C.22ORCID,LoCastro Eve23ORCID,Paudyal Ramesh23,Wolansky Ivan A.23ORCID,Shukla‐Dave Amita2324,Schouten Pepijn25,Gurney‐Champion Oliver J.2526,Jiřík Radovan27ORCID,Macíček Ondřej27ORCID,Bartoš Michal28ORCID,Vitouš Jiří27ORCID,Das Ayesha Bharadwaj29ORCID,Kim S. Gene29ORCID,Bokacheva Louisa30,Mikheev Artem30,Rusinek Henry30ORCID,Berks Michael31ORCID,Hubbard Cristinacce Penny L.31ORCID,Little Ross A.31,Cheung Susan31,O'Connor James P. B.313233ORCID,Parker Geoff J. M.3435ORCID,Moloney Brendan36,LaViolette Peter S.37ORCID,Bobholz Samuel37ORCID,Duenweg Savannah37ORCID,Virostko John38ORCID,Laue Hendrik O.39,Sung Kyunghyun40ORCID,Nabavizadeh Ali4142,Saligheh Rad Hamidreza4344ORCID,Hu Leland S.45,Sourbron Steven2ORCID,Bell Laura C.46ORCID,Fathi Kazerooni Anahita4347ORCID

Affiliation:

1. School of Physics and Astronomy University of Leeds Leeds UK

2. Department of Infection Immunity and Cardiovascular Disease, University of Sheffield Sheffield UK

3. Department of Radiology University of Alabama Birmingham Alabama USA

4. Department of Radiology & Nuclear Medicine Erasmus MC University Medical Center Rotterdam The Netherlands

5. Department of Radiology University of Wisconsin–Madison Madison Wisconsin USA

6. Corewell Health William Beaumont University Hospital Royal Oak Michigan USA

7. Department of Radiology, Neuroradiology Division Mayo Clinic Scottsdale Arizona USA

8. Oden Institute for Computational Engineering and Sciences, The University of Texas Austin Texas USA

9. Biomedical Imaging Center, Livestrong Cancer Institutes, University of Texas at Austin Austin Texas USA

10. Departments of Biomedical Engineering, Diagnostic Medicine, Oncology, Livestrong Cancer Institutes Oden Institute for Computational Engineering and Sciences, The University of Texas Austin Texas USA

11. Department of Imaging Physics MD Anderson Cancer Center Houston Texas USA

12. Department of Translational Neuroscience Barrow Neurological Institute Phoenix Arizona USA

13. Department of Biomedicine and Prevention University of Rome Tor Vergata Italy

14. Department of Surgery and Cancer Imperial College London UK

15. Department of Computer Science University College London London UK

16. Lysholm Department of Neuroradiology, National Hospital for Neurology and Neurosurgery University College London Hospitals NHS Foundation Trust London UK

17. Athinoula A. Martinos Center for Biomedical Imaging Harvard Medical School Boston Massachusetts USA

18. University Medical Center Göttingen Göttingen Germany

19. Center for Biomedical Engineering, Indian Institute of Technology Delhi New Delhi India

20. Institute of Bioengineering and Bioimaging Singapore Singapore

21. Institute of Psychiatry, Psychology & Neuroscience King's College London UK

22. Department of Radiology University of Washington Seattle Washington USA

23. Department of Medical Physics Memorial Sloan Kettering Cancer Center New York New York USA

24. Department of Radiology Memorial Sloan Kettering Cancer Center New York New York USA

25. Department of Radiology and Nuclear Medicine University of Amsterdam Amsterdam The Netherlands

26. Cancer Center Amsterdam, Imaging and Biomarkers Amsterdam The Netherlands

27. Czech Academy of Sciences, Institute of Scientific Instruments Brno Czech Republic

28. Czech Academy of Sciences, Institute of Information Theory and Automation Praha Czech Republic

29. Department of Radiology Weill Cornell Medical College New York New York USA

30. Department of Radiology Grossman School of Medicine, New York University New York New York USA

31. Division of Cancer Sciences University of Manchester Manchester UK

32. Department of Radiology The Christie Hospital NHS Trust Manchester UK

33. Division of Radiotherapy and Imaging The Institute of Cancer Research London UK

34. Center for Medical Image Computing, Department of Medical Physics and Biomedical Engineering University College London London UK

35. Bioxydyn Ltd Manchester UK

36. Advanced Imaging Research Center, Oregon Health & Science Institute Portland Oregon USA

37. Department of Radiology Medical College of Wisconsin Milwaukee Wisconsin USA

38. Department of Diagnostic Medicine University of Texas Austin Texas USA

39. Fraunhofer Institute for Digital Medicine MEVIS Bremen Germany

40. Department of Radiological Sciences University of California Los Angeles California USA

41. Department of Radiology, Perelman School of Medicine University of Pennsylvania Philadelphia Pennsylvania USA

42. Center for Data‐Driven Discovery, Division of Neurosurgery Children's Hospital of Philadelphia Philadelphia Pennsylvania USA

43. Quantitative MR Imaging and Spectroscopy Group, Research Center for Molecular and Cellular Imaging Tehran University of Medical Sciences Tehran Iran

44. Center for Computational Imaging & Simulation Technologies in Biomedicine School of Computing/School of Medicine, University of Leeds Leeds UK

45. Neuroradiology Division, Department of Radiology Mayo Clinic Phoenix Arizona USA

46. Clinical Imaging Group, Genentech, Inc. South San Francisco California USA

47. Department of Neurosurgery, Perelman School of Medicine University of Pennsylvania Pennsylvania USA

Abstract

AbstractPurpose has often been proposed as a quantitative imaging biomarker for diagnosis, prognosis, and treatment response assessment for various tumors. None of the many software tools for quantification are standardized. The ISMRM Open Science Initiative for Perfusion Imaging–Dynamic Contrast‐Enhanced (OSIPI‐DCE) challenge was designed to benchmark methods to better help the efforts to standardize measurement.MethodsA framework was created to evaluate values produced by DCE‐MRI analysis pipelines to enable benchmarking. The perfusion MRI community was invited to apply their pipelines for quantification in glioblastoma from clinical and synthetic patients. Submissions were required to include the entrants' values, the applied software, and a standard operating procedure. These were evaluated using the proposed score defined with accuracy, repeatability, and reproducibility components.ResultsAcross the 10 received submissions, the score ranged from 28% to 78% with a 59% median. The accuracy, repeatability, and reproducibility scores ranged from 0.54 to 0.92, 0.64 to 0.86, and 0.65 to 1.00, respectively (0–1 = lowest–highest). Manual arterial input function selection markedly affected the reproducibility and showed greater variability in analysis than automated methods. Furthermore, provision of a detailed standard operating procedure was critical for higher reproducibility.ConclusionsThis study reports results from the OSIPI‐DCE challenge and highlights the high inter‐software variability within estimation, providing a framework for ongoing benchmarking against the scores presented. Through this challenge, the participating teams were ranked based on the performance of their software tools in the particular setting of this challenge. In a real‐world clinical setting, many of these tools may perform differently with different benchmarking methodology.

Funder

Bracco Diagnostics

Publisher

Wiley

Subject

Radiology, Nuclear Medicine and imaging

Cited by 1 articles. 订阅此论文施引文献 订阅此论文施引文献,注册后可以免费订阅5篇论文的施引文献,订阅后可以查看论文全部施引文献

同舟云学术

1.学者识别学者识别

2.学术分析学术分析

3.人才评估人才评估

"同舟云学术"是以全球学者为主线,采集、加工和组织学术论文而形成的新型学术文献查询和分析系统,可以对全球学者进行文献检索和人才价值评估。用户可以通过关注某些学科领域的顶尖人物而持续追踪该领域的学科进展和研究前沿。经过近期的数据扩容,当前同舟云学术共收录了国内外主流学术期刊6万余种,收集的期刊论文及会议论文总量共计约1.5亿篇,并以每天添加12000余篇中外论文的速度递增。我们也可以为用户提供个性化、定制化的学者数据。欢迎来电咨询!咨询电话:010-8811{复制后删除}0370

www.globalauthorid.com

TOP

Copyright © 2019-2024 北京同舟云网络信息技术有限公司
京公网安备11010802033243号  京ICP备18003416号-3