•Tumor proliferation is an important breast cancer prognostic biomarker.
•Previous efforts for automatic assessment were limited to mitosis detection in predefined regions.
•In a real-world setting, automatic methods must produce a score for whole-slide images.
•To bridge this gap, we have organized the TUPAC16 medical image analysis challenge.
•Eleven methods for assessment of two proliferation scores (mitosis-based and PAM50 molecular) were compared and evaluated.
Tumor proliferation is an important biomarker indicative of the prognosis of breast cancer patients. Assessment of tumor proliferation in a clinical setting is a highly subjective and labor-intensive task. Previous efforts to automate tumor proliferation assessment by image analysis only focused on mitosis detection in predefined tumor regions. However, in a real-world scenario, automatic mitosis detection should be performed in whole-slide images (WSIs) and an automatic method should be able to produce a tumor proliferation score given a WSI as input. To address this, we organized the TUmor Proliferation Assessment Challenge 2016 (TUPAC16) on prediction of tumor proliferation scores from WSIs.
The challenge dataset consisted of 500 training and 321 testing breast cancer histopathology WSIs. In order to ensure fair and independent evaluation, only the ground truth for the training dataset was provided to the challenge participants. The first task of the challenge was to predict mitotic scores, i.e., to reproduce the manual method of assessing tumor proliferation by a pathologist. The second task was to predict the gene expression based PAM50 proliferation scores from the WSI.
The best performing automatic method for the first task achieved a quadratic-weighted Cohen's kappa score of κ = 0.567, 95% CI [0.464, 0.671] between the predicted scores and the ground truth. For the second task, the predictions of the top method had a Spearman's correlation coefficient of r = 0.617, 95% CI [0.581 0.651] with the ground truth.
This was the first comparison study that investigated tumor proliferation assessment from WSIs. The achieved results are promising given the difficulty of the tasks and weakly-labeled nature of the ground truth. However, further research is needed to improve the practical utility of image analysis methods for this task.
Mitko Veta 1, Yujing J Heng 2, Nikolas Stathonikos 3, Babak Ehteshami Bejnordi 4, Francisco Beca 5, Thomas Wollmann 6, Karl Rohr 6, Manan A Shah 7, Dayong Wang 2, Mikael Rousson 8, Martin Hedlund 8, David Tellez 5, Francesco Ciompi 5, Erwan Zerhouni 9, David Lanyi 9, Matheus Viana 10, Vassili Kovalev 11, Vitali Liauchuk 11, Hady Ahmady Phoulady 12, Talha Qaiser 13, Simon Graham 13, Nasir Rajpoot 13, Erik Sjöblom 14, Jesper Molin 14, Kyunghyun Paeng 15, Sangheum Hwang 15, Sunggyun Park 15, Zhipeng Jia 16, Eric I-Chao Chang 17, Yan Xu 18, Andrew H Beck 2, Paul J van Diest 3, Josien P W Pluim 19
1Medical Image Analysis Group, Eindhoven University of Technology, Eindhoven, the Netherlands
2Department of Pathology, Beth Israel Deaconess Medical Center, Harvard Medical School, Boston, MA, USA
3Department of Pathology, University Medical Center Utrecht, Utrecht, the Netherlands
4Diagnostic Image Analysis Group, Radboud University Medical Center, Nijmegen, the Netherlands
5Department of Pathology, Stanford University School of Medicine, USA
6Biomedical Computer Vision Group, University of Heidelberg, BIOQUANT, IPMB and DKFZ, Heidelberg, Germany
7The Harker School, San Jose, USA
8ContextVision AB, Linköping, Sweden
9Foundations of Cognitive Computing, IBM Research Zürich, Rüschlikon, Switzerland
10Visual Analytics and Insights, IBM Research Brazil, São Paulo, Brazil
11Biomedical Image Analysis Department, United Institute of Informatics, Minsk, Belarus
12Department of Computer Science and Engineering, University of South Florida, Tampa, FL, USA
13Department of Computer Science, University of Warwick, Warwick, UK
14Research, Sectra, Linköping, Sweden
15Lunit Inc., Seoul, South Korea
16Institute for Interdisciplinary Information Sciences, Tsinghua University, Beijing, China
17Microsoft Research, Beijing, China
18Biology and Medicine Engineering, Beihang University, Beijing, China
Abstract: Deep learning-based predictive biomarker for adjuvant chemotherapy in early-stage hormone receptor-positive breast cancer
Abstract: Pan-cancer analysis of tumor microenvironment using deep learning-based cancer stroma and immune profiling in H&E images
Abstract: Deep learning-based predictive biomarker for immune checkpoint inhibitor response in metastatic non-small cell lung cancer
Abstract: Comprehensive deep learning analysis of H&E tissue phenomics reveals distinct immune landscape and transcriptomic enrichment profile among immune inflamed, excluded and desert subtypes...
Abstract: Deep-learning analysis of H&E images to define three immune phenotypes to reveal loss-of-target in excluded immune cells as a novel resistance mechanism of immune checkpoint inhibitor...
Abstract: Deep learning-based immune phenotype analysis reveals distinct resistance pattern of immune checkpoint inhibitor in non-small cell lung cancer
Accuracy and efficiency of an artificial intelligence tool when counting breast mitoses
Abstract: Artificial intelligence-powered spatial analysis of tumor infiltrating lymphocytes (TIL) to reflect target gene expressions of novel immuno-oncology agents.
Abstracts: Distinct subset of immune cells assessed by multiplex immunohistochemistry correlates with immune phenotype classified by ...
Abstracts : Pathologic validation of artificial intelligence-powered prediction of combined positive score of PD-L1 immunohistochemistry in urothelial carcinoma.
Abstracts : Clinical performance of artificial intelligence-powered annotation of tumor cell PD-L1 expression for treatment of immune-checkpoint inhibitor (ICI) ...
Abstracts : Artificial intelligence-powered spatial analysis of tumor-infiltrating lymphocytes predicts survival after immune checkpoint inhibitor therapy across multiple cancer types.
Abstracts : Deep learning based radiomic biomarker for predicting the presence of high-grade histologic patterns in lung adenocarcinoma
Abstract : Artificial intelligence-powered tissue analysis reveals distinct tumor-infiltrating lymphocyte profile as a potential biomarker of molecular subtypes in endometrial cancer
Abstract : Artificial intelligence-powered spatial analysis of tumor-infiltrating lymphocytes reveals distinct genomic profile of immune excluded phenotype in pan-carcinoma
Deep learning from HE slides predicts the clinical benefit from adjuvant chemotherapy in hormone receptor-positive breast cancer patients