Programmed death ligand 1 (PD-L1) expression is the standard biomarker in advanced non-small cell lung cancer (NSCLC). However, manual evaluation of PD-L1 tumor proportion score (TPS) by pathologists has practical limitations of interobserver bias, variation in subjectivity on the area of interest, and intensive labor. This study aimed to explore whether the artificial intelligence (AI)-powered TPS analyzer could reduce the human discrepancy.
AI-powered TPS analyzer, namely Lunit SCOPE PD-L1, was developed with a total of 393,565 tumor cells annotated by board-certified pathologists for PD-L1 expression in 802 whole-slide images (WSI) of NSCLC stained by 22C3 pharmDx immunohistochemistry. Three independent pathologists labeled PD-L1 TPS into 3 class categories: TPS < 1%, 1-49%, or ≥ 50%, of 479 NSCLC slides. For the cases of disagreement between each pathologist and AI model, the pathologists were asked to revise TPS class in assistance with AI model which not only detects PD-L1 positivity of tumor cells, but also calculates WSI-level TPS. Finally, we compared the concordance rate of three pathologists with or without AI assistance.
Without AI assistance, 3 pathologists concordantly labeled TPS in 81.4% of cases (n = 390 / 479, κ = 0.798), and the concordance rate between the consensus of pathologists and standalone AI model was 86.4% (n = 337 / 390). Afterward, pathologists revised their initial labeling with assistance of AI model for the cases of disagreement between the pathologist and AI model (n = 91, 93, and 107, respectively for each pathologist). Interestingly, the overall concordance rate of three pathologists with AI assistance was increased to 90.2% (n = 432 / 479, κ = 0.890). Subgroup analysis showed that the concordance rates without AI assistance according to PD-L1 TPS <1%, 1-49%, and ≥50% class were 67.9%, 72.2%, and 92.4%, respectively, which were increased with AI assistance to 89.6%, 86.2%, and 93.6%, respectively.
Assistance with AI-powered TPS analyzer substantially improved the pathologist’s consensus and could be regarded as a reference for the final labeling of TPS, especially in the subgroups of TPS <1% and 1-49%.
S. Choi1, S. Kim2, H. Kim3, S. Cho4, M. Ma4, S. Park4, S. Pereira4, B.J. Aum4, S. Shin4, K. Paeng4, D. Yoo4, W. Jung4, C. Ock4, S. Lee5, Y. Choi1, J. Chung3, T.S. Mok6
1 Department Of Pathology And Translational Genomics, Samsung Medical Center, Sungkyunkwan University School of Medicine, 135-710 - Seoul/KR
2 Department Of Pathology, Ajou University School of Medicine, 16499 - Suwon/KR
3 Department Of Pathology, Seoul National University Bundang Hospital, 13620 - Seongnam/KR
4 Oncology Group, Lunit Inc., 06241 - Seoul/KR
5 Division Of Hematology-oncology, Department Of Medicine, Samsung Medical Center, Sungkyunkwan University School of Medicine, 135-710 - Seoul/KR
6 Department Of Clinical Oncology, State Key Laboratory of Translational Oncology and Chinese University of Hong Kong, 999077 - Shatin/HK
Abstract: Deep learning-based predictive biomarker for adjuvant chemotherapy in early-stage hormone receptor-positive breast cancer
Abstract: Pan-cancer analysis of tumor microenvironment using deep learning-based cancer stroma and immune profiling in H&E images
Abstract: Deep learning-based predictive biomarker for immune checkpoint inhibitor response in metastatic non-small cell lung cancer
Abstract: Comprehensive deep learning analysis of H&E tissue phenomics reveals distinct immune landscape and transcriptomic enrichment profile among immune inflamed, excluded and desert subtypes...
Abstract: Deep-learning analysis of H&E images to define three immune phenotypes to reveal loss-of-target in excluded immune cells as a novel resistance mechanism of immune checkpoint inhibitor...
Abstract: Deep learning-based immune phenotype analysis reveals distinct resistance pattern of immune checkpoint inhibitor in non-small cell lung cancer
Reducing Domain Gap by Reducing Style Bias
Predicting breast tumor proliferation from whole-slide images: The TUPAC16 challenge
Accuracy and efficiency of an artificial intelligence tool when counting breast mitoses
Abstract: Artificial intelligence-powered spatial analysis of tumor infiltrating lymphocytes (TIL) to reflect target gene expressions of novel immuno-oncology agents.
Abstract: Distinct subset of immune cells assessed by multiplex immunohistochemistry correlates with immune phenotype classified by ...
Abstract : Pathologic validation of artificial intelligence-powered prediction of combined positive score of PD-L1 immunohistochemistry in urothelial carcinoma.
Abstract : Clinical performance of artificial intelligence-powered annotation of tumor cell PD-L1 expression for treatment of immune-checkpoint inhibitor (ICI) ...
Abstract : Artificial intelligence-powered spatial analysis of tumor-infiltrating lymphocytes predicts survival after immune checkpoint inhibitor therapy across multiple cancer types.
Abstract : Deep learning based radiomic biomarker for predicting the presence of high-grade histologic patterns in lung adenocarcinoma
Abstract : Artificial intelligence-powered tissue analysis reveals distinct tumor-infiltrating lymphocyte profile as a potential biomarker of molecular subtypes in endometrial cancer
Abstract : Artificial intelligence-powered spatial analysis of tumor-infiltrating lymphocytes reveals distinct genomic profile of immune excluded phenotype in pan-carcinoma
Deep learning from HE slides predicts the clinical benefit from adjuvant chemotherapy in hormone receptor-positive breast cancer patients
Abstract : Interim results of phase I dose escalation study of YBL-006: A novel anti-PD-1 monoclonal antibody in advanced solid tumors
Abstract : AI-powered whole-slide image analysis of tumor-infiltrating lymphocytes for prediction of prognosis in colorectal cancer
Deep Learning Analysis of CT Images Reveals High-Grade Pathological Features to Predict Survival in Lung Adenocarcinoma
Artificial Intelligence–Powered Spatial Analysis of Tumor-Infiltrating Lymphocytes as Complementary Biomarker for Immune Checkpoint Inhibition in Non–Small-Cell Lung Cancer
Artificial Intelligence–Powered Hematoxylin and Eosin Analyzer Reveals Distinct Immunologic and Mutational Profiles among Immune Phenotypes in Non–Small-Cell Lung Cancer
Abstract : Artificial Intelligence-Powered Analyzer Reduces Inter-observer Variation in PD-L1 Tumor Proportion Score of Non-Small Cell Lung Cancer
Abstract : Artificial Intelligence-Powered Tumor Purity Assessment From H&E Whole Slide Images Correlates...
Abstract : Deep learning-based H&E analyzer reveals distinct immune profiles and clinical outcomes among immune phenotypes in uterine corpus endometrial carcinoma
Abstract : Artificial intelligence-powered spatial analysis of tumor-infiltrating lymphocytes reveals immune-excluded phenotype is correlated with TGF-beta pathway related genomic aberrations