Artificial intelligence in immunotherapy PET/SPECT imaging.
Immunotherapy has dramatically altered the therapeutic landscape for oncology, but more research is needed to identify patients who are likely to achieve durable clinical benefit and those who may develop unacceptable side effects. We investigated the role of artificial intelligence in PET/SPECT-guided approaches for immunotherapy-treated patients.
We performed a scoping review of MEDLINE, CENTRAL, and Embase databases using key terms related to immunotherapy, PET/SPECT imaging, and AI/radiomics through October 12, 2022.
Of the 217 studies identified in our literature search, 24 relevant articles were selected. The median (interquartile range) sample size of included patient cohorts was 63 (157). Primary tumors of interest were lung (n = 14/24, 58.3%), lymphoma (n = 4/24, 16.7%), or melanoma (n = 4/24, 16.7%). A total of 28 treatment regimens were employed, including anti-PD-(L)1 (n = 13/28, 46.4%) and anti-CTLA-4 (n = 4/28, 14.3%) monoclonal antibodies. Predictive models were built from imaging features using univariate radiomics (n = 7/24, 29.2%), radiomics (n = 12/24, 50.0%), or deep learning (n = 5/24, 20.8%) and were most often used to prognosticate (n = 6/24, 25.0%) or describe tumor phenotype (n = 5/24, 20.8%). Eighteen studies (75.0%) performed AI model validation.
Preliminary results suggest broad potential for the application of AI-guided immunotherapy management after further validation of models on large, prospective, multicenter cohorts.
This scoping review describes how artificial intelligence models are built to make predictions based on medical imaging and explores their application specifically in the PET and SPECT examination of immunotherapy-treated cancers.
• Immunotherapy has drastically altered the cancer treatment landscape but is known to precipitate response patterns that are not accurately accounted for by traditional imaging methods. • There is an unmet need for better tools to not only facilitate in-treatment evaluation but also to predict, a priori, which patients are likely to achieve a good response with a certain treatment as well as those who are likely to develop side effects. • Artificial intelligence applied to PET/SPECT imaging of immunotherapy-treated patients is mainly used to make predictions about prognosis or tumor phenotype and is built from baseline, pre-treatment images. Further testing is required before a true transition to clinical application can be realized.
McGale JP
,Chen DL
,Trebeschi S
,Farwell MD
,Wu AM
,Cutler CS
,Schwartz LH
,Dercle L
... -
《-》
Artificial intelligence and radiomics: fundamentals, applications, and challenges in immunotherapy.
Immunotherapy offers the potential for durable clinical benefit but calls into question the association between tumor size and outcome that currently forms the basis for imaging-guided treatment. Artificial intelligence (AI) and radiomics allow for discovery of novel patterns in medical images that can increase radiology's role in management of patients with cancer, although methodological issues in the literature limit its clinical application. Using keywords related to immunotherapy and radiomics, we performed a literature review of MEDLINE, CENTRAL, and Embase from database inception through February 2022. We removed all duplicates, non-English language reports, abstracts, reviews, editorials, perspectives, case reports, book chapters, and non-relevant studies. From the remaining articles, the following information was extracted: publication information, sample size, primary tumor site, imaging modality, primary and secondary study objectives, data collection strategy (retrospective vs prospective, single center vs multicenter), radiomic signature validation strategy, signature performance, and metrics for calculation of a Radiomics Quality Score (RQS). We identified 351 studies, of which 87 were unique reports relevant to our research question. The median (IQR) of cohort sizes was 101 (57-180). Primary stated goals for radiomics model development were prognostication (n=29, 33.3%), treatment response prediction (n=24, 27.6%), and characterization of tumor phenotype (n=14, 16.1%) or immune environment (n=13, 14.9%). Most studies were retrospective (n=75, 86.2%) and recruited patients from a single center (n=57, 65.5%). For studies with available information on model testing, most (n=54, 65.9%) used a validation set or better. Performance metrics were generally highest for radiomics signatures predicting treatment response or tumor phenotype, as opposed to immune environment and overall prognosis. Out of a possible maximum of 36 points, the median (IQR) of RQS was 12 (10-16). While a rapidly increasing number of promising results offer proof of concept that AI and radiomics could drive precision medicine approaches for a wide range of indications, standardizing the data collection as well as optimizing the methodological quality and rigor are necessary before these results can be translated into clinical practice.
Dercle L
,McGale J
,Sun S
,Marabelle A
,Yeh R
,Deutsch E
,Mokrane FZ
,Farwell M
,Ammari S
,Schoder H
,Zhao B
,Schwartz LH
... -
《Journal for ImmunoTherapy of Cancer》
CT radiomics compared to a clinical model for predicting checkpoint inhibitor treatment outcomes in patients with advanced melanoma.
Predicting checkpoint inhibitors treatment outcomes in melanoma is a relevant task, due to the unpredictable and potentially fatal toxicity and high costs for society. However, accurate biomarkers for treatment outcomes are lacking. Radiomics are a technique to quantitatively capture tumour characteristics on readily available computed tomography (CT) imaging. The purpose of this study was to investigate the added value of radiomics for predicting clinical benefit from checkpoint inhibitors in melanoma in a large, multicenter cohort.
Patients who received first-line anti-PD1±anti-CTLA4 treatment for advanced cutaneous melanoma were retrospectively identified from nine participating hospitals. For every patient, up to five representative lesions were segmented on baseline CT, and radiomics features were extracted. A machine learning pipeline was trained on the radiomics features to predict clinical benefit, defined as stable disease for more than 6 months or response per RECIST 1.1 criteria. This approach was evaluated using a leave-one-centre-out cross validation and compared to a model based on previously discovered clinical predictors. Lastly, a combination model was built on the radiomics and clinical model.
A total of 620 patients were included, of which 59.2% experienced clinical benefit. The radiomics model achieved an area under the receiver operator characteristic curve (AUROC) of 0.607 [95% CI, 0.562-0.652], lower than that of the clinical model (AUROC=0.646 [95% CI, 0.600-0.692]). The combination model yielded no improvement over the clinical model in terms of discrimination (AUROC=0.636 [95% CI, 0.592-0.680]) or calibration. The output of the radiomics model was significantly correlated with three out of five input variables of the clinical model (p < 0.001).
The radiomics model achieved a moderate predictive value of clinical benefit, which was statistically significant. However, a radiomics approach was unable to add value to a simpler clinical model, most likely due to the overlap in predictive information learned by both models. Future research should focus on the application of deep learning, spectral CT-derived radiomics, and a multimodal approach for accurately predicting benefit to checkpoint inhibitor treatment in advanced melanoma.
Ter Maat LS
,van Duin IAJ
,Elias SG
,Leiner T
,Verhoeff JJC
,Arntz ERAN
,Troenokarso MF
,Blokx WAM
,Isgum I
,de Wit GA
,van den Berkmortel FWPJ
,Boers-Sonderen MJ
,Boomsma MF
,van den Eertwegh FJM
,de Groot JWB
,Piersma D
,Vreugdenhil A
,Westgeest HM
,Kapiteijn E
,van Diest PJ
,Pluim JPW
,de Jong PA
,Suijkerbuijk KPM
,Veta M
... -
《-》