Development and validation of an interpretable machine learning model for predicting the risk of hepatocellular carcinoma in patients with chronic hepatitis B: a case-control study.
The aim of this study was to develop and internally validate an interpretable machine learning (ML) model for predicting the risk of hepatocellular carcinoma (HCC) in patients with chronic hepatitis B (CHB) infection.
We retrospectively collected clinical data from patients with HCC and CHB treated at the Fourth Affiliated Hospital of Guangxi Medical University from January 2022 to December 2022, including demographics, comorbidities, and laboratory parameters. The datasets were randomly divided into a training set (361 cases) and a validation set (155 cases) in a 7:3 ratio. Variables were screened using Least Absolute Shrinkage and Selection Operator (LASSO) and multifactor logistic regression. The prediction model of HCC risk in CHB patients was constructed based on five machine learning models, including logistic regression (LR), K-nearest neighbour (KNN), support vector machine (SVM), random forest (RF) and artificial neural network (ANN). Receiver operating characteristic (ROC) curve, calibration curve and decision curve analysis (DCA) were used to evaluate the predictive performance of the model in terms of identification, calibration and clinical application. The SHapley Additive exPlanation (SHAP) method was used to rank the importance of the features and explain the final model.
Among the five ML models constructed, the RF model has the best performance, and the RF model predicts the risk of HCC in patients with CHB in the training set [AUC: 0.996, 95% confidence interval (CI) (0.991-0.999)] and internal validation set [AUC: 0.993, 95% CI (0.986-1.000)]. It has high AUC, specificity, sensitivity, F1 score and low Brier score. Calibration showed good agreement between observed and predicted risks. The model yielded higher positive net benefits in DCA than when all participants were considered to be at high or low risk, indicating good clinical utility. In addition, the SHAP plot of the RF showed that age, basophil/lymphocyte ratio (BLR), D-Dimer, aspartate aminotransferase/alanine aminotransferase (AST/ALT), γ-glutamyltransferase (GGT) and alpha-fetoprotein (AFP) can help identify patients with CHB who are at high or low risk of developing HCC.
ML models can be used as a tool to predict the risk of HCC in patients with CHB. The RF model has the best predictive performance and helps clinicians to identify high-risk patients and intervene early to reduce or delay the occurrence of HCC. However, the model needs to be further improved through large sample studies.
Wu L
,Liu Z
,Huang H
,Pan D
,Fu C
,Lu Y
,Zhou M
,Huang K
,Huang T
,Yang L
... -
《BMC GASTROENTEROLOGY》
Comparison of Two Modern Survival Prediction Tools, SORG-MLA and METSSS, in Patients With Symptomatic Long-bone Metastases Who Underwent Local Treatment With Surgery Followed by Radiotherapy and With Radiotherapy Alone.
Survival estimation for patients with symptomatic skeletal metastases ideally should be made before a type of local treatment has already been determined. Currently available survival prediction tools, however, were generated using data from patients treated either operatively or with local radiation alone, raising concerns about whether they would generalize well to all patients presenting for assessment. The Skeletal Oncology Research Group machine-learning algorithm (SORG-MLA), trained with institution-based data of surgically treated patients, and the Metastases location, Elderly, Tumor primary, Sex, Sickness/comorbidity, and Site of radiotherapy model (METSSS), trained with registry-based data of patients treated with radiotherapy alone, are two of the most recently developed survival prediction models, but they have not been tested on patients whose local treatment strategy is not yet decided.
(1) Which of these two survival prediction models performed better in a mixed cohort made up both of patients who received local treatment with surgery followed by radiotherapy and who had radiation alone for symptomatic bone metastases? (2) Which model performed better among patients whose local treatment consisted of only palliative radiotherapy? (3) Are laboratory values used by SORG-MLA, which are not included in METSSS, independently associated with survival after controlling for predictions made by METSSS?
Between 2010 and 2018, we provided local treatment for 2113 adult patients with skeletal metastases in the extremities at an urban tertiary referral academic medical center using one of two strategies: (1) surgery followed by postoperative radiotherapy or (2) palliative radiotherapy alone. Every patient's survivorship status was ascertained either by their medical records or the national death registry from the Taiwanese National Health Insurance Administration. After applying a priori designated exclusion criteria, 91% (1920) were analyzed here. Among them, 48% (920) of the patients were female, and the median (IQR) age was 62 years (53 to 70 years). Lung was the most common primary tumor site (41% [782]), and 59% (1128) of patients had other skeletal metastases in addition to the treated lesion(s). In general, the indications for surgery were the presence of a complete pathologic fracture or an impending pathologic fracture, defined as having a Mirels score of ≥ 9, in patients with an American Society of Anesthesiologists (ASA) classification of less than or equal to IV and who were considered fit for surgery. The indications for radiotherapy were relief of pain, local tumor control, prevention of skeletal-related events, and any combination of the above. In all, 84% (1610) of the patients received palliative radiotherapy alone as local treatment for the target lesion(s), and 16% (310) underwent surgery followed by postoperative radiotherapy. Neither METSSS nor SORG-MLA was used at the point of care to aid clinical decision-making during the treatment period. Survival was retrospectively estimated by these two models to test their potential for providing survival probabilities. We first compared SORG to METSSS in the entire population. Then, we repeated the comparison in patients who received local treatment with palliative radiation alone. We assessed model performance by area under the receiver operating characteristic curve (AUROC), calibration analysis, Brier score, and decision curve analysis (DCA). The AUROC measures discrimination, which is the ability to distinguish patients with the event of interest (such as death at a particular time point) from those without. AUROC typically ranges from 0.5 to 1.0, with 0.5 indicating random guessing and 1.0 a perfect prediction, and in general, an AUROC of ≥ 0.7 indicates adequate discrimination for clinical use. Calibration refers to the agreement between the predicted outcomes (in this case, survival probabilities) and the actual outcomes, with a perfect calibration curve having an intercept of 0 and a slope of 1. A positive intercept indicates that the actual survival is generally underestimated by the prediction model, and a negative intercept suggests the opposite (overestimation). When comparing models, an intercept closer to 0 typically indicates better calibration. Calibration can also be summarized as log(O:E), the logarithm scale of the ratio of observed (O) to expected (E) survivors. A log(O:E) > 0 signals an underestimation (the observed survival is greater than the predicted survival); and a log(O:E) < 0 indicates the opposite (the observed survival is lower than the predicted survival). A model with a log(O:E) closer to 0 is generally considered better calibrated. The Brier score is the mean squared difference between the model predictions and the observed outcomes, and it ranges from 0 (best prediction) to 1 (worst prediction). The Brier score captures both discrimination and calibration, and it is considered a measure of overall model performance. In Brier score analysis, the "null model" assigns a predicted probability equal to the prevalence of the outcome and represents a model that adds no new information. A prediction model should achieve a Brier score at least lower than the null-model Brier score to be considered as useful. The DCA was developed as a method to determine whether using a model to inform treatment decisions would do more good than harm. It plots the net benefit of making decisions based on the model's predictions across all possible risk thresholds (or cost-to-benefit ratios) in relation to the two default strategies of treating all or no patients. The care provider can decide on an acceptable risk threshold for the proposed treatment in an individual and assess the corresponding net benefit to determine whether consulting with the model is superior to adopting the default strategies. Finally, we examined whether laboratory data, which were not included in the METSSS model, would have been independently associated with survival after controlling for the METSSS model's predictions by using the multivariable logistic and Cox proportional hazards regression analyses.
Between the two models, only SORG-MLA achieved adequate discrimination (an AUROC of > 0.7) in the entire cohort (of patients treated operatively or with radiation alone) and in the subgroup of patients treated with palliative radiotherapy alone. SORG-MLA outperformed METSSS by a wide margin on discrimination, calibration, and Brier score analyses in not only the entire cohort but also the subgroup of patients whose local treatment consisted of radiotherapy alone. In both the entire cohort and the subgroup, DCA demonstrated that SORG-MLA provided more net benefit compared with the two default strategies (of treating all or no patients) and compared with METSSS when risk thresholds ranged from 0.2 to 0.9 at both 90 days and 1 year, indicating that using SORG-MLA as a decision-making aid was beneficial when a patient's individualized risk threshold for opting for treatment was 0.2 to 0.9. Higher albumin, lower alkaline phosphatase, lower calcium, higher hemoglobin, lower international normalized ratio, higher lymphocytes, lower neutrophils, lower neutrophil-to-lymphocyte ratio, lower platelet-to-lymphocyte ratio, higher sodium, and lower white blood cells were independently associated with better 1-year and overall survival after adjusting for the predictions made by METSSS.
Based on these discoveries, clinicians might choose to consult SORG-MLA instead of METSSS for survival estimation in patients with long-bone metastases presenting for evaluation of local treatment. Basing a treatment decision on the predictions of SORG-MLA could be beneficial when a patient's individualized risk threshold for opting to undergo a particular treatment strategy ranged from 0.2 to 0.9. Future studies might investigate relevant laboratory items when constructing or refining a survival estimation model because these data demonstrated prognostic value independent of the predictions of the METSSS model, and future studies might also seek to keep these models up to date using data from diverse, contemporary patients undergoing both modern operative and nonoperative treatments.
Level III, diagnostic study.
Lee CC
,Chen CW
,Yen HK
,Lin YP
,Lai CY
,Wang JL
,Groot OQ
,Janssen SJ
,Schwab JH
,Hsu FM
,Lin WH
... -
《-》
AI model using CT-based imaging biomarkers to predict hepatocellular carcinoma in patients with chronic hepatitis B.
Various hepatocellular carcinoma (HCC) prediction models have been proposed for patients with chronic hepatitis B (CHB) using clinical variables. We aimed to develop an artificial intelligence (AI)-based HCC prediction model by incorporating imaging biomarkers derived from abdominal computed tomography (CT) images along with clinical variables.
An AI prediction model employing a gradient-boosting machine algorithm was developed utilizing imaging biomarkers extracted by DeepFore, a deep learning-based CT auto-segmentation software. The derivation cohort (n = 5,585) was randomly divided into the training and internal validation sets at a 3:1 ratio. The external validation cohort included 2,883 patients. Six imaging biomarkers (i.e. abdominal visceral fat-total fat volume ratio, total fat-trunk volume ratio, spleen volume, liver volume, liver-spleen Hounsfield unit ratio, and muscle Hounsfield unit) and eight clinical variables were selected as the main variables of our model, PLAN-B-DF.
In the internal validation set (median follow-up duration = 7.4 years), PLAN-B-DF demonstrated an excellent predictive performance with a c-index of 0.91 and good calibration function (p = 0.78 by the Hosmer-Lemeshow test). In the external validation cohort (median follow-up duration = 4.6 years), PLAN-B-DF showed a significantly better discrimination function compared to previous models, including PLAN-B, PAGE-B, modified PAGE-B, and CU-HCC (c-index, 0.89 vs. 0.65-0.78; all p <0.001), and maintained a good calibration function (p = 0.42 by the Hosmer-Lemeshow test). When patients were classified into four groups according to the risk probability calculated by PLAN-B-DF, the 10-year cumulative HCC incidence was 0.0%, 0.4%, 16.0%, and 46.2% in the minimal-, low-, intermediate-, and high-risk groups, respectively.
This AI prediction model, integrating deep learning-based auto-segmentation of CT images, offers improved performance in predicting HCC risk among patients with CHB compared to previous models.
The novel predictive model PLAN-B-DF, employing an automated computed tomography segmentation algorithm, significantly improves predictive accuracy and risk stratification for hepatocellular carcinoma in patients with chronic hepatitis B (CHB). Using a gradient-boosting algorithm and computed tomography metrics, such as visceral fat volume and myosteatosis, PLAN-B-DF outperforms previous models based solely on clinical and demographic data. This model not only shows a higher c-index compared to previous models, but also effectively classifies patients with CHB into different risk groups. This model uses machine learning to analyze the complex relationships among various risk factors contributing to hepatocellular carcinoma occurrence, thereby enabling more personalized surveillance for patients with CHB.
Shin H
,Hur MH
,Song BG
,Park SY
,Kim GA
,Choi G
,Nam JY
,Kim MA
,Park Y
,Ko Y
,Park J
,Lee HA
,Chung SW
,Choi NR
,Park MK
,Lee YB
,Sinn DH
,Kim SU
,Kim HY
,Kim JM
,Park SJ
,Lee HC
,Lee DH
,Chung JW
,Kim YJ
,Yoon JH
,Lee JH
... -
《-》
Functional cure of hepatitis B in patients with cancer undergoing immune checkpoint inhibitor therapy.
Immune checkpoint inhibitors (ICIs) can restore exhausted T-cell immunity not only for cancer treatment but also potentially to cure chronic hepatitis B (CHB). Thus, we aimed to determine the previously unclear impact of ICIs on hepatitis B surface antigen (HBsAg) seroclearance in patients with cancer.
Consecutive patients with cancer from 2016 to 2020 (cohort 1, n = 118), and hepatocellular carcinoma from 2020 to 2022 (cohort 2, n = 44, as validation) receiving ICIs and positive for HBsAg were retrospectively recruited. An additional HBV-HCC cohort (cohort 3, n = 85) not receiving ICIs served as a control group. Factors associated with HBsAg loss or a HBsAg decline >1 log were analyzed.
With median follow-up of 17.5 months, 8 (6.8%) patients in cohort 1 and 4 (9.1%) in cohort 2 achieved HBsAg seroclearance, and an additional four in cohort 1 and one in cohort 2 had a HBsAg decline >1 log. In multivariate analysis, HBsAg <100 IU/ml was associated with HBsAg seroclearance (hazard ratio 6.274, p = 0.028). In the validation cohort, the cumulative incidences of HBsAg loss at months 12 and 24 were 13.0% and 38.4%, respectively, for baseline HBsAg <100 IU/ml, which were significantly higher than those in the control group (p = 0.0267). No case in cohort 3 achieved HBsAg loss within 24 months. Of the 17 cases who achieved HBsAg loss or a decline >1 log, 16 (94.1%) received nucleos(t)ide analogue treatment. The median time to HBsAg loss or HBsAg decline was 16.5 (range 9.6 to 27.5) months.
ICIs may accelerate HBsAg seroclearance in patients with cancer and baseline HBsAg <100 IU/ml. This finding provides important information for the design of future trials evaluating the ability of ICIs to induce functional cure in patients with CHB.
Immune checkpoint inhibitors (ICIs) can restore exhausted T-cell immunity not only for cancer treatment but also potentially to cure chronic hepatitis B. Functional cure of hepatitis B was observed in patients with cancer or HCC undergoing ICI treatment, and the cumulative incidence of HBsAg loss was higher compared with controls without ICIs. ICIs may accelerate the HBsAg loss in patients with baseline HBsAg levels <100 IU/ml. This finding provides important information for the design of future ICI trials evaluating the ability of ICIs to induce functional cure in patients with CHB.
Mon HC
,Lee PC
,Hung YP
,Hung YW
,Wu CJ
,Lee CJ
,Chi CT
,Lee IC
,Hou MC
,Huang YH
... -
《-》