-
Machine learning for early prediction of in-hospital cardiac arrest in patients with acute coronary syndromes.
Previous studies have used machine leaning to predict clinical deterioration to improve outcome prediction. However, no study has used machine learning to predict cardiac arrest in patients with acute coronary syndrome (ACS). Algorithms are required to generate high-performance models for predicting cardiac arrest in ACS patients with multivariate features.
Machine learning algorithms will significantly improve outcome prediction of cardiac arrest in ACS patients.
This retrospective cohort study reviewed 166 ACS patients who had in-hospital cardiac arrest. Eight machine learning algorithms were trained using multivariate clinical features obtained 24 h prior to the onset of cardiac arrest. All machine learning models were compared to each other and to existing risk prediction scores (Global Registry of Acute Coronary Events, National Early Warning Score, and Modified Early Warning Score) using the area under the receiver operating characteristic curve (AUROC).
The XGBoost model provided the best performance with regard to AUC (0.958 [95%CI: 0.938-0.978]), accuracy (88.9%), sensitivity (73%), negative predictive value (89%), and F1 score (80%) compared with other machine learning models. The K-nearest neighbor model generated the best specificity (99.3%) and positive predictive value (93.8%) metrics, but had low and unacceptable values for sensitivity and AUC. Most, but not all, machine learning models outperformed the existing risk prediction scores.
The XGBoost model, which was generated based on a machine learning algorithm, has high potential to be used to predict cardiac arrest in ACS patients. This proposed model significantly improves outcome prediction compared to existing risk prediction scores.
Wu TT
,Lin XQ
,Mu Y
,Li H
,Guo YS
... -
《-》
-
An intelligent warning model for early prediction of cardiac arrest in sepsis patients.
Sepsis-associated cardiac arrest is a common issue with the low survival rate. Early prediction of cardiac arrest can provide the time required for intervening and preventing its onset in order to reduce mortality. Several studies have been conducted to predict cardiac arrest using machine learning. However, no previous research has used machine learning for predicting cardiac arrest in adult sepsis patients. Moreover, the potential of some techniques, including ensemble algorithms, has not yet been addressed in improving the prediction outcomes. It is required to find methods for generating high-performance predictions with sufficient time lapse before the arrest. In this regard, various variables and parameters should also been examined.
The aim was to use machine learning in order to propose a cardiac arrest prediction model for adult patients with sepsis. It is required to predict the arrest several hours before the incidence with high efficiency. The other goal was to investigate the effect of the time series dynamics of vital signs on the prediction of cardiac arrest.
30 h clinical data of every sepsis patients were extracted from Mimic III database (79 cases, 4532 controls). Three datasets (multivariate, time series and combined) were created. Various machine learning models for six time groups were trained on these datasets. The models included classical techniques (SVM, decision tree, logistic regression, KNN, GaussianNB) and ensemble methods (gradient Boosting, XGBoost, random forest, balanced bagging classifier and stacking). Proper solutions were proposed to address the challenges of missing values, imbalanced classes of data and irregularity of time series.
The best results were obtained using a stacking algorithm and multivariate dataset (accuracy = 0.76, precision = 0.19, sensitivity = 0.77, f1-score = 0.31, AUC= 0.82). The proposed model predicts the arrest incidence of up to six hours earlier with the accuracy and sensitivity over 70%.
We illustrated that machine learning techniques, especially ensemble algorithms have high potentials to be used in prognostic systems for sepsis patients. The proposed model, in comparison with the exiting warning systems including APACHE II and MEWS, significantly improved the evaluation criteria. According to the results, the time series dynamics of vital signs are of great importance in the prediction of cardiac arrest incidence in sepsis patients.
Layeghian Javan S
,Sepehri MM
,Layeghian Javan M
,Khatibi T
... -
《-》
-
Decision tree model for predicting in-hospital cardiac arrest among patients admitted with acute coronary syndrome.
In-hospital cardiac arrest (IHCA) may be preventable, with patients often showing signs of physiological deterioration before an event. Our objective was to develop and validate a simple clinical prediction model to identify the IHCA risk among cardiac arrest (CA) patients hospitalized with acute coronary syndrome (ACS).
A predicting model could help to identify the risk of IHCA among patients admitted with ACS.
We conducted a case-control study and analyzed 21 337 adult ACS patients, of whom 164 had experienced CA. Vital signs, demographic, and laboratory data were extracted from the electronic health record. Decision tree analysis was applied with 10-fold cross-validation to predict the risk of IHCA.
The decision tree analysis detected seven explanatory variables, and the variables' importance is as follows: VitalPAC Early Warning Score (ViEWS), fatal arrhythmia, Killip class, cardiac troponin I, blood urea nitrogen, age, and diabetes. The development decision tree model demonstrated a sensitivity of 0.762, a specificity of 0.882, and an area under the receiver operating characteristic curve (AUC) of 0.844 (95% CI, 0.805 to 0.849). A 10-fold cross-validated risk estimate was 0.198, while the optimism-corrected AUC was 0.823 (95% CI, 0.786 to 0.860).
We have developed and internally validated a good discrimination decision tree model to predict the risk of IHCA. This simple prediction model may provide healthcare workers with a practical bedside tool and could positively impact decision-making with regard to deteriorating patients with ACS.
Li H
,Wu TT
,Yang DL
,Guo YS
,Liu PC
,Chen Y
,Xiao LP
... -
《-》
-
Prediction of Neurological Outcomes in Out-of-hospital Cardiac Arrest Survivors Immediately after Return of Spontaneous Circulation: Ensemble Technique with Four Machine Learning Models.
We performed this study to establish a prediction model for 1-year neurological outcomes in out-of-hospital cardiac arrest (OHCA) patients who achieved return of spontaneous circulation (ROSC) immediately after ROSC using machine learning methods.
We performed a retrospective analysis of an OHCA survivor registry. Patients aged ≥ 18 years were included. Study participants who had registered between March 31, 2013 and December 31, 2018 were divided into a develop dataset (80% of total) and an internal validation dataset (20% of total), and those who had registered between January 1, 2019 and December 31, 2019 were assigned to an external validation dataset. Four machine learning methods, including random forest, support vector machine, ElasticNet and extreme gradient boost, were implemented to establish prediction models with the develop dataset, and the ensemble technique was used to build the final prediction model. The prediction performance of the model in the internal validation and the external validation dataset was described with accuracy, area under the receiver-operating characteristic curve, area under the precision-recall curve, sensitivity, specificity, positive predictive value (PPV), and negative predictive value (NPV). Futhermore, we established multivariable logistic regression models with the develop set and compared prediction performance with the ensemble models. The primary outcome was an unfavorable 1-year neurological outcome.
A total of 1,207 patients were included in the study. Among them, 631, 139, and 153 were assigned to the develop, the internal validation and the external validation datasets, respectively. Prediction performance metrics for the ensemble prediction model in the internal validation dataset were as follows: accuracy, 0.9620 (95% confidence interval [CI], 0.9352-0.9889); area under receiver-operator characteristics curve, 0.9800 (95% CI, 0.9612-0.9988); area under precision-recall curve, 0.9950 (95% CI, 0.9860-1.0000); sensitivity, 0.9594 (95% CI, 0.9245-0.9943); specificity, 0.9714 (95% CI, 0.9162-1.0000); PPV, 0.9916 (95% CI, 0.9752-1.0000); NPV, 0.8718 (95% CI, 0.7669-0.9767). Prediction performance metrics for the model in the external validation dataset were as follows: accuracy, 0.8509 (95% CI, 0.7825-0.9192); area under receiver-operator characteristics curve, 0.9301 (95% CI, 0.8845-0.9756); area under precision-recall curve, 0.9476 (95% CI, 0.9087-0.9867); sensitivity, 0.9595 (95% CI, 0.9145-1.0000); specificity, 0.6500 (95% CI, 0.5022-0.7978); PPV, 0.8353 (95% CI, 0.7564-0.9142); NPV, 0.8966 (95% CI, 0.7857-1.0000). All the prediction metrics were higher in the ensemble models, except NPVs in both the internal and the external validation datasets.
We established an ensemble prediction model for prediction of unfavorable 1-year neurological outcomes in OHCA survivors using four machine learning methods. The prediction performance of the ensemble model was higher than the multivariable logistic regression model, while its performance was slightly decreased in the external validation dataset.
Heo JH
,Kim T
,Shin J
,Suh GJ
,Kim J
,Jung YS
,Park SM
,Kim S
,For SNU CARE investigators
... -
《-》
-
Machine learning-based in-hospital mortality prediction models for patients with acute coronary syndrome.
The purpose of this study is to identify the risk factors of in-hospital mortality in patients with acute coronary syndrome (ACS) and to evaluate the performance of traditional regression and machine learning prediction models.
The data of ACS patients who entered the emergency department of Fujian Provincial Hospital from January 1, 2017 to March 31, 2020 for chest pain were retrospectively collected. The study used univariate and multivariate logistic regression analysis to identify risk factors for in-hospital mortality of ACS patients. The traditional regression and machine learning algorithms were used to develop predictive models, and the sensitivity, specificity, and receiver operating characteristic curve were used to evaluate the performance of each model.
A total of 6482 ACS patients were included in the study, and the in-hospital mortality rate was 1.88%. Multivariate logistic regression analysis found that age, NSTEMI, Killip III, Killip IV, and levels of D-dimer, cardiac troponin I, CK, N-terminal pro-B-type natriuretic peptide (NT-proBNP), high-density lipoprotein (HDL) cholesterol, and Stains were independent predictors of in-hospital mortality. The study found that the area under the receiver operating characteristic curve of the models developed by logistic regression, gradient boosting decision tree (GBDT), random forest, and support vector machine (SVM) for predicting the risk of in-hospital mortality were 0.884, 0.918, 0.913, and 0.896, respectively. Feature importance evaluation found that NT-proBNP, D-dimer, and Killip were top three variables that contribute the most to the prediction performance of the GBDT model and random forest model.
The predictive model developed using logistic regression, GBDT, random forest, and SVM algorithms can be used to predict the risk of in-hospital death of ACS patients. Based on our findings, we recommend that clinicians focus on monitoring the changes of NT-proBNP, D-dimer, Killip, cTnI, and LDH as this may improve the clinical outcomes of ACS patients.
Ke J
,Chen Y
,Wang X
,Wu Z
,Zhang Q
,Lian Y
,Chen F
... -
《-》