Predicting the risk of malignancy in adnexal masses based on the Simple Rules from the International Ovarian Tumor Analysis group.

Accurate methods to preoperatively characterize adnexal tumors are pivotal for optimal patient management. A recent metaanalysis concluded that the International Ovarian Tumor Analysis algorithms such as the Simple Rules are the best approaches to preoperatively classify adnexal masses as benign or malignant. We sought to develop and validate a model to predict the risk of malignancy in adnexal masses using the ultrasound features in the Simple Rules. This was an international cross-sectional cohort study involving 22 oncology centers, referral centers for ultrasonography, and general hospitals. We included consecutive patients with an adnexal tumor who underwent a standardized transvaginal ultrasound examination and were selected for surgery. Data on 5020 patients were recorded in 3 phases from 2002 through 2012. The 5 Simple Rules features indicative of a benign tumor (B-features) and the 5 features indicative of malignancy (M-features) are based on the presence of ascites, tumor morphology, and degree of vascularity at ultrasonography. Gold standard was the histopathologic diagnosis of the adnexal mass (pathologist blinded to ultrasound findings). Logistic regression analysis was used to estimate the risk of malignancy based on the 10 ultrasound features and type of center. The diagnostic performance was evaluated by area under the receiver operating characteristic curve, sensitivity, specificity, positive likelihood ratio (LR+), negative likelihood ratio (LR-), positive predictive value (PPV), negative predictive value (NPV), and calibration curves. Data on 4848 patients were analyzed. The malignancy rate was 43% (1402/3263) in oncology centers and 17% (263/1585) in other centers. The area under the receiver operating characteristic curve on validation data was very similar in oncology centers (0.917; 95% confidence interval, 0.901-0.931) and other centers (0.916; 95% confidence interval, 0.873-0.945). Risk estimates showed good calibration. In all, 23% of patients in the validation data set had a very low estimated risk (<1%) and 48% had a high estimated risk (≥30%). For the 1% risk cutoff, sensitivity was 99.7%, specificity 33.7%, LR+ 1.5, LR- 0.010, PPV 44.8%, and NPV 98.9%. For the 30% risk cutoff, sensitivity was 89.0%, specificity 84.7%, LR+ 5.8, LR- 0.13, PPV 75.4%, and NPV 93.9%. Quantification of the risk of malignancy based on the Simple Rules has good diagnostic performance both in oncology centers and other centers. A simple classification based on these risk estimates may form the basis of a clinical management system. Patients with a high risk may benefit from surgery by a gynecological oncologist, while patients with a lower risk may be managed locally.

Timmerman D ，Van Calster B ，Testa A ，Savelli L ，Fischerova D ，Froyman W ，Wynants L ，Van Holsbeke C ，Epstein E ，Franchi D ，Kaijser J ，Czekierdowski A ，Guerriero S ，Fruscio R ，Leone FPG ，Rossi A ，Landolfo C ，Vergote I ，Bourne T ，Valentin L ... -  《-》

Simple ultrasound-based rules for the diagnosis of ovarian cancer.

Timmerman D ，Testa AC ，Bourne T ，Ameye L ，Jurkovic D ，Van Holsbeke C ，Paladini D ，Van Calster B ，Vergote I ，Van Huffel S ，Valentin L ... -  《-》

Adnexal masses difficult to classify as benign or malignant using subjective assessment of gray-scale and Doppler ultrasound findings: logistic regression models do not help.

To develop a logistic regression model that can discriminate between benign and malignant adnexal masses perceived to be difficult to classify by subjective evaluation of gray-scale and Doppler ultrasound findings (subjective assessment) and to compare its diagnostic performance with that of subjective assessment, serum CA 125 and the risk of malignancy index (RMI). We used data from the 3511 patients with an adnexal mass included in the International Ovarian Tumor Analysis (IOTA) studies. All patients had been examined using transvaginal gray-scale and Doppler ultrasound following a standardized research protocol carried out by an experienced ultrasound examiner using a high-end ultrasound system. In addition to prospectively collecting information on > 40 clinical and ultrasound variables, the ultrasound examiner classified each mass as certainly or probably benign, unclassifiable, or certainly or probably malignant. A logistic regression model to discriminate between benignity and malignancy was developed for the unclassifiable masses (n = 244, i.e. 7% of all tumors) using a training set (160 tumors, 45 malignancies) and then tested on a test set (84 tumors, 28 malignancies). The gold standard was the histological diagnosis of the surgically removed adnexal mass. The area under the receiver-operating characteristics curve (AUC), sensitivity, specificity, positive likelihood ratio (LR+) and negative likelihood ratio (LR-) were used to describe diagnostic performance and were compared between subjective assessment, CA 125, the RMI and the logistic regression model created. One variable was retained in the logistic regression model: the largest diameter (in mm) of the largest solid component of the tumor (odds ratio (OR) = 1.04; 95% CI, 1.02-1.06). The model had an AUC of 0.68 (95% CI, 0.59-0.78) on the training set and an AUC of 0.65 (95% CI, 0.53-0.78) on the test set. On the test set, a cut-off of 25% probability of malignancy (corresponding to the largest diameter of the largest solid component of 23 mm) resulted in a sensitivity of 64% (18/28), a specificity of 55% (31/56), an LR+ of 1.44 and an LR- of 0.65. The corresponding values for subjective assessment were 68% (19/28), 59% (33/56), 1.65 and 0.55. On the test set of patients with available CA 125 results, the LR+ and LR- of the logistic regression model (cut-off = 25% probability of malignancy) were 1.29 and 0.73, of subjective assessment were 1.45 and 0.63, of CA 125 (cut-off = 35 U/mL) were 1.24 and 0.84 and of RMI (cut-off = 200) were 1.21 and 0.92. About 7% of adnexal masses that are considered appropriate for surgical removal cannot be classified as benign or malignant by experienced ultrasound examiners using subjective assessment. Logistic regression models to estimate the risk of malignancy, CA 125 measurements and the RMI are not helpful in these masses.

Valentin L ，Ameye L ，Savelli L ，Fruscio R ，Leone FP ，Czekierdowski A ，Lissoni AA ，Fischerova D ，Guerriero S ，Van Holsbeke C ，Van Huffel S ，Timmerman D ... -  《-》

Prospective external validation of IOTA methods for classifying adnexal masses and retrospective assessment of two-step strategy using benign descriptors and ADNEX model: Portuguese multicenter study.

To externally and prospectively validate the International Ovarian Tumor Analysis (IOTA) Simple Rules (SRs), Logistic Regression model 2 (LR2) and Assessment of Different NEoplasias in the adneXa (ADNEX) model in a Portuguese population, comparing these approaches with subjective assessment and the risk-of-malignancy index (RMI), as well as with each other. This study also aimed to retrospectively validate the IOTA two-step strategy, using modified benign simple descriptors (MBDs) followed by the ADNEX model in cases in which MBDs were not applicable. This was a prospective multicenter diagnostic accuracy study conducted between January 2016 and December 2021 of consecutive patients with an ultrasound diagnosis of at least one adnexal tumor, who underwent surgery at one of three tertiary referral centers in Lisbon, Portugal. All ultrasound assessments were performed by Level-II or -III sonologists with IOTA certification. Patient clinical data and serum CA 125 levels were collected from hospital databases. Each adnexal mass was classified as benign or malignant using subjective assessment, RMI, IOTA SRs, LR2 and the ADNEX model (with and without CA 125). The reference standard was histopathological diagnosis. In the second phase, all adnexal tumors were classified retrospectively using the two-step strategy (MBDs + ADNEX). Sensitivity, specificity, positive and negative predictive values, positive and negative likelihood ratios and overall accuracy were determined for all methods. Receiver-operating-characteristics curves were constructed and corresponding areas under the curve (AUC) were determined for RMI, LR2, the ADNEX model and the two-step strategy. The ADNEX model calibration plots were constructed using locally estimated scatterplot smoothing (LOESS). Of the 571 patients included in the study, 428 had benign disease and 143 had malignant disease (prevalence of malignancy, 25.0%), of which 42 had borderline ovarian tumor, 93 had primary invasive adnexal cancer and eight had metastatic tumors in the adnexa. Subjective assessment had an overall sensitivity of 97.9% and a specificity of 83.6% for distinguishing between benign and malignant lesions. RMI showed high specificity (95.6%) but very low sensitivity (58.7%), with an AUC of 0.913. The IOTA SRs were applicable in 80.0% of patients, with a sensitivity of 94.8% and specificity of 98.6%. The IOTA LR2 had a sensitivity of 84.6%, specificity of 86.9% and an AUC of 0.939, at a malignancy risk cut-off of 10%. At the same cut-off, the sensitivity, specificity and AUC for the ADNEX model with vs without CA 125 were 95.8% vs 98.6%, 82.5% vs 79.7% and 0.962 vs 0.960, respectively. The ADNEX model gave heterogeneous results for distinguishing between benign masses and different subtypes of malignancy, with the highest AUC (0.991) for discriminating benign masses from primary invasive adnexal cancer Stages II-IV, and the lowest AUC (0.696) for discriminating primary invasive adnexal cancer Stage I from metastatic lesion in the adnexa. The calibration plot suggested underestimation of the risk by the ADNEX model compared with the observed proportion of malignancy. The MBDs were applicable in 26.3% (150/571) of cases, of which none was malignant. The two-step strategy using the ADNEX model in the second step only, with and without CA 125, had AUCs of 0.964 and 0.961, respectively, which was similar to applying the ADNEX model in all patients. The IOTA methods showed good-to-excellent performance in the Portuguese population, outperforming RMI. The ADNEX model was superior to other methods in terms of accuracy, but interpretation of its ability to distinguish between malignant subtypes was limited by sample size and large differences in the prevalence of tumor subtypes. The IOTA MBDs are reliable in identifying benign disease. The two-step strategy comprising application of MBDs followed by the ADNEX model if MBDs are not applicable, is suitable for daily clinical practice, circumventing the need to calculate the risk of malignancy in all patients. © 2024 International Society of Ultrasound in Obstetrics and Gynecology.

Borges AL ，Brito M ，Ambrósio P ，Condeço R ，Pinto P ，Ambrósio B ，Mahomed F ，Gama JMR ，Bernardo MJ ，Gouveia AI ，Djokovic D ... -  《-》

Vessel morphology depicted by three-dimensional power Doppler ultrasound as second-stage test in adnexal tumors that are difficult to classify: prospective diagnostic accuracy study.

To assess whether vessel morphology depicted by three-dimensional (3D) power Doppler ultrasound improves discrimination between benignity and malignancy if used as a second-stage test in adnexal masses that are difficult to classify. This was a prospective observational international multicenter diagnostic accuracy study. Consecutive patients with an adnexal mass underwent standardized transvaginal two-dimensional (2D) grayscale and color or power Doppler and 3D power Doppler ultrasound examination by an experienced examiner, and those with a 'difficult' tumor were included in the current analysis. A difficult tumor was defined as one in which the International Ovarian Tumor Analysis (IOTA) logistic regression model-1 (LR-1) yielded an ambiguous result (risk of malignancy, 8.3% to 25.5%), or as one in which the ultrasound examiner was uncertain regarding classification as benign or malignant when using subjective assessment. Even when the ultrasound examiner was uncertain, he/she was obliged to classify the tumor as most probably benign or most probably malignant. For each difficult tumor, one researcher created a 360° rotating 3D power Doppler image of the vessel tree in the whole tumor and another of the vessel tree in a 5-cm3 spherical volume selected from the most vascularized part of the tumor. Two other researchers, blinded to the patient's history, 2D ultrasound findings and histological diagnosis, independently described the vessel tree using predetermined vessel features. Their agreed classification was used. The reference standard was the histological diagnosis of the mass. The sensitivity of each test for discriminating between benign and malignant difficult tumors was plotted against 1 - specificity on a receiver-operating-characteristics diagram, and the test with the point furthest from the reference line was considered to have the best diagnostic ability. Of 2403 women with an adnexal mass, 376 (16%) had a difficult mass. Ultrasound volumes were available for 138 of these cases. In 79/138 masses, the ultrasound examiner was uncertain about the diagnosis based on subjective assessment, in 87/138, IOTA LR-1 yielded an ambiguous result and, in 28/138, both methods gave an uncertain result. Of the masses, 38/138 (28%) were malignant. Among tumors that were difficult to classify as benign or malignant by subjective assessment, the vessel feature 'densely packed vessels' had the best discriminative ability (sensitivity 67% (18/27), specificity 83% (43/52)) and was slightly superior to subjective assessment (sensitivity 74% (20/27), specificity 60% (31/52)). In tumors in which IOTA LR-1 yielded an ambiguous result, subjective assessment (sensitivity 82% (14/17), specificity 79% (55/70)) was superior to the best vascular feature, i.e. changes in the diameter of vessels in the whole tumor volume (sensitivity 71% (12/17), specificity 69% (48/70)). Vessel morphology depicted by 3D power Doppler ultrasound may slightly improve discrimination between benign and malignant adnexal tumors that are difficult to classify by subjective ultrasound assessment. For tumors in which the IOTA LR-1 model yields an ambiguous result, subjective assessment is superior to vessel morphology as a second-stage test. © 2020 The Authors. Ultrasound in Obstetrics & Gynecology published by John Wiley & Sons Ltd on behalf of International Society of Ultrasound in Obstetrics and Gynecology.

Sladkevicius P ，Jokubkiene L ，Timmerman D ，Fischerova D ，Van Holsbeke C ，Franchi D ，Savelli L ，Epstein E ，Fruscio R ，Kaijser J ，Czekierdowski A ，Guerriero S ，Pascual MA ，Testa AC ，Ameye L ，Valentin L ... -  《-》