Clinical evaluation of five different automated SARS-CoV-2 serology assays in a cohort of hospitalized COVID-19 patients.
The global market for SARS-CoV-2-immunoassays is becoming ever more crowded with antibody-tests of various formats, targets and technologies, careful evaluation is crucial for understanding the implications of individual test results. Here, we evaluate the clinical performance of five automated immunoassays on a set of clinical samples.
Serum/plasma samples of 75 confirmed COVID-19 patients and 320 pre-pandemic serum samples of healthy blood donors were subjected to two IgG and three total antibody SARS-CoV-2-immunoassays. All test setups were automated workflows.
Positivity of assays (onset of symptoms > 10 days) ranged between 68.4 % and 81.6 % (Diasorin 68.4 %, Euroimmun 70.3 %, Siemens 73.7 %, Roche 79.0 % and Wantai 81.6 %). All examined assays demonstrated high specificity of >99 % (Euroimmun, Diasorin: 99.1 %, Wantai: 99.4 %) but only two reached levels above 99.5 % (Roche: 99.7 %, Siemens 100 %). Interestingly, there was no overlap in false positive results between the assays. The strongest correlation of quantitative results was observed between the Diasorin and Euroimmun IgG tests (r2 = 0.76). Overall, we observed no difference in the distribution of test results between female and male patients (p-values: 0.18-0.87). A significant difference between severely versus critically ill patients was demonstrated for the Euroimmun, Diasorin, Wantai and Siemens assays (p-values:0.041).
All assays showed good clinical performance. Our data confirm that orthogonal test strategies as recommended by the CDC can enhance clinical specificity. However, the suboptimal rates of test positivity found at time of hospitalization in this cohort underline the importance of molecular diagnostics to rule out/confirm active infection with SARS-CoV-2.
Pflüger LS
,Bannasch JH
,Brehm TT
,Pfefferle S
,Hoffmann A
,Nörz D
,van der Meirschen M
,Kluge S
,Haddad M
,Pischke S
,Hiller J
,Addo MM
,Lohse AW
,Schulze Zur Wiesch J
,Peine S
,Aepfelbacher M
,Lütgehetmann M
... -
《-》
Antibody tests for identification of current and past infection with SARS-CoV-2.
The severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) virus and resulting COVID-19 pandemic present important diagnostic challenges. Several diagnostic strategies are available to identify current infection, rule out infection, identify people in need of care escalation, or to test for past infection and immune response. Serology tests to detect the presence of antibodies to SARS-CoV-2 aim to identify previous SARS-CoV-2 infection, and may help to confirm the presence of current infection.
To assess the diagnostic accuracy of antibody tests to determine if a person presenting in the community or in primary or secondary care has SARS-CoV-2 infection, or has previously had SARS-CoV-2 infection, and the accuracy of antibody tests for use in seroprevalence surveys.
We undertook electronic searches in the Cochrane COVID-19 Study Register and the COVID-19 Living Evidence Database from the University of Bern, which is updated daily with published articles from PubMed and Embase and with preprints from medRxiv and bioRxiv. In addition, we checked repositories of COVID-19 publications. We did not apply any language restrictions. We conducted searches for this review iteration up to 27 April 2020.
We included test accuracy studies of any design that evaluated antibody tests (including enzyme-linked immunosorbent assays, chemiluminescence immunoassays, and lateral flow assays) in people suspected of current or previous SARS-CoV-2 infection, or where tests were used to screen for infection. We also included studies of people either known to have, or not to have SARS-CoV-2 infection. We included all reference standards to define the presence or absence of SARS-CoV-2 (including reverse transcription polymerase chain reaction tests (RT-PCR) and clinical diagnostic criteria).
We assessed possible bias and applicability of the studies using the QUADAS-2 tool. We extracted 2x2 contingency table data and present sensitivity and specificity for each antibody (or combination of antibodies) using paired forest plots. We pooled data using random-effects logistic regression where appropriate, stratifying by time since post-symptom onset. We tabulated available data by test manufacturer. We have presented uncertainty in estimates of sensitivity and specificity using 95% confidence intervals (CIs).
We included 57 publications reporting on a total of 54 study cohorts with 15,976 samples, of which 8526 were from cases of SARS-CoV-2 infection. Studies were conducted in Asia (n = 38), Europe (n = 15), and the USA and China (n = 1). We identified data from 25 commercial tests and numerous in-house assays, a small fraction of the 279 antibody assays listed by the Foundation for Innovative Diagnostics. More than half (n = 28) of the studies included were only available as preprints. We had concerns about risk of bias and applicability. Common issues were use of multi-group designs (n = 29), inclusion of only COVID-19 cases (n = 19), lack of blinding of the index test (n = 49) and reference standard (n = 29), differential verification (n = 22), and the lack of clarity about participant numbers, characteristics and study exclusions (n = 47). Most studies (n = 44) only included people hospitalised due to suspected or confirmed COVID-19 infection. There were no studies exclusively in asymptomatic participants. Two-thirds of the studies (n = 33) defined COVID-19 cases based on RT-PCR results alone, ignoring the potential for false-negative RT-PCR results. We observed evidence of selective publication of study findings through omission of the identity of tests (n = 5). We observed substantial heterogeneity in sensitivities of IgA, IgM and IgG antibodies, or combinations thereof, for results aggregated across different time periods post-symptom onset (range 0% to 100% for all target antibodies). We thus based the main results of the review on the 38 studies that stratified results by time since symptom onset. The numbers of individuals contributing data within each study each week are small and are usually not based on tracking the same groups of patients over time. Pooled results for IgG, IgM, IgA, total antibodies and IgG/IgM all showed low sensitivity during the first week since onset of symptoms (all less than 30.1%), rising in the second week and reaching their highest values in the third week. The combination of IgG/IgM had a sensitivity of 30.1% (95% CI 21.4 to 40.7) for 1 to 7 days, 72.2% (95% CI 63.5 to 79.5) for 8 to 14 days, 91.4% (95% CI 87.0 to 94.4) for 15 to 21 days. Estimates of accuracy beyond three weeks are based on smaller sample sizes and fewer studies. For 21 to 35 days, pooled sensitivities for IgG/IgM were 96.0% (95% CI 90.6 to 98.3). There are insufficient studies to estimate sensitivity of tests beyond 35 days post-symptom onset. Summary specificities (provided in 35 studies) exceeded 98% for all target antibodies with confidence intervals no more than 2 percentage points wide. False-positive results were more common where COVID-19 had been suspected and ruled out, but numbers were small and the difference was within the range expected by chance. Assuming a prevalence of 50%, a value considered possible in healthcare workers who have suffered respiratory symptoms, we would anticipate that 43 (28 to 65) would be missed and 7 (3 to 14) would be falsely positive in 1000 people undergoing IgG/IgM testing at days 15 to 21 post-symptom onset. At a prevalence of 20%, a likely value in surveys in high-risk settings, 17 (11 to 26) would be missed per 1000 people tested and 10 (5 to 22) would be falsely positive. At a lower prevalence of 5%, a likely value in national surveys, 4 (3 to 7) would be missed per 1000 tested, and 12 (6 to 27) would be falsely positive. Analyses showed small differences in sensitivity between assay type, but methodological concerns and sparse data prevent comparisons between test brands.
The sensitivity of antibody tests is too low in the first week since symptom onset to have a primary role for the diagnosis of COVID-19, but they may still have a role complementing other testing in individuals presenting later, when RT-PCR tests are negative, or are not done. Antibody tests are likely to have a useful role for detecting previous SARS-CoV-2 infection if used 15 or more days after the onset of symptoms. However, the duration of antibody rises is currently unknown, and we found very little data beyond 35 days post-symptom onset. We are therefore uncertain about the utility of these tests for seroprevalence surveys for public health management purposes. Concerns about high risk of bias and applicability make it likely that the accuracy of tests when used in clinical care will be lower than reported in the included studies. Sensitivity has mainly been evaluated in hospitalised patients, so it is unclear whether the tests are able to detect lower antibody levels likely seen with milder and asymptomatic COVID-19 disease. The design, execution and reporting of studies of the accuracy of COVID-19 tests requires considerable improvement. Studies must report data on sensitivity disaggregated by time since onset of symptoms. COVID-19-positive cases who are RT-PCR-negative should be included as well as those confirmed RT-PCR, in accordance with the World Health Organization (WHO) and China National Health Commission of the People's Republic of China (CDC) case definitions. We were only able to obtain data from a small proportion of available tests, and action is needed to ensure that all results of test evaluations are available in the public domain to prevent selective reporting. This is a fast-moving field and we plan ongoing updates of this living systematic review.
Deeks JJ
,Dinnes J
,Takwoingi Y
,Davenport C
,Spijker R
,Taylor-Phillips S
,Adriano A
,Beese S
,Dretzke J
,Ferrante di Ruffano L
,Harris IM
,Price MJ
,Dittrich S
,Emperador D
,Hooft L
,Leeflang MM
,Van den Bruel A
,Cochrane COVID-19 Diagnostic Test Accuracy Group
... -
《Cochrane Database of Systematic Reviews》
Head-to-Head Comparison of Two SARS-CoV-2 Serology Assays.
While molecular techniques remain the gold standard for diagnosis of acute SARS-CoV-2 infection, serological tests have the unique potential to ascertain how much of the population has been exposed to the COVID-19 pathogen. There have been limited published studies to date documenting the performance of SARS-CoV-2 antibody assays.
We compared the DiaSorin Liaison SARS-CoV-2 S1/S2 IgG and Roche Diagnostics Elecsys Anti-SARS-CoV-2 assays using 228 samples spanning patients with positive PCR for SARS-CoV-2, patients with compatible symptoms but negative PCR, pre-COVID specimens, and potential cross-reactives.
Both assays detected antibodies in 18/19 samples collected at least one week after a positive PCR result. Neither method consistently detected antibodies in specimens collected within one week of a positive PCR result (sensitivity < 50%), but antibodies were detected by only Roche in four samples in this time frame. Using 139 pre-COVID and 35 PCR-negative samples, the Roche and DiaSorin assays demonstrated specificities of 100.0% and 98.9%, respectively. Neither assay demonstrated cross-reactivity from other coronaviruses (229E, HKU1, NL63, OC43), respiratory pathogens (adenovirus, metapneumovirus, rhinovirus/enterovirus), or antibodies to other viruses (HIV, EBV, CMV, HBV, HCV, HAV).
Overall, the qualitative interpretations afforded by the Roche and DiaSorin assays agreed for 97% of samples evaluated. Minor discrepancies in sensitivity and specificity were observed between methods, with the differences in specificity more clinically significant for our low-prevalence population. For the DiaSorin assay, all disagreements with the Roche assay occurred in samples with quantitative signals near the cut-off determining positivity.
Merrill AE
,Jackson JB
,Ehlers A
,Voss D
,Krasowski MD
... -
《-》
Multi-Platform Comparison of SARS-CoV-2 Serology Assays for the Detection of COVID-19.
COVID-19 is caused by the severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2), a novel beta-coronavirus that is responsible for the 2019 coronavirus pandemic. Acute infections should be diagnosed by polymerase chain reaction (PCR) based tests, but serology tests can demonstrate previous exposure to the virus.
We compared the performance of the Diazyme, Roche, and Abbott SARS-CoV-2 serology assays using 179 negative participants to determine negative percentage agreement (NPA) and in 60 SARS-CoV-2 PCR-confirmed positive patients to determine positive percentage agreement (PPA) at 3 different time frames following a positive SARS-CoV-2 PCR result.
At ≥15 days, the PPA (95% CI) was 100 (86.3-100)% for the Diazyme IgM/IgG panel, 96.0 (79.7-99.9)% for the Roche total Ig assay, and 100 (86.3-100)% for the Abbott IgG assay. The NPA (95% CI) was 98.3 (95.2-99.7)% for the Diazyme IgM/IgG panel, 99.4 (96.9-100)% for the Roche total Ig assay, and 98.9 (96.0-99.9)% for the Abbott IgG assay. When the Roche total Ig assay was combined with either the Diazyme IgM/IgG panel or the Abbott IgG assay, the positive predictive value was 100% while the negative predictive value remained greater than 99%.
Our data demonstrates that the Diazyme, Roche, and Abbott SARS-CoV-2 serology assays have similar clinical performances. We demonstrated a low false-positive rate across all 3 platforms and observed that false positives observed on the Roche platform are unique compared to those observed on the Diazyme or Abbott assays. Using multiple platforms in tandem increases the PPVs, which is important when screening populations with low disease prevalence.
Suhandynata RT
,Hoffman MA
,Kelner MJ
,McLawhon RW
,Reed SL
,Fitzgerald RL
... -
《-》