-
Comparative performance of SARS-CoV-2 lateral flow antigen tests and association with detection of infectious virus in clinical specimens: a single-centre laboratory evaluation study.
Lateral flow devices (LFDs) for rapid antigen testing are set to become a cornerstone of SARS-CoV-2 mass community testing, although their reduced sensitivity compared with PCR has raised questions of how well they identify infectious cases. Understanding their capabilities and limitations is, therefore, essential for successful implementation. We evaluated six commercial LFDs and assessed their correlation with infectious virus culture and PCR cycle threshold (Ct) values.
In a single-centre, laboratory evaluation study, we did a head-to-head comparison of six LFDs commercially available in the UK: Innova Rapid SARS-CoV-2 Antigen Test, Spring Healthcare SARS-CoV-2 Antigen Rapid Test Cassette, E25Bio Rapid Diagnostic Test, Encode SARS-CoV-2 Antigen Rapid Test Device, SureScreen COVID-19 Rapid Antigen Test Cassette, and SureScreen COVID-19 Rapid Fluorescence Antigen Test. We estimated the specificities and sensitivities of the LFDs using stored naso-oropharyngeal swabs collected at St Thomas' Hospital (London, UK) for routine diagnostic SARS-CoV-2 testing by real-time RT-PCR (RT-rtPCR). Swabs were from inpatients and outpatients from all departments of St Thomas' Hospital, and from health-care staff (all departments) and their household contacts. SARS-CoV-2-negative swabs from the same population (confirmed by RT-rtPCR) were used for comparative specificity determinations. All samples were collected between March 23 and Oct 27, 2020. We determined the limit of detection (LOD) for each test using viral plaque-forming units (PFUs) and viral RNA copy numbers of laboratory-grown SARS-CoV-2. Additionally, LFDs were selected to assess the correlation of antigen test result with RT-rtPCR Ct values and positive viral culture in Vero E6 cells. This analysis included longitudinal swabs from five infected inpatients with varying disease severities. Furthermore, the sensitivities of available LFDs were assessed in swabs (n=23; collected from Dec 4, 2020, to Jan 12, 2021) confirmed to be positive (RT-rtPCR and whole-genome sequencing) for the B.1.1.7 variant, which was the dominant genotype in the UK at the time of study completion.
All LFDs showed high specificity (≥98·0%), except for the E25Bio test (86·0% [95% CI 77·9-99·9]), and most tests reliably detected 50 PFU/test (equivalent SARS-CoV-2 N gene Ct value of 23·7, or RNA copy number of 3 × 106/mL). Sensitivities of the LFDs on clinical samples ranged from 65·0% (55·2-73·6) to 89·0% (81·4-93·8). These sensitivities increased to greater than 90% for samples with Ct values of lower than 25 for all tests except the SureScreen fluorescence (SureScreen-F) test. Positive virus culture was identified in 57 (40·4%) of 141 samples; 54 (94·7%) of the positive cultures were from swabs with Ct values lower than 25. Among the three LFDs selected for detailed comparisons (the tests with highest sensitivity [Innova], highest specificity [Encode], and alternative technology [SureScreen-F]), sensitivity of the LFDs increased to at least 94·7% when only including samples with detected viral growth. Longitudinal studies of RT-rtPCR-positive samples (tested with Innova, Encode, and both SureScreen-F and the SureScreen visual [SureScreen-V] test) showed that most of the tests identified all infectious samples as positive. Test performance (assessed for Innova and SureScreen-V) was not affected when reassessed on swabs positive for the UK variant B.1.1.7.
In this comprehensive comparison of antigen LFDs and virus infectivity, we found a clear relationship between Ct values, quantitative culture of infectious virus, and antigen LFD positivity in clinical samples. Our data support regular testing of target groups with LFDs to supplement the current PCR testing capacity, which would help to rapidly identify infected individuals in situations in which they would otherwise go undetected.
King's Together Rapid COVID-19, Medical Research Council, Wellcome Trust, Huo Family Foundation, UK Department of Health, National Institute for Health Research Comprehensive Biomedical Research Centre.
Pickering S
,Batra R
,Merrick B
,Snell LB
,Nebbia G
,Douthwaite S
,Reid F
,Patel A
,Kia Ik MT
,Patel B
,Charalampous T
,Alcolea-Medina A
,Lista MJ
,Cliff PR
,Cunningham E
,Mullen J
,Doores KJ
,Edgeworth JD
,Malim MH
,Neil SJD
,Galão RP
... -
《Lancet Microbe》
-
Performance of antigen lateral flow devices in the UK during the alpha, delta, and omicron waves of the SARS-CoV-2 pandemic: a diagnostic and observational study.
Antigen lateral flow devices (LFDs) have been widely used to control SARS-CoV-2. We aimed to improve understanding of LFD performance with changes in variant infections, vaccination, viral load, and LFD use, and in the detection of infectious individuals.
In this diagnostic study, paired LFD and RT-PCR test results were prospectively collected from asymptomatic and symptomatic participants in the UK between Nov 4, 2020, and March 21, 2022, to support the National Health Service (NHS) England's Test and Trace programme. The LFDs evaluated were the Innova SARS-CoV-2 Antigen Rapid Qualitative Test, the Orient Gene Rapid Covid-19 (Antigen) Self-Test, and the Acon Flowflex SARS-CoV-2 Antigen Rapid Test (Self-Testing). Test results were collected across various community testing settings, including predeployment testing sites, routine testing centres, homes, schools, universities, workplaces, targeted community testing, and from health-care workers. We used multivariable logistic regression to analyse LFD sensitivity and specificity using RT-PCR as a reference standard, adjusting for viral load, LFD manufacturer, test setting, age, sex, test assistance, symptom status, vaccination status, and SARS-CoV-2 variant. National contact tracing data from NHS Test and Trace (Jan 1, 2021, to Jan 11, 2022) were used to estimate the proportion of transmitting index patients (with ≥1 RT-PCR-positive or LFD-positive contact) potentially detectable by LFDs (specifically Innova, as the most widely used LFD) with time, accounting for index viral load, variant, and symptom status.
We assessed 75 382 pairs of LFD and RT-PCR tests. Of these, 4131 (5·5%) were RT-PCR-positive. LFD sensitivity versus RT-PCR was 63·2% (95% CI 61·7-64·6) and specificity was 99·71% (95% CI 99·66-99·74). Increased viral load was independently associated with being LFD positive (adjusted odds ratio [aOR] 2·85 [95% CI 2·66-3·06] per 1 log10 copies per mL increase; p<0·0001). There was no evidence that LFD sensitivity differed for delta (B.1.617.2) infections versus alpha (B.1.1.7) or pre-alpha (B.1.177) infections (aOR 1·00 [0·69-1·45]; p=0·99), whereas omicron (BA.1 or BA.2) infections appeared more likely to be LFD positive (aOR 1·63 [1·02-2·59]; p=0·042). Sensitivity was higher in symptomatic participants (68·7% [95% CI 66·9-70·4]) than in asymptomatic participants (52·8% [50·1-55·4]). Among 347 374 unique index patients with probable onward transmission, 78·3% (95% CI 75·3-81·2) were estimated to have been detectable with LFDs (Innova), and this proportion was mostly stable with time and for successive variants. Overall, the estimated proportion of infectious index patients detectable by the Innova LFD was lower in asymptomatic patients (57·6% [53·6-61·9]) versus symptomatic patients (79·7% [76·7-82·5]).
LFDs remained able to detect most SARS-CoV-2 infections throughout vaccine roll-out and across different viral variants. LFDs can potentially detect most infections that transmit to others and reduce the risk of transmission. However, performance is lower in asymptomatic individuals than in symptomatic individuals.
UK Health Security Agency, the UK Government Department of Health and Social Care, National Institute for Health Research (NIHR) Health Protection Research Unit in Healthcare Associated Infections and Antimicrobial Resistance, and the University of Oxford NIHR Biomedical Research Centre.
Eyre DW
,Futschik M
,Tunkel S
,Wei J
,Cole-Hamilton J
,Saquib R
,Germanacos N
,Dodgson AR
,Klapper PE
,Sudhanva M
,Kenny C
,Marks P
,Blandford E
,Hopkins S
,Peto TEA
,Fowler T
... -
《-》
-
Rapid antigen testing for SARS-CoV-2 by lateral flow assay: A field evaluation of self- and professional testing at UK community testing sites.
The advent of lateral flow devices (LFDs) for SARS-CoV-2 detection enabled widespread use of rapid self-tests during the pandemic. While self-testing using LFDs is now common, whether self-testing provides comparable performance to professional testing was a key question that remained important for pandemic planning.
Three prospective multi-centre studies were conducted to compare the performance of self- and professional testing using LFDs. Participants tested themselves or were tested by trained (professional) testers at community testing sites in the UK. Corresponding qRT-PCR test results served as reference standard. The performance of Innova, Orient Gene and SureScreen LFDs by users (self) and professional testers was assessed in terms of sensitivity, specificity, and kit failure (void) rates. Impact of age, sex and symptom status was analysed using logistic regression modelling.
16,617 participants provided paired tests, of which 15,418 were included in the analysis. Self-testing with Innova, Orient Gene or SureScreen LFDs achieved sensitivities of 50 %, 53 % or 72 %, respectively, compared to qRT-PCR. Self and professional LFD testing showed no statistically different sensitivity with respect to corresponding qRT-PCR testing. Specificity was consistently equal to or higher than 99 %. Sex and age had no or only marginal impact on LFD performance while sensitivity was significantly higher for symptomatic individuals. Sensitivity of LFDs increased strongly to up to 90 % with higher levels of viral RNA measured by qRT-PCR.
Our results support SARS-CoV-2 self-testing with LFDs, especially for the detection of individuals whose qRT-PCR tests showed high viral concentrations.
Futschik ME
,Johnson S
,Turek E
,Chapman D
,Carr S
,Thorlu-Bangura Z
,Klapper PE
,Sudhanva M
,Dodgson A
,Cole-Hamilton JR
,Germanacos N
,Kulasegaran-Shylini R
,Blandford E
,Tunkel S
,Peto T
,Hopkins S
,Fowler T
... -
《-》
-
Rapid, point-of-care antigen and molecular-based tests for diagnosis of SARS-CoV-2 infection.
Accurate rapid diagnostic tests for SARS-CoV-2 infection could contribute to clinical and public health strategies to manage the COVID-19 pandemic. Point-of-care antigen and molecular tests to detect current infection could increase access to testing and early confirmation of cases, and expediate clinical and public health management decisions that may reduce transmission.
To assess the diagnostic accuracy of point-of-care antigen and molecular-based tests for diagnosis of SARS-CoV-2 infection. We consider accuracy separately in symptomatic and asymptomatic population groups.
Electronic searches of the Cochrane COVID-19 Study Register and the COVID-19 Living Evidence Database from the University of Bern (which includes daily updates from PubMed and Embase and preprints from medRxiv and bioRxiv) were undertaken on 30 Sept 2020. We checked repositories of COVID-19 publications and included independent evaluations from national reference laboratories, the Foundation for Innovative New Diagnostics and the Diagnostics Global Health website to 16 Nov 2020. We did not apply language restrictions.
We included studies of people with either suspected SARS-CoV-2 infection, known SARS-CoV-2 infection or known absence of infection, or those who were being screened for infection. We included test accuracy studies of any design that evaluated commercially produced, rapid antigen or molecular tests suitable for a point-of-care setting (minimal equipment, sample preparation, and biosafety requirements, with results within two hours of sample collection). We included all reference standards that define the presence or absence of SARS-CoV-2 (including reverse transcription polymerase chain reaction (RT-PCR) tests and established diagnostic criteria).
Studies were screened independently in duplicate with disagreements resolved by discussion with a third author. Study characteristics were extracted by one author and checked by a second; extraction of study results and assessments of risk of bias and applicability (made using the QUADAS-2 tool) were undertaken independently in duplicate. We present sensitivity and specificity with 95% confidence intervals (CIs) for each test and pooled data using the bivariate model separately for antigen and molecular-based tests. We tabulated results by test manufacturer and compliance with manufacturer instructions for use and according to symptom status.
Seventy-eight study cohorts were included (described in 64 study reports, including 20 pre-prints), reporting results for 24,087 samples (7,415 with confirmed SARS-CoV-2). Studies were mainly from Europe (n = 39) or North America (n = 20), and evaluated 16 antigen and five molecular assays. We considered risk of bias to be high in 29 (50%) studies because of participant selection; in 66 (85%) because of weaknesses in the reference standard for absence of infection; and in 29 (45%) for participant flow and timing. Studies of antigen tests were of a higher methodological quality compared to studies of molecular tests, particularly regarding the risk of bias for participant selection and the index test. Characteristics of participants in 35 (45%) studies differed from those in whom the test was intended to be used and the delivery of the index test in 39 (50%) studies differed from the way in which the test was intended to be used. Nearly all studies (97%) defined the presence or absence of SARS-CoV-2 based on a single RT-PCR result, and none included participants meeting case definitions for probable COVID-19. Antigen tests Forty-eight studies reported 58 evaluations of antigen tests. Estimates of sensitivity varied considerably between studies. There were differences between symptomatic (72.0%, 95% CI 63.7% to 79.0%; 37 evaluations; 15530 samples, 4410 cases) and asymptomatic participants (58.1%, 95% CI 40.2% to 74.1%; 12 evaluations; 1581 samples, 295 cases). Average sensitivity was higher in the first week after symptom onset (78.3%, 95% CI 71.1% to 84.1%; 26 evaluations; 5769 samples, 2320 cases) than in the second week of symptoms (51.0%, 95% CI 40.8% to 61.0%; 22 evaluations; 935 samples, 692 cases). Sensitivity was high in those with cycle threshold (Ct) values on PCR ≤25 (94.5%, 95% CI 91.0% to 96.7%; 36 evaluations; 2613 cases) compared to those with Ct values >25 (40.7%, 95% CI 31.8% to 50.3%; 36 evaluations; 2632 cases). Sensitivity varied between brands. Using data from instructions for use (IFU) compliant evaluations in symptomatic participants, summary sensitivities ranged from 34.1% (95% CI 29.7% to 38.8%; Coris Bioconcept) to 88.1% (95% CI 84.2% to 91.1%; SD Biosensor STANDARD Q). Average specificities were high in symptomatic and asymptomatic participants, and for most brands (overall summary specificity 99.6%, 95% CI 99.0% to 99.8%). At 5% prevalence using data for the most sensitive assays in symptomatic people (SD Biosensor STANDARD Q and Abbott Panbio), positive predictive values (PPVs) of 84% to 90% mean that between 1 in 10 and 1 in 6 positive results will be a false positive, and between 1 in 4 and 1 in 8 cases will be missed. At 0.5% prevalence applying the same tests in asymptomatic people would result in PPVs of 11% to 28% meaning that between 7 in 10 and 9 in 10 positive results will be false positives, and between 1 in 2 and 1 in 3 cases will be missed. No studies assessed the accuracy of repeated lateral flow testing or self-testing. Rapid molecular assays Thirty studies reported 33 evaluations of five different rapid molecular tests. Sensitivities varied according to test brand. Most of the data relate to the ID NOW and Xpert Xpress assays. Using data from evaluations following the manufacturer's instructions for use, the average sensitivity of ID NOW was 73.0% (95% CI 66.8% to 78.4%) and average specificity 99.7% (95% CI 98.7% to 99.9%; 4 evaluations; 812 samples, 222 cases). For Xpert Xpress, the average sensitivity was 100% (95% CI 88.1% to 100%) and average specificity 97.2% (95% CI 89.4% to 99.3%; 2 evaluations; 100 samples, 29 cases). Insufficient data were available to investigate the effect of symptom status or time after symptom onset.
Antigen tests vary in sensitivity. In people with signs and symptoms of COVID-19, sensitivities are highest in the first week of illness when viral loads are higher. The assays shown to meet appropriate criteria, such as WHO's priority target product profiles for COVID-19 diagnostics ('acceptable' sensitivity ≥ 80% and specificity ≥ 97%), can be considered as a replacement for laboratory-based RT-PCR when immediate decisions about patient care must be made, or where RT-PCR cannot be delivered in a timely manner. Positive predictive values suggest that confirmatory testing of those with positive results may be considered in low prevalence settings. Due to the variable sensitivity of antigen tests, people who test negative may still be infected. Evidence for testing in asymptomatic cohorts was limited. Test accuracy studies cannot adequately assess the ability of antigen tests to differentiate those who are infectious and require isolation from those who pose no risk, as there is no reference standard for infectiousness. A small number of molecular tests showed high accuracy and may be suitable alternatives to RT-PCR. However, further evaluations of the tests in settings as they are intended to be used are required to fully establish performance in practice. Several important studies in asymptomatic individuals have been reported since the close of our search and will be incorporated at the next update of this review. Comparative studies of antigen tests in their intended use settings and according to test operator (including self-testing) are required.
Dinnes J
,Deeks JJ
,Berhane S
,Taylor M
,Adriano A
,Davenport C
,Dittrich S
,Emperador D
,Takwoingi Y
,Cunningham J
,Beese S
,Domen J
,Dretzke J
,Ferrante di Ruffano L
,Harris IM
,Price MJ
,Taylor-Phillips S
,Hooft L
,Leeflang MM
,McInnes MD
,Spijker R
,Van den Bruel A
,Cochrane COVID-19 Diagnostic Test Accuracy Group
... -
《Cochrane Database of Systematic Reviews》
-
Rapid, point-of-care antigen tests for diagnosis of SARS-CoV-2 infection.
Accurate rapid diagnostic tests for SARS-CoV-2 infection would be a useful tool to help manage the COVID-19 pandemic. Testing strategies that use rapid antigen tests to detect current infection have the potential to increase access to testing, speed detection of infection, and inform clinical and public health management decisions to reduce transmission. This is the second update of this review, which was first published in 2020.
To assess the diagnostic accuracy of rapid, point-of-care antigen tests for diagnosis of SARS-CoV-2 infection. We consider accuracy separately in symptomatic and asymptomatic population groups. Sources of heterogeneity investigated included setting and indication for testing, assay format, sample site, viral load, age, timing of test, and study design.
We searched the COVID-19 Open Access Project living evidence database from the University of Bern (which includes daily updates from PubMed and Embase and preprints from medRxiv and bioRxiv) on 08 March 2021. We included independent evaluations from national reference laboratories, FIND and the Diagnostics Global Health website. We did not apply language restrictions.
We included studies of people with either suspected SARS-CoV-2 infection, known SARS-CoV-2 infection or known absence of infection, or those who were being screened for infection. We included test accuracy studies of any design that evaluated commercially produced, rapid antigen tests. We included evaluations of single applications of a test (one test result reported per person) and evaluations of serial testing (repeated antigen testing over time). Reference standards for presence or absence of infection were any laboratory-based molecular test (primarily reverse transcription polymerase chain reaction (RT-PCR)) or pre-pandemic respiratory sample.
We used standard screening procedures with three people. Two people independently carried out quality assessment (using the QUADAS-2 tool) and extracted study results. Other study characteristics were extracted by one review author and checked by a second. We present sensitivity and specificity with 95% confidence intervals (CIs) for each test, and pooled data using the bivariate model. We investigated heterogeneity by including indicator variables in the random-effects logistic regression models. We tabulated results by test manufacturer and compliance with manufacturer instructions for use and according to symptom status.
We included 155 study cohorts (described in 166 study reports, with 24 as preprints). The main results relate to 152 evaluations of single test applications including 100,462 unique samples (16,822 with confirmed SARS-CoV-2). Studies were mainly conducted in Europe (101/152, 66%), and evaluated 49 different commercial antigen assays. Only 23 studies compared two or more brands of test. Risk of bias was high because of participant selection (40, 26%); interpretation of the index test (6, 4%); weaknesses in the reference standard for absence of infection (119, 78%); and participant flow and timing 41 (27%). Characteristics of participants (45, 30%) and index test delivery (47, 31%) differed from the way in which and in whom the test was intended to be used. Nearly all studies (91%) used a single RT-PCR result to define presence or absence of infection. The 152 studies of single test applications reported 228 evaluations of antigen tests. Estimates of sensitivity varied considerably between studies, with consistently high specificities. Average sensitivity was higher in symptomatic (73.0%, 95% CI 69.3% to 76.4%; 109 evaluations; 50,574 samples, 11,662 cases) compared to asymptomatic participants (54.7%, 95% CI 47.7% to 61.6%; 50 evaluations; 40,956 samples, 2641 cases). Average sensitivity was higher in the first week after symptom onset (80.9%, 95% CI 76.9% to 84.4%; 30 evaluations, 2408 cases) than in the second week of symptoms (53.8%, 95% CI 48.0% to 59.6%; 40 evaluations, 1119 cases). For those who were asymptomatic at the time of testing, sensitivity was higher when an epidemiological exposure to SARS-CoV-2 was suspected (64.3%, 95% CI 54.6% to 73.0%; 16 evaluations; 7677 samples, 703 cases) compared to where COVID-19 testing was reported to be widely available to anyone on presentation for testing (49.6%, 95% CI 42.1% to 57.1%; 26 evaluations; 31,904 samples, 1758 cases). Average specificity was similarly high for symptomatic (99.1%) or asymptomatic (99.7%) participants. We observed a steady decline in summary sensitivities as measures of sample viral load decreased. Sensitivity varied between brands. When tests were used according to manufacturer instructions, average sensitivities by brand ranged from 34.3% to 91.3% in symptomatic participants (20 assays with eligible data) and from 28.6% to 77.8% for asymptomatic participants (12 assays). For symptomatic participants, summary sensitivities for seven assays were 80% or more (meeting acceptable criteria set by the World Health Organization (WHO)). The WHO acceptable performance criterion of 97% specificity was met by 17 of 20 assays when tests were used according to manufacturer instructions, 12 of which demonstrated specificities above 99%. For asymptomatic participants the sensitivities of only two assays approached but did not meet WHO acceptable performance standards in one study each; specificities for asymptomatic participants were in a similar range to those observed for symptomatic people. At 5% prevalence using summary data in symptomatic people during the first week after symptom onset, the positive predictive value (PPV) of 89% means that 1 in 10 positive results will be a false positive, and around 1 in 5 cases will be missed. At 0.5% prevalence using summary data for asymptomatic people, where testing was widely available and where epidemiological exposure to COVID-19 was suspected, resulting PPVs would be 38% to 52%, meaning that between 2 in 5 and 1 in 2 positive results will be false positives, and between 1 in 2 and 1 in 3 cases will be missed.
Antigen tests vary in sensitivity. In people with signs and symptoms of COVID-19, sensitivities are highest in the first week of illness when viral loads are higher. Assays that meet appropriate performance standards, such as those set by WHO, could replace laboratory-based RT-PCR when immediate decisions about patient care must be made, or where RT-PCR cannot be delivered in a timely manner. However, they are more suitable for use as triage to RT-PCR testing. The variable sensitivity of antigen tests means that people who test negative may still be infected. Many commercially available rapid antigen tests have not been evaluated in independent validation studies. Evidence for testing in asymptomatic cohorts has increased, however sensitivity is lower and there is a paucity of evidence for testing in different settings. Questions remain about the use of antigen test-based repeat testing strategies. Further research is needed to evaluate the effectiveness of screening programmes at reducing transmission of infection, whether mass screening or targeted approaches including schools, healthcare setting and traveller screening.
Dinnes J
,Sharma P
,Berhane S
,van Wyk SS
,Nyaaba N
,Domen J
,Taylor M
,Cunningham J
,Davenport C
,Dittrich S
,Emperador D
,Hooft L
,Leeflang MM
,McInnes MD
,Spijker R
,Verbakel JY
,Takwoingi Y
,Taylor-Phillips S
,Van den Bruel A
,Deeks JJ
,Cochrane COVID-19 Diagnostic Test Accuracy Group
... -
《Cochrane Database of Systematic Reviews》