Abstract
Background Mass testing for early identification and isolation of infectious COVID-19 individuals, irrespective of concurrent symptoms, is an efficacious strategy to reduce disease transmission. Antigen-detecting rapid diagnostic tests (Ag-RDT) appear as a potentially suitable tool for mass testing on account of their ease-of-use, fast turnaround time, and low cost. However, benchmark comparisons are scarce, particularly in the context of unexposed asymptomatic individuals.
Methods We used nasopharyngeal specimens from unexposed asymptomatic individuals to assess five Ag-RDTs: PanBio™ COVID-19 Ag Rapid test (Abbott), CLINITEST® Rapid COVID-19 Antigen Test (Siemens), SARS-CoV-2 Rapid Antigen Test (Roche Diagnostics), SARS-CoV-2 Antigen Rapid Test Kit (Lepu Medical), and COVID-19 Coronavirus Rapid Antigen Test Cassette (Surescreen). Samples were collected between December 2020-January 2021 during the third wave of the epidemic in Spain.
Findings The analysis included 101 specimens with confirmed positive PCR results and 185 with negative PCR. For the overall sample, the performance parameters of Ag-RDTs were as follows: Abbott assay, sensitivity 38·6% (95% CI 29·1–48·8) and specificity 99·5% (97–100%); Siemens, sensitivity 51·5% (41·3–61·6) and specificity 98·4% (95·3–99·6); Roche, sensitivity 43·6% (33·7–53·8) and specificity 96·2% (92·4–98·5); Lepu, sensitivity 45·5% (35·6–55·8) and specificity 89·2% (83·8–93·3%); Surescreen, sensitivity 28·8% (20·2–38·6) and specificity 97·8% (94·5–99·4%). For specimens with cycle threshold (Ct) <30 in RT-qPCR, all Ag-RDT achieved a sensitivity of at least 70%, with Siemens, Roche, and Lepu assays showing sensitivities higher than 80%. In models according to population prevalence, all Ag-RDTs will have a NPV >99% and a PPV<50% at 1% prevalence.
Interpretation Two commercial, widely available assays can be used for SARS-CoV-2 antigen testing to achieve sensitivity in specimens with a Ct<30 and specificity of at least 80% and 96%, respectively. Estimated negative and positive predictive values suggests the suitability of Ag-RDTs for mass screenings of SARS-CoV-2 infection in the general population.
Funding Blueberry diagnostics, Fundació Institut d’Investigació en Ciències de la Salut Germans Trias i Pujol, and #YoMeCorono.org crowdfunding campaign.
Evidence before this study In December 2020, we searched on PubMed for articles containing the terms “antigen”, “test” (or Ag-RDT), and “SARS-CoV-2” or “COVID-19” either in the title or the abstract. Our search yielded 79 entries corresponding to articles written in English. Of them, 33 were articles presenting the diagnostic performance of qualitative lateral-flow antigen-detecting rapid diagnostic tests (Ag-RDT). Four of these articles reported the results of head-to-head comparisons of various Ag-RDTs; in all cases, the number of tests was lower than the recommended for retrospective assessments of diagnostic performance (i.e., minimum of 100 PCR positive and 100 PCR negative). Furthermore, all head-to-head comparisons found in the literature included specimens obtained among individuals with varying disease status (none of which asymptomatic), thus limiting the adequacy of the estimates for an asymptomatic screening strategy.
Added value of this study We compared for the first time head-to-head five Ag-RDT using a powered set of fresh respiratory specimens PCR-confirmed positive or negative, collected from unexposed asymptomatic individuals during screening campaigns for early detection of SARS-CoV-2 infection. The sample size was large enough to draw robust conclusions. Our analysis identified four Ag-RDTs (i.e., assays marketed by Abbott, Siemens, Roche, and Surescreen) with specificity higher than 96%. Despite the low sensitivity for the overall sample (range 29% to 51%), the corresponding values for the subset of samples with Ct <30 were higher than 80% for Siemens, Roche, and Lepu assays. The estimated NPV for a screening performed in an area with 1% prevalence would be >99% for all tests, while the PPV would be <50%.
Implications of all the available evidence Current data on the diagnostic performance of Ag-RDTs is heterogeneous and precludes benchmark assessments. Furthermore, the screening of asymptomatic populations is currently not considered among the intended uses of Ag-RDT, mostly because of lack of evidence on test performance in samples from unexposed asymptomatic individuals. Our findings add to the current evidence in two ways: first, we provide benchmarking data on Ag-RDTs, assessed head-to-head in a single set of respiratory specimens; second, we provide data on the diagnostic performance of Ag-RDTs in unexposed asymptomatic individuals. Our findings support the idea that Ag-RDTs can be used for mass screening in low prevalence settings and accurately rule out a highly infectious case in such setting.
Competing Interest Statement
The authors have declared no competing interest.
Funding Statement
Blueberry diagnostics, Fundacio Institut d'Investigacio en Ciencies de la Salut Germans Trias i Pujol, and #YoMeCorono.org crowdfunding campaign.
Author Declarations
I confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.
Yes
The details of the IRB/oversight body that provided approval or exemption for the research described are given below:
The study received approval from the Ethics Committe of the Hospital Universitari Germans Trias i Pujol
All necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived.
Yes
I understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).
Yes
I have followed all appropriate research reporting guidelines and uploaded the relevant EQUATOR Network research reporting checklist(s) and other pertinent material as supplementary files, if applicable.
Yes
Data Availability
Data are available upon request tp the corresponding author
