ABSTRACT
BACKGROUND SARS-CoV-2 testing capacity is important to monitor epidemic dynamics and as a mitigation strategy. Given difficulties of large-scale quantitative reverse transcription polymerase chain reaction (qRT-PCR) implementation, rapid antigen tests (Rapid Ag-T) have been proposed as alternatives in settings like Mexico. Here, we evaluated diagnostic performance of Rapid Ag-T for SARS-CoV-2 infection and its associated clinical implications compared to qRT-PCR testing in Mexico.
METHODS We analyzed data from the COVID-19 registry of the Mexican General Directorate of Epidemiology up to April 30th, 2021 (n=6,632,938) and cases with both qRT-PCR and Rapid Ag-T (n=216,388). We evaluated diagnostic performance using accuracy measures and assessed time-dependent changes in the Area Under the Receiver Operating Characteristic curve (AUROC). We also explored test discordances as predictors of hospitalization, intubation, severe COVID-19 and mortality.
RESULTS Rapid Ag-T is primarily used in Mexico City. Rapid Ag-T have low sensitivity 37.6% (95%CI 36.6-38.7), high specificity 95.5% (95%CI 95.1-95.8) and acceptable positive 86.1% (95%CI 85.0-86.6) and negative predictive values 67.2% (95%CI 66.2-69.2). Rapid Ag-T has optimal diagnostic performance up to days 3 after symptom onset, and its performance is modified by testing location, comorbidity, and age. qRT-PCR (-) / Rapid Ag-T (+) cases had higher risk of adverse COVID-19 outcomes (HR 1.54 95% CI 1.41-1.68) and were older, qRT-PCR (+)/ Rapid Ag-T(-) cases had slightly higher risk or adverse outcomes and ≥7 days from symptom onset (HR 1.53 95% CI 1.48-1.59). Cases detected with rapid Ag-T were younger, without comorbidities, and milder COVID-19 course.
CONCLUSIONS Rapid Ag-T could be used as an alternative to qRT-PCR for large scale SARS-CoV-2 testing in Mexico. Interpretation of Rapid Ag-T results should be done with caution to minimize the risk associated with false negative results.
INTRODUCTION
SARS-CoV-2 testing capacity has been regarded as a fundamental factor to achieve pandemic control around the world1. It has been proposed that prompt isolation of possibly contagious individuals identified by testing and contact tracing is one of the most effective measures to reduce community-level transmission of SARS-CoV-2 infection; furthermore, effective reduction of community-level transmission can only be achieved with well-designed, universal, and cost-effective testing strategies2. Although quantitative reverse transcription polymerase chain reaction tests (qRT-PCR) have been the reference for detection of active SARS-CoV-2 infections, its systematic implementation entails significant technical difficulties in limited resource settings3. In order to address these methodological issues, the World Health Organization (WHO) proposed that rapid antigen tests (Rapid Ag-T) and other point-of-care tests (POCTs), which have demonstrated to have a high specificity compared to other molecular techniques4,5, could be useful alternatives for large-scale epidemiologic monitoring. With the worldwide rise in the use of Rapid Ag-T and POCTs, the presence of false negative results becomes of high epidemiologic importance, as unknown infected persons can be a vector of community transmission in countries where active SARS-CoV-2 infection is ongoing8.
In Mexico, local authorities implemented a sentinel system-testing policy focused on tracking severe cases of COVID-19, and to a lesser extent those mild to moderate cases. Nevertheless, it has been reported that the implementation of full contact tracing procedure is only performed in areas where qRT-PCR testing facilities are available9. Rapid Ag-T have been recently promoted as a dynamic strategy for detection of active SARS-CoV-2 infection in Mexico to address these issues; however, despite being recommended by the WHO and used worldwide, few studies have evaluated their performance using large epidemiological real-world data6,7. The increased use for Rapid Ag-T in Mexico demands a comprehensive evaluation for its diagnostic performance when compared with current reference testing techniques. Furthermore, its clinical implications could lead to the identification of subjects at risk for discrepancies of Rapid Ag-T results to minimize the risk of complications from COVID-19 and streamline prompt medical care. Here, we aim to assess the performance of Rapid Ag-T for diagnosis of SARS-CoV-2 infection and to examine the clinical implications of the discrepancies in its result compared to qRT-PCR test using national epidemiological dataset collected during the COVID-19 pandemic in Mexico.
METHODS
Data sources
This is a retrospective analysis of the open COVID-19 registry dataset collected by the General Directorate of Epidemiology of the Mexican Ministry of Health within the National Epidemiological Surveillance System (NESS), which includes daily updated suspected COVID-19 cases10. The database holds information on all persons tested for SARS-CoV-2 infection at public facilities in Mexico, as well as in all private healthcare facilities that follow the legal mandate to report COVID-19 cases to health authorities and the public locations for rapid antigen testing approved by the Mexican Ministry of Health. Furthermore, all samples registered in the NESS were conducted under the official guidelines from the Institute of Epidemiological Diagnosis and Reference (InDRE) to manage nasopharyngeal samples for rapid-antigen test9. This report adheres to the STARD guidelines for reporting of diagnostic accuracy tests11. A full list of available variables is presented in Supplementary Material.
Testing strategies for SARS-CoV-2 in Mexico
Prior to October 28th, 2020, suspected cases were tested for SARS-CoV-2 infection using real-time qRT-PCR according to the Berlin Protocol9. Suspected COVID-19 cases were defined as an individual whom in the last 7 days has presented ≥2 of the following: cough, fever or headache; accompanied by either dyspnea, arthralgias, myalgias, sore throat, rhinorrhea, conjunctivitis or chest pain. Amongst suspected cases, the Ministry of Health established two protocols for case confirmation: 1) SARS-CoV-2 testing is done widespread for suspected COVID-19 cases with severe acute respiratory infection and signs of breathing difficulty or deaths with suspected COVID-19, 2) for all other cases, a sentinel surveillance model is being utilized, whereby 475 health facilities, which comprise a nationally representative sample, evaluate ∼10% of mild outpatient cases to provide estimates of mild cases9,12.
After October 28th, 2020, tests for SARS-CoV-2 infections additionally included those who were detected using one of the three available Rapid Ag-T including STANDARD(tm)Q COVID-19 Ag Test, Panbio(tm) COVID-19 Ag RAPID Test Device, and Sofia2 SARS Antigen FIA by Quidel Corporation, which are approved to use and evaluated for efficacy by the National Institute for Epidemiological Diagnosis and Reference and the WHO13. These Rapid Ag-T are available in healthcare community-level locations for testing of suspected COVID-19 cases or by epidemiological association with a suspected case and they are currently used extensively for tracking the epidemic in Mexico City14. A full list of qRT-PCR and Rapid Ag-T kits available and approved for its use in Mexico is presented in Supplementary Materials. Confirmed SARS-CoV-2 infection is defined as an individual with a positive Rapid Ag-T or a positive qRT-PCR test; cases with Rapid Ag-T and suspected epidemiological association with a confirmed SARS-CoV-2 case or a clinical profile with high suspicion of COVID-19 are eligible for further evaluation with qRT-PCR testing within testing facilities9. According to InDRE, all negative cases need be re-tested at the same moment with qRT-PCR test to confirm or discard the diagnosis of SARS-CoV-2 infection.
Definitions of outcomes and predictors
For cases who had both qRT-PCR and rapid antigen test information available, we used the qRT-PCR result as a reference test to classify cases as true positive (qRT-PCR + / Rapid Ag-T +), true negative (qRT-PCR - / Rapid Ag-T -), false positive (qRT-PCR - / Rapid Ag-T +) and false negative (qRT-PCR + / Rapid Ag-T -). Severe outcomes were defined as a composite of either death, ICU admission or requirement for invasive ventilation; hospital admission, requirement for intubation and lethality were also evaluated as outcomes. Follow-up time was estimated in days from symptom onset until either hospitalization or death, depending on the outcome of interest, or censoring, whichever occurred first.
Statistical analysis
Population-based statistics
We compared testing rates standardized per 100,000 inhabitants across Mexican municipalities and its trends over time after its implementation in late October comparing testing rates between Mexico City and the rest of Mexico due to the high density of Rapid Ag-T in the former. We also compared incident cases detected with qRT-PCR and Rapid Ag-T in Mexico City compared to the rest with the country. Furthermore, we compared cases who were assessed exclusively with Rapid Ag-T, qRT-PCR, or both to identify factors which influence testing in these settings.
Performance of rapid antigen tests compared to qRT-PCR
We evaluated the performance of Rapid Ag-T compared to qRT-PCR using complete-case analysis of individuals who had both results available using confusion matrices and areas under the receiving operating characteristic curves (AUROC) with the caret and pROC R packages. We estimated the concordance of both testing methods using Cohen’s Kappa (κ) coefficient. We further estimated sensitivity, specificity, positive and negative predictive values (PPV, NPV, respectively) and positive and negative likelihood ratios (LR+ and LR-, respectively) and their corresponding 95% confidence intervals with DeLong’s method with the OptimalCutpoints R package. To evaluate the performance of Rapid Ag-T in different settings, we stratified these metrics according to testing location (Mexico City vs. Rest of Mexico), patient status (inpatient vs. outpatient), cases with and without comorbidities, age (>60 vs. ≤60 years) and time from symptom onset to evaluation (>7 vs ≤7 days from onset).
Time-dependent performance of rapid antigen tests
We evaluated time-varying diagnostic performance or Rapid Ag-T using time-dependent ROC curves with the timeROC R package with inverse probability weighting in Cox regression, adjusted for age and sex for 1, 3, 5, 7, 10 and 15 days from symptom onset. We further evaluated the performance of Rapid Ag-T to predict hospitalization, mortality, and intubation, in cases with or without added qRT-PCR testing using the same proposed cut-offs.
Predictors of test discordances
We tested for predictors of Rapid Ag-T and qRT-PCR discrepancies using mixed effects logistic regression, considering heterogeneity in epidemic dynamics across Mexico including municipality of residence as a random effect. To dissect predictors of test discrepancy, for false positive models we included only false positive and true negative cases and for false negative models we included true positive and false negative cases. We adjusted all models for age, sex, time from symptom onset and number of comorbidities.
Clinical implications of Rapid Ag-T results
We evaluated test discordances as predictors for hospitalization, lethality and the composite event of severe outcomes using mixed-effects Cox regression incorporating municipality of residence as a random effect within the frailty term to control for geographical heterogeneity. Both for outcome predictors and for the implication of test discordances on intubation rates, we fitted mixed effects logistic regression models adjusted for age, sex, diabetes, arterial hypertension, CORP, immunosuppression, cardiovascular disease, obesity, asthma, and chronic kidney disease and considering municipality of residence as a random intercept. Next, we evaluated predictors for hospitalization, lethality and the composite event of severe outcomes using mixed-effects Cox regression in SARS-CoV-2 cases detected using Rapid Ag-T. For Cox models, proportional risk assumptions were verified using Schönfeld residuals and visual inspection of time-varying effects; for logistic regression models, goodness of fit was evaluated using the Hosmer-Lemeshow test and model selection was carried out using minimization of the Bayesian Information Criterion (BIC). All statistical analyses were conducted using R language version 4.0.3 and a p-value <0.05 was considered as the statistical significance threshold.
RESULTS
Study population
Until April 30th, 2021 a total of 6,307,964 subjects had been tested for SARS-CoV-2 in Mexico. Amongst them, 3,703,978 (58.7%) had only qRT-PCR test, 2,387,598 (37.8%) had only a rapid antigen test and 216,388 (3.4%) subjects had both qRT-PCR and rapid antigen tests. When comparing characteristics amongst the three previous groups, cases tested using Rapid Ag-T were younger, predominantly female, had lower rates of chronic comorbidities, and fewer cases who presented with features of severe COVID-19. Notably, cases who undertook Rapid Ag-T had lower median days from symptom onset to clinical assessment (Table 1).
Amongst tested cases, a total of 2,194,872 (34.7%) cases had confirmed SARS-CoV-2 infection using either of those tests and 4,133,092 (65.4%) had a negative result. The positivity rate was lower for Rapid Ag-T (22.1%) compared to qRT-PCR (43.2%). After the implementation of Rapid Ag-T, the rate of testing using this method was the largest in Mexico City, with over 18,767.32 tests per 100,000 habitants, followed by the state of Morelos with 5,619.06 Rapid Ag-T per 100,000 habitants and Queretaro with 2,004.04 Rapid Ag-T per 100,000 habitants. Between October 2020 and April 2021, ∼80% of SARS-CoV-2 testing in Mexico City was carried out using Rapid Ag-T. compared with <10% in the rest of Mexico. Nevertheless, since January up to April 2021 there was a rapid increase of Rapid Ag-T across Mexico. Overall, amongst 527,068 confirmed SARS-CoV-2 cases using Rapid Ag-T, 296,823 (56.3%) were confirmed in Mexico City (Figure 1). A STARD diagram depicting all evaluated cases and a histogram of time from onset to testing is presented in Supplementary Material.
Performance of rapid antigen tests compared to qRT-PCR
A total of 216,388 subjects were tested using both qRT-PCR and Rapid Ag-T. Amongst them, 18,373 had pending tests results and 4,191 had inadequate qRT-PCR samples. Overall, a total of 193,824 cases had valid qRT-PCR and rapid antigen test results (Supplementary Materials). Subjects tested with qRT-PCR test had higher rates of chronic comorbidities and COVID-19 complications compared to cases with Rapid Ag-T only, but lower rates compared to qRT-PCR only (Table 1). Overall, we observed low concordance between both test modalities (κ=0.368, 95%CI 0.363-0.372); when considering qRT-PCR as reference test, we identified 20,738 (10.69%) true positives, 128,464 (21.17%) false negatives, 3,572 (1.84%) false positives and 41,050 (66.2%) true negatives, yielding and AUROC of 0.666 (95%CI 0.660-0.671). Overall, we identified that rapid antigen tests have a sensitivity of 37.6% (95%CI 36.6-38.7) and a specificity of 95.5% (95%CI 95.1-95.9), with a PPV of 86.1% (95%CI 85.0-86.6), a NPV of 67.2% (95%CI 66.2-69.2), a LR+ of 8.3 (95%CI 7.6-9.1), and a LR-of 0.65 (95%CI 0.64-0.66). Next, we assessed how the Rapid Ag-T performed in different scenarios and identified a lower performance in Mexico City compared to the rest of Mexico, for outpatients, younger cases, cases without comorbidities and, notably, in cases who had ≥7 days from symptom onset at evaluation (Table 2).
Time-dependent variation in Rapid Ag-T performance
As a sensitivity analysis, we used time-dependent ROC curves to model changes in diagnostic performance over time for detection of SARS-CoV-2 infection. Notably, Rapid Ag-T had unreliable test performance when disaggregating by time from symptom onset, which could be related to variability in CT values over the course of SARS-CoV-2 infections15. Here, we observed that, compared to qRT-PCR, Rapid Ag-T had the better AUROC at 3 days and its performance subsequently decreased until reaching the lowest AUROC at 15 days after symptom onset, adjusted for age and sex. Next, we evaluated whether using one test modality provided better predictive capacity for hospitalization, intubation and mortality, which would have relevant clinical implications for test selection. We observed that a positive qRT-PCR was relatively better at predicting hospital admission between 10-15 days after symptom onset and mortality at days 10-15, with a poor utility for all outcomes. For Rapid Ag-T, we observed similar trends, with a window for hospitalization and mortality between days 7-10 after symptom onset, but very low overall time-dependent test performance (Table 3).
Clinical characterization of cases with discordant Rapid Ag-T results
We evaluated predictors of false positive and false negative results in Rapid Ag-T for SARS-CoV-2 using qRT-PCR as reference test. Cases with false negative results had ≥7 days from symptom onset, were younger, and predominantly female. Regarding comorbidities, cases with false negative results were less likely to have underlying immunosuppression, obesity and chronic kidney disease. Regarding false positive results, we only observed increasing age as a significant predictor, with a non-significant trend in cases with chronic kidney disease (Figure 2). Next, we investigated whether these test discordances were predictive of COVID-19 outcomes. Regarding hospitalization we observed that, compared to true negative results, risk for hospitalization was higher for cases with true positive (HR 1.05, 95%CI 1.03-1.08) Rapid Ag-T results when compared with true negatives, adjusting for treatment setting, comorbidities, sex and age. Compared to true negative results, risk of intubation requirement was higher for false positive test results (OR 2.21, 95%CI 1.78-2.75), followed by true positive (OR 1.89, 95%CI 1.69-2.11) and false negative results (OR 1.36, 95%CI 1.23-1.51). When assessing the composite of any severe outcome, we observed a higher risk for cases with true positive results (HR 2.28, 95%CI 2.19-2.37), false positive results (HR 1.54, 95%CI 1.41-1.68) and for false negatives (HR 1.42, 95%CI 1.37-1.47). Finally, mortality risk was the highest for cases with true positive results (HR 2.46, 95%CI 2.36-2.56), followed by cases with false positive (HR 1.55, 95%CI 1.42-1.70) and false negative results (HR 1.53, 95%CI 1.48-1.59, Figure 3).
Characterization of SARS-CoV-2 positive cases using Rapid Ag-T
Finally, we compared positive cases detected using qRT-PCR and Rapid Ag-T. As expected, positive SARS-CoV-2 cases detected using Rapid Ag-T have a wider spectrum of disease severity with correspondingly lower rates of hospitalization, intubation, mortality and pneumonia. Cases detected using Rapid Ag-T were younger with lower rates of comorbidity and, notably, less median days from symptom onset to evaluation. Amongst cases assessed using Rapid Ag-T, positive SARS-CoV-2 cases had higher risk for hospitalization in older adults, males and subjects with obesity, immunosuppression, CKD, COPD, diabetes or hypertension. For severe COVID-19 and mortality, we identified higher risk in those with CKD, immunosuppression, hypertension, diabetes, males and older adults (Supplementary Material).
DISCUSSION
Here, we performed a real-world large-scale evaluation of Rapid Ag-T for the detection of SARS-CoV-2 at a community-wide level in Mexico. Rapid Ag-T are primarily used in Mexico City for rapid detection of cases to promote self-isolation and prompt initiation of treatment in severe COVID-19 cases. Given the larger availability of Rapid Ag-T, tested cases are younger and have lower rates of comorbidities previously linked to high risk of severe COVID-19, thus leading to lower rates of severe outcomes likely reflective of the true spectrum of SARS-CoV-2 infection in the community12,16. We observed that age, comorbidity, and time from symptom onset significantly impact the performance of Rapid Ag-T for SARS-CoV-2 and that optimal performance for these tests decreases after 7-10 days from symptom onset. Furthermore, we identified that positive Rapid Ag-T in cases with negative qRT-PCR have higher risks for severe COVID-19 outcomes, indicating potential benefit for the use of Rapid Ag-T in addition to qRT-PCR testing; notably, cases with false negative results in Rapid Ag-T have slightly higher risk of severe COVID-19 outcomes, with the main determinant for false negative status being the time from symptom onset to test assessment. Finally, older patients with negative qRT-PCR had higher odds of a positive Rapid Ag-T, which might call for implementation of sequential testing using Rapid Ag-T after a negative qRT-PCR in older adults with high clinical suspicion. Our results represent the largest evaluation on the usefulness of Rapid Ag-T in a real-world setting as well as on how some common chronic conditions might modify its accuracy in comparison with qRT-PCR tests. With the recent but limited availability of vaccines to prevent symptomatic SARS-CoV-2, consistent prevention of community-level transmission remains paramount to reduce contagions and prevent mortality until an ideal vaccination threshold can be achieved17. In this setting, widespread, frequent and repeated use of Rapid Ag-T is preferable given the limited implementation of large-scale qRT-PCR testing for SARS-CoV-2 in Mexico4,18.
The use of POCTs is relevant in pandemic settings, where test results can be used to promote self-isolation, adequate treatment allocation and to further contact tracing to reduce rapid dissemination of SARS-CoV-219. A recent meta-analysis of rapid POCTs for SARS-CoV-2 infection evaluated the use of Rapid Ag-T in different settings, identifying varying values of sensitivity coupled with high specificity, accordingly with our study20. The authors concluded that Rapid Ag-T can be used as a triage to allocate qRT-PCR testing in limited resource settings, which is compatible with our assessment of the clinical implications of false negatives using Rapid Ag-T to detect SARS-CoV-2 infection21. Our results show that Rapid Ag-T yield a low sensitivity but a very high specificity for detection of SARS-CoV-2 when compared to qRT-PCR. Despite the low sensitivity, the positive and negative predictive values are high likely due to the high prevalence of SARS-CoV-2 in the community20. This is consistent with reports of a re-analysis of published data of diagnostic accuracy of qRT-PCR SARS-CoV-2 testing, which described that the risk of false positives increases when extending testing strategies, with increased in false negatives being attributable to local outbreaks22. Furthermore, a recent study from Cameroon yields that Rapid-Ag testing is highly correlated and specific to lower cycle threshold values from qRT-PCR testing, providing evidence that Rapid Ag-T could be used as a first approach to evaluate SARS-CoV-2 infection15. Interestingly, diagnostic performance metrics were very similar to the more controlled setting of the Rapid Ag-T study in Cameroon, reflecting that despite possible differences in testing implementation, results are largely reproducible. In our study, Rapid Ag-T in Mexico City had a higher LR+ compared with the rest of the country, with equally high rates of false negative results using rapid antigen testing; notably, this testing modality is being used in this location to track trends of the COVID-19 pandemic. Although local authorities have promoted the use of Rapid-Ag T around all the country since November 2020, our results show that there is an unequal testing capacity for each state in Mexico. This inequality in testing could be related to unequal socioeconomic and demographic factors reported during the COVID-19 pandemic rather than individual conditions related to testing performance23. Special caution should be taken when evaluating and communicating negative results of rapid antigen tests for SARS-CoV-2, which if misinterpreted could be misleading and reduce adherence for self-isolation of asymptomatic cases identified via contact tracing24.
Prior to the recommendation from Mexican authorities for the widespread use of Rapid Ag-T, the Mexican Ministry of Health selected cases for qRT-PCR testing based on a sentinel-surveillance system which identified cases based on the presence of respiratory symptoms, leading to an overrepresentation of severe and critical COVID-19 cases9. Our group previously profiled cases with non-respiratory symptoms and asymptomatic SARS-CoV-2 infections in Mexico City; we identified that no single symptom offered a reliable assessment of disease severity at the time of initial evaluation, even in population at high risk of contagion such as healthcare workers, as has been confirmed by a recent meta-analysis25–27. Given recent evidence which highlights the potential of pre-symptomatic and asymptomatic SARS-CoV-2 transmission and the usefulness of contact tracing as a complement to social distancing and community mitigation policies, SARS-CoV-2 testing should be extended to cases with recent contact with known COVID-19 cases despite the absence of symptoms24,28,29. Unfortunately, POCTs have relevant limitations on its diagnostic performance which may question its widespread use to inform public policy or for clinical decision making. Particularly, Rapid Ag-T require an active and symptomatic infection and sampling must be done no later than 7 days after beginning of symptoms, while qRT-PCR can be used to assess asymptomatic cases and requires less amount of sample to yield a positive result30. Low sensitivity in Rapid Ag-T could also be attributable to additional factors including varying degrees of quality implementation and lack of standardization in testing; however, this should be considered when these tests are implemented at a larger scale, particularly for POCTs. Our data similarly suggests that the time-varying diagnostic performance of Rapid Ag-T might have similar shortcomings to those observed in qRT-PCR testing and which need to be considered when using the result of either method to inform decision-making31,32. Future studies should investigate the utility of Rapid Ag-T as triage for qRT-PCR use in asymptomatic SARS-CoV-2 infection as well as the ideal time frames to reduce the likelihood of discordant results when implementing sequential testing.
Our study had some strengths and limitations. We are using a large national registry of COVID-19 cases, many of whom were tested using both Rapid Ag-T and qRT-PCR in a real-world setting which allowed us to reasonably assess diagnostic performance of Rapid Ag-T to detect SARS-CoV-2 infection. We were also able to assess the clinical impact of discordant results on COVID-19 outcomes as well as predictors which indicate settings where additional testing might be useful to reduce the externalities associated with false negative results. Regarding the limitations to be acknowledged is the potential influence of a spectrum effect, where diagnostic accuracy measures vary according to COVID-19 prevalence and the potential detection bias of only testing most cases once, likely missing infections who were initially categorized as false negative with qRT-PCR early in the course of infection33,34. Furthermore, the use of the sentinel surveillance system to detect and report COVID-19 cases in Mexico likely skews detection towards more severe cases who may also have longer time from symptom onset to evaluation, increasing time-dependent heterogeneity within estimation of predictive accuracy measures31. Similarly, since the largest number of Rapid Ag-T were conducted in Mexico City, caution should be taken when generalizing these results to the rest of the country. The lack of disaggregated symptom data prevents assessment of the influence of various symptom clusters in modifying disease detection with different testing modalities, which remains as an area of opportunity for future research35. Another limitation to be acknowledged is that the NESS dataset does not include a variable whether there was any delay in time between the performance of both qRT-PCR and Rapid Ag-T testing, which may influence testing performance; however, similarities to other controlled studies on Rapid Ag-T in other settings show similar diagnostic performance15. Finally, since the specific Rapid Ag-T were not clearly labeled in the registry, disaggregated diagnostic performance metrics by individual tests could not be estimated.
In conclusion, Rapid Ag-T could be a useful strategy to extend SARS-CoV-2 screening and track trends of the COVID-19 pandemic in Mexico during high transmissibility periods. Rapid Ag-T have poor sensitivity with high specificity but in a setting of local outbreaks, these tests might have high predictive values and be a helpful complement to contact tracing if properly implemented. Rapid Ag-T should be performed widely and frequently to increase the usefulness of low-sensitive tests and increase diagnostic accuracy as well as to guide allocation of qRT-PCR testing in low-resource settings4,20,36. Our results could inform situations when a discordant result of Rapid Ag-T for SARS-CoV-2 could be expected and the associated clinical implication of using test results for policy and clinical decision making. The use of Rapid Ag-T warrants future evaluations regarding the influence of symptom presentation, recent contact with confirmed COVID-19 case and disease severity on test accuracy and its role in detecting asymptomatic infection as a complement to contact tracing.
Data Availability
All data sources and R code are available for reproducibility of results at https://github.com/oyaxbell/covid_antigen_mx
DATA AVAILABILITY
All data sources and R code are available for reproducibility of results at https://github.com/oyaxbell/covid_antigen_mx.
AUTHOR CONTRIBUTIONS
Research idea and study design OYBC, NEAV, LFC, ECG, AVV, JPBL, CAFM, AMS; data acquisition: OYBC, NEAV; data analysis/interpretation: OYBC, NEAV, LFC, ECG, AVV, CAFM, AMS, JPBL; statistical analysis: OYBC, NEAV; manuscript drafting: OYBC, NEAV, LFC, ECG, AVV, JPBL, CAFM, AMS; supervision or mentorship: OYBC. Each author contributed important intellectual content during manuscript drafting or revision and accepts accountability for the overall work by ensuring that questions about the accuracy or integrity of any portion of the work are appropriately investigated and resolved.
FUNDING
The publication of this paper was supported by a grant from Secretaría de Educación, Ciencia, Tecnología e Innovación de la Ciudad de México CM-SECTEI/200/2020 “Red Colaborativa de Investigación Traslacional para el Envejecimiento Saludable de la Ciudad de México (RECITES)”. The funding body had no role the design of the study or in the collection, analysis, and interpretation of data nor in the process of writing the present manuscript.
CONFLICT OF INTEREST/FINANCIAL DISCLOSURE
Nothing to disclose.
ACKNOWLEDGMENTS
NEAV, ECG, CAFM, AMS, JPBL and AVV are enrolled at the PECEM program of the Faculty of Medicine at UNAM. JPBL, NEAV and AVV are supported by CONACyT. The authors would like to acknowledge the invaluable work of all of Mexico’s healthcare community in managing the COVID-19 epidemic. Its participation in the COVID-19 surveillance program has made this work a reality, we are thankful for your effort.
Footnotes
CONFLICT OF INTERESTS: Nothing to disclose.
FUNDING: This research receivedsno specific funding
We have updated all analyses up to April 30th, 2021 and have incorporated comments by reviewers where the paper is currently under consideration.