High Sensitivity and NPV for BinaxNOW Rapid Antigen Test in Children at a Mass Testing Site During Prevalent Delta Variant Period ================================================================================================================================= * Kristie J. Sun * Mary Jane E. Vaeth * Matthew Robinson * Maryam Elhabashy * Ishaan Gupta * Sophia Purekal * E. Adrianne Hammershaimb * Ria Peralta * Asia Mitchell * Maisha Foyez * J. Kristie Johnson * James R Ficke * Yukari C. Manabe * James D. Campbell * Charles W. Callahan * Charles F. Locke * Melinda Kantsiper * CONQUER COVID Consortium * Zishan K. Siddiqui ## ABSTRACT SARS-CoV-2 continues to develop new, increasingly infectious variants, such as delta and omicron. Here, we evaluate the efficacy of the Abbott BinaxNOW Rapid Antigen Test against Reverse Transcription Polymerase Chain Reaction (“RT-PCR”) in 1054 pediatric participants presenting to a state-owned high-volume Coronavirus Disease 2019 (COVID-19) testing site. During the testing period, the delta variant was predominant. Participants were grouped by self-reported COVID-19 exposure and symptom status. RT-PCR results demonstrated an overall prevalence rate of 5.2%. For all participants, the sensitivity of the rapid antigen tests was 92.7% (95% CI 82.4% - 98.0%) and specificity was 98.0% (95% CI 97.0%-98.8%). For symptomatic participants, the sensitivity was 92.3% (95% CI 74.9% - 99.1%), specificity was 96.6% (95% CI 93.6%-98.4%), positive predictive value (PPV) was 72.7% (95% CI 54.5% - 86.7%) and negative predictive value (NPV) was 99.2% (95% CI 98.2% - 100%). Among asymptomatic participants, the sensitivity was 92.6% (95% CI 75.7% - 99.1%), specificity was 98.6% (95% CI 97.5% - 99.3%) the PPV was 71.4% (95% CI 53.7% - 85.4%) and the NPV was 99.7% (95% CI 99.0% - 100%). Our reported sensitivity and NPV are higher than other pediatric studies, potentially because of higher viral load from the more transmissible delta variant, but specificity and PPV are lower. **Importance** The BinaxNOW rapid antigen COVID-19 test had a sensitivity of nearly 92% in both symptomatic and asymptomatic children when performed at a high-throughput setting during the more transmissible delta variant dominant period. The test may play an invaluable role in asymptomatic screening and keeping children safe in school. Keywords * COVID-19 * pediatric rapid antigen testing ## INTRODUCTION Many U.S. children remain susceptible to SARS-CoV-2 infection. 20 million children under 5 have no option for vaccination.1 Among the 28 million eligible children aged 5-11, 18% have received at least one dose of the Coronavirus Disease 2019 (COVID-19) vaccine as of December 8, 2021.2 Similarly, only 51% of 25 million eligible children aged 12-17 years have received two doses of the vaccine.2 Quick, accurate, and accessible diagnostic testing for SARS-CoV-2 in pediatric populations is critical to keeping children in classrooms, especially given the transmissibility of newer variants (e.g. delta, omicron) among vaccinated individuals.3,4 The impact of disrupted in-person learning has been substantial. Students are more behind in foundational coursework, with the effect compounded for students with historical racial or socioeconomic disadvantages.5 One strategy to keep children safely in school is with routine testing. Challenges around testing include delayed result reporting, high cost for reverse transcription polymerase chain reaction (“RT-PCR”) tests, and access disparities among marginalized populations.6 Rapid antigen tests offer an attractive alternative with results often returned in 15 minutes, lower cost, and ability to predict patients harboring culturable, infectious virus.7 Studies of the accuracy of these tests in children are conflicting. Most were conducted before the more aggressive variants like delta became prevalent.8,9 We evaluated the real-world characteristics of the Abbott BinaxNOW rapid antigen test (Abbott Laboratories, Abbott Park, IL) in children presenting to a high-throughput setting. Our study took place in the context of a high prevalence of the delta variant, between May 7, 2021 and December 6, 2021.The prevalence of the delta variant rapidly increased from less than 2.5% of COVID-19 cases to more than 99% in Maryland and surrounding states during the first month of the study period.10 ## METHODS ### Study design This single-center prospective study compared the performance, quantified as sensitivity and specificity, of the BinaxNOW rapid antigen test against the current gold standard of RT-PCR. BinaxNOW is a lateral flow assay that targets the SARS-CoV-2 viral nucleocapsid (N) protein. The RT-PCR assay includes a panel of primer/probe sets targeting the viral N gene. This study was approved by the Johns Hopkins institutional review board. ### Participants and study site All individuals under 18 years old were offered enrollment from 5/7/2021 – 12/6/2021. Potential enrollees and guardians were given written and verbal information about the study and given the opportunity to opt out of the additional anterior nares swabs for the rapid antigen test. The study site was a high-volume walk-up community collection site linked to the Baltimore Convention Center Field Hospital. ### Data collection Before sample collection, data for demographics, symptoms, and any self-perceived exposure status was collected for each participant. Presence of active COVID-19 symptoms was assessed based on the standard Centers for Disease Control and Prevention (CDC) symptom checklist.11 Participants who reported at least one symptom were considered “symptomatic,” while those who reported no symptoms were considered “asymptomatic.” Participant exposure status was obtained according to CDC risk stratification. Participants were asked about living with someone with confirmed or suspected COVID-19; if they had been within 6 feet of someone with confirmed or suspected COVID-19 for more than 15 minutes; and if they had any other exposure to anyone with confirmed or suspected COVID-19. Participants were considered to have had high risk exposures if they lived with or were within 6 feet for more than 15 minutes of someone with confirmed or suspected COVID-19. Date of symptom onset and exposure were recorded. Test implementation, education, and training processes have been previously described.12 ### Sample collection The rapid antigen and RT-PCR samples were collected sequentially for each participant in the study by medical staff who were trained to perform rapid antigen tests. Manufacturer’s guidelines were followed in obtaining and processing rapid antigen samples.13 Staff collected bilateral anterior nares swabs first for direct inoculation onto rapid antigen tests followed by additional bilateral anterior nares sample for RT-PCR. A designated, trained reader interpreted and recorded the result on-site for each rapid antigen test 15 minutes after the test was administered per the instructions for use. All samples for RT-PCR were sent to the University of Maryland Pathology Associates-Maryland Genomics reference laboratory (University of Maryland School of Medicine, Baltimore, MD) and processed using a modification of the CDC 2019 Novel Coronavirus Real-Time RT-PCR Diagnostic Panel. Individuals for whom the RT-PCR or rapid antigen test was deemed indeterminate (control line not interpretable) were excluded from analysis. ### Statistical analysis Accuracy results (sensitivity, specificity, and positive and negative predictive values [PPV, NPV respectively]) and 95% confidence intervals (CIs) were calculated using the binomial exact method for the rapid antigen test for both symptomatic and asymptomatic populations compared with the RT-PCR gold standard. Accuracy results for symptomatic and asymptomatic group were compared. Two tailed P values were calculated using Fisher’s exact test. Similar test accuracy was calculated for exposure groups and age groups. Cycle threshold (CT) values for PCR-positive tests were summarized and compared for symptomatic and asymptomatic groups. A plot showing the distribution of RT-PCR CT values was generated for symptomatic and asymptomatic individuals (Figure 1). All statistical analyses were performed using JMP Pro, version 14.0.0, software (SAS Institute, Cary, NC). ![Figure 1.](http://medrxiv.org/https://www.medrxiv.org/content/medrxiv/early/2022/01/20/2022.01.05.22268788/F1.medium.gif) [Figure 1.](http://medrxiv.org/content/early/2022/01/20/2022.01.05.22268788/F1) Figure 1. CT counts for symptomatic and asymptomatic participants *Darker dots represent false negative rapid antigen results ## RESULTS During the testing period, 1054 of 2811 children who were seen for diagnostic testing participated in the study. Among participants, 508 (48.3%) were female, 438 (41.6%) were White, 373 (35.4%) were African American, 105 (9.9%) were Hispanic, and the mean age was 8.9 years. Non-participants were similar for gender (female 49.1%, P = 0.6), were older (mean 9.4 years, P = 0.001), and were more often African American (55%, P < 0.0001) or Hispanic (15.1%, P < 0.0001). Symptomatic status was obtained for 1046 (99.2%) participants, of which 756 (72.4%) were asymptomatic. Symptomatic participants were younger (7.8 vs 9.3 years, P < 0.0001). High risk exposure was reported by 152 (20.1%) asymptomatic and 50 (17.2%) symptomatic participants. The COVID-19 prevalence rate, based on RT-PCR results, was 5.2% (55/1054) overall, 9.0% (26/290) for symptomatic individuals, and 3.6% (27/756) for asymptomatic individuals. For symptomatic participants, 96.2% (275/286) tested within 7 days after symptom onset. The prevalence rate was 20% for symptomatic participants with high-risk exposure and 7.2% for asymptomatic with high-risk exposure (Table 1). View this table: [Table 1.](http://medrxiv.org/content/early/2022/01/20/2022.01.05.22268788/T1) Table 1. Demographics of Children Presenting for COVID-19 Diagnostic Testing with Concurrent RT-PCR and Rapid Antigen Test, Baltimore, 2021 ### Test accuracy The sensitivity of the rapid antigen tests for all participants was 92.7% (95% CI 82.4% - 98.0%) and specificity was 98.0% (95% CI 97.0%-98.8%). Sensitivity was similar for symptomatic participants and asymptomatic participants (92.3% vs. 92.6%) (P = 1.0). It was also similar for high-risk exposure groups, both symptomatic (80.0%; 95% CI 44.4% - 97.5%) and asymptomatic (81.8%; 95% CI 48.2% - 97.7%) (Table 2). The specificity for symptomatic participants was 96.6% (95% CI 93.6% - 98.4%) and for asymptomatic participants was 98.6% (95% CI 97.5% - 99.3%). Among symptomatic individuals the PPV was 72.7% (95% CI 54.5% - 86.7%) and the NPV was 99.2% (95% CI 98.2% - 100%).). Among asymptomatic individuals the PPV was 71.4% (95% CI 53.7% - 85.4%) and the NPV was 99.7% (95% CI 99.0% - 100%). Mean CT values were similar for the asymptomatic and symptomatic groups (28.6 vs 27) (P = 0.2). The test showed 100% sensitivity at CT count 30 or below in both the symptomatic and asymptomatic populations (Figure 1). View this table: [Table 2.](http://medrxiv.org/content/early/2022/01/20/2022.01.05.22268788/T2) Table 2. Antigen Test Accuracy Rates Compared to RT-PCR as Reference Standard ## DISCUSSION This single center prospective study at a state-owned walk-up testing site showed high sensitivity, specificity, and NPV for the rapid antigen test in both symptomatic and asymptomatic children. The sensitivity was 92.3% in symptomatic participants, and all but one of these 26 RT-PCR positive participants were tested within 7 days of symptom onset. The sensitivity in asymptomatic population was nearly identical at 92.6%, with an NPV of nearly 100%. Cycle threshold counts were similar for symptomatic and asymptomatic individuals and rapid tests showed 100% sensitivity in both these groups at CT count less than 30, which signifies higher viral loads and greater transmissibility. Our point estimate of BinaxNOW rapid antigen test sensitivity in children is above the 80% threshold set by the US Food & Drug Administration (FDA) for Emergency Use Authorization (EUA) for both symptomatic and asymptomatic children.14 Our results show that rapid antigen tests provide a reliable means to diagnose and screen for COVID-19 in children. The near 100% NPVs for both symptomatic and asymptomatic children, including some children with recent high-risk exposures, should provide providers and parents with assurance that a negative rapid antigen test with this product can be trusted. These data also provide support to the use of these tests as part of a “test-to-stay” approach in schools.15 Because our study showed that roughly 30% of positive antigen tests were false positives, it would be prudent to confirm all positive antigen tests with a PCR test. Our study shows higher sensitivity and NPV but lower specificity and PPV than other pediatric studies.8,9 Differences could be related to higher viral load from prevalent delta variant during the study period as most of the prior pediatric studies were conducted before the delta variant became widespread.16 Additionally, ambient conditions for kit storage and use, variation in quality of the test kit between lots, and the skill of our experienced testers may also explain higher sensitivity in our study.17 Our study has a few limitations. The results from a single-site with over one-year of experience in high volume testing may not be generalizable to all situations. However, with implementation of best practices, similar accuracy would be expected.12 Our study enrolled only a small number of children with high-risk exposure and the estimates of accuracy had broad confidence interval. However, the results are similar to overall symptomatic and asymptomatic groups. Additionally, three of the four false negative tests in the high-risk exposure group were tested within 3 days of exposure and samples were likely collected too early for detection by a rapid antigen test. Given the short turn-around-time, low cost, and ease of use, this test could play an important role in allowing children to limit absence from school and other activities while in quarantine or awaiting PCR test results especially for asymptomatic children. It may assist in implementing test-to-stay strategies, where exposed school children are allowed to continue uninterrupted in-person learning given frequent testing for one week after exposure.18 The higher accuracy reported in our study also underscores the magnitude of missed opportunity in failing to make this important tool widely available to schools. If further studies with the extremely transmissible omicron variant show very high viral load and rapid antigen accuracy, these tests could become one of most valuable tools used to fight current and future COVID-19 variants. ## Data Availability All data produced in the present work are available upon reasonable request to the authors ## Conflict of Interest and Financial Disclosures Dr. Manabe reports institutional grants (to Johns Hopkins) from National Institutes of Health, Becton-Dickinson, Centers for Disease Control, and Baltimore City Health Department and institutional receipt (to Johns Hopkins) of equipment, materials, drugs, medical writing, gifts or other services from Hologic, Becton Dickinson, Roche, Cepheid, and ChemBio. Dr. Robinson reports institutional grants (to Johns Hopkins) from National Institutes of Health, Becton-Dickinson, Centers for Disease Control, and institutional receipt (to Johns Hopkins) of equipment, materials, drugs from Becton Dickinson. All other authors report no conflicts of interests. ## Funding No funding support was received for this study. BinaxNOW test kits were provided by the Maryland Department of Health, free of cost. ## Acknowledgements ## Footnotes * Abstract updated to clarify importance * Received January 5, 2022. * Revision received January 19, 2022. * Accepted January 20, 2022. * © 2022, Posted by Cold Spring Harbor Laboratory The copyright holder for this pre-print is the author. All rights reserved. The material may not be redistributed, re-used or adapted without the author's permission. ## References 1. 1.Kates J, Tolbert J, Rouw A. An Update on Vaccine Roll-Out for 5-11 Year-olds in the U.S. Kaiser Family Foundation. Published December 8, 2021. Accessed December 22, 2021. [https://www.kff.org/coronavirus-covid-19/issue-brief/an-update-on-vaccine-roll-out-for-5-11-year-olds-in-the-u-s/](https://www.kff.org/coronavirus-covid-19/issue-brief/an-update-on-vaccine-roll-out-for-5-11-year-olds-in-the-u-s/) 2. 2.Children and COVID-19 Vaccination Trends. American Academy of Pediatrics (AAP). Published December 17, 2021. Accessed December 22, 2021. [http://www.aap.org/en/pages/2019-novel-coronavirus-covid-19-infections/children-and-covid-19-vaccination-trends/](http://www.aap.org/en/pages/2019-novel-coronavirus-covid-19-infections/children-and-covid-19-vaccination-trends/) 3. 3.Rosenberg ES. New COVID-19 Cases and Hospitalizations Among Adults, by Vaccination Status — New York, May 3–July 25, 2021. MMWR Morb Mortal Wkly Rep. 2021;70. doi:10.15585/mmwr.mm7034e1 [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.15585/mmwr.mm7034e1&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=34437517&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2022%2F01%2F20%2F2022.01.05.22268788.atom) 4. 4.HKUMed finds Omicron SARS-CoV-2 can infect faster and better than Delta in human bronchus but with less severe infection in lung. Li Ka Shing Faculty of Medicine, The University of Hong Kong (HKUMed). Published December 15, 2021. Accessed December 22, 2021. [https://www.med.hku.hk/en/news/press/20211215-omicron-sars-cov-2-infection](https://www.med.hku.hk/en/news/press/20211215-omicron-sars-cov-2-infection) 5. 5.Dorn E, Hancock B, Sarakatsannis J, Viruleg E. COVID-19 and education: The lingering effects of unfinished learning. McKinsey & Company. Published online July 27, 2021:15. 6. 6.Chwe H, Quintana A, Lazer D, et al. The COVID States Project #17: COVID-19 test result times. Published online February 10, 2021. doi:10.31219/osf.io/rz34x [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.31219/osf.io/rz34x&link_type=DOI) 7. 7.Pekosz A, Parvu V, Li M, et al. Antigen-Based Testing but Not Real-Time Polymerase Chain Reaction Correlates With Severe Acute Respiratory Syndrome Coronavirus 2 Viral Culture. Clin Infect Dis Off Publ Infect Dis Soc Am. Published online January 20, 2021:ciaa1706. doi:10.1093/cid/ciaa1706 [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1093/cid/ciaa1706&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=33479756&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2022%2F01%2F20%2F2022.01.05.22268788.atom) 8. 8.Shaikh N, Friedlander EJ, Tate PJ, et al. Performance of a Rapid SARS-CoV-2 Antigen Detection Assay in Symptomatic Children. Pediatrics. doi:10.1542/peds.2021-050832 [FREE Full Text](http://medrxiv.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiRlVMTCI7czoxMToiam91cm5hbENvZGUiO3M6MTA6InBlZGlhdHJpY3MiO3M6NToicmVzaWQiO3M6MTc6IjE0OC8zL2UyMDIxMDUwODMyIjtzOjQ6ImF0b20iO3M6NTA6Ii9tZWRyeGl2L2Vhcmx5LzIwMjIvMDEvMjAvMjAyMi4wMS4wNS4yMjI2ODc4OC5hdG9tIjt9czo4OiJmcmFnbWVudCI7czowOiIiO30=) 9. 9.Sood N, Shetgiri R, Rodriguez A, et al. Evaluation of the Abbott BinaxNOW rapid antigen test for SARS-CoV-2 infection in children: Implications for screening in a school setting. PLOS ONE. 2021;16(4):e0249710. doi:10.1371/journal.pone.0249710 [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1371/journal.pone.0249710&link_type=DOI) 10. 10.CDC. COVID Data Tracker. Centers for Disease Control and Prevention. Published March 28, 2020. Accessed September 1, 2021. [https://covid.cdc.gov/covid-data-tracker](https://covid.cdc.gov/covid-data-tracker) 11. 11.Coronavirus Disease 2019 (COVID-19) – Symptoms. Centers for Disease Control and Prevention. Published February 22, 2021. Accessed December 22, 2021. [https://www.cdc.gov/coronavirus/2019-ncov/symptoms-testing/symptoms.html](https://www.cdc.gov/coronavirus/2019-ncov/symptoms-testing/symptoms.html) 12. 12.Siddiqui ZK, Chaudhary M, Robinson ML, et al. Implementation and Accuracy of BinaxNOW Rapid Antigen COVID-19 Test in Asymptomatic and Symptomatic Populations in a High-Volume Self-Referred Testing Site. Microbiology Spectrum. Published online December 1, 2021. doi:10.1128/Spectrum.01008-21 [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1128/Spectrum.01008-21&link_type=DOI) 13. 13.Abbott. BinaxNOW COVID-19 Ag Card. Published online December 2020. Accessed August 16, 2021. [https://www.fda.gov/media/141570/download](https://www.fda.gov/media/141570/download) 14. 14.Food and Drug Administration. 2021. Antigen template for test developers. Version October 26, 2020. From the Policy for Coronavirus Disease-2019 tests during the public health emergency (revised). [https://www.fda.gov/regulatory-information/search-fda-guidance-documents/policy-coronavirus-disease-2019-tests-during-public-health-emergency-revised](https://www.fda.gov/regulatory-information/search-fda-guidance-documents/policy-coronavirus-disease-2019-tests-during-public-health-emergency-revised). Template xavailable at [https://www.fda.gov/media/137907/download](https://www.fda.gov/media/137907/download). Accessed on June 14. 15. 15.CDC. Transmission of SARS-CoV-2 in K-12 Schools. Centers for Disease Control and Prevention. Published December 17, 2021. Accessed December 26, 2021. [https://www.cdc.gov/coronavirus/2019-ncov/science/science-briefs/transmission\_k\_12\_schools.html](https://www.cdc.gov/coronavirus/2019-ncov/science/science-briefs/transmission_k_12_schools.html) 16. 16.Bolze, A., Luo, S., White, S., Cirulli, E.T., Wyman, D., Dei Rossi, A., Machado, H., Cassens, T., Jacobs, S., Schiabor Barrett, K.M. and Tanudjaja, F., 2021. SARS-CoV-2 variant Delta rapidly displaced variant Alpha in the United States and led to higher viral loads. 17. 17.Li B, Deng A, Li K, et al. Viral infection and transmission in a large, well-traced outbreak caused by the SARS-CoV-2 Delta variant. medRxiv. Published online January 1, 2021:2021.07.07.21260122. doi:10.1101/2021.07.07.21260122 [Abstract/FREE Full Text](http://medrxiv.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6NzoibWVkcnhpdiI7czo1OiJyZXNpZCI7czoyMToiMjAyMS4wNy4wNy4yMTI2MDEyMnYyIjtzOjQ6ImF0b20iO3M6NTA6Ii9tZWRyeGl2L2Vhcmx5LzIwMjIvMDEvMjAvMjAyMi4wMS4wNS4yMjI2ODc4OC5hdG9tIjt9czo4OiJmcmFnbWVudCI7czowOiIiO30=) 18. 18.Nemoto N, Dhillon S, Fink S, et al. Evaluation of Test to Stay Strategy on Secondary and Tertiary Transmission of SARS-CoV-2 in K–12 Schools — Lake County, Illinois, August 9–October 29, 2021. MMWR Morb Mortal Wkly Rep. 2021;70(5152). doi:10.15585/mmwr.mm705152e2 [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.15585/mmwr.mm705152e2&link_type=DOI)