Abstract
In a population-based survey of NYC adults, we assessed positive SARS-CoV-2 tests (including via exclusive at-home testing) and possible cases among untested respondents. An estimated 27.4% (95%CI: 22.8%-32.0%) or 1.8 million adults (95%CI: 1.6-2.1 million) had SARS-CoV-2 infection. SARS-CoV-2 prevalence was high among groups that are more vulnerable to severe SARS-CoV-2 and death, including unvaccinated persons (21.7%, 95%CI 9.6%-33.8%) and those aged 65+ (17.8%, 95%CI 10.2-25.4%). Population-based representative surveys are an important adjunct surveillance tool to standard testing-based SARS-CoV-2 surveillance.
Introduction
Routine case-based surveillance data on individuals who test or present to care for SARS-CoV-2 underestimate the true burden of SARS-CoV-2 infection in the general population due to 1) undiagnosed/untested cases1; and 2) the exclusive use of at-home rapid tests which are not reflected in routine case surveillance in the U.S.2 The degree of underestimation could be differential by geographic and sociodemographic factors, and vary over time.3,4 Concerns raised about the potential for biased interpretation of SARS-CoV-2 case counts, case rates, and test positivity rates recently led the Centers of Disease Control and Prevention (CDC) to update their guidelines for community COVID-19 metrics to inform community prevention measures, shifting emphasis to hospital admissions and deaths.2 While important, elevated hospital admissions and deaths resulting from a surge lag behind increases in community transmission, resulting in missed opportunities for earlier mitigation of a surge.
Despite these national shifts in emphasis, the number of new cases and the test positivity rates among SARS-CoV-2 testers are still relied on by local governments, citizens, and the news media to infer levels of SARS-CoV-2 community transmission and trigger action. This could be increasingly problematic, especially early in surges, due to time-varying factors such as decreased test-seeking behaviors and increased access to and availability of at-home testing, which complicate interpretation of these metrics.5
This study aimed to assess the extent to which routine case surveillance underestimated the burden of SARS-CoV-2 infections during the recent Omicron surge.
Methods
We conducted a cross-sectional survey March 14-16, 2022, of 1,030 adult New York City (NYC) residents. Respondents were asked about SARS-CoV-2 testing and related outcomes since January 1, 2022, which represents the second half of the Omicron BA.1 surge in NYC. Survey weights were applied to generate estimates for non-institutionalized NYC residents aged 18+. Additional details on the survey design are included in the Statistical Appendix. The study protocol was approved by the Institutional Review Board at the City University of New York (CUNY).
Period Prevalence Estimation
The survey questionnaire ascertained the types and results of viral diagnostic tests taken between January 1, 2022, and survey date (March 14-16, 2022), including PCR, rapid antigen and/or at-home rapid tests. The survey also captured information on COVID-19 symptoms among respondents during this time period, as well as known close contacts with a confirmed or probable case of SARS-CoV-2 infection. COVID-19 symptoms included any of the following: fever of 100° F or greater, cough, runny nose and/or nasal congestion, shortness of breath, sore throat, fatigue, muscle/body aches, headaches, loss of smell/taste, nausea, vomiting and/or diarrhea.6
We estimated the number and proportion of respondents who likely had SARS-CoV-2 infection during the study period based on the following mutually exclusive, hierarchical case classification: 1) Confirmed case: self-report of one or more positive tests with a health care or testing provider; or 2) Probable case: self-report of a positive test result exclusively on at-home rapid tests (i.e. those that were not followed up with confirmatory diagnostic testing with a provider); or 3) Possible case: self-report of COVID-like symptoms and a known epidemiologic link (close contact) to one or more laboratory confirmed or probable (symptomatic) SARS-CoV-2 case(s)6 in a respondent who reported never testing or only testing negative during the study period. Categories 1 and 2 of our case definition would likely capture some, but not all, of the estimated 20-30% of individuals whose SARS-CoV-2 infection may remain asymptomatic throughout their infection.7
Statistical Analysis
We described the testing status and estimated period prevalence of SARS-CoV-2 by socio-demographic characteristics, geography, and vaccination status. Pearson’s chi-squared test of independence was performed to assess group differences between testers and non-testers. Analyses were performed using SAS version 9.4.
Results
We estimate that 27.4% (95% CI22.8%-32.0%) of approximately 6.6 million adult New Yorkers may have had SARS-CoV-2 infection during January 1-March 16, 2022, corresponding to about 1.8 million adults (95%CI 1.6-2.1 million). The estimate of 27.4% includes: 1) 14.1% (95%CI 10.4%-17.8%) who were positive based on one or more tests with a health care or testing provider; 2) 5.2% (95%CI 3.1%-7.3%) who were positive exclusively based on one or more at-home rapid tests; and 3) 8.1% (95%CI 5.4%-10.9%) who met the definition for possible SARS-CoV-2 infection. The test positivity rate among those who tested with a healthcare or testing provider was 41.3% (95%CI 33.2% - 49.4%).
The weighted characteristics of survey participants and period prevalence estimates are shown in Table 1. SARS-CoV-2 period prevalence during this was high among all groups, but varied substantially by sociodemographic factors and geography. Importantly, SARS-CoV-2 prevalence was high among groups that are more vulnerable to severe SARS-CoV-2 and death, including unvaccinated persons (21.7%, 95%CI 9.6%-33.8%) and those aged 65+ (17.8%, 95%CI 10.2-25.4%). Individuals who tested at all were more likely to be 18-34 years, Hispanic, and have higher education levels and combined household income >$65K compared with those who did not test at all.
Discussion
Our study found a high prevalence of SARS-CoV-2 among adult New Yorkers during the second half of the city’s Omicron BA.1 surge in January-mid March 2022 (27.4% or about 1.8 million people), including among groups who are at higher risk for a severe outcome of SARS-CoV-2 infection. We also found that the characteristics of adult New Yorkers testing with a health care or testing provider differ substantially from those who do not test, highlighting the challenges of using surveillance data solely based on testing to gain insights into the burden and epidemiology of SARS-CoV-2 community transmission.
During the study period, routine case surveillance data from the NYC DOHMH reported 552,084 NYC residents of all ages (∼6.7% of the NYC population of 8.3M) who tested positive for SARS-CoV-2 with a health care or testing provider by PCR or point of care rapid test.8 The 7-day average test percent positivity during the study period ranged from 34.8% on January 1st to 1.6% on March 16th with 11.5% percent positivity among total testers during the entire period.8 When compared with our estimate of 1.8 million adults infected during the same time period, our findings point to the extent to which official case counts underestimated the SARS-CoV-2 burden during the surge. This ‘hidden prevalence’ is due to both non-testing, exclusive at-home rapid testing, and testing too soon after exposure/symptom onset with either a point of care and at-home rapid tests.1,9
The recent CDC metrics may be inadequate for informing timely public health countermeasures, including protecting and reaching those who are most at risk of a severe outcome. While wastewater surveillance10 is an important tool for early detection of a surge, surveillance methods like routinely and strategically deployed surveys enables an assessment of the prevalence of infection as well as an assessment of the characteristics of populations, including vulnerable populations, that are infected, thereby providing critical epidemiologic intelligence between wastewater signals and possible future spikes in hospitalizations.
While our study suggests a viable and simple approach to gather important and timely information about the prevalence of SARS-CoV-2 infections among adults in NYC, it also has limitations. First, we measured testing outcomes and symptoms via self-report over a long recall period, which is subject to recall bias. More frequent surveys with shorter recall periods (e.g., 7-14 days), could improve the accuracy of estimates. Our prevalence estimates also included possible SARS-CoV-2 cases based on self-reported symptoms who had a known contact with a confirmed/probable case, which, even though both prevalence of exposures and attack rates were very high during the BA.1 Omicron surge11, could lead to an overestimate of prevalence. Conversely, our estimates may not have captured some SARS-CoV-2 cases that are asymptomatic for their entire infection, resulting in an underestimate (e.g., by 10-30%).7 In addition, our survey excludes children and adolescents <18, those who died (about 4,426 NYC residents) during the study period. The small sample size limits the precision of some estimates across respondent characteristics. Part of our sample (32%) was derived from online panel data, as opposed to a population-based sampling frame (see Statistical Appendix), which could introduce bias. Finally, those who chose to participate in the survey could be more or less likely to have had COVID-19 recently (participation bias).
Population-based representative surveys are an important adjunct surveillance tool to standard testing-based SARS-CoV-2 surveillance. At this stage of the pandemic, the application of low-cost and low-resource intensive surveys may have a large impact on the efforts of governments and individuals to control and prevent community spread of SARS-CoV-2, as well as secondary prevention of severe SARS-CoV-2 outcomes. Future surveys should capture additional detail on vulnerability to a severe COVID-19 outcome among those with SARS-CoV-2 infection.
Data Availability
All data produced in the present study are available upon reasonable request to the authors.
Funding
Funding for this project was provided by the CUNY Institute for Implementation Science in Population Health (cunyisph.org).
Statistical Appendix
Sampling Frame
Sampling frames of NYC residents, one of 2,185,659 NYC residents with mobile numbers and one of an additional 1,532,518 with landlines, were used. From these sampling frames, two stratified proportionate random samples were drawn, one from the mobile number frame and one from the landline frame. These two samples comprised 68% of the larger study sample. The remaining 32% of the study sample came from an opt-in Online Panel provided by Consensus Strategies was used to supplement underrepresented populations in the main study sample. The final sample included n=1,030 and was weighted to the adult NYC population (details below).
Multi-mode data collection design
Short message service (SMS) aka text messages were sent using SMS platform. The respondents were sent a personalized first name text message which included a link to the survey and an opt-out option. The respondents had the option to reply to the SMS text with any queries. Data was verified by IP address and scrubbed against the original survey sample.
Interactive voice response (IVR) aka robo-poll messages were sent to landlines using a voice recorded IVR platform. The respondents were able to answer the survey questions using the touch tone keypad on their phones.
The opt-in online panel was created by Consensus Strategies and participants were paid an incentive to complete the surveys of up to $2. Respondents were verified by payment information.
Mode of data collection
Data was collected March 14-16, 2022.
Survey weighting
To account for differences in the distribution by groups the following demographic weights were developed based on the American Community Survey 1 year estimates and US Census data. These included respondent self-identified sex, educational attainment, age, ethnicity/race and region. The samples (landline, online, mobile) were normalized at the borough level based on sex, age, gender, education, race and sample size then combined and weighted back based on the proportion of the borough to the overall population and the other demographics. All variables were weighted at the same time for each borough and then the five boroughs were recombined to create the overall sample for NYC. Weights were created with IBM’s SPSS software. The inference population is 6.6 million adult NYC residents.
Survey questionnaire
Survey on recent COVID exposure, COVID infection, and testing behaviors in New York City
The following questions will ask about demographic characteristics
Which zip code do you reside in?
What is your age?
How do you currently identify your gender? Do you identify as …
Male
Female
Gender non-binary
Don’t know/not sure
Are you Latino/a, or of Hispanic or Spanish origin?
Yes
No
Don’t know/not sure
Which one of the following would you use to describe yourself ?
White
Black or Black American
Asian, Native Hawaiian or Other Pacific Islander
American Indian, Native, First Nations, Indigenous Peoples of the Americas, or Alaska Native
More than one race
Don’t know/not sure
What is the highest grade or year of school you completed?
Never attended school or only attended kindergarten
Grades 1 through 8 (Elementary)
Grades 9 through 11 (Some high school)
Grade 12 or GED (High school graduate)
College 1 year to 3 years (Some college or technical school, associate degree)
College 4 years or more (College graduate)
Don’t know/not sure
How many members of your household, including yourself, are 18 years of age or older?
How many children 17 years old or younger usually live or stay with you?
Are you currently employed for wages or salary?
Yes
No
Don’t know/not sure
Refused
What is your household’s annual income?
Below $15,000
Between $15,001 - $25,000
Between $25,001 - $35,000
Between $35,001 - $45,000
Between $45,001 - $55,000
Between $55,001 - $65,000
Between $65,001 - $75,000
Above $75,0000
The following questions will ask about your COVID exposure since January 1st, 2022
Since January 1, 2022, did you experience any COVID-like symptoms (e.g., 100 degrees fever, chills, cough, sore throat, fatigue, headache, shortness of breath, congestion or runny nose, muscle aches, loss of smell or taste, nausea, or diarrhea)?
Yes
No
Don’t know/not sure
Since January 1, 2022, not including yourself, did anyone in your household either experience COVID-like symptoms or has tested positive for COVID-19?
Yes
No
Don’t know/not sure
Since January 1, 2022, were you exposed to any other person outside of your household who either had COVID-like symptoms or tested positive for COVID-19?
Yes
No
Don’t know/not sure
Have you been fully vaccinated against COVID-19 with a vaccine that has received FDA approval or emergency use authorization?
Yes
No
Don’t know/not sure
If you have been fully vaccinated, have you received a coronavirus booster?
Yes, before January 1, 2022
Yes, after January 1, 2022
No
Don’t know/not sure
Do you have any kind of health care coverage, including health insurance, prepaid plans such as HMOs, or government plans such as Medicare, or Indian Health Service?
Yes
No
Don’t know/not sure
Since January 1, 2022, do you think you had a COVID-19 infection?
Yes
No
Don’t know/not sure
The following questions will ask about COVID-19 testing since January 1st, 2022
Since January 1, 2022, have you tested positive for COVID-19 on an at-home rapid test (a rapid at-home test allows you to collect your own sample and get results within minutes at home)?
1. Yes
2. No
c. Don’t know/not sure
Since January 1, 2022, have you tested negative for COVID-19 on an at-home rapid test (a rapid at-home test allows you to collect your own sample and get results within minutes at home)?
Yes
No
Don’t know/not sure
Since January 1, 2022, have you tested positive for COVID-19 on a rapid antigen or a PCR test from a healthcare or testing provider?
Yes
No
Don’t know/not sure
Since January 1, 2022, have you tested negative for COVID-19 on a rapid antigen or a PCR test from a healthcare or testing provider?
Yes
No
Don’t know/not sure
If you tested positive on any viral test (at home-self test, or rapid or PCR at a healthcare or testing provider) since January 1st, did you test positive in the last 7 days?
Yes
No
Don’t know/not sure
Since January 1, 2022, did you have any difficulty in getting a viral COVID-19 test (PCR or rapid at a healthcare or testing provider) for yourself?
I had no difficulty in getting a viral COVID-19 test
I had some difficulty in getting a viral COVID-19 test
I had a lot of difficulty in getting a viral COVID-19 test
I did not seek a viral COVID-19 test
Don’t know/not sure
The following questions will ask about the locations where you may have tested for COVID-19 since January 1st, 2022
Since January 1, 2022, have you tested for COVID-19 at a hospital or a physician’s office?
Yes, and tested positive
Yes, but tested negative
No
Don’t know/not sure
Refused
Since January 1, 2022, have you tested for COVID-19 at a CityMD clinic?
Yes, and tested positive
Yes, but tested negative
No
Don’t know/not sure
Refused
Since January 1, 2022, have you tested for COVID-19 at an urgent care clinic that is not CityMD?
Yes, and tested positive
Yes, but tested negative
No
Don’t know/not sure
Refused
Since January 1, 2022, have you tested for COVID-19 at a mobile testing site?
Yes, and tested positive
Yes, but tested negative
No
Don’t know/not sure
Refused
Since January 1, 2022, have you tested for COVID-19 at a pharmacy?
Yes, and tested positive
Yes, but tested negative
No
Don’t know/not sure
Refused
Acknowledgements
The authors wish to acknowledge the survey participants and Consensus Strategies for completing survey sampling and data collection.