Abstract
Active monitoring of health outcomes after COVID-19 vaccination provides early detection of rare outcomes post-licensure.
Objective To evaluate health outcomes following bivalent COVID-19 Pfizer-BioNTech (BNT162b2) and Moderna (mRNA-1273.222) vaccination among individuals 6 months and older in the United States.
Design Monthly monitoring of health outcomes from August 2022 to July 2023 in four administrative claims databases. Descriptive analyses monitored vaccine uptake, outcome counts and coadministration of bivalent COVID-19 and influenza vaccines. Sequential analyses tested for elevated risk of each outcome in a prespecified post-vaccination risk interval, or a period of hypothesized elevation based on clinical guidance, compared to a historical baseline.
Participants and Exposures Persons 6 months and older who received a bivalent COVID-19 BNT162b2 or mRNA-1273.222 vaccine during the study period, with continuous enrollment in a medical insurance plan from the start of an outcome-specific clean interval to the COVID-19 vaccination date. Vaccines were identified using product-specific codes from medical coding systems.
Health Outcomes Twenty outcomes were monitored in BNT162b2 vaccine recipients 6 months-4 years, and mRNA-1273.222 vaccine recipients 6 months-5 years. Twenty-one outcomes were monitored in BNT162b2 vaccine recipients 5-17 years and mRNA-1273.222 vaccine recipients 6-17 years. Eighteen outcomes were monitored in persons 18 years and older for both mRNA vaccines.
Results Overall, 13.9 million individuals 6 months and older received a single bivalent COVID-19 mRNA vaccine. The statistical threshold for a signal was met for two outcomes in one database: anaphylaxis following bivalent BNT162b2 and mRNA-1273.222 vaccines in persons 18-64 years and myocarditis/pericarditis following bivalent BNT162b2 vaccines in individuals 18-35 years. There were no signals identified in young children.
Conclusions Results were consistent with prior observations from published studies on COVID-19 vaccine safety. This study supports the safety profile of bivalent COVID-19 mRNA vaccines and the conclusion that the benefits of vaccination outweigh the risks.
1. Background
The U.S. Food & Drug Administration (FDA) first authorized bivalent formulations of COVID-19 mRNA vaccines in August 2022.1 These updated vaccines included both the SARS-CoV-2 ancestral strain and omicron BA.4 and BA.5 subvariants and offered added protection against more recently circulating strains of the virus.1 Vaccines were first authorized in persons 12 years and older for the bivalent COVID-19 Pfizer-BioNTech (BNT162b2) vaccine, and 18 years and older for the bivalent COVID-19 Moderna (mRNA-1273.222) vaccine.2,3 The authorization for both vaccine brands was expanded in October 2022 to include persons 5 years and older for the bivalent BNT162b2 vaccine and 6 years and older for the mRNA-1273.222 vaccine.2,3 In December 2022, the authorization for both vaccine brands was further expanded to include populations 6 months and older.2,3
There have been approximately 56 million bivalent COVID-19 vaccine doses administered in the U.S. as of May 2023.4 Of these, 42.0% have been administered to persons 65 years and older, 51.9% to persons aged 18-64 years, 5.9% to persons aged 5-17 years, and <1% to the population aged 6 months-4 years.4 Overall, bivalent COVID-19 mRNA vaccines have been administered to about 17.0% of the U.S. population.4
FDA has been performing near real-time surveillance to monitor the real-world safety of bivalent COVID-19 vaccines available in the U.S. Near real-time surveillance is a screening method designed to rapidly identify potential safety signals as vaccines are administered. However, results do not establish a causal association due to methodologic limitations. More robust epidemiological studies may be used to evaluate potential safety signals identified from screening methods.
This study presents results from FDA’s near real-time safety monitoring of bivalent COVID-19 vaccines using data from three commercial databases representing vaccine recipients aged 6 months to 64 years, and the Centers for Medicare & Medicaid Services (CMS) Medicare database representing vaccine recipients aged 65 years and older.
2. Methods
2.1 Data Sources
This study used administrative commercial health claims data from Carelon Research, CVS Health, and Optum to capture health care data on the population aged 6 months – 64 years old. Medicare Fee-For-Service (FFS) data from the CMS Shared Systems Database was used to capture data on the population aged 65 years and older. These databases contain longitudinal medical and pharmacy claims data that captures patient’s demographic information, clinical diagnoses, and vaccine administration information among other health care utilization information. The CMS Medicare enrollment database was used to capture enrollment information for the Medicare population. Where available, local and state-based Immunization Information Systems (IIS) data was linked to commercial claims databases to supplement the capture of patient’s COVID-19 vaccination history. Once validated, data from select IIS jurisdictions was included in the analysis. Supplementary Table E1 summarizes individual database-related characteristics including enrollment size and claims delay.
2.2 Study Population and Period
Health plan members aged 6 months and older were included in surveillance if they received a bivalent COVID-19 mRNA vaccine during the vaccine brand- and age-specific authorization periods and were continuously enrolled in their respective health plan for the complete duration of the outcome-specific clean interval. The surveillance period extended from the U.S. authorization date for the bivalent COVID-19 mRNA vaccines (i.e., August 2022 for ages 12 years and older; October 2022 for 5-11 years of age; December 2022 for 6 months to 4 years of age) through mid-2023. Exact surveillance start dates varied by vaccine brand and age group based on vaccine authorization dates (Supplementary Table E2).
2.3 Exposures and Follow-Up
The exposure was defined as the receipt of the bivalent BNT162b2 or mRNA-1273.222 COVID-19 vaccines in any setting during the vaccine brand and age-specific authorization periods. Bivalent COVID-19 mRNA vaccines were identified in claims and IIS data using product and dose-specific codes from the Current Procedural Terminology (CPT)/ Health Care Common Procedure Coding System (HCPCS), National Drug Codes (NDCs), and CVX (vaccine administered) codes.5 Only individuals’ first bivalent vaccine administration was included in surveillance because bivalent COVID-19 vaccines were authorized as a single dose at the start of surveillance.
Follow-up time included all person-time accrued during the prespecified post-vaccination risk intervals. Risk intervals were defined as a period of hypothesized elevated risk due to vaccination and were established based on guidance from clinicians and literature review. Risk intervals were censored at disenrollment, subsequent COVID-19 vaccination, surveillance end date, or death.
2.4 Health Outcomes
Health outcomes were selected based on literature review, consultation with clinicians, and prior COVID-19 vaccine surveillance activities. Outcomes were monitored separately: an individual with multiple different outcomes was included in surveillance for each outcome, but only the first eligible occurrence of an outcome was included in the analysis. Eligible outcomes were defined as those occurring in the risk interval with no prior occurrence of the respective outcome during the outcome-specific clean interval. The clean interval was a period defined relative to vaccination date used to identify incident outcomes, in which an individual enters the outcome-specific study cohort only if the outcome did not occur during this interval. Table 1 presents the outcomes with clinical care settings, risk intervals, and clean intervals used to identify incident outcomes. It also indicates outcomes that were included in descriptive monitoring and sequential testing, by age group.
While most outcomes underwent sequential testing, outcomes were only descriptively monitored if there were limited historical case counts to estimate background rates, which were required for testing. Among children aged 6 months – 4 years and 6 months – 5 years receiving BNT162b2 and mRNA-1273.222 vaccines respectively, 12 outcomes underwent descriptive monitoring and sequential testing, while eight were only descriptively monitored. For persons 5-17 years and 6-17 years receiving BNT162b2 and mRNA-1273.222 vaccines respectively, 13 outcomes were both descriptively monitored and sequentially tested, and eight outcomes were only descriptively monitored. Seventeen outcomes were included in descriptive monitoring and sequential testing for adults 18 years and older, while a single outcome was only descriptively monitored (Table 4).
2.5 Statistical Analyses
Descriptive Monitoring
Vaccine uptake and health outcome counts were monitored monthly along with the demographic characteristics of vaccine recipients. The frequency of concomitant bivalent COVID-19 and seasonal influenza vaccination was also monitored. Prevalence of concomitant influenza vaccination was measured on the same-day and within 42 days prior to or following the bivalent COVID-19 mRNA vaccination date. Concomitant influenza vaccination was only descriptively monitored and was not included in inferential testing nor adjusted for in any analyses.
Sequential Testing
The Poisson Maximized Sequential Probability Ratio Test (PMaxSPRT) was used to evaluate the rate of outcomes in specific age groups following vaccination compared to a historical baseline rate.6 Monthly sequential testing was performed to generate incidence rate ratios (IRRs) of observed outcome rates compared with database-specific historical (expected) rates. Historical rates were adjusted to account for claims processing delay, and where case counts permitted, standardized by age and sex for the population younger than 65 years old, and by age, sex, race, and nursing home residency for the population 65 years and older.7 We estimated annual historical rates for a pre-COVID-19 period (2017-2019) and a COVID-19 period between April and December 2020. Selection of the comparator rate was based on the overlap between the 95% confidence intervals for the periods. If rates in the historical period (individual years between 2017 and 2020) did not have overlapping 95% confidence intervals indicating a substantive difference in the rates, we selected the lower or more stable rate as the most conservative approach. This was performed to enhance the sensitivity of the test by increasing the likelihood that potential signals were not missed. Otherwise, the median annual rate was selected. Pre-COVID-19 rates from 2019 were selected for most outcomes; however, rates from the 2020 COVID-19 period were selected if the COVID-19 period rates did not return to pre-COVID-19 levels.
For each outcome, monthly sequential testing was conducted in each database and began when a minimum of three outcomes after bivalent COVID-19 vaccination was observed. Testing was conducted until the earlier of one of the following events occurred: an observed signal, surveillance end, or when the outcome-specific prespecified surveillance length was met, which was defined as the expected number of outcomes within a 6-month period.5 We used a one-tailed test with a null hypothesis that the observed outcome rate was no greater than the historical comparator beyond a prespecified test margin with an overall alpha of 1%. A strict alpha level was selected to minimize false signals based on the large number of tests performed. Testing margins were determined for each outcome based on input from clinicians to avoid detection of minimal increases in risk that were unlikely to be clinically relevant. A statistical signal occurred if the log likelihood ratio exceeded the critical value, which was a threshold set to determine if the observed result was due to chance.5 SAS © version 9.4, R version 4.1.2, and R Sequential Package Version 3.3.1 were used for the analysis.
This surveillance activity was performed under the FDA Biologics Effectiveness and Safety (BEST) Initiative and is covered under the scope of the FDA public health surveillance mandate.
3. Results
Descriptive Monitoring
A total of 13.9 million bivalent COVID-19 mRNA vaccine doses were observed, including 5.5 million vaccinations across commercial databases including Carelon Research, CVS Health, and Optum databases, and 8.4 million vaccinations in the Medicare FFS database (Table 2). Figure 1 shows weekly vaccine uptake by vaccine brand and database. Among commercial databases, Carelon had the highest weekly vaccine uptake compared to CVS Health and Optum databases. Figure 2 shows weekly vaccine uptake in commercial and Medicare databases by vaccine brand and age group. For adults 18 years and older, peak vaccination uptake occurred between September and December 2022, with the highest weekly vaccination uptake observed for persons 65 years and older. For children 5-17 years, BNT162b2 vaccine recipients had the highest weekly vaccine uptake between September and December 2022. Minimal weekly vaccine uptake was observed for BNT162b2 and mRNA-1273.222 vaccine users 6 months-4 years and 6 months-5 years respectively, and mRNA-1273.222 vaccine users 6-17 years.
Among vaccine recipients 6 months-64 years in commercial insurance databases, 12% were 6 months-17 years, 24% were 18-35 years, 39% were 36-55 years, and 25% were 56-64 years (Table 2). There was a slightly higher proportion of female recipients (54%) than males, which was consistent for BNT162b2 and mRNA-1273.222 vaccine brands. The majority of vaccine users resided in urban areas (95%). The prevalence of same-day concomitant bivalent COVID-19 and seasonal influenza vaccination was 40%, increasing to 62% in the 42 days prior to or after the COVID-19 vaccination date. There was a slightly higher proportion of same-day concomitant vaccination among BNT162b2 recipients (41%) than mRNA-1273.222 recipients (39%), increasing to 62% for both vaccine brands in the 42 days before or after bivalent COVID-19 vaccination (Table 2).
In the Medicare FFS population 65 years and older, 88% of vaccine recipients were aged 65-84 years with a higher proportion of females (57%) than males. This was relatively consistent across BNT162b2 and mRNA-1273.222 vaccine users (Table 2). The majority of COVID-19 vaccine users resided in urban areas (82%), with a slightly higher proportion of BNT162b2 vaccine users residing in urban areas (85%) compared to mRNA-1273.222 users (79%). Only a small portion of vaccine users resided in the nursing home (2%). The prevalence of same-day concomitant bivalent COVID-19 and seasonal influenza vaccination was 33%, increasing to 72% in the 42 days before or after bivalent COVID-19 vaccination. There was a higher rate of same-day concomitant vaccination with influenza vaccines among BNT162b2 vaccine users (35%) compared to mRNA-1273.222 users (30%), increasing to 73% and 70% respectively in the 42 days prior to or following COVID-19 vaccination.
Sequential Testing
Sequential testing was performed for outcomes with estimable background rates. Of 17 outcomes monitored with sequential testing in adults aged 18-64 years, anaphylaxis and myocarditis/pericarditis met the statistical threshold for a signal in one of three databases (Table 3). An anaphylaxis signal was detected following bivalent BNT162b2 and mRNA-1273.222 vaccination among participants aged 18-64 years in the Carelon Research database, based on <11 events1 for each vaccine brand. Similarly, a myocarditis/pericarditis signal was observed among bivalent BNT162b2 vaccine recipients aged 18-35 years in the Carelon Research database, based on <11 events1. No statistical signals were observed in CVS Health, Optum, or Medicare FFS databases.
The incidence rate of anaphylaxis following bivalent BNT162b2 and mRNA-1273.222 vaccination was 74.5 and 109.4 cases per 100,000 person-years respectively, among those 18-64 years in the Carelon database. The incidence rate of myocarditis/pericarditis following bivalent BNT162b2 vaccination was 131.4 cases per 100,000 person-years for persons 18-35 years in the Carelon database.
Among the population aged 6 months-4 years and 6 months-5 years receiving the bivalent COVID-19 BNT162b2 and mRNA-1273.222 vaccines, respectively, sequential testing was not initiated for any of the 12 outcomes for which testing was planned, as the minimum number of cases needed to start testing (i.e., 3 cases) was not observed. Similarly, for the population aged 5-17 years, of 13 outcomes included in testing, testing was only initiated for appendicitis, seizures/convulsions, and Bell’s Palsy following BNT162b2 vaccination across commercial databases due to limited case counts for the other outcomes. Testing was not initiated for any outcomes among mRNA-1273.222 vaccine recipients aged 5-17 years due to limited case counts. The majority of outcomes did not initiate testing in persons 6 months-17 years due to limited case counts. Of outcomes that initiated testing in this age group, no statistical signals were detected for either vaccine brand (Table 3).
In the Medicare population aged 65 years and older, sequential testing was initiated for all 17 outcomes for both BNT162b2 and mRNA-1273.222 vaccinations, and no statistical signals were detected (Table 3).
4. Discussion
This study monitored the safety of bivalent COVID-19 mRNA vaccines administered to 13.9 million persons 6 months and older in the U.S. by evaluating the risk of several outcomes following vaccination. Two outcomes met the statistical threshold for a signal in one of three commercial databases: anaphylaxis following bivalent BNT162b2 and mRNA-1273.222 vaccination in recipients aged 18-64 years and myocarditis/pericarditis following BNT162b2 vaccination in recipients aged 18-35 years.
These findings are largely consistent with existing safety assessments of COVID-19 mRNA vaccines. An elevated risk of myocarditis/pericarditis and anaphylaxis was identified following monovalent mRNA vaccines.8–12 Risk of myocarditis/pericarditis was specifically identified in males aged 12-39 years of age in other studies.8,10,12 While an increased anaphylaxis risk has been reported,9,11,13 more recent studies have suggested a comparable risk to that of other vaccines.14 Surveillance for the bivalent COVID-19 mRNA vaccines by the Vaccine Adverse Event Reporting System (VAERS) has similarly shown cases of myocarditis/pericarditis and allergic/anaphylactic events among the population aged 12 years and older.15 A prior near-real time surveillance study identified a statistical signal for seizures/convulsions following monovalent BNT162b2 and mRNA-1273 vaccination in children 2-4/5 years.16 Our study identified zero cases of seizures/convulsions in this age group following bivalent vaccination, and no outcomes met the statistical threshold for signal in the young age group.
Our study population had a high prevalence of same-day concomitant administration of bivalent COVID-19 mRNA and influenza vaccines. Clinical trials that have assessed the safety and reactogenicity of concomitant administration of these vaccines have not found any safety concerns or reduced immune response related to the concomitant use of these vaccines.17–19 While we had a high prevalence of concomitant vaccination, our study did not perform testing stratified by concomitant influenza vaccination status; thus, we are unable to draw any conclusions about the safety of concomitant vaccination.
This study had several strengths. The study included a large sample size of geographically diverse participants from all age groups authorized to receive bivalent BNT162b2 or mRNA-1273.222 vaccines from both commercially and publicly insured populations across the U.S. The study also evaluated several outcomes as vaccines were administered. The near-real time surveillance method allowed for vaccine safety to be monitored shortly after bivalent COVID-19 mRNA vaccine authorizations. Outcomes were similarly able to be monitored for an extensive period varying from three to eleven months depending on database, vaccine brand and age group.
The near-real time surveillance method applied in this study is a crude signal detection method used for rapid safety screening. This method uses a comparator (i.e., aggregate historical rates) with limited adjustment for confounding factors. This method, similarly, requires the specification of multiple parameters that, if misspecified, could affect the presence or absence of detected signals such as risk interval timing and length, and the testing margin used to identify meaningful elevations in risk. Additionally, we did not adjust for multiple testing of outcomes which may have increased the likelihood of observing a false positive safety signal when risk is not truly elevated. Therefore, this method does not establish a causal association between the vaccines and outcomes. Furthermore, although we observed substantial uptake of bivalent COVID-19 mRNA vaccines, this was reduced relative to administration of monovalent COVID-19 mRNA vaccine doses. This could have decreased our power to detect statistical signals, particularly for rare outcomes, and may explain some differences in signals detected or not detected across databases. Our study was also limited by the use of administrative claims data, collected for billing purposes, but used for safety surveillance activities. Our medical record review has shown that certain outcomes are detected in claims data more accurately than others.20,21 Since we did not conduct medical record review nor adjust for outcome misclassification for outcomes evaluated in this study, the presence and extent of outcome misclassification is unknown and could apply to at least some of the outcomes included in surveillance. This can bias signal detection in either direction.
The surveillance of bivalent COVID-19 mRNA vaccines supports the safety of these vaccines and is consistent with findings from surveillance results of monovalent COVID-19 mRNA vaccines. This study contributes to regulatory decision-making for COVID-19 vaccines and public health and supports the conclusion that the benefits of vaccination outweigh the risks.
All authors attest they meet the ICMJE criteria for authorship.
Conflicts of Interest Statement
Co-authors from U.S. Food and Drug Administration and Acumen LLC declared no conflicts of interests. The following authors reported a conflict of interest: Kandace L. Amend, 1 John D. Seeger, 1 Jennifer Song,1 Robin Clifford, 1 Cheryl N. McMahill-Walraven,2 Djeneba Audrey Djibo,2 Jonathan P. DeShazo,2 Eugenio Abente,2 Daniel C. Bleacher,3 Alex Secora,4 Nandini Selvam.4 1Employee of Optum, with reported stock or stock options in UnitedHealth Group.
Data Availability
The data used in the present study is confidential and is not available for reference.
Funding
This work was supported by the U.S. Food and Drug Administration, whom were an integral part of the study design, implementation and interpretation of the analysis, writing of the report, along with the decision to submit the manuscript for publication.
Acknowledgements
We would like to thank Bowen Chen, Yue Wu, Vincent Varvaro, Kamran Kazemi, Olivia Zhang, Nimesh Shah, Samikshya Siwakoti, Anchi Lo, Jing Wang, Bing Lyu from Acumen LLC; Grace Yang, Sarah Sargen, Alexandra Stone, Wafa Tarazi, Megan Ketchell, Kathryn Federici, Amaka Ume, Emily Myers, Eli Wolter, Jackson Slaney, Bobby Smith, Lauren Peetluk, and Elizabeth Bell from Optum; Anne Marie Kline, Nancy B. Shaik, Ana M. Martinez-Baquero, Smita Bhatia, Vaibhav Sharma from CVS; Shiva Vojjala, Ramya Avula, Shiva Chaudhary, Shanthi P Sagare, Ramin Riahi, Brian Greenwald, and Grace Stockbower, Michael Goodman, Michael Bruhn, and Ruth Weed from Carelon/IQVIA.
Footnotes
Patricia C. Lloyd (patricia.lloyd{at}fda.hhs.gov), Elizabeth R. Smith (esmith{at}acumenllc.com), Joann F. Gruber (joann.gruber{at}fda.hhs.gov), Michelle Ondari (mondari{at}acumenllc.com), Hui Lee Wong (huilee.wong{at}fda.hhs.gov), Mao Hu (mhu{at}acumenllc.com), Tainya C. Clarke (tainya.clarke{at}fda.hhs.gov), Rowan McEvoy (rmcevoy{at}acumenllc.com), Kandace L. Amend (kandace.amend{at}optum.com), Daniel C. Beachler (daniel.beachler{at}carelon.com), Cheryl N McMahill-Walraven (cheryl.walraven{at}cvshealth.com), John D. Seeger (john.seeger{at}optum.com), Alex Secora (alex.secora{at}iqvia.com), Djeneba Audrey Djibo (audrey.djibo{at}cvshealth.com), Jennifer Song (jennifer.song{at}optum.com), Nandini Selvam (nandini.selvam{at}iqvia.com), Jonathan P. DeShazo (jonathan.deshazo{at}cvshealth.com), Robin Clifford (robin.clifford{at}optum.com), Eugenio Abente (abentee{at}aetna.com), Yoganand Chillarige (ychillarige{at}acumenllc.com), Richard A. Forshee (richard.forshee{at}fda.hhs.gov), Steven A. Anderson (steven.anderson{at}fda.hhs.gov), Azadeh Shoaibi (azadeh.shoaibi{at}nih.gov).
↵1 Cell counts < 11 have been suppressed in the manuscript text and tables.
↵2 Employee of CVS Health.
↵3 Employee of Elevance Health Incorporated.
↵4 Employee of IQVIA.