Abstract
Introduction Our objective was to describe and compare self-reported side effects of COVID-19 vaccines in the USA.
Methods A web-based registry enrolled volunteers who received a COVID-19 vaccine between March 19 –July 15, 2021. We collected self-reported short-term side effects, medical consultation, hospitalization, and quality of life impact following completed vaccination regimens (Pfizer, Moderna, J&J).
Results We recruited 6,966 volunteers who completed their full course of vaccination (median age 48 years, IQR 35.0-62.0; 83.6% female): Pfizer 3,486; Moderna 2,857; J&J 623. Few (3.1%) sought medical care for post-vaccination side effects. Hospitalization (n=17; 0.3%) and severe allergic reactions (n=39; 0.6%) also were rare. Those with autoimmune disease or lung disease were approximately twice as likely to seek medical care (adjusted odds ratio (aOR) 2.01 [95% CI: 1.39;2.92] and 1.70 [95% CI: 1.12;2.58] respectively). 92.4% of participants reported ≥1 side effect (median 3), with injection site reactions (78.9%), fatigue (70.3%), headache (49.0%) reported most frequently. More side effects were reported after the second dose of two-dose vaccines (medians: 1 vs. 2 for Pfizer and 1 vs. 3 for Moderna for first and second doses respectively) versus 3 for J&J’s single-dose vaccine. For the employed, the median number of workdays missed was one. Diabetics and those vaccinated against influenza were substantially less likely to report ≥3 symptoms (aOR 0.68, 95% CI 0.56,0.82 and aOR 0.82, 95% CI 0.73,0.93, respectively.)
Discussion The total side effect burden was, not unexpectedly, greater with two-dose regimens but all three vaccines appear relatively safe. Very few subjects reported side effects serious enough to warrant medical care or reported post-vaccination hospitalization. While these findings do not address possible long-term effects, they do inform on their short-term safety and tolerability and will hopefully provide some reassurance and positively inform the benefit-risk and pharmacoeconomic assessment for all three vaccines.
Introduction
The United States (U.S.) Food and Drug Administration’s (FDA) regulatory pathway for Emergency Use Authorization (EUA) supports expedited review and authorization of vaccines for health emergencies, but never before have so many vaccines been developed and so quickly. Despite the pandemic proportions of coronavirus disease 2019 (COVID-19) and its heavy toll on society, vaccine hesitancy persists, in part due to concern regarding the “speed and safety” of the vaccines developed to fight COVID-19.[1] Additionally, there is little information about how most people react to COVID-19 vaccinations outside of clinical trials, aside from a constant stream of anecdotal evidence. Reliable population-based scientific evidence may help address concerns by providing granularity on the number, type and severity of side effects and the clinical characteristics of those most impacted.
The objective of this work is to describe and compare self-reported side effects from the three COVID-19 vaccines authorized for use in the U.S. between March 19 and July 15, 2021: two two-dose mRNA vaccines, Pfizer, Inc. and BioNTech (Pfizer) and Moderna, Inc. (Moderna), and a single-dose viral vector vaccine, Janssen Pharmaceuticals Companies of Johnson & Johnson (J&J). [2–4] In addition, we characterize the side effects in terms of their impact on work and life and identify medical and other health-related practices that affect the risk of an acute side effect, such as having been vaccinated for influenza.
Materials and methods
We used a web-based registry the COVID-19 Active Registry Experience (CARE) that was first launched on April 2, 2020 to study COVID-19 symptoms and severity outside of the hospital setting with the goal of understanding what factors, if any, could mitigate the impact of infection with COVID-19 (www.helpstopCOVID19.com).[5] The protocol and web technology have been updated several times, with the most recent major update in March 2021, updated to record self-reported COVID-19 vaccination and subsequent side effects.
Here we examined CARE participants who reported having received a complete course of COVID-19 vaccination between March 19 –July 15, 2021, either both doses of the Pfizer or Moderna vaccines or a single dose of the J&J vaccine. Participants were recruited via social media targeting adult U.S. residents who received a COVID-19 vaccine. Volunteers provided on-line informed consent. The enrollment and follow-up CARE surveys request information on demographics, medical history, COVID-19-like symptoms [6] and severity, COVID-19 test results, COVID-19 vaccination, and use of prescription and non-prescription medications and dietary supplements. Those who reported having been vaccinated are also asked to provide the date of vaccination for first and second doses, as appropriate, manufacturer, and lot number, if known; patients were instructed to refer to their vaccination card to enhance data accuracy. Respondents are asked about side effects after each vaccination using a drop-down menu of choices along with a free text field where additional information can be provided. We also asked whether the COVID-19 vaccination affected their ability to perform activities of daily living such as bathing or dressing, whether they worked less or missed work due to the vaccine, and if they sought health care or were hospitalized due to these side effects. Missing data were not imputed.
We report individual side effects and the total number of side effects by manufacturer and first or booster shots, as appropriate. For the two-dose vaccines, we also counted all side effects reported at either the first and/or second dose. Side effects that were not listed on the survey but were entered as free text were reviewed. The most frequent free text entries that used related terms (e.g. extreme chills, chills, severe chill) were collapsed and categorized into a new side effect (e.g. chills); we included these in the summation of total side effects. We used logistic regression to estimate the odds of self-reported vaccine side effects by manufacturer. Due to small sample size in some variable categories, we combined categories for the logistic regression model. Multivariate models were adjusted by: age (categorical), gender (female vs. nonfemale (including male, transgender, not disclosed, other)), education (high school or less, some college, 4-year college degree, >4 year college degree), race (White, Black or African American, Other), ethnicity of Hispanic or Latino (yes, no), BMI (underweight or normal weight, overweight, obese, severe obesity), smoker (yes, no), medical conditions including anxiety, autoimmune disease, blood disorder, cardiovascular disease, depression, diabetes, hypertension, insomnia or trouble sleeping, kidney disease, lung disease, and influenza vaccination (yes, no).
Results
Participant Characteristics
COVID-19 vaccination was reported by 6,966 volunteers, including 3,486 who received both doses of the Pfizer vaccine, 2,857 who received both doses of the Moderna vaccine, and 623 who received the single-dose J&J vaccine (Table 1). Most CARE participants described themselves as White (90.8%), with additional representation from Asians (1.6%), Black or African American (1.3%) and a small group of people who reported a combination of races (3.6%). Approximately 80% of participants were female, a balance that was consistent across all vaccine manufacturers (range: 80.9-84.1%). A substantial proportion of COVID-19 vaccine recipients reported having anxiety (39.3%), depression (32.4%) and/or insomnia or trouble sleeping (30.7%), and only a small proportion of participants reported being treated for cancer (1.1%), a balance that was generally consistent for these conditions across all vaccines.
There were small differences in age across vaccine manufacturers (Pfizer recipients were slightly younger, median age of 45 years old compared to 51 years old for Moderna and 48 years old for J&J). Participants vaccinated with J&J included a higher percentage of smokers (13.6%) than those vaccinated with Moderna (9.7%) or Pfizer (8.4%). Participants who received Pfizer or Moderna vaccines had a higher education level, with many having completed a 4-year college degree and most having completed additional education after the college degree (63.5% and 61.3% respectively), compared to recipients of the J&J vaccine (50.5%). Other demographics and medical characteristics appeared to be comparable across the three vaccine manufacturers.
Vaccine Side Effects
Most COVID-19 vaccine recipients (92.4%) reported having at least one side effect at the first or second dose (80.9% to 95.4% across manufacturers), with a median of 3 side effects, ranging from 3-4 across vaccine manufacturers (Table 2). However, only 3.1% reported seeking medical care for their post vaccination side effects (4.3% for J&J vaccine recipients followed by Moderna (3.3%) and Pfizer (2.8%)). Very few participants reported being hospitalized after vaccination (n=17; 0.3% overall) or had severe allergic reactions (0.6%). Severe allergic reactions differed slightly by vaccine, with more reported for recipients of J&J (1.3%) compared to 0.6% for Moderna and 0.4% for Pfizer.
The most frequently reported side effects were injection site reactions (78.9%) and fatigue (70.3%) followed by headache (49.0%). Injection site reactions were reported most often for Moderna vaccine recipients (86.4%), followed by Pfizer (77.3%) and J&J (53.0%). Similarly, fatigue was also reported more frequently by recipients of Moderna (77.8%) than Pfizer (66.3%) or J&J (58.3%) as was headache (55.8% for Moderna compared to 45.4% for J&J and 44.1% for Pfizer. Other reactions included muscle pain (30.3%), fever (29.9%) and joint pain (21.6%) among all participants. Some differences were noted in the reporting of muscle pain and fever, with these events reported most frequently by those who received a Moderna vaccine (36.5% and 39.2%, respectively), followed by J&J (28.3%, 31.3%) and Pfizer (25.6%, 22.1%). Joint pain was also more frequently reported by Moderna vaccine recipients (26.8%) compared to J&J (19.9%) and Pfizer (17.6%).
Those who received a two-dose regimen (mRNA vaccines) reported more side effects at the second dose (Pfizer: 2 and Moderna: 3) than the first (Pfizer: 1 and Moderna: 1), with the median of 3 side effects for the single-dose J&J vaccine more like the second doses of the mRNA vaccines than the first doses of those vaccines (Table 3). Similarly, difficulty with self-care was reported more frequently after the second dose than the first dose for the mRNA vaccines (36.0% and 25.8% for the second doses of Moderna and Pfizer, respectively) than their first doses (17.0% and 11.7% for Moderna and Pfizer, respectively). Of those receiving the J&J vaccine, 27.2% reported trouble with self-care after the single dose. Overall few people sought medical care (3.1%) or were hospitalized (0.3%) after vaccination, with negligible differences between the first and second dose.
Figure 1 shows the odds of specific side effects for each mRNA vaccine (experienced at either first or second dose) compared to the J&J vaccine. After adjustment for potential confounding factors, injection site reactions, swollen lymph nodes, and fatigue were more likely to be reported with the two mRNA vaccines. Specifically, injection site reactions (pain, redness, or swelling at the vaccine injection site) were more likely to be reported by recipients of Pfizer and Moderna compared to J&J (Pfizer: aOR=3.13, 95% CI: 2.58, 3.81; Moderna: aOR=6.60, 95% CI=5.33, 8.18), as were swollen lymph nodes (Pfizer: aOR=1.69, 95% CI=1.20, 2.38; Moderna: aOR=1.97, 95% CI=1.40, 2.77), and fatigue (Moderna: aOR=1.43 95% CI=1.18, 1.74; Pfizer: aOR=2.93 95% CI=2.39, 3.59). Looking at side effects collectively, those who received the Moderna vaccine were more likely to report having three or more side effects (aOR 2.48, 95% CI 2.03, 3.02) compared to the J&J vaccine (Table 4).
Nearly one-third (31.4%) of COVID-19 vaccine recipients reported having trouble taking care of themselves (e.g., with activities such as bathing and dressing) due to vaccination side effects, though only 6.0% described themselves as having had “a lot of trouble” (table 3). The second dose of both mRNA vaccines (Pfizer: 25.8% and Moderna: 36.0%) were associated with greater trouble with self-care than the first doses (Pfizer: 11.7% and Moderna: 17.0%) compared with 27.2% for J&J. Those who received the Moderna vaccine were more than twice as likely to report having trouble caring for themselves (aOR 2.22, 95% CI 1.75, 2.80) compared to the J&J vaccines whereas there was essentially no difference between Pfizer and J&J vaccines (aOR 1.08, 95% CI 0.86, 1.36) (Table 4).
Among those employed 35.4% reported working less after being vaccinated, with a higher proportion of people missing work who received the Moderna vaccine (42.6%) than those who received either the J&J (31.3%) or Pfizer vaccines (30.3%). Of those employed, the median days missed from work was one for all vaccines.
In general, females reported experiencing more side effects and more trouble with self-care than men and others who described themselves as transgender or preferred not to disclose their gender (aOR 1.41 95 CI 1.22, 1.63), though they did not report working any less. Younger people were more likely to report three or more side effects and to report problems caring for themselves than older people, with those ages 18-29 more than three times as likely to report three or more side effects (aOR 3.65, 95% CI 2.95,4.51) and nearly five times as likely to report having trouble with self-care (aOR 4.80, 95% CI 3.84 6.01). Black or African American participants were less likely to report three or more symptoms (aOR 0.50, 95% CI 0.31, 0.81). For people reporting a high BMI (≥30), there was little difference in the proportion of participants reporting three or more symptoms, seeking medical consultation or working less than those who had lower BMI.
For self-reported medical conditions, those with autoimmune disorders were more likely to report trouble with self-care (aOR 1.21, 95% CI 1.01, 1.45) and to have sought medical care more often for side effects (aOR 2.01, 95% CI 1.38, 2.92) than those without autoimmune disorders. Those who reported having insomnia or lung disease also were more likely to report three or more side effects (aOR 1.44, 95% CI 1.27, 1.63 for insomnia, and aOR 1.35, 95% CI 1.11, 1.63 for lung disease) and report having more trouble caring for themselves (aOR 1.53, 95% CI 1.34, 1.75 for insomniacs, and aOR 1.35, 95% CI 1.11, 1.64 for those with lung disease) than those without insomnia or lung disease. In contrast, those with diabetes were less likely to report having three or more symptoms (aOR 0.68, 95% CI 0.56, 0.82) than those without diabetes.
Those who reported having been vaccinated for influenza were less likely to report three or more symptoms (aOR 0.82, 95% CI 0.73, 0.93) or to have trouble caring for themselves (aOR 0.82, 95% CI 0.72, 0.94) than those who did not report having been vaccinated for influenza.
Discussion
These registry data are consistent with other real-world studies that document few serious side effects from currently authorized COVID-19 vaccines, and also support anecdotal reports describing mostly mild side effects with rapid resolution.[7–9] In this cohort, only 3.1% of vaccine recipients sought medical care for side effects post-vaccination, and almost none (0.3%) were hospitalized. Nonetheless, 57.7% of CARE participants reported experiencing three or more side effects. Roughly one-third (31.4%) of COVID-19 vaccine recipients attributed having some amount of trouble taking care of themselves for the short period immediately after the vaccine due to vaccination side effects and 35.4% of employed participants reported working less, for a single day, due to side effects, noting that the median time lost from work of only one day may reflect employer practices of giving time off from work to encourage vaccination. It seems reasonable to conclude that work time lost from vaccination is far less impactful than work time lost as a consequence of COVID-19 illness.
When comparing the three vaccine manufacturers, Moderna appears to be the most reactogenic overall, with those who received a Moderna vaccine reporting more side effects than those who received Pfizer or J&J vaccines. Second doses of mRNA vaccines were more reactogenic than first doses and these second doses had higher rates of trouble with self-care compared with the first doses of Pfizer and Moderna.
Given the difficulty of comparing two-dose and single-dose regimens to understand side effects, our data enables some degree of comparison between the mRNA and viral vector vaccine classes. When the mean number of side effects per participant is compared, the J&J viral vector vaccine lies somewhere between that observed for the first and second doses of both mRNA vaccines. Thus, per ‘shot’ one might conclude that there is not a great difference in overall tolerability between the two classes, but that the total side effect burden is greater, as might be expected, with a two-dose regimen. This information may be of interest as vaccine supply and choice increase.
An interesting and biologically curious observation was that CARE participants who reported also having had a vaccination for influenza were less likely to report experiencing three or more side effects from COVID-19 vaccination, and had fewer problems taking care of themselves. Although these findings may be associated with health-seeking behavior of influenza vaccine recipients or a greater understanding of common vaccination side effects, there is some evidence that influenza vaccine effectiveness does not vary according to health-seeking behavior,[10] adding credence to the possibility that this may be a true biologic effect.
An increased number of side effects were reported for those with depression, anxiety, insomnia, lung disease, and autoimmune disease. We have previously reported that people with autoimmune disorders appeared to be particularly vulnerable to COVID-19, and their response to COVID-19 vaccination may possibly relate to this susceptibility.[11] In contrast, those with diabetes were less likely than others to report vaccine side effects. The lower reporting rates for diabetics may be influenced by an overlap in potential side effects with their metabolic disorder, or they may have found the vaccine associated side effects rather insignificant as a result. Alternatively, it could be that the progression to severe disease in diabetics has an immunological component that is being reflected in a different immunological reaction to the vaccine, or to the presence of actual virus.
It is important to keep in mind that online registries that survey volunteers without intervention or collaboration from medical care providers rely on the goodwill of participants to contribute information faithfully and accurately, and the results lack clinical or other confirmation. For example, although CARE participants reported their vaccine receipt, including manufacturer and lot number, there was no independent verification of such receipt – a condition that would have been challenging due to the diverse locations used for vaccine administration, the lack of centralized reporting and widespread handwritten vaccine information which would require manual coding. That said, the validity of reports from lay people of medication use has been demonstrated,[12] and as such, reporting quality is likely to apply at least as well to vaccine reporting.
Also, although our findings are derived from community volunteers who responded to internet-based advertisements and posts from medical, patient and other community organizations, this study population has broad geographic representation across the U.S., with participants from all 50 states (with most participants from New York and California, followed by Illinois, Ohio, Pennsylvania, Florida and Texas).
But CARE participants are undoubtedly not representative of the entire US population, including those without internet access nor the free time to participate in surveys. CARE participants have a median age of 48 years, which is consistent with research showing a greater degree of altruism in older than younger adults. More side effects may have been reported by CARE participants than others due to the fact that they self-selected into the registry whereas those with no side effects may be less motivated to enroll in a study. Considering the high proportion of CARE participants who reported suffering from anxiety (39.3%), these reports also may reflect the experience of people who may be more attuned to how they react to vaccination. Nonetheless, comparisons within the CARE population, such as between vaccine manufacturers and by various medical and other personal characteristics, should be broadly generalizable. It is unlikely that there was differential participation according to vaccine manufacturer or that responses selectively exaggerated reactions to one vaccine over another.
Further, although nearly 7,000 people reported their vaccination experience through CARE, the sample is too small to support detection of rare events nor to study rare subgroups. For example, we were not able to separately examine vaccine side effects for transgender people and others who did not wish to report their gender or whose gender did not conform to any of the choices presented in this study. Nonetheless, sensitivity analyses of our statistical models revealed little differences when restricted to those who reported their gender either as male or female.
Conclusion
On the whole, these community-based insights combined with other information that is accumulating about the effectiveness and safety of COVID-19 vaccines may provide a framework for guiding decision making on vaccine options and addressing vaccine hesitancy, including in particular vulnerable populations, such as diabetics and those with autoimmune disorders. Importantly, these findings provide a patient-centric estimation of vaccine burden by vaccine type and may help inform patients and health care providers on expected side effects and any potential short-term impact on their ability to perform daily activities or work. As CARE registry data continue to accrue, additional analyses may provide insight into real-world effectiveness of COVID-19 vaccines against COVID-19 infection in the context of both presence and severity of break-through infections, as well as more information on how various subgroups of special interest are impacted.
These data may also be useful in the context of current debates about whether COVID-19 vaccination should be made mandatory, at least for certain groups, e.g., healthcare workers and workers in residential care facilities. One of the discussion points in this debate concerns the safety and tolerability of the current COVID-19 vaccines, especially those which have been granted EUA only. While these data currently cannot address the long-term safety and tolerability of these vaccines, vaccines generally display the bulk of their side effects in the very short-term, often a day or less.[13–14] Our findings inform on the short-term safety and tolerability of these vaccines, and will hopefully provide some reassurance on their adverse effects.
Data Availability
These data are not publicly available but indications of interest for collaboration are welcomed.
Ethics approval and informed consent
This study was approved by Institutional Review Board and registered at Clinicaltrials.gov NCT04368065 and EU PAS register EUPAS36240. All participants provided informed consent online.
Consent for publication
Consent for publication of research finding was provided online.
Data availability
Due to data privacy and security regulations the researchers are not able to share participant level data.
Funding
This work was supported in part by a contract with the US Food and Drug Administration. The bulk of the funding was provided by IQVIA.
Conflict of interests
The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper.
Acknowledgements
We thank Savitha Pallipuram for leading the tech team, Damir Mohamed for his contributions to the statistical analysis, and Alex Secora for his thoughtful editing contributions.
Footnotes
Authors’ email addresses: Nancy.Dreyer{at}IQVIA.com
Matthew.Reynolds{at}IQVIA.com
Lisa.Albert{at}IQVIA.com
Emma.Brinkley{at}IQVIA.com
Tom.Kwon{at}IQVIA.com
Christina.Mack{at}IQVIA.com
Malaria{at}sunrise.ch [Stephen Toovey]