Abstract
Importance Phase 3 randomized controlled trials (RCTs) of mRNA COVID-19 vaccines in children and adolescents showed efficacy in preventing COVID-19 infections. Vaccines may have non-specific effects; this is not assessed within the current regulatory framework.
Objective Conduct a systematic review and meta-analysis of the phase 3 trials to assess overall and non-specific health effects of the mRNA COVID-19 vaccines in children.
Data Sources PubMed, Embase, Clinical Trials, Web of Science, and regulatory websites were searched for RCTs of mRNA vaccines. The latest trial data was included.
Study Selection All RCTs conducted with mRNA vaccines BNT162b2 and mRNA-1237 in children and adolescents below 18 years of age, with placebo, adjuvant, or other vaccines as controls. Two authors independently screened 1199 studies, six were included in the analysis.
Data Extraction and Synthesis Data on serious adverse events (SAEs) and severe adverse events (AEs) as well as organ-specific diseases was extracted following the PRISMA reporting guideline, with a focus on non-specific infectious events. Risk Ratios (RRs) comparing vaccine and placebo cohorts were calculated separately for each vaccine and combined in Mantel-Haenszel estimates.
Main Outcomes and Measures The primary outcome was SAEs, overall and infectious. Secondary outcomes were severe AEs and lower respiratory tract infection (LRTI) including RSV.
Results The analyses included 25,549 individuals (17,538 mRNA vaccine recipients and 8,011 placebo recipients). The risk of SAEs was similar for vaccine and placebo recipients. Both mRNA vaccines were associated with increased risk of severe AEs in older children. In a combined analysis, the RR was 3.77 (1.56-9.13[0.4% vs 0.1% in vaccine vs placebo recipients]) in above 5 year-olds, and 0.82 (0.53-1.29)[0.8% vs 0.9%])in younger children (p=0.003 for same effect in older and younger children). In the younger children, mRNA vaccines were associated with higher risk of LRTI (RR=3.03 (1.29-7.09)[0.6% vs 0.2%]).
Conclusions and Relevance mRNA vaccines did not increase the risk of SAEs but were associated with an increased risk of severe AEs in older children, and an increased risk of LRTI in the young. Further research into the overall and non-specific health effects of mRNA vaccines is warranted.
Question What is the overall health effect of mRNA COVID-19 vaccines in children?
Findings In this systematic review and meta-analysis of phase 3 trials, mRNA vaccine vs. placebo was not associated with increased risk of serious adverse events. The mRNA vaccines were associated with higher risk of severe adverse events in children aged 5 years and older. In children younger than 5 years, mRNA vaccines were associated with a 3-fold higher risk of lower respiratory tract infections.
Meaning The results suggest that mRNA vaccines are associated with increased risk of severe adverse events and increased risk of LRTI. Given the low risk of severe COVID-19 infection in children, it is not clear that the benefits of COVID-19 vaccines in children outweigh the harms.
INTRODUCTION
COVID-19 vaccines were developed and implemented at an unprecedent speed. As of September 2023, 11 COVID-19 vaccines had received licensure or emergency use authorization (EUA). All COVID-19 vaccines were tested in phase 3 randomized clinical trials (RCTs) in adults and showed efficacy in preventing COVID-19 infections. Subsequent phase 3 trials included progressively younger populations. The most administered vaccine types in children and adolescents are the messenger RNA (mRNA) vaccines (Pfizer/BioNTech (BNT162B2) and Moderna (mRNA-1273)). Both have received full approval or emergency/conditional authorization in the United States and the European Union in children 6 months of age and older.
Children have biological differences from adults that gradually diminish with age.1 Most children with a COVID-19 infection are asymptomatic or have influenza-like symptoms.2,3 Given the age-related differences in COVID-19 morbidity, COVID-19 mRNA vaccine benefit-risk assessments may differ in children vs. adults.
Safety data collected during vaccine trials are reported as either “solicited” adverse reactions, i.e., events related to reactogenicity, or as “unsolicited” adverse events (AEs) that are spontaneously reported unexpected events. AEs are divided by severity. Serious AEs (SAEs) are outcomes leading to death, life-threatening events, hospitalization, or disability/permanent damage, also defined as Grade 4 and/or 5 AEs.4 Severe AEs are medically significant but not immediately life-threatening events, also known as Grade 3 adverse events. In vaccine trials, Severe AEs are usually collected up to 1 month after vaccination, whereas information on SAEs, (all-cause deaths, and hospitalizations) and AEs of special interest (AESIs) should be observed in all study participants for at least 6 months after the last vaccination dose.5
Since the implementation of COVID-19 vaccines in children, several AEs have been detected in post-authorization safety monitoring.6–10 These include encephalitis,11 nephritis,12 neurological complications,13 and myocarditis.14
Vaccines may have non-specific (off-target) effects, i.e., an ability to affect the risk of other diseases by either reducing or increasing the susceptibility to other infections. In general, live vaccines reduce susceptibility to a broad range of other infections, whereas non-live vaccines may increase susceptibility to other infections.15 The existence of non-specific effects was not taken into consideration when the current framework for testing vaccine efficacy and safety was established.16
In this review, as previously performed for the adults’ phase 2-3-trials,17 the available phase 3 trial reports were used to examine the overall health effect of COVID-19 mRNA vaccines in children, with a particular focus on non-COVID-19 infectious disease outcomes.
METHODS
The systematic review was conducted under the Preferred Reporting Items for Systematic Reviews and Meta-analyses (PRISMA) reporting guideline and registered in PROSPERO before initiating the search.18,19
Search strategy
Randomized controlled trials (RCTs) with participants under 18 years old meeting the following criteria were included: phase 2/3 studies of randomized placebo-controlled trials of COVID-19 mRNA vaccines published in a peer-reviewed journal or in the process of applying for regulatory approval.
Search for published literature
In March 2023, we searched PubMed, Embase, Clinical Trials, and Web of Science for RCTs of mRNA vaccines. The search string is available in Supplementary Material. All identified studies were exported into Covidence. The search was rerun in September 2023 to ensure that the review was up to date. All included trials are ongoing; data on long-term safety will, according to protocols, be available from 2024.
All RCTs with original data, comparing Pfizer and Moderna mRNA vaccines as interventions, with placebo, adjuvant, or other vaccines as controls. After removing duplicates, two review authors (SH and CSB) independently assessed titles and abstracts of all records and conducted a full-text review.
Search for regulatory reports
Next, trial data was found on The United States Food and Drug Administration (FDA) and The European Medicines Agency (EMA) websites, for both advisory committee meeting material and sponsor presentations. For each study, we obtained the newest vaccine trial data published by the FDA and EMA matching on clinical trial number, local trial number, and number of participants in each age group.20–27
Data extraction
Relevant data was extracted from the most comprehensive report. The following data were extracted (where possible): study characteristics (including author, publication year, local Pfizer/Moderna trial number and Clinical Trial number), age and sex of participants, enrollment period and location, trial phase, type of vaccine and placebo, number of vaccines and antigen dose per injection. Furthermore, health outcome data was extracted.
Health outcome data
The primary outcome was SAEs (overall, excluding accidents, and infectious SAEs). Additional outcomes were Infectious disease deaths; Infectious disease hospitalization; Severe AEs (overall and infectious); AESIs, and other health outcomes where reporting and numbers allow for meaningful analysis, with a focus on non-COVID infectious diseases.
For efficacy estimates and the safety outcomes SAEs, AESIs, and death, participants had been followed for the full duration of the study (Table 1). The less severe outcomes, Severe AEs and other health outcomes, were only registered for one month after each vaccine dose.
Details on other health outcomes defined by System Organ Class (SOC) group are described in Supplementary materials.
Lastly, the trials in the younger children reported specific data on respiratory infections, including pneumonia, and pathogen-specific disease such as RSV. As non-specific effects of vaccines have been shown to be most pronounced for lower respiratory infections (LRTIs),28 we analyzed the effect of the vaccines on “RSV infection”, as well as LRTI which we defined as pneumonia, lower tract infection, and/or RSV. “Upper respiratory tract infections” (URTI), defined as upper respiratory infections (URIs), viral URI, and croup, were also analyzed.
Data on vaccine efficacy against COVID-19 was extracted from each trial’s main publications plus supplementary material. We chose the local trial definition of COVID-19.
All health outcomes are presented in Supplementary Tables 1 and 2, where details on data extraction are also presented. Cochrane Risk of Bias tool (RoB) for RCTs was used to assess the quality of the included publications (Supplementary Table 3).
Data analysis
The absolute risks for vaccine and placebo groups were presented as [X% vs X%]. Risk ratios (RRs) were calculated using the metan command in Stata BE version 18 providing Mantel-Haenszel (MH) estimates. All MH estimates were stratified for vaccine type and age group, whenever combining across these strata. The metan command in Stata was used to produce forest plots and test of homogeneity of RRs across strata. All analyses were done by age group (6-23 months, 2-4(5)-years, 5(6)-11 years, 12-15(17) years) and vaccine manufacturer. Events in children older and younger than 5(6) years of age were analyzed, stratified for age group (older vs younger children) and vaccine type. There was insufficient information to analyze data by sex.
We compared the Number Needed to Treat (NNT) separately for the four age groups, for preventing a case of COVID-19 to the risk of different adverse event outcomes, by using the bcii command in Stata. A positive NNT indicates the number of children that need to be vaccinated to prevent one event (hereafter the number needed to treat to benefit (NNTB)). A negative NNT implies that the vaccine is more likely to harm than benefit and the absolute value may also be interpreted as number needed to treat to harm (NNTH).29
All RRs were reported with 95% confidence intervals (95% CI).
RESULTS
The main search for published literature resulted in 1864 records. After removing duplicates, 1199 studies were screened, 1135 of these were excluded by title or abstracts and 64 full texts were assessed. Of these, six studies were included in the analysis.30–35 (Supplementary Figure 1). For each of the two mRNA COVID-19 vaccines, three main publications were published according to age groups: 12-15 years,30 5-11 years,31 and 6 months to 4 years for Pfizer (presenting safety data for the 6 to 23 months and 2-4 year old groups separately),32 and for Moderna 12-17 years,33 6-11 years,34 and 6 months to 5 years (presenting safety data for the 6-23 months and 2-5 year old groups separately).35 Table 1 presents background information on the included phase 3 studies. Table 2 presents the number of participants with outcomes, for both vaccines combined, overall and across age groups. Supplementary Tables 4a (Pfizer trials) and 4b (Moderna trials) present the data extracted from each of the vaccine trials along with our RR calculations.
Primary outcome: SAEs (overall, excluding accidents, and infectious only)
There were no reported deaths in any of the trials. The combined RR for SAEs for mRNA vaccine vs placebo recipients was 1.12 (0.74-1.70) (Table 2). For the Pfizer vaccine, the RR tended to be highest in the older children (3.49 (0.73-16.78[0.6% vs 0.2% in vaccine vs placebo recipients]) and declined with lower age. For Moderna vaccines, the highest RR was seen among the youngest population (5.02 (0.66-37.90[0.9% vs 0.2%])), but overall numbers were small (Figure 1, Supplementary tables 4a+b). Splitting data by above and below 5(6) years of age, the combined estimates were 1.84 (0.81-4.20[0.2% vs 0.1%]) for the oldest children and 0.93 (0.57-1.51[0.7% vs 0.8%]) for the youngest (p for homogeneity of effects=0.20) (Figure 1). The results were similar when excluding accidents (1.11 (0.72-1.72)) and when focusing on SAEs due to infections (1.08 (0.41-2.83)) (Table 2, Supplementary Tables 4a+b).
Severe AEs
Severe AEs were not reported as narratives, so it was not possible to distinguish between overall and infectious Severe AEs. For both vaccines there was higher risk of Severe AEs in vaccine vs placebo recipients in the two oldest populations, but not in the two youngest populations. For the 12-15(17)-year-olds, the combined RR was 3.76 (1.24-11.39[0.6% vs 0.2%]) (Table 2). In the 5(6)-12-year-olds, the same tendency was observed (Figure 2, Supplementary tables 4a+b), though not statistically significant. The overall risk of Severe AEs for younger children was lower in vaccine recipients (Table 2). Splitting data by above and below 5(6) years of age, the estimates were significantly different for the oldest (3.77 (1.56-9.13)[0.4% vs 0.1%]) and the youngest children (0.82 (0.53-1.29)[0.8% vs 0.9%]), p for homogeneity of effect=0.003 (Figure 2).
AESIs
All RCT studies presented AESIs adapted from the Brighton Collaboration judged to be relevant to COVID-19 vaccines. Numbers of events per age group were lower than for SAEs and Severe AEs (Supplementary tables 4a+b). The combined RR was 0.97 (0.48-1.95[0.2% vs 0.1%]) (Table 2).
Respiratory tract infections
In the 6-23 months and 2-4(5) year age groups, trials reported data on respiratory tract infections. The risk of LRTI was higher in vaccine recipients (3.03 (1.29-7.09[0.6% vs 0.2%]) (Table 2 and Figure 3). For RSV, the risk tended to be higher in vaccine recipients (2.09 (0.92-4.74 [0.4% vs. 0.2%]) (Table 2, Figure 3). For the youngest, the RR was significantly higher in Moderna recipients vs placebo: 2.91 (1.04-8.19[0.4% vs 0.2%]) for the 2–5-year-olds, 3.25 (1.16-9.08[0.8% vs. 0.2%]) for the 6-23-months-olds. There was no difference in the risk of URTI (1.01 (0.87-1.16[3.8% vs. 2.8%]).
Other health outcomes defined by System Organ Class, and COVID-19 infections
There were no clear patterns in the presented System Organ Class systems. However, “skin and tissue disorders” had a combined RR of 1.33 (1.06-1.67[1.8% vs. 1.2%])(Table 2).
As expected, the risk of COVID-19 infections was significantly lower in vaccine recipients with overall RRs of 0.15 (0.08-0.27[0.5% vs.2.7%]) for Pfizer and 0.55 (0.41-0.74[1.2% vs.2.1%]) for Moderna. However, analyzed by age group, only the RR for the 2–5-year-olds in Moderna trials was statistically significant (RR 0.55, 0.38-0.79[2.7% vs 5.0%])(Supplementary tables 4a+b).
Number needed to treat
For COVID-19 infections, the combined NNTB ranged from 37 to 103. For SAEs and Severe AEs, the NNT range included both possibilities of benefit and harm, with a range from -2219 to 630. For LRTI in young children, the NNTH ranged from 183 to 271 (Supplementary table 5).
DISCUSSION
From the RCTs in children aged 6 months to 15(17) years, neither of the mRNA vaccines had a beneficial effect on overall health, assessed as the incidence of SAEs, Severe AEs, RTIs, and other organ-specific diseases. mRNA vaccines were not associated with an increased risk of SAEs, but the risk of Severe AEs was more than 3.5-fold higher in the older children. In younger children, information on respiratory infections was provided, and mRNA vaccines were associated with a 3-fold increased risk of LRTI and a 2-fold increased risk of RSV. As expected, the vaccines reduced the risk of COVID-19 infection.
Strengths and limitations
The review was based on placebo controlled RCTs and represents the best available estimates of the overall health effect of COVID-19 vaccines in children.
Our analyses also have several limitations, which are largely a consequence of the data availability.
First, the included trials were designed to collect and analyze safety and efficacy of vaccines, not overall health effects. Only SAEs and AESI were collected for the full duration. All health outcomes ought to be investigated to include non-specific effects of vaccines.16,36 The occurrence (or absence) of e.g., another respiratory infection several months after randomization may well be the result of the vaccination.15 While it is not customary to collect all health outcomes for the full duration of vaccine trials, the results on respiratory infections presented here suggest this data can provide important insights.
Second, vaccine efficacy in the younger populations has primarily been assessed by “immunobridging”, where antibody responses in children receiving the vaccine are compared to antibody responses in older age groups, in which efficacy was demonstrated. Hence, clinical trial populations including children were much smaller than in adults. This led to several limitations regarding safety analysis, as also highlighted in the EMA report: “The study size did not allow detection of rare adverse events, or to evaluate whether the characteristics of identified, but rarer risks differ compared with the adolescent and adult populations.”21
Third, data comparison and counting of unsolicited SAEs, Severe AEs, and AESIs was challenging due to inconsistencies in the reported number of events between the main texts, supplementary data, and trial reports: a problem that has been previously addressed.37,38 Furthermore, AEs could be registered as both Severe AEs and SAEs according to event definition in each trial’s supplementary material, AESIs could also be SAEs, and respiratory infections could also be registered as Severe AEs or SAEs confounding composite outcome analysis as cases could have counted twice or thrice.
Fourth, there were considerable differences between the two vaccine types regarding the incidence of reported events. For example, the incidences of some SOC groups differed markedly (Supplementary Tables 4a+b), e.g., “infections and infestations” (incidence 13.5% vs 2.8% for Moderna vs Pfizer vaccinees), “nervous system disorders” (2.2% vs 0.7%), and “respiratory disorders” (5.6% vs. 0.5%). The difference in infections and respiratory disorders could be related to Fall dates for the Moderna trial versus Summer dates for the Pfizer trials. However, different dosing and reporting standards might complicate combined analyses.
Fifth, data was not reported by sex. Non-specific effects have been shown to be sex-differential, and in several instances, an overall null-effect has been shown to be a result of a positive effect in one sex but a negative effect in another.39,40 As it pertains to COVID-19 mRNA vaccines and adults, there is a striking female predominance in severe allergic reactions.41 Many journals require data be broken down by biological sex.42 It is a serious omission that this is still not done consistently.16
Interpretation
For SAEs and Severe AEs, the oldest populations generally had the highest risk of events compared to the youngest. The observed risk difference could be an effect of the vaccine dose. The youngest children received a lower dose than the 5-11-year-olds who again received a lower than adolescents (Pfizer 3 vs 10 vs. 30 μg, Moderna 25 vs 50 vs 100 μg). The Pfizer dose for the youngest children is 10 times lower than for the oldest group, whereas the Moderna dose was only 4 times lower, which might help explain the stronger dose-response in Severe AEs and SAEs in the Pfizer trials. During the open-label dose-level finding part of the studies, children 2 to 5 years of age in the Pfizer trials had a higher frequency and greater severity of adverse reactions to the 10 µg dose compared with the 3 µg dose, which contributed to the selection of the lower dose.21
Our finding of a higher rate of LRTI after mRNA vaccination lines with other studies showing negative non-specific effects of non-live vaccines for respiratory infections. Sørup et al found a higher risk of both RSV-related and other non-targeted infections in children after receiving a non-live vaccine compared to the live vaccine against Measles, Mumps, and Rubella.43,44 Two small immunological studies, one in adults and one in children, have found mRNA vaccines to be associated with a decrease in cytokine responses to viral stimulants for 6 months.45,46 Similar immunological effects have been observed for other non-live vaccines.47,48 Taken together, the results suggest that mRNA vaccines may have negative non-specific immunologic effects, lasting at least some months.
Regarding the increased overall risk of “skin and tissue disorders”, this apparent association could be a chance finding as many outcomes were assessed. Nevertheless, various skin reactions from COVID-19 mRNA-vaccines have previously been described.49
Number needed to treat to benefit or harm
Only COVID-19, SAEs, and AESIs were captured for more than four weeks post-vaccination. Thus, there would inherently be a lower baseline risk for other health outcomes, which would bias towards higher NNTB/H for other health outcomes. Nonetheless, the data indicates that for the 12–15-year-olds receiving either vaccine, the NNTB for preventing one additional case of COVID-19 was 103, and the NNTH for developing one additional Severe AE was 260. Thus, there would be roughly one Severe AE for each 3 cases of COVID-19 prevented (260 NNTH/103 NNTB≈2.52). In the youngest age group, the data suggest that for each 3 prevented COVID-19 cases, one child would develop an LRTI (NNTB for COVID-19 60 and NNTH for LTRI 183), and for each 12 COVID-19 cases prevented, one child would get an RSV infection (NNTH for RSV 709). LRTI including RSV infections in infants and small children are usually more severe than COVID-19 infections.50
CONCLUSION
Both mRNA vaccines approved to children were associated with reductions in the risk of COVID-19 and showed no difference in the risk of SAEs. Among the older children, the vaccines were associated with a 3.5-fold higher risk of Severe AEs. Among children younger than 5 years of age, the mRNA vaccines were associated with a 3-fold higher risk of LRTI and a 2-fold higher risk of RSV. Given the low risk of severe COVID-19 infections in children, the RCTs call for a renewed assessment of the value of COVID-19 vaccination of children and adolescents.
Data Availability
All data produced in the present work are contained in the manuscript
Data sharing
All analyzed data is freely available in the public domain, as per references. Funding:
This study was funded by a grant from the Bluebell foundation. The funding agency had no role in the design of the study, data collection, analysis, interpretation, writing or decision to publish the results.
Transparency statement
All authors affirm that the manuscript is an accurate and transparent presentation of the studies being reported, no important aspects has been omitted, and all relevant data has been published.
Author contributions
The study was conceptualized by CSB and SMT. SSH wrote the first draft with input from the other authors. SN provided statistical advice. All authors commented and approved the final version.
Acknowledgements
In relation to the study published by Anderson et al35, Dr. Schnyder Ghamloush kindly provided information on the enrolment period for part 2 of the study.
Footnotes
Minor cosmetic changes.