OpenSAFELY: Effectiveness of COVID-19 vaccination in children and adolescents

Data source

All data were linked, stored and analysed securely using the OpenSAFELY platform, https://www.opensafely.org/, as part of the NHS England OpenSAFELY COVID-19 service. Data include pseudonymised data such as coded diagnoses, medications and physiological parameters. No free text data was included. All code is shared openly for review and re-use under MIT open license [https://github.com/opensafely/vaccine-effectiveness-in-kids]. Detailed pseudonymised patient data is potentially re-identifiable and therefore not shared. Primary care records managed by the GP software provider, TPP were linked to ONS death data and the Index of Multiple Deprivation through OpenSAFELY.

Eligibility criteria, vaccination groups, and matching

We included a) all adolescents aged 12-15 years and b) all children aged 5-11 years on 31 August 2021, when age-based vaccine eligibility criteria were defined, who were not clinically vulnerable, as defined by the Joint Committee on Vaccination and Immunisation (JCVI) (clinically vulnerable individuals were eligible for vaccination prior to the start of the study entry period); had been continuously registered at a GP practice using TPP’s SystmOne clinical information system for 42 days; had no evidence of SARS-CoV-2 infection or COVID-19 disease within the 30 days before vaccination; and had complete information on sex, deprivation, ethnicity, and NHS region.

We estimated the effectiveness and safety of: i) first vaccine dose vs. no vaccination, and ii) a second dose vs. a single dose only by emulating a sequence of target trials. For the first vaccine dose, on each day of the study period, each eligible individual vaccinated with their first dose was matched 1:1 without replacement with an eligible individual who had not yet been vaccinated. Unvaccinated individuals were matched to at most one vaccinated individual, but were eligible for inclusion in the vaccination group later on if they were subsequently vaccinated. Follow-up of the vaccinated group included time after second vaccination. We used the same approach to assess effectiveness and safety of a second vaccine dose, amongst individuals who had received a first vaccine dose.

Matching criteria were: age within year on 31 August 2021 (i.e., in the same school-year); sex (male/female); region; evidence of prior infection (yes/no); prior tests in the preceding 26 weeks (0, 1-2, 3+) and prior non-COVID childhood vaccination (MMR: yes/no); all other childhood vaccines(10) (yes/no) and, for the second dose comparison, first vaccination date within 7 days.

Outcomes

Five effectiveness outcomes were considered: positive SARS-CoV-2 test; COVID-19 A&E attendance; COVID-19 hospitalisation; COVID-19 critical care admission; COVID-19 death. Freely-available community testing for COVID-19 ended on 31 March 2022, and as non-high-risk children became eligible for vaccination in April 2022 the positive SARS-CoV-2 test was not considered for children (age 5-11 years). non-COVID-19 death, fractures and effectiveness in the first week after vaccination were considered as negative control outcomes(11). We also considered A&E attendance, unplanned hospitalisation, pericarditis and myocarditis as safety endpoints (Supplementary Box 1). Outcomes are described in Supplementary Box 1.

Follow-up

Each individual was followed from assignment to a comparison group (‘time zero’) until the earliest of: end of freely-available community testing (positive SARS-CoV-2 test only); outcome; death; practice de-registration; 20 weeks; vaccination of the unvaccinated control (first dose group only) or second vaccination of the control (second dose group only).

Statistical Analysis

We estimated period-specific incidence rates in each treatment group (number of events divided by person-time at risk) and derived incidence rate ratios and 95% CIs. We also derived 20-week risk differences (RD), and corresponding 95% CIs from the sum of squares of Greenwood standard errors. We estimated effectiveness separately according to whether there was evidence of prior SARS-CoV-2 infection (Supplementary Tables 1-4).

Software, code, and reproducibility

Data management and analyses were conducted in Python version 3.8.10 and R version 4.0.5. Code for data management and analysis, as well as codelists, are archived online https://github.com/opensafely/vaccine-effectiveness-in-kids.

Disclosure control

Any reported figures based on counts below 8 were redacted. Cumulative incidence plots are not reported for outcomes with fewer than 30 outcomes. To reduce re-identification risk, counts are reported to the nearest n∗6−3 (3,9,15,21,…). All derived statistics are based on these rounded counts, including cumulative incidence curves which are based on rounded numbers-at-risk and event counts.

Adolescents

Of 513,192 eligible adolescents who were registered at a TPP practice and received a BNT162b2 vaccination during the study period, 410,463 (80%) were matched with unvaccinated controls. (Supplementary Figure 1, panel A). 220,929 (81%) of 271,440 eligible adolescents who received a second BNT162b2 vaccination were matched with single vaccinated controls (Supplementary Figure 1, panel B).

As expected, the matching factors, other than age, were identically distributed in the vaccinated and control groups at the start of follow-up for all of the study populations (Table 1). Over 60% of adolescents in the first vaccination group received a second vaccination. Most second vaccinations occurred at least 12 weeks after first vaccination (Supplementary Figure 2).

Effectiveness of first dose in adolescents

In 95,641 person-years of potential follow-up, there were 56,496 positive SARS-CoV-2 tests; 72 COVID-19 A&E attendances; 90 COVID-19 hospitalisations, of which 3 included admission to critical care; and no COVID-19 deaths. There were 3 non-COVID-19 related deaths; 3,444 fractures; 22,764 A&E attendances; 2,664 unplanned hospitalisations; 9 cases of pericarditis and 3 cases of myocarditis. All pericarditis and myocarditis events occurred in the first dose group, while all COVID-19 related critical care admissions were in the unvaccinated group. Further analyses were restricted to positive SARS-CoV-2 tests, COVID-19 A&E attendance, COVID-19 hospitalisation, fractures, A&E attendance and unplanned hospitalisation.

The incidence of positive SARS-CoV-2 test after first vaccine dose in adolescents declined substantially between 10 days and 6 weeks after vaccination, then increased (Figure 1). By 15 weeks the cumulative incidence of positive SARS-CoV-2 tests was similar in the first dose and unvaccinated groups. The 20-week risks per 10,000 were 1,961 (95% CI 1,932-1,990) and 1,979 (1,950-2,008) in the vaccinated and unvaccinated groups respectively. The IRR comparing vaccinated with unvaccinated adolescents was 0.74 (95% CI 0.72-0.75) (Table 2).

• Download figure
• Open in new tab

Figure 1: Kaplan-Meier estimates of cumulative incidence and risk ratios of outcomes.

• Download figure
• Open in new tab

Figure 2: Kaplan-Meier estimates of cumulative incidence and risk ratios of outcomes.

The incidence of COVID-19 A&E attendance was lower after first vaccination than in the unvaccinated group (IRR 0.60; 95% CI 0.37-0.97). The 20-week risks per 10,000 were 1.91 (95% CI 1.23-2.98) and 2.54 (1.83-3.54) respectively. The incidence of COVID-19 hospitalisation was lower after first vaccination than in the unvaccinated group (IRR 0.58; 0.38-0.89). The 20-week risks per 10,000 were 3.09 (2.05-4.67) and 4.23 (3.05-5.87) respectively.

The incidence of fractures (negative control outcome) was similar in the first vaccination and unvaccinated groups: (IRR 0.99; 95% CI 0.93-1.06). The 20-week risks per 10,000 were 135 (95% CI 126-144) and 127 (119-136) respectively. The incidence of A&E attendance (safety outcome) was lower after first vaccination than in the unvaccinated group (IRR 0.89; 0.87-0.91). The 20-week risks per 10,000 were 812 (95% CI 792-834) and 885 (864-907) respectively. The incidence of unplanned hospitalisation was lower after first vaccination than in the unvaccinated group (IRR 0.88; 0.81-0.95). The 20-week risks per 10,000 were 104 (96-112) and 115 (107-123) respectively.

Effectiveness of second dose vs single dose only in adolescents

In 30,444 person-years follow-up after first vaccination in adolescents, there were 14,910 positive SARS-CoV-2 tests; 6 COVID-19 A&E attendances; 24 COVID-19 hospitalisations, none of which included admission to critical care; and no COVID-19 deaths. There were no non-COVID-19 related deaths; 1,158 fractures; 7,488 A&E attendances; 876 unplanned hospitalisations; 3 cases of pericarditis and no cases of myocarditis. All pericarditis events occurred in the single dose group. Further analyses were restricted to positive SARS-CoV-2 tests, A&E attendance, fractures and unplanned hospitalisation.

The incidence of positive SARS-CoV-2 test after second dose declined between 10 days and 6 weeks after vaccination, then increased (Figure 1). By 14 weeks the cumulative incidence of positive SARS-CoV-2 test was similar in the second and single dose groups. The 20-week risks per 10,000 were 850 (95% CI 802-899) and 898 (861-935) after second and single dose respectively. The IRR comparing second with single doses was 0.67 (95% CI 0.65-0.69) (Table 2).

The IRR comparing the incidence of fractures (negative control outcome) was similar in the second and single dose groups was 0.94 (95% CI 0.84-1.05). The 20-week risks per 10,000 were 92 (95% CI 81-105) and 144 (110-189) respectively. The incidence of A&E attendance (safety outcome) was lower after second than single dose (IRR 0.93; 0.89-0.98). The 20-week risks per 10,000 were 651 (95% CI 602-703) and 709 (658-763) respectively. The incidence of unplanned hospitalisation was similar in the second and single dose groups (IRR 0.99; 0.86-1.13). The 20-week risks per 10,000 were 69 (60-80) and 67 (58-77) respectively.

Myocarditis and pericarditis in adolescents

Less than 51% of adolescents diagnosed with pericarditis were admitted to hospital, and less than 51% attended emergency care. More than 51% of adolescents with myocarditis were admitted to hospital and more than 51% attended emergency care. The maximum length of critical care admission was 1 day for either event. The maximum length of hospitalisation stay was 0 days for pericarditis and 2 days for myocarditis. There were no deaths after these events.

Children

Of 177,360 children eligible in the first vaccination group 141,711 (80%) were matched with unvaccinated controls. (Supplementary Figure 2, panel A). 66,231 (67%) of 99,102 children who received a second BNT162b2 vaccination were matched with single vaccinated control. (Supplementary Figure 2, panel 2). Nearly 60% of children in the first vaccination group received a second vaccination. Most second vaccinations occurred at least 12 weeks after the first vaccination (Supplementary Figure 2).

Effectiveness of first dose vs unvaccinated in children

In 32,476 person-years follow-up, there were no COVID-19 A&E attendances; 6 COVID-19 hospitalisations (none included admission to critical care) and no COVID-19 or non-COVID-19 related deaths. There were 1,254 fractures; 8,016 A&E attendances; 798 unplanned hospitalisations; 3 cases of pericarditis and no cases of myocarditis. All pericarditis events occurred in the first dose group. Further analyses were restricted to fractures, A&E attendance and unplanned hospitalisation. The incidence of fractures was similar in the first vaccination and unvaccinated groups (IRR 1.02; 95% CI 0.91-1.14). The 20-week risks per 10,000 were 113 (95% CI 102-127) and 106 (95-118) respectively. The incidence of A&E attendance was higher after first vaccination than in the unvaccinated group (IRR 1.05; 95% CI 1.01-1.10). The 20-week risks per 10,000 were 834 (748-929) and 687 (653-723) respectively. The IRR comparing the incidence of unplanned hospitalisation in the first vaccination and unvaccinated groups was 1.10 (95% CI 0.95-1.26). The 20-week risks per 10,000 were 73 (65-83) and 60 (52-69) respectively.

Effectiveness of second dose vs single dose only in children

In 8,875 person-years follow-up, there were no COVID-19 A&E attendances; no COVID-19 hospitalisations; no admissions to critical care; and no COVID-19 or non-COVID-19 related deaths. There were 264 fractures; 1,680 A&E attendances; 144 unplanned hospitalisations; and no cases of pericarditis or myocarditis. Further analyses were restricted to fractures, A&E attendance and unplanned hospitalisation.

The IRR comparing the incidence of fractures in the second and single dose groups was 0.87 (95% CI 0.69-1.11). The 20-week risks per 10,000 were 58 (95% CI 45-73) and 103 (77-138) respectively. The incidence of A&E attendance was similar in the second and single dose groups (IRR 0.95; 0.86-1.05). The 20-week risks per 10,000 were 483 (419-557) and 556 (488-632) respectively. The IRR comparing the incidence of unplanned hospitalisation in the second and single dose groups was 0.78 (95% CI 0.56-1.08). The 20-week risks per 10,000 were 37 (24-57) and 41 (30-55) respectively.

Myocarditis and pericarditis events in children

No children experienced a myocarditis event, all 3 pericarditis events occurred after first vaccination and did not require hospitalisation or critical care.

Strengths and Limitations

Our study has several limitations. First, bias due to unmeasured confounding is possible, although the detailed data available in OpenSAFELY allowed us to match vaccinated with control individuals on multiple characteristics. For example, it was not possible to reliably identify individuals with COVID-19 symptoms prior to testing or hospital admission, because this information is not routinely recorded in primary care records. Delayed vaccination in individuals with symptoms may explain the apparent effectiveness against positive tests during the first week, however, the incidence of positive tests substantially reduced from 1-2 weeks in the vaccinated group (Figure 1A) compared with the unvaccinated group, consistent with a delayed but protective immunological response to vaccination. A similar pattern was observed for second dose versus single dose vaccination (Figure 1B). Lifestyle factors that may influence both health and vaccination are not fully recorded in health records. The slightly higher rate of fractures (negative control outcome) in single-vaccinated adolescents and children compared to the second dose group could indicate limited unmeasured confounding. Second, positive SARS-CoV-2 test data underestimates the true incidence of infection. Both lateral flow tests and PCR tests were freely available in the UK until 31 March 2023, but many asymptomatic and some symptomatic infections will not have been recorded. Differences in testing behaviour between vaccinated and unvaccinated people may have contributed to the apparent waning effect if testing is more common among vaccinated individuals. Third, myocarditis and pericarditis following COVID-19 vaccination were publicly reported from May 2021(12). The vaccinations in our study were after this date, so there is a potential for ascertainment bias if diagnostic thresholds were lower in vaccinated than unvaccinated individuals. Fourth, we excluded clinically vulnerable children and adolescents who were eligible for vaccination before the general roll out, so our results may not be generalisable to this group. Vaccine safety and effectiveness in this group are important, but there are significant challenges in controlling confounding arising from unmeasured severity of underlying conditions that could influence vaccine uptake and effectiveness. Fifth, due to small numbers we did not study vaccine effectiveness in those who had received a vaccination other than BNT162b2.

Findings in context

BNT162b2 vaccination was shown to be effective in protecting against COVID-19 infection in a multinational phase 3 trial of 2,260 adolescents aged 12-15 with a median follow up of 2 months(13,14). Multiple observational studies have found that effectiveness wanes with time since vaccination(15,16). A recent systematic review found generally limited evidence regarding clinical outcomes of BNT162b2 vaccination amongst children and adolescents(17), although vaccination lowered hospitalisation rates including emergency admission.

Several studies have reported that children infected with SARS-CoV-2 appear to have the same degree of severity of illness as seen in adults(18–20). Most reported post-vaccination cases of myocarditis and pericarditis in children and adolescents were mild(21). A systematic review found that myocarditis and pericarditis in children and adolescents were more prevalent among males and after the second dose of BNT162b2(22). Whilst all cases of myocarditis and pericarditis in our study occurred in the vaccinated groups, we did not find higher rates of myocarditis or pericarditis after the second compared to the first dose. The rates of heart inflammation (myocarditis and pericarditis) in under 18s reported by the UK Medicines and Healthcare products Regulatory Agency were 13 and 8 per million after first and second doses respectively, compared with our estimates of 27 and 10 per million respectively.