Effectiveness of the mRNA BNT162b2 vaccine six months after vaccination: findings from a large Israeli HMO ========================================================================================================== * Jennifer Kertes * Sharon Baruch Gez * Yaki Saciuk * Lia Supino-Rosin * Naama Shamir Stein * Miri Mizrahi-Reuveni * Anat Ekka Zohar ## Abstract Israel is currently experiencing a new wave of CoVid-19 infection, six months after implementing a national vaccination campaign. We carried out three discrete analyses using data from a large Israeli HMO to determine whether IgG levels of those fully vaccinated drop over time, the relationship between IgG titer and subsequent PCR-confirmed infection, and compare PCR-confirmed infection rates by period of vaccination. We found that mean IgG antibody levels steadily decreased over the six-month period in the total tested population, and in all age groups. An inverse relationship was found between IgG titer and subsequent CoVid-19 infection (PCR-positive). Those participants vaccinated in the first two months of the campaign were more likely to become infected than those subsequently vaccinated. The 60+ vaccinated had lower initial IgG levels, and were at greater risk of infection. The findings support the decision to add a booster vaccine for those aged 60 and over. **Article Summary Line** The BNT162b2 vaccine was found to be less effective in protecting against Covid-19 infection after six months, and vaccination with a third dose is indicated. Keywords * COVID-19 * serologic tests * vaccines * epidemiology * public health * infections * immune response ## INTRODUCTION The first case of Covid-19 was identified in Israel at the end of February 2019.*(1)* As in other countries, Israel has experienced a number of infection waves. The third and largest wave to-date, largely attributed to the entry of the Alpha variant to Israel, commenced in September 2020. At its’ peak, over 8,000 new cases were being identified daily.*(2)* Israel was among the first countries to introduce a national vaccination campaign, using the mRNA BNT162b2 vaccine (Pfizer-BioNTech©). The BNT162b2 vaccine received emergency approval for use by the FDA after demonstrating 95% efficacy over an average two-month follow-up period.*(3,4)* The vaccine was initially approved for any person aged 16 and over, with a recommended 21-day interval, two-dose administration. The vaccine campaign commenced on the 20th December 2020 (concurrent with a two-month nationwide lockdown), first targeting all healthcare workers and the 60+ population, and quickly extending to all the population aged 16+. Initially those members with a prior infection were not eligible for vaccination, but within three months, policy was changed to offer a single dose to all those with prior infection. By April 2021, over 50% of those aged 16 and over, and 88% of the 50+ age group country-wide had been fully vaccinated.*(2)* Incidence rates dropped to 140/day by April 2021.*(2)* Initial population-based studies in Israel comparing the vaccinated and unvaccinated, reported vaccine effectiveness rates of 95%.*(5,6)* One of the biggest questions regarding the vaccine is the length of protection provided. In publishing its third phase results, Pfizer-BioNTech reported a 91% efficacy rate over a six month follow-up period, with an estimated 6% drop in efficacy every two months.*(7)* Israeli population-based observational studies are no longer a feasible method of evaluating long-term effectiveness of the vaccine, given that the majority of the population have now been fully vaccinated. Infection rates in Israel are on the rise again, with Israel currently experiencing it’s fourth wave of infection. The majority (97%) of those infected in this current wave are infected with the Delta variant (B.1.617.2) (unpublished data provided by Israel Ministry of Health Laboratories). Initial serological studies of the Delta variant suggest that the BNT162b2 vaccine provides protection against Delta-variant infection, but at lower rates than for the Alpha variant (88% vs 93.7% respectively).*(8)* Given the rise in infection rates, the dilemma arose whether this rise was attributable to reduced effectiveness of the vaccine against the Delta variant or a waning of protection provided by the vaccine over time. The objective of this study was to determine if the BNT162b2 vaccine had become less effective in preventing infection, and if so, in which population groups and to what degree. In order to meet this objective, we carried out three discrete analyses to answer the following questions: a) do antibody levels (IgG) of those fully vaccinated drop over time and if so, for who and how quickly, b) what is the relationship between antibody level (IgG) and subsequent PCR-confirmed infection, and c) is there a difference in PCR-confirmed infection incidence rates between those vaccinated in the initial months of the vaccination campaign to those vaccinated later? ## METHODS We conducted a series of retrospective cohort analyses to meet the study objectives. All data were extracted from the Maccabi HealthCare Services database. Maccabi is the second largest HMO in Israel, providing healthcare coverage for over 2.5 million citizens (a quarter of Israel’s population). The database includes demographic data (date of birth, gender, socioeconomic status based on census and national survey classifications applied to home address), laboratory data (all PCR and IgG test results) and health status data (chronic illness registries, such as heart disease, HTN, CKD, diabetes and immunosuppressive disorder, based on hospital and community-based diagnoses and procedures, relevant laboratory and test results). The study was approved by the Maccabi Helsinki Committee (#0178-20-MHS), with informed consent waived, as all data extracted from the database were anomized and aggregated. ### Testing Procedures PCR testing is carried out free of charge for any HMO member presenting with symptoms or reporting exposure to a confirmed case. Testing is carried out using real-time polymerase chain reaction tests (PCR) using Allplex™ 2019-nCoV Assay, Seegene Inc. Serology testing was carried out among specific target populations (such as employees (19%) and residents and employees of geriatric medical and retirement home facilities owned by the HMO (4%)) at discrete points in time, but the majority of testing was carried out in the general HMO population (77%) for whom testing is freely available upon request. IgG antibody testing was carried out using SARS-CoV-2 specific anti-spike antibodies with follow-up chemo-luminescence immunoassay (Quant II IgG anti-Spike CoV2-SARS by Abbott (Illinois, USA)) and reported as AU/ml (Arbitrary units). Antibody levels are reported numerically, except for outliers (below 21 and above 40,000 AU/ml) which are coded. Coded results were converted to numeric results (‘below 21’ as 21 and ‘above 40,000’ as 40,001). ### IgG antibody levels of the vaccinated population over time All HMO members that had received both vaccine doses and had a subsequent IgG test for SARS-CoV-2 antibodies at least seven days after the second vaccination were included in this component of the study. The study period extended from 11th January 2021 (when those first vaccinated reached day seven post-second dose) to 7th July 2021. IgG antibody results were mapped over the 180-day period, by demographic and health characteristics (age group, gender, socio-economic status and presence of selected chronic illnesses). ### Relationship between IgG antibody levels and subsequent SARS-CoV-2 Infection All HMO members that had a PCR test (irrespective of vaccination status) between 1st June 2021 and 14th July 2021 (peak of fourth wave of infection to date) with an IgG serology test between seven and 120 days prior to the PCR test were included in this component of the study. Last test result was included for those with more than one test. Last PCR test date was utilized if all results were negative and first positive PCR test date was utilized for those more than one result. The proportion of participants with subsequent positive PCR results by antibody level status was calculated. ### Comparison of infection rates by vaccination period All HMO members who, as of the 9.6.2021, were at least seven days post-second vaccination dose with no prior positive PCR result were included in this component of the study. Members having received three doses or with an appointment to receive the third dose (N=320) in the follow-up period were excluded from analysis. (At this time, a recommendation to offer a booster vaccination for those with immune-suppressive disorder had been authorized). The study population was categorized by vaccination completion: Jan-Feb 2021 and Mar-May 2021. For both groups, the proportion that were tested PCR-positive between 9.6.2021-18.7.2021 (yes/no) was calculated. ### Statistical Analyses Mann Whitney and Kruskal Wallis tests were carried out to compare antibody levels over time between different population groups. Linear regression was used to identify those factors associated with serology level. Ln of serology levels evidenced a normal distribution and was selected as the outcome variable. Other variables entered into a hierarchical model were a) days from vaccination, b) age, gender and socio-economic status, and c) selected chronic illnesses. Chi square analyses were used to test the association between serology levels (categorized) with PCR outcome. Serology status was categorized into below or equal to 300 AU/ml, or above 300 AU/ml. Kaplan-Meier survival curves were calculated to compare time from serologic test to positive PCR result for the serology categories using log-rank tests. Event was defined as positive PCR result. Time to event was the number of days from serology test to PCR test, with censoring for those that died or left the HMO, or had a follow up of less than 120 days. Logistic regression analysis was used to compare PCR-positive outcome between vaccination periods, while controlling for age group, socio-economic status and presence of chronic illness (heart disease, HTN, diabetes, CKD, and immunosuppressive disorder). Statistical analyses were carried out using SPSS, version 25 (BMI©) and R (version 3.6.2) ## RESULTS ### IgG antibody levels of the vaccinated population over time (N=8,395) The description of the study population is provided in Table 1. Of all HMO members who received both vaccine doses, those subsequently tested for IgG antibodies were more likely to be male, younger (in the 18-44 age group), in a higher socio-economic bracket and less likely to have a chronic illness than those not IgG tested. View this table: [Table 1:](http://medrxiv.org/content/early/2021/09/07/2021.09.01.21262957/T1) Table 1: Demographic and Health Characteristics of vaccinated population by serology test status, Jan-Jun 2021, Maccabi HealthCare Services, Israel Serology levels in the study population were found to decrease over time from a mean of 14,008 for those tested within a month of being vaccinated to a mean of 1,411 for those tested in the sixth month after vaccination (Table 4). A decrease over time was observed in all sub-population groups, when results were stratified by age group, gender, socio-economic status and selected chronic illnesses (Table 2). The largest mean differences between sub-populations were observed in their initial serology levels (within the first month). Serology levels of participants aged 60 and over were almost half those of participants under the age of 60 in the first month, attenuating to a less than 10% difference six months later (Figure 1). Large differences in initial serology levels were also observed for participants with chronic illness, in particular participants with immunosuppressive disorder, CKD or heart disease. Initial (first-month) serology levels increased by socio-economic level. View this table: [Table 2:](http://medrxiv.org/content/early/2021/09/07/2021.09.01.21262957/T2) Table 2: Demographic and Health Characteristics of vaccinated population by PCR test status, June-July 2021, Maccabi HealthCare Services, Israel View this table: [Table 3:](http://medrxiv.org/content/early/2021/09/07/2021.09.01.21262957/T3) Table 3: Demographic and Health Characteristics of vaccinated population by vaccination period, Jan-May 2021, Maccabi HealthCare Services, Israel View this table: [Table 4:](http://medrxiv.org/content/early/2021/09/07/2021.09.01.21262957/T4) Table 4: Mean antibody level by demographic and health variables and time from vaccination (days), Jan-June 2021, Maccabi HealthCare Services, Israel ![Figure 1:](http://medrxiv.org/https://www.medrxiv.org/content/medrxiv/early/2021/09/07/2021.09.01.21262957/F1.medium.gif) [Figure 1:](http://medrxiv.org/content/early/2021/09/07/2021.09.01.21262957/F1) Figure 1: Serology levels of vaccinated population over time by age group, Jan-June 2021, Maccabi HealthCare Services, Israel Of all those that were vaccinated with both doses, 2.8% also had a positive PCR result. Comparable declines in serology means by month were observed in this group, as in others. However, the mean serology level for those tested in the first 7-30 days was much higher than for the total study population (22,630 AU/ml, p<.001). When demographic and health variables were entered into a linear regression model (Appendix, Table A1), all factors remained independently associated with serology levels, with the highest co-efficient observed for participants with immunosuppressive disorder. No multi-collinearity was observed between the factors in the regression model. ### Relationship between IgG antibody levels and subsequent SARS-CoV-2 Infection (N=5,141) Demographic and health characteristics of HMO members with a serology result who had subsequently tested for PCR were similar to those that had no PCR test result (Table 2) with the exception of socio-economic status and diabetes status. PCR testers were more likely to be in the lower socio-economic bracket and have diabetes than non-PCR testers. Of all those who had both tests (N=5,141), 57% had a serology test result of 150 AU/ml and lower, 6% had a result between 150-299 AU/ml, 10% had a test result between 300-799 AU/ml and 27% had a result greater than 800 AU/ml. The proportion of participants with a positive PCR result were 1.2% for those with serology levels lower 150 AU/ml and lower, 1.3% for those with serology levels between 150-299, 0.2% of those with a result of 300-799 AU/ml and for those with a result of 800+ AU/ml (p=.004). Mean serology levels for the 42 study participants with a positive PCR result was 175 (SD: 490) compared to a mean serology level of 2057 (SD: 6030) for those with a negative result (p<.001). Of all the study participants for this component of the study, 365 (7%) had a prior infection (37% of whom received one vaccine dose). Those with a prior infection were less likely to have a serology level of 300 AU/ml and below than those without a prior infection (40.3% vs 65.2% respectively, p<.001. However, irrespective of prior infection (yes/no), the proportion of those with a new PCR positive result was 0.8%. Kaplan-Meier survival curves (over time by serology status (+/- 300 AU/ml) are presented in Figure 2. The curves indicate that participants with lower serology level (th 2020. FDA Briefing Document - Pfizer BioNTech COVID-19 vaccine. 2021. [https://www.fda.gov/media/144245/download](https://www.fda.gov/media/144245/download) 4. 4.Polack FP, Thomas SJ, Kitchin N, Absalon J, Gurtman A, Lockhart S, et al. Safety and efficacy of the BNT162b2 mRNA Covid-19 vaccine. N Engl J Med. 2020;382(27):2603–2615. 5. 5.Haas EJ, Angulo FJ, McLaughlin JM, Anis E, Singer SR, Khan F, et al. Impact and effectiveness of mRNA BNT162b2 vaccine against SARS-CoV-2 infections and COVID-19 cases, hospitalisations, and dealth following a nationwide vaccination campaign in Israel: an observational study using national surveillance data. Lancet. 2021;397(10287):1819–1829. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1016/s0140-6736(21)00947-8&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=http://www.n&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2021%2F09%2F07%2F2021.09.01.21262957.atom) 6. 6.Dagan N, Barda N, Kepten E, Miron E, Perchik S, Katz MA, et al. BNT162b2 mRNA COVID-19 vaccine in a nationwide mass vaccination setting. N Engl J Med. 2020;384(15):1412–1423. 7. 7.Thomas SJ, Moreira ED, Kitchin N, Absalon J, Gurtman A, Lockhart S, et al. Six month safety and efficacy of the BNT162b2 mRNA COVID-19 vaccine. medRxiv [Preprint] [Cited July 28, 2021]. Available from [https://doi.org/10.1101/2021.07.28.21261159](https://doi.org/10.1101/2021.07.28.21261159) 8. 8.Lopez Bernal J, Andrews N, Gower C, Gallagher E, Simmons R, Thelwall S, et al. Effectiveness of Covid-19 vaccines against the B.1.617.2 (Delta) Variant. N Engl J Med. Aug 12;385(7):585–594. Epub 2021 Jul 21. 9. 9.Zhao J, Yuan Q, Wang H, Liu W, Liao X, Su Y, et al. Antibody responses to SARS-CoV-2 in patients of novel coronavirus disease 2019. Clin Infect Dis. 2020;71(16):2027–2034. [PubMed](http://medrxiv.org/lookup/external-ref?access_num=http://www.n&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2021%2F09%2F07%2F2021.09.01.21262957.atom) 10. 10.Zhou W, Xu X, Chang Z, Wang H, Zhong X, Tong X, et al. The dynamic changes of serum IgM and IgG against SARS-CoV-2 in patients with COVID-19. J Med Virol. 2021;93(2):924–933. 11. 11.Harvey RA, Rassen JA, Kabelac CA, Turenne W, Leonard S, Klesh R, et al. Association of SARS-CoV-2 seropositive antibody test with risk of future infection. JAMA Intern Med. 2021;181(5):672–679. 12. 12.Jalkanen P,, Kolehmainen P, Häkkinen HK, Huttunen M, Tähtinen PA, Lundberg R, et al. COVID-19 mRNA vaccine induced antibody responses against three SARS-CoV-2 variants. Nat Commun. 2021;12(1):3991. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1038/s41467-021-24285-4&link_type=DOI) 13. 13.Grupel D, Gazit S, Schreiber L, Nadler V, Wolf T, Lazar R, et al. Kinetics of SARS-CoV-2 anti-S IgG after BNT162b2 vaccination. Vaccine. Aug 11;S0264-410X(21)01045-8. Epub PMID: 34393018 [PubMed](http://medrxiv.org/lookup/external-ref?access_num=34393018&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2021%2F09%2F07%2F2021.09.01.21262957.atom) 14. 14.Wei J, Stoesser N, Matthews PC, Ayoubkhani D, Studley R, Bell I, et al. Antibody responses to SARS-CoV-2 vaccines in 45,965 adults from the general population of the United Kingdom. Nat Microbiol. July 2021:1–10. Epub. PMID: 34290390 [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1038/s41564-021-00947-3&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=34290390&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2021%2F09%2F07%2F2021.09.01.21262957.atom) 15. 15.Cox RJ, Brokstad KA. Not just antibodies: B cells and Tcells mediate immunity to COVID-19. Nat Rev Immunol. 2020;20(10):581–582. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1038/s41577-020-00436-4&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=32839569&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2021%2F09%2F07%2F2021.09.01.21262957.atom) 16. 16.Khoury DS, Cromer D, Reynaldi A, Schlub TE, Wheatley AK, Juno JA et al. Neutralizing antibody levels are highly predictive of immune protection from symptomatic SARS-CoV-2 infection. Nat Med. 2021;27(7):1205–1211. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1038/s41591-021-01377-8&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=http://www.n&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2021%2F09%2F07%2F2021.09.01.21262957.atom)