COVID-19 Vaccination Mandates and Vaccine Uptake ================================================ * Alexander Karaivanov * Dongwoo Kim * Shih En Lu * Hitoshi Shigeoka ## Abstract We evaluate the impact of government mandated proof of vaccination requirements for access to public venues and non-essential businesses on COVID-19 vaccine uptake. We find that the *announcement* of a mandate is associated with a rapid and significant surge in new vaccinations (more than 60% increase in weekly first doses) using the variation in the timing of these measures across Canadian provinces in a difference-in-differences approach. Time-series analysis for each province and for France, Italy and Germany corroborates this finding, and we estimate cumulative gains of up to 5 percentage points in provincial vaccination rates and 790,000 or more first doses for Canada as a whole as of October 31, 2021 (5 to 13 weeks after the provincial mandate announcements). We also find large vaccination gains in France (3 to 5 mln first doses), Italy (around 6 mln) and Germany (around 3.5 mln) 11 to 16 weeks after the proof of vaccination mandate announcements. Keywords * COVID-19 * vaccine mandates * proof of vaccination * vaccine uptake * vaccine hesitancy * difference-in-differences * time-series analysis * counterfactuals JEL codes * I18 * I12 * C23 ## 1 Introduction Immunization with mRNA or adenoviral vaccines has proven very effective for reducing the spread and severity of COVID-19, with fully vaccinated people benefiting from a large reduction in the risk of severe outcomes.1 Yet, following a quick-paced uptake in early 2021, COVID-19 immunization rates in many countries slowed down significantly at about 60% of the population during the summer despite the vaccines’ proven benefits (see Fig. B1). In addition, most countries or regions, even those with high vaccination rates, experienced increased viral transmission or had to maintain or re-introduce non-pharmaceutical interventions such as mask-wearing mandates or indoor capacity limits in fall 2021 because of the elevated reproduction rate of the Delta variant.2 A further increase in vaccination coverage therefore remains essential for reducing the health and economic impacts of COVID-19 and allowing the eventual lifting of restrictions. Moreover, the administration of vaccines with updated formulations may be necessary in the face of new variants. Public health authorities around the world have actively sought the most effective strategy to increase vaccine uptake and provide incentives for *vaccine hesitant* or procrastinating people that have had access to immunization but have not taken it up. In response to this challenge, several local or national governments have recently introduced *proof of vaccination* mandates, which allow only vaccinated persons to attend non-essential sports or social activities, events and settings such as concerts, stadiums, museums, restaurants, bars, etc.3 The goal of these policies is two-fold: to provide incentives for immunization and to reduce viral transmission in risky indoor or crowded settings.4 We evaluate and quantify the effect of proof of vaccination mandates on first-dose vaccine uptake in the ten Canadian provinces and three European countries (France, Italy and Germany) that announced and implemented such mandates during July–September, 2021. This is a period without binding vaccine supply constraints and with high base first-dose vaccination rate (above 60% of those eligible in the three countries and above 80% in Canada at the time of the mandate announcements). Hence, we evaluate the mandates’ impact on people, such as the vaccine hesitant, that chose to remain unvaccinated for weeks or months after immunization became available to them. While requiring proof of vaccination is expected to raise vaccine uptake, the magnitude and time profile of the increase are hard to predict: they depend on the relative importance of the factors leading to hesitancy or procrastination, such as a lack of social or economic incentives or entrenched political or religious beliefs. We use first doses as the main outcome in our statistical analysis because they most directly reflect the decision to be immunized.5 The Canadian province-level data is key for our identification strategy as it allows us to use the time variation in mandate announcement dates (from Aug. 5, 2021 in Quebec to Sep. 21, 2021 in Prince Edward Island) across different geographic units in the same country via a difference-in-differences (DID) approach.6 In contrast, the French, Italian or German mandates, or the announced U.S. vaccine mandate for employees, apply at the national level, which makes it more challenging to separate the effect of the mandate from that of time trends or other concurrent events or policies. Fig. 1 plots the weekly vaccine first doses administered in the four most populous Canadian provinces and four European countries. All locations except Spain have a province-wide or country-wide proof of vaccination mandate. We observe a sizable boost in vaccine uptake within two weeks after the mandate *announcement* date (the dashed vertical line) in all four provinces and in France, Italy and Germany, often following a sharp decline in the pre-announcement weeks. In France, daily first-dose appointments data also shows a striking surge on the day after the mandate announcement (see Fig. B2). In contrast, Spain exhibits a steady decrease in weekly first doses over the displayed period. ![Figure 1:](http://medrxiv.org/https://www.medrxiv.org/content/medrxiv/early/2021/12/07/2021.10.21.21265355/F1.medium.gif) [Figure 1:](http://medrxiv.org/content/early/2021/12/07/2021.10.21.21265355/F1) Figure 1: Vaccination mandates and first dose uptake Notes: The figure plots the weekly first doses of COVID-19 vaccines administered for dates *t* − 6 to *t*, where *t* is the date on the horizontal axis. The dashed red lines denote the proof of vaccination mandate announcement dates (for countries, this is the date of a *national* mandate). Spain had not announced a national proof of vaccination mandate as of October 31, 2021. We show the four most populated Canadian provinces totalling about 87% of Canada’s population (see Fig. B4 for all ten provinces). Alberta also had a $100 debit card incentive for doses received between Sep. 3 and Oct. 14, 2021. Motivated by this evidence, we aim to answer two important policy questions. First, what is the magnitude of the increase in the pace of first dose vaccinations after a proof of vaccination mandate announcement? Second, how long do these gains persist and what is the cumulative effect of the mandates on vaccine uptake? Using Canadian province-level data in a difference-in-differences (DID) statistical analysis, we find a quick and significant increase in vaccine uptake, measured by new weekly first doses, following the announcement of a proof of vaccination mandate. In our baseline DID specification, using the period June 15 to Sep. 14, 2021 and splitting the data into five ‘treated’ provinces (those with the earliest announcements) and five ‘control’ provinces (not yet announced), we estimate a 66% (50.6 log points) average increase in weekly first doses following the announcement of a proof of vaccination mandate, relative to in absence of mandate. The increased uptake is sustained over the post-announcement period with available data. We obtain similar results, a more than 60% increase in weekly first doses on average over the post-announcement weeks, when using alternative dates and treatment groups varying from the first three to the first nine provinces to announce a mandate. We complement the DID panel-data results with a structural break and time-series analysis, which allows us to study the mandates’ longer-term impact on vaccine uptake (using our full data set up to October 31, 2021) and to obtain individual policy effect estimates for each province and country. We test for the presence of a structural break at the announcement date and find that we can reject the null hypothesis of no break for all locations. The time-series analysis confirms the rapid and large increase in first-dose uptake after a mandate announcement relative to the no-mandate trend found in the DID analysis. The estimated effect varies across the provinces, from a 34% (29 log points) estimated increase in Ontario to over 300% in Alberta. We note that several factors may contribute to the heterogeneity of the estimates, including the time between the mandate announcement and implementation and the fraction of the population that is already vaccinated at the time of announcement (both are negatively correlated with the size of the estimated initial effect). We find similar results for the countries – an average estimated initial increase in weekly first doses of 17% (15.4 log points) for France, 179% for Italy and 55% for Germany, relative to the respective pre-mandate trends.7 Simulation results using our DID estimates suggest that, as of September 14, 2021, by which date five provinces had announced proof of vaccination mandates, Canada saw about 287,000 additional first dose vaccinations, i.e., around 0.9 percentage points (p.p.) of the eligible age 12+ population, compared to the counterfactual scenario without mandates. In addition, using our time series estimates for each province, we calculate that, as of October 31, 2021, by which date all ten provinces had announced mandates, Canada’s net vaccination gains grew to between 790,000 and 989,000 (2.4 to 3 p.p. of the eligible population), depending on the empirical specification. This is a significant increase in vaccine uptake considering the relatively short time in which it was achieved and the high pre-mandate first dose vaccination rate in Canada. Our simulations also imply large boosts in first-dose vaccinations relative to the no-mandate counterfactual in the three countries: 12.1 p.p. (6.5 mln additional doses) in Italy, 8 p.p. (4.6 mln doses) in France and 4.7 p.p. (3.5 mln doses) in Germany as of October 31, 2021, in our baseline specification. These estimated gains are larger than that for Canada, possibly because of the earlier mandate announcements and implementation in these countries or the lower starting vaccination rates, or they may partly reflect expanding the scope of the initial mandates, e.g., in Italy. Vaccination mandates have been controversial, as some people perceive them as restrictions on personal freedom. This can affect compliance and increase both the direct implementation and enforcement costs, as well as the political costs of introducing a mandate. In this paper, we do not address ethical considerations; our goal is to assess the mandates’ effectiveness purely in terms of raising vaccine uptake, which can then be weighed against various costs or compared to other policies such as financial incentives (cash, gift cards, lotteries) or behavioral nudges (e.g., messages from experts, appointment reminders). Unfortunately, there is little evidence that financial or behavioural nudges increase the vaccination rate among vaccine hesitant people. In particular, Chang et al. (2021) report results from a mid-2021 randomized controlled trial (RCT) with unvaccinated members of a large Medicare health plan in a California county where the vaccination rate at the time of the study was 77%. They examine the effect of $10 and $50 financial incentives, different public health messages, and an appointment scheduler on vaccination intentions and uptake within 30 days of the intervention. The authors find that none of the financial or behavioural treatments increased the vaccination rate among the vaccine hesitant. The proof-of-vaccination mandates we analyze target a similar group of unvaccinated people that have had the opportunity to be vaccinated for a long time. The population-weighted average first-dose vaccination rate on the dates of the provincial mandate announcements is 83.3%, which is even higher than that in Chang et al. (2021), suggesting that financial or behavioural incentives are even less likely to be effective in our setting.8 On behavioral nudges, see also Dai et al. (2021), Alsan and Eichmeyer (2021) and Kluver et al. (2021). On financial incentives, see Barber and West (2021), Brehm et al. (2021), Sehgal (2021), and Walkey et al. (2021) on Ohio’s vaccine lottery, with mixed results. ## 2 Data ### 2.1 Data sources and definitions We use data on COVID-19 vaccination numbers, cases and deaths for all ten Canadian provinces, as well as for France, Italy, Germany and Spain.9 Announcement and implementation dates of the proof of vaccination mandates were collected from the respective government websites and major newspapers (see Table C1). The main variables in our statistical analysis are defined below. Everywhere, *i* denotes province or country and *t* denotes time measured in days (date). We aggregate the data on vaccinations, cases and deaths on a weekly basis (totals for the week ending on date *t*, i.e., dates *t* − 6 to *t*) to reduce the influence of day-of-the-week effects and reporting artifacts.10 #### Outcome, *V**it* Our main outcome variable is the logarithm of administered vaccine *first doses* per 100,000 people, *V**it*, for the week ending at *t* (dates *t* − 6 to *t*). We use first doses as they most directly reflect the impact of proof of vaccination mandates on the intent to be immunized.11 Using the logarithm of weekly first doses allows us to interpret the regression coefficients as percentage changes in the outcome; moreover, the estimates are invariant to normalization, e.g., by population, as its effect is subsumed in the regression constant or fixed effects. We thus use “log weekly first doses” for simplicity throughout the paper, except where the actual scale is important. #### Policy, *P**it* Let ![Graphic][1] be the announcement date of the proof of vaccination mandate in jurisdiction *i*. We construct a binary policy variable *P**it* equal to 1 for all post-announcement dates ![Graphic][2] and equal to 0 for all ![Graphic][3]. Proof of vaccination mandates were announced in all ten Canadian provinces over the period August 5, 2021 to September 21, 2021 (see Table C1 and Fig. B3).12 Several European countries, including France, Italy and Germany, also introduced proof of vaccination mandates in summer 2021 (see Table C1). #### Information, *I**it* We construct variables related to the underlying COVID-19 epidemiological situation, specifically log of weekly cases, *C**it*, and log of weekly deaths, *D**it*, for the week ending at date *t* (dates *t* − 6 to *t*).13 We refer to these variables jointly as *information, I**it*, (see Chernozhukov et al., 2021 or Karaivanov et al., 2021) since they can inform a person’s COVID-19 exposure risk assessment and/or decision to be vaccinated.14 #### Controls, *W**it* We include province fixed effects and date fixed effects in our panel data analysis. The province fixed effects account for any time-invariant province characteristics such as sentiment towards vaccination, age distribution, etc. The date fixed effects control for nation-wide trends or events, e.g., public messaging, vaccine-related international travel regulations, or political campaigning for the September 2021 federal election. In the time-series analysis, we control for time trends. #### Time period We use the period June 15, 2021 to October 31, 2021. The start date is chosen to ensure that possible constraints to obtain a first dose related to eligibility or vaccine supply are minimal or non-existent.15 We explore different sample start dates in robustness checks. The sample end date is based on data availability at the time of statistical analysis and writing. First doses for the 5–11 age group were not approved in this period. ### 2.2 Descriptive analysis Fig. 2 plots the time profile of weekly first doses after a mandate announcement, with first doses in the week ending on the mandate announcement date normalized to 100. The figure only provides a raw-data illustration of the magnitude of the increase in weekly first doses following a mandate announcement. We follow up with formal analysis, controlling for information, fixed effects, pre-trends and other factors, in Sections 3 and 4. ![Figure 2:](http://medrxiv.org/https://www.medrxiv.org/content/medrxiv/early/2021/12/07/2021.10.21.21265355/F2.medium.gif) [Figure 2:](http://medrxiv.org/content/early/2021/12/07/2021.10.21.21265355/F2) Figure 2: First doses after mandate announcement Notes: The figure plots the weekly administered first doses of COVID-19 vaccine for all dates after the mandate announcement against the number of weeks since the respective announcement date (denoted by 0 on the horizontal axis), as of Oct. 31, 2021. The weekly first doses for the week just prior to the mandate announcement are normalized to 100 for each respective province (on the left) or country (on the right). Fig. 2 shows that weekly first doses in the Canadian provinces and in France, Italy and Germany grow quickly after the proof of vaccination mandate announcement, reach a peak at about 1 to 3 weeks after the announcement date and then decrease, as in the pre-announcement trend in most locations (see Fig. B4).16 Several provinces, notably New Brunswick, Newfoundland, Alberta, Nova Scotia and Saskatchewan, as well as France, registered large increases in first-dose vaccine uptake of over 100% relative to the pre-announcement week. In other locations, e.g., Quebec, Ontario, Manitoba and Germany the observed increase is more moderate (under 50%). ## 3 Panel data results – Canadian provinces ### 3.1 Estimation We estimate a behavioral model in which the decision to receive a COVID-19 vaccine (measured by new weekly first doses) is affected by the policy setting, *P**it* (whether a proof of vaccination mandate has been announced) and the current COVID-19 epidemiological and public health conditions, *I**it*, proxied by weekly cases and deaths. Based on the raw data patterns in Fig. 1 and Fig. B4 and the absence of vaccine supply constraints in the studied period, we assume no lag between the mandate announcement and a person’s ability to receive a first vaccine dose.17 Finally, we assume that individuals take into account the weekly public health indicators, *I**it*, for the week ending at date *t*, with no lag. We use a difference-in-differences (DID) method to study the average effect of proof of vaccination mandates in Canada. In addition to information *I**it*, we control for other potential confounding variables or unobserved heterogeneity by including time and location fixed effects. We estimate the following equation: ![Formula][4] where *V**it* is log weekly first doses for location *i* and date *t, I**it* is information, *γ**t* are date fixed effects, *δ**i* are province fixed effects, and *ε**it* is the error term. The coefficient *α* on the policy variable *P**it* captures the average effect of the mandate announcement on weekly first doses over all post-announcement dates. To capture dynamic effects of the mandates, we also estimate a version of equation (1) with *P**it* broken into separate indicator variables, one for each week after the mandate announcement date. To correct for the small number of clusters in the estimation due to there being only ten provinces, we compute and report “wild bootstrap” p-values (Cameron et al., 2008).18 The recent methodological literature has argued that the standard OLS two-way fixed effects (TWFE) estimator can be invalid in panel-data settings with staggered adoption like ours if there is heterogeneity in the treatment effect across groups/cohorts (provinces in this paper) and/or over time. The reason is that the TWFE estimate is a weighted average of many 2-by-2 DID treatment effects, where some of the weights can be negative or incorrect because of contamination from other periods (Goodman-Bacon, 2021).19 In particular, Sun and Abraham (2021) develop an ‘interaction-weighted’ difference-in-differences estimator that is valid under these conditions and which we use to estimate (1). The Sun and Abraham estimator uses never-treated or last-treated units as the control group and is constructed as an appropriately weighted average of treatment effects for each cohort (by date of mandate announcement) and each relative time after or before the announcement.20 The Sun-Abraham estimator requires excluding from the estimation all time periods in which units in the control group are treated. Since the last province to announce a mandate is Prince Edward Island, on September 21, 2021, this means that we can use only data until September 20, at the latest (see Table C1). We present results for different control groups and corresponding sample periods in Table 2. We also compare our baseline results with the OLS TWFE estimates in Table A1. In addition, in Section 4 we report results from time-series analysis using all available data until October 31. ### 3.2 Main results Fig. 3 displays an ‘event study’ analysis of weekly first doses administered in the ten Canadian provinces, from six weeks before to five or more weeks after the announcement of a proof of vaccination mandate. *T* = 0 denotes the week starting at the announcement date. The reference point is one week before the mandate announcement (*T* = –1). We use the Sun and Abraham (2021) treatment effect heterogeneity robust estimator and use as the control group (latest treated) the last five provinces to announce a mandate (Alberta, New Brunswick, Saskatchewan, Newfoundland and Prince Edward Island). We chose this control group as the latest-in-time representative set of provinces, containing a mix of smaller and larger provinces by population. The chosen control group implies September 14, 2021 (the day before mandate announcement in Alberta and New Brunswick, see Table C1) as the (latest possible) sample end date in our baseline specification. We present results with different control groups, corresponding to both earlier and later end dates, in Table 2. ![Figure 3:](http://medrxiv.org/https://www.medrxiv.org/content/medrxiv/early/2021/12/07/2021.10.21.21265355/F3.medium.gif) [Figure 3:](http://medrxiv.org/content/early/2021/12/07/2021.10.21.21265355/F3) Figure 3: Canadian provinces – event study Notes: Sun and Abraham (2021) treatment effect heterogeneity robust estimates. Sample period: June 15 to September 14, 2021 using Alberta, New Brunswick, Saskatchewan, Prince Edward Island and Newfoundland as the control group (latest treated). The outcome variable, *V**it* is log weekly first doses per 100,000 people administered for dates *t* − 6 to *t* inclusive. The figure plots the estimates from a variant of equation (1) where the mandate announcement variable *P**it* is replaced by the interaction of being in the ‘treatment’ group (announced mandate) with a series of dummies for each week ranging from 6 weeks before (*T* = −6) to 5 or more weeks after the announcement (*T* = 5), where *T* = 0 is the week of the announcement. The reference point is one week before the announcement (*T* = –1). The dotted lines correspond to 95% confidence intervals. We make several observations on Fig. 3. First, there is no mandate-associated pre-trend – the Sun-Abraham DID estimates before the mandate announcement are statistically indistinguishable from zero. This addresses the potential endogeneity concern that provinces that announced a mandate may have had a different trend in first-dose vaccinations than provinces that did not announce a mandate. Second, the impact of the mandate announcement on first-dose vaccine uptake is realized relatively quickly. Third, the mandate effect on the pace of first-dose vaccinations is large in magnitude — an increase of 35 log points (42 percent) in weekly first doses in the first post-announcement week and 71% in the second week, each relative to one week before the announcement.21 The observed quick increase in uptake mitigates possible concerns that vaccine supply or scheduling constraints may be affecting our results (see also Fig. 2 for a raw data plot of the post-announcement increase in first-dose vaccinations by province). Fourth, the average policy effect persists over time over the six-week post-announcement period we analyze (*T* = 0 to *T* = 5). Unfortunately, the limitations of the data (the timing of the announcements) and the need for a valid not-yet-treated control group do not allow us to investigate longer horizons. We return to this question in Section 4 using time-series analysis and all available data until October 31. Table 1 shows the Sun-Abraham DID estimates of equation (1) along with p-values from wild bootstrap standard errors clustered by province in the square brackets.22 Columns (1) and (2) (without and with controlling for weekly cases and deaths) show that the mandate announcement is associated with an average increase of about 50.5 log points or 66 percent (p-value< 0.01) in weekly first doses. View this table: [Table 1:](http://medrxiv.org/content/early/2021/12/07/2021.10.21.21265355/T1) Table 1: Canadian provinces – difference-in-differences results In column (3) of Table 1, we report estimates from a variant of equation (1) where the policy variable *P**it* is split into six binary variables, one for each week after the mandate announcement date, to account for dynamic effects. The results indicate a fast increase in weekly first doses of 36 log points (43 percent, *p* < 0.01) in the week beginning at the announcement date (week 0). The increase is sustained until the sample end date, as all coefficients are positive (*p* < 0.02 each week, except for “week 5+”, *p* < 0.1) and indeed larger than in week 0. (We note that the later estimates are based primarily (week 3) or only (week 4) on post-mandate vaccinations in Quebec, the province with the earliest announcement.) Thus, the DID analysis provides no evidence that short-term net intertemporal substitution, which would be manifested as a negative policy estimate for the later weeks, is the mechanism behind the observed boost in vaccinations in the studied period. In Table 2 (for estimates by week after announcement) and the top left panel of Fig. B5 (for the average estimate), we use different sets of provinces as control group, from Prince Edward Island (PEI) only (using data up to Sept. 20), to all provinces except Quebec, British Columbia and Manitoba (using data up to Aug. 31). Column (4) of Table 2 reproduces our baseline estimates from specification (3) in Table 1. We find that our main results from Table 1 remain robust to using alternative control groups. View this table: [Table 2:](http://medrxiv.org/content/early/2021/12/07/2021.10.21.21265355/T2) Table 2: Canadian provinces - different control groups ### 3.3 Robustness analysis #### Alternative initial dates In Fig. B5, top right panel, we show that our estimates of the effect of a mandate announcement on first dose vaccine uptake are not very sensitive to the choice of initial sample date between May 1 and Jul. 15, 2021. This provides further reassurance that vaccine supply constraints are not a major concern for our results. #### Lags In equation (1), we assume no lag between the mandate announcement *P**it* and a person’s ability to receive the first dose (the outcome *V**it*). In practice, a few days of delay may occur (e.g., from making an appointment to receiving the vaccine) even in the absence of supply constraints. The bottom left panel of Fig. B5 displays the coefficient estimates ![Graphic][5] of the policy effect when assuming a lag of zero (our baseline) to seven days. The mandate effect estimates remain large and statistically significant when varying the lag length, with a slight decrease for the longer lags. The bottom right panel of Fig. B5 shows that the R-squared value is the highest when the lag is zero, supporting our choice of baseline specification.23 #### Other robustness checks We perform several additional robustness checks in Table A1. For easier comparison, column (1) replicates the baseline estimates from columns (2) and (3) of Table 1. Column (2) of Table A1 does not include cases and deaths, whose coefficients are not significant in the baseline specification. In column (3), we control for log weekly deaths and log average weekly hospitalizations as information. Column (4) reports the estimates of a weighted specification using the provincial populations as weights and the baseline set of information variables (cases and deaths). The estimates are smaller than in the unweighted baseline (column 1), suggesting that smaller provinces contribute more to the the estimated effect of mandate announcements on vaccine uptake. In column (5), we re-estimate equation (1) using the standard OLS two-way fixed effects (TWFE) estimator which, as discussed in Section 3.1, can be biased in the presence of heterogeneous treatment effects over cohorts and/or time. In our setting, we find that these estimates differ relatively little from our baseline Sun-Abraham treatment effect heterogeneity robust estimates. In Table A1 column (6), we use log of daily (instead of weekly) first doses as the outcome and log of daily cases and deaths as information and find similar estimates to those in our baseline specification, although larger in week 0 since the outcome is not a moving sum. In column (7), we use the *level* of weekly first doses per 100,000 people as the outcome. The estimates are noisier than in the baseline and indicate that a mandate announcement increases weekly first dose uptake by roughly 482 per 100,000 people on average (*p* < 0.06), and up to 754 per 100,000 (*p* < 0.07) in week 4 after the announcement. Overall, all these alternative specifications confirm the robustness of our main finding of statistically significant and large impact of mandate announcements on vaccine uptake. #### Randomization inference Difference-in-differences inference from the model in equation (1) relies on asymptotic approximations requiring a sufficiently large number of provinces. While we do account for the fact that there are only 10 provinces in our sample by using wild bootstrap to compute the estimates’ p-values, as an additional robustness check, we implement a variant of Fisher’s randomization test (Fisher, 1935). Specifically, we estimate equation (1) 5,000 times by randomly assigning the mandate announcement date for each of the ‘treated’ provinces in our baseline specification. Fig. B6 plots the histogram of the randomized inference (placebo) mandate effect estimates, along with the 95% confidence band. The figure shows that only 2.88% of the 5,000 placebo estimates are larger than our baseline estimate (0.506) from column (2) of Table 1 (the solid vertical line on Fig. B6), offering assurance that our main result does not hinge on asymptotic inference approximations. ### 3.4 Second doses In Table A3, we estimate the specifications in Table 1 using log of weekly *second doses* as the outcome. There are two potential mechanisms through which proof of vaccination mandates may have an impact on second dose uptake: (i) people that already had a first dose decide to receive their second dose soon after the announcement or implementation (e.g., because most mandates require full vaccination) and (ii) people that took a first dose because of the mandate take their second dose roughly 4 weeks after the first. We do not find a statistically significant effect of mandate announcements on second dose uptake in our sample period. This is consistent with second doses being more spread out after the announcement. We also plot weekly second doses over time on Fig. B7 and, unlike the sharp increases for first doses, we only see relatively small and gradual second-dose increases after the mandate announcements in some of the (smaller) provinces. ### 3.5 Mandate implementation Our main results use the regional variation in the timing of announcement of proof of vaccination mandates to examine their effect on vaccine uptake. In addition, there is variation in the interval between the mandates’ announcement and *implementation* (coming into force), as well as in the implementation dates themselves – see Table C1 and Fig. B4.24 We checked whether we can detect additional effects on first-dose uptake, associated with the mandates’ implementation, by adding to equation (1) an indicator variable that equals to 1 post-implementation and 0 otherwise. The estimate on this indicator variable is positive but not statistically significantly different from zero (not displayed). However, we cannot conclude that there do not exist implementation effects, since even the latest feasible sample end date (Sep. 20, 2021) necessitated by the requirement to have a not yet treated control group is only soon after the mandate implementation date in 3 of the 10 provinces (see Table C1). ## 4 Time series analysis ### 4.1 Estimation We complement and extend our panel data analysis for Canada by time-series analysis for each of the ten Canadian provinces, as well as for France, Italy and Germany. While the Sun and Abraham (2021) difference-in-differences approach in Section 3 allows us to reliably estimate the impact of mandate announcements on new first doses in Canada by exploiting the variation in the timing of the mandates across provinces, it can only be used with data from before the last treatment date and hence it does not allow us to evaluate the effect of the mandates beyond the short term. In contrast, at the cost of stronger identification assumptions, the time-series approach allows us to use all our data until October 31, 2021 to estimate the mandates’ effect on vaccine uptake and the cumulative additional vaccinations compared to the counterfactual of no mandate separately for each province and country. We use the *interrupted time-series analysis* (ITSA) framework (e.g., Linden, 2015) and estimate the following equation for each country or province25 ![Formula][6] where *V**t* are log weekly first doses for the week ending at date *t, c* is a constant, *I**t* is proxy for information analogous to its counterpart in equation (1), and *η**t* is the error term. In our baseline time-series specification, we construct the policy variable *P**t* as the weekly average from date *t* − 6 to *t* of the ‘mandate announced’ indicator *P**it* defined in Section 2.1.26 We include 7-day and 14-day lagged values of *V**t* (instead of *t* − 1 or *t* − 2 autoregressive terms) since the outcome variable *V**t* is a weekly total. We include two time trends in equation (2): *T**t* is a linear daily time trend initialized at the sample start date *t* = 0 and ![Graphic][7] is an ‘interaction’ time trend which takes value 0 at all dates until the announcement date (inclusive) and increases by 1 for each day afterwards. The coefficients *τ*1 (slope) and *τ*2 (change in slope at the announcement date) characterize respectively the baseline (pre-announcement) time trend and the post-announcement time trend (with slope *τ*1 + *τ*2) in weekly first doses. The time-series estimation approach requires stronger identifying assumptions than the DID approach since there is no control group. Specifically, we need to assume that the time-series process of weekly first doses changed after the mandate announcement only because of the policy, i.e., that it would have followed the same pre-trend if no mandate had been announced. Another needed assumption is exogeneity of the announcement date. We also cannot control for fixed effects in a flexible way beyond including a constant and time trends. Under these assumptions, the coefficient on the policy variable *P**t* captures the average level shift in first-dose uptake attributed to the mandate announcement. Similarly, the coefficient on the interaction time trend ![Graphic][8] measures the slope change in the time trend of first doses after the mandate announcement, relative to the pre-announcement trend. ### 4.2 Structural break at the announcement date We first show the impact of the proof of vaccination mandate announcements on first dose uptake in Table A4, where we perform a structural break test (Chow (1960) test for a known break point) for the log weekly first doses, *V**t*. The presence of a break point in *V**t* at the mandate announcement date indicates an abrupt change (shift) in the first-dose time series process. We use a bandwidth of 50 days before and 35 days after the mandate announcement date.27 The before-after bandwidth was chosen to reduce the size distortion of the test since the outcome variable is a weekly sum and the error terms are serially correlated.28 Columns (1) and (2) in Table A4 use the log of weekly first doses, *V**t*. For all ten Canadian provinces and all three countries, we strongly reject the null hypothesis that the mandate announcement date is not a structural break (*p* < 0.01). We also perform the structural break test using first-differenced weekly first doses in Table A4 column (3). The differenced series is stationary, and the error terms are not serially correlated, which alleviates concerns about size distortion in the Chow test. The null hypothesis of no structural break at the announcement date is rejected with *p* < 0.05 in most locations except Saskatchewan and three Atlantic provinces.29 Overall, the structural break test results suggest that a mandate announcement is strongly associated with a trend break in first-dose vaccine uptake in all or most locations depending on the specification. ### 4.3 Results In Table 3, we report the results from estimating the time-series model (2) for each country and province in our data.30 We include log weekly cases and deaths as information, *I**t*. In columns (1)-(3), we report the estimated coefficients on the mandate announcement variable, *P**t*, the time trend, *T**t*, and the interaction time trend, ![Graphic][9] in equation (2). Since the outcome and information variables are level variables that can introduce non-stationarity, we use the augmented Dickey-Fuller (ADF) unit root test to test whether the residuals *η**t* are stationary, to avoid a spurious regression.31 We reject the null hypothesis that the residual contains a unit root at the 95% confidence level for all locations except Newfoundland, where we can reject the null at the 90% level. View this table: [Table 3:](http://medrxiv.org/content/early/2021/12/07/2021.10.21.21265355/T3) Table 3: Time series estimates The coefficient estimates ![Graphic][10] on the mandate announcement variable *P**t* in Table 3 are statistically significantly positive (*p* < 0.01) and large for all three countries. Italy has the largest estimated boost to weekly first doses after the mandate announcement (102.5 log points or 179% increase relative to the pre-announcement trend), followed by Germany (55% increase) and France (17% increase).32 The baseline time trend is downward sloping ![Graphic][11] in all countries and indicates a steep decrease in vaccinations of 1.7% to 2.9% per day. The post-announcement trend in first doses turns less steep in all three countries (the post-announcement slope change estimate ![Graphic][12] is positive, although only statistically significant for Germany), which suggests a lack of net intertemporal substitution as of October 31. Turning to the Canadian provinces, in our baseline specification in Table 3, we obtain statistically significantly positive and large estimates ![Graphic][13] of the increase in weekly first doses after mandate announcement for all provinces except for Quebec.33 The statistically significant policy estimates range from 0.293 in Ontario (equivalent to a 34% increase in first doses relative to the pre-announcement trend) to 1.455 in Alberta (a 328% increase). This range of estimates is consistent with our DID estimate in Table 1 for the average policy effect for Canada, although the two estimation methods are not directly comparable. The estimated effect of the mandate announcement tends to be larger for provinces experiencing a surge in cases at the same time (for which we control in *I**t*), namely Alberta, Saskatchewan and New Brunswick. These provinces also announced their mandates relatively late (mid-September) and set a relatively short time interval between mandate announcement and implementation (see Table C1). A larger fraction of eligible unvaccinated people at the time of mandate announcement is also positively associated with a larger policy effect estimate. We illustrate these associations in Fig. B8. As in the results for the countries, the estimates of the baseline time trend in first doses, *τ*1, are negative for all ten provinces (although not statistically significant in the two smallest provinces, Newfoundland and Prince Edward Island). The estimates ![Graphic][14] of the post-announcement change in slope of the time trend are large and statistically significantly negative for Alberta, New Brunswick, Saskatchewan, and PEI (British Columbia’s estimate is also negative but not statistically significant). This result is consistent with the mandate effect on new first doses diminishing over time in these provinces.34 In Table A5, we also present results from two alternative specifications of equation (2): using log weekly deaths and log average weekly hospitalizations as information, in columns (1) and (2), and using a binary (instead of weekly-averaged) policy variable *P**t*. We obtain results that are very similar to our baseline findings in Table 3 and confirm the positive and large estimated effect of mandate announcements on first dose vaccine uptake.35 ## 5 Counterfactual analysis We use the difference-in-differences estimate ![Graphic][15] of the average effect of mandate announcements on weekly first doses from Table 1 to evaluate the counterfactual of no proof of vaccination mandates in any Canadian province. Define the counterfactual log weekly first doses ![Graphic][16] per 100,000 people in province *i* for the week ending at date *t* as ![Formula][17] where ![Graphic][18] is the fitted value of log weekly first doses for the week ending at *t* in equation (1), and ![Graphic][19] is the DID estimate on the policy variable *P**it* (i.e., 0.506 in Table 1, column (2)). Averaging across the provinces *i*, we obtain ![Graphic][20] as the estimated counterfactual log weekly first doses per 100,000 people in Canada in the absence of mandates. We also use the time-series location-specific estimates of the mandate effect from Section 4 and Table 3 to construct no-mandate counterfactual weekly vaccine doses separately for each province and for France, Italy and Germany. Accounting for the lagged terms in (2), define the counterfactual log weekly doses per 100,000 people, ![Graphic][21] as ![Formula][22] where ![Graphic][23] is the mandate announcement date, ![Graphic][24] is the fitted value of log weekly first doses for the week ending at *t* in regression equation (2), ![Graphic][25] is the coefficient estimate of the mandate announcement variable *P**t* from column (1) of Table 3, ![Graphic][26] is the estimate of the interaction time trend ![Graphic][27] from column (2) of Table 3, and ![Graphic][28] and ![Graphic][29] are the coefficient estimates on the lagged terms *V**t*−7 and *V**t*−14 in equation (2) (not displayed). The policy effect estimate ![Graphic][30], as well as ![Graphic][31] and ![Graphic][32] are specific for each respective country or province. ### 5.1 DID counterfactual – Canada In Fig. 4, we start from the actual total doses on the day before the mandate announcement and add up forward in time using the weekly counterfactual doses ![Graphic][33] defined in equation (3).36 We then compare the counterfactual total doses (the dotted red line on Fig. 4) with the actually observed total doses (the black diamonds). ![Figure 4:](http://medrxiv.org/https://www.medrxiv.org/content/medrxiv/early/2021/12/07/2021.10.21.21265355/F4.medium.gif) [Figure 4:](http://medrxiv.org/content/early/2021/12/07/2021.10.21.21265355/F4) Figure 4: Canada – observed vs. no-mandate counterfactual first doses as of Sep. 14, 2021 Notes: The figure plots the observed (black diamonds) and the expected no-mandate counterfactual (dotted red line) cumulative first doses (in millions) by date. The counterfactual uses the *P**it* coefficient estimate from column (2) of Table 1. The number in the caption indicates the percentage point increase in first doses relative to the no-mandate counterfactual as of September 14, 2021. We estimate that, as of September 14, 2021, the sample end date in Table 1, the proof-of-vaccination mandates in the five Canadian provinces that announced mandates by that date have led to 287,000 additional first doses, or an increase in new first-dose vaccinations of 0.9 p.p. of the eligible population relative to the no-mandate counterfactual. This number equals approximately 4.4 percent of all unvaccinated eligible people of age 12 or older at the time of the first proof-of-vaccination mandate announcement in Canada (August 5, 2021 in Quebec). This is a sizable increase in vaccine uptake from a very high base rate (above 80% with first dose) achieved in a short time (less than 6 weeks) among vaccine hesitant people. ### 5.2 Time series counterfactuals #### 5.2.1 Canadian provinces We next use the time-series estimates in Table 3 to compute counterfactual weekly doses, ![Graphic][34], as defined in (4), and counterfactual total first doses for each province. The results are displayed in Fig. 5.37 The left vertical axis displays total first doses in millions. The right axis displays the total doses in terms of the percentage of eligible people (age 12 and above; see Table C3). The number next to the province name is the estimated percentage-point (p.p.) increase in first doses relative to the no-mandate counterfactual, as of October 31, 2021. In Table A6, we display the gains in thousands of doses, along with estimated gains from alternative specifications. ![Figure 5:](http://medrxiv.org/https://www.medrxiv.org/content/medrxiv/early/2021/12/07/2021.10.21.21265355/F5.medium.gif) [Figure 5:](http://medrxiv.org/content/early/2021/12/07/2021.10.21.21265355/F5) Figure 5: Canadian provinces – observed vs. no-mandate counterfactual first doses as of October 31, 2021 (time-series estimates) Notes: The figure plots the observed (black diamonds) and the expected no-mandate counterfactual (dotted red lines) cumulative first doses by date and province. The shaded areas denote 5-95 percent confidence bands. The vertical dashed line denotes the mandate announcement date. The counterfactuals are computed using the estimates in Table 3. The number next to each province name indicates the percentage point increase in first doses relative to the no-mandate counterfactual, as of Oct. 31, 2021. Fig. 5 shows a relatively quick divergence and sizable gap between the observed and counterfactual cumulative first-dose numbers. The largest absolute gains in new vaccinations (left axis of Fig. 5 and column (1) in Table A6) are naturally in the four largest provinces (Ontario, Quebec, Alberta and British Columbia). As a proportion of the eligible population (right axis), however, we estimate the largest mandate impacts on vaccine uptake to be in Saskatchewan and New Brunswick (5 p.p.), followed by Alberta (4.3 p.p.) and Nova Scotia (4.2 p.p.). These gains occurred within 6 to 10 weeks of the mandate announcement for most provinces (13 for Quebec) and are on top of a high base vaccination rate (see Table C3). For example, Saskatchewan’s 5 p.p. estimated gain amounts to about one quarter of all unvaccinated eligible people on the mandate announcement date (Sep. 16, 2021). We do not find evidence of significant net intertemporal substitution (decrease in the cumulative first-dose gains due to pulling vaccinations forward in time) as of October 31, 2021, except in PEI. However, the strongly negative *τ*2 estimates in Table 3 column (3) and the trends in Fig. B9 indicate that Alberta, New Brunswick and Saskatchewan are projected to exhibit net intertemporal substitution soon after the end of October 2021. That said, given the flattening of the counterfactual curves, cumulative gains are likely to remain significant. #### 5.2.2 Countries We also use our time-series estimates in Table 3 to estimate the gains in first dose uptake for France, Italy and Germany, relative to the counterfactual assuming the absence of a proof of vaccination mandate. The results are displayed in Fig. 6 and Table A6. The estimated increases in first-dose uptake after the mandate announcements are large in all three countries: 12.1 p.p. (6.54 mln additional first doses) in Italy, 8 p.p. (4.60 mln doses) in France, and 4.7 p.p. (3.46 mln doses) in Germany. The larger estimated effect in Italy could be partly attributed to the complementary vaccination requirements for inter-regional travel and for employment introduced in September and October. ![Figure 6:](http://medrxiv.org/https://www.medrxiv.org/content/medrxiv/early/2021/12/07/2021.10.21.21265355/F6.medium.gif) [Figure 6:](http://medrxiv.org/content/early/2021/12/07/2021.10.21.21265355/F6) Figure 6: Countries – observed vs. no-mandate counterfactual first doses Notes: The figure plots the observed (black diamonds) and the expected counterfactual (dotted red line) cumulative first doses for each country by date. The shaded areas denote 5–95 percent confidence bands. The vertical dashed line denotes the mandate announcement date. The counterfactuals are computed using the estimates from Table 3. The number next to each country name indicates the percentage point increase in first doses relative to the no-mandate counterfactual, as of October 31, 2021. All counterfactual simulations assume that all explanatory variables except the mandate announcement (e.g., deaths or time fixed effects) would remain fixed at their observed values, and that the estimated model coefficients remain stable. This is a strong assumption that is more plausible over relatively short periods. These results should therefore be interpreted with caution and as an illustration of the estimated impact of the proof of vaccination mandates on vaccine uptake. ## 6 Discussion and conclusions We evaluate the impact of government-mandated proof of vaccination requirements on COVID-19 vaccine uptake. Using difference-in-differences analysis and the variation of timing of mandate announcements across the Canadian provinces, we estimate a statistically significant and large (about 66% on average) increase in weekly first-dose vaccine uptake in Canada over the first weeks after the announcement of a proof of vaccination mandate, relative to in absence of mandate. We obtain similar results from time-series analysis for each Canadian province and for France, Italy and Germany — a sizable rise in new first-dose vaccinations after a mandate announcement relative to the pre-announcement trend. The estimated mandate announcement effect varies across the Canadian provinces, with the provinces exhibiting a larger initial gain tending to drop back toward the baseline pace of vaccination more quickly. Using simulations based on our time-series results, we estimate that, as of October 31, 2021, all the provinces and all three countries achieved large net increases in the first-dose vaccination rate relative to the hypothetical scenario of absence of proof of vaccination mandate (2.4 to 3 percentage points (p.p.) of the vaccine-eligible population for Canada as a whole, 8 p.p. for France, 12.1 p.p. for Italy and 4.7 p.p. for Germany). These time-series estimates may include effects from complementary measures (e.g., vaccination requirements for health workers or for inter-regional travel, etc.) adopted after the original proof of vaccination mandates, particularly in the European countries. In terms of external validity, in June 2020, Lazarus et al. (2021) conducted a survey on vaccine hesitancy across 19 countries comprising around 55% of the world population.38 Canada, Italy and Germany placed around the middle in self-reported vaccine hesitancy rate (29% to 31%), while France had a higher hesitancy rate (41%). In this regard, our results on the large impact of proof of vaccination mandates on first-dose uptake in these four countries can be useful to public health authorities in other countries looking for an effective strategy to increase vaccine uptake. Our objective is not to engage in normative or ethical debates related to vaccination mandates (e.g., Gostin, 2021), but to provide a benchmark range of estimates for their effectiveness in terms of new first dose uptake, which can be compared to other approaches such as monetary incentives or behavioural nudges. Monetary incentives for vaccination have been criticized by many for the ‘optics’ of putting a (low) dollar value on being vaccinated,39 because of the perceived unfairness in “rewarding” people who delayed their vaccination, or, if payments are unavailable to those that were vaccinated earlier, because of potential moral hazard problems (e.g., expecting future payments). Related to this, Chang et al. (2021) find that financial incentives may even have the perverse effect of validating vaccine concerns among unvaccinated individuals aged 40 or above and those that supported Donald Trump in the 2020 U.S. presidential election (see also Hsieh, 2021). Others have argued that, given the already high vaccination rates in developed countries, behavioural nudges may not be very effective (Thaler, 2021), which is consistent with the findings of Chang et al. (2021) and Campos-Mercade et al. (2021). Naturally, a full cost-benefit analysis of proof of vaccination mandates is beyond the scope of this paper. In particular, the costs of imposing and enforcing the mandates – economic, political, or personal – are very hard to estimate, as is the social value of vaccinating an additional person.40 Our results are a first step toward quantifying the benefits of proof of vaccination requirements. ## Data Availability All data used in this manuscript is based on information available in public domain. Data sources and links are provided within the manuscript. ## Author contributions A.K., D.K., S.L. and H.S. contributed equally to the conceptualization, writing and statistical analysis. ## Competing interests All authors declare no competing financial or other interest in the presented research. ## Data availability All data sources are described in Appendix C. The data used in the study are available at: [https://github.com/C19-SFU-Econ/dataV](https://github.com/C19-SFU-Econ/dataV). ## Acknowledgements We thank Serena Canaan, Hiro Kasahara and Pierre Mouganie for helpful suggestions. ## Appendix A. Additional Tables View this table: [Table A1:](http://medrxiv.org/content/early/2021/12/07/2021.10.21.21265355/T4) Table A1: Robustness View this table: [Table A2:](http://medrxiv.org/content/early/2021/12/07/2021.10.21.21265355/T5) Table A2: Robustness – standard errors View this table: [Table A3:](http://medrxiv.org/content/early/2021/12/07/2021.10.21.21265355/T6) Table A3: Second doses View this table: [Table A4:](http://medrxiv.org/content/early/2021/12/07/2021.10.21.21265355/T7) Table A4: Test for structural break at the mandate announcement date View this table: [Table A5:](http://medrxiv.org/content/early/2021/12/07/2021.10.21.21265355/T8) Table A5: Time series estimates – alternative specifications View this table: [Table A6:](http://medrxiv.org/content/early/2021/12/07/2021.10.21.21265355/T9) Table A6: Counterfactuals – estimated additional first doses relative to no mandate ## Appendix B. Additional Figures ![Figure B1:](http://medrxiv.org/https://www.medrxiv.org/content/medrxiv/early/2021/12/07/2021.10.21.21265355/F7.medium.gif) [Figure B1:](http://medrxiv.org/content/early/2021/12/07/2021.10.21.21265355/F7) Figure B1: Share of people with at least one dose – example countries Notes: The Figure plots the share of the population who have received at least one dose of a COVID-19 vaccine in selected countries. Source: [Our World in Data](https://ourworldindata.org/). ![Figure B2:](http://medrxiv.org/https://www.medrxiv.org/content/medrxiv/early/2021/12/07/2021.10.21.21265355/F8.medium.gif) [Figure B2:](http://medrxiv.org/content/early/2021/12/07/2021.10.21.21265355/F8) Figure B2: France – first-dose vaccination appointments Notes: The figure plots the daily first-dose vaccination appointments by date made on Doctolib, a booking website accounting for about 2/3 of cumulative COVID-19 vaccinations in France as of Q4 2021. Source: [doctolib.fr](https://about.doctolib.fr/vaccination/statistiques.html). The dashed red line denotes the mandate announcement date, July 12, 2021. ![Figure B3:](http://medrxiv.org/https://www.medrxiv.org/content/medrxiv/early/2021/12/07/2021.10.21.21265355/F9.medium.gif) [Figure B3:](http://medrxiv.org/content/early/2021/12/07/2021.10.21.21265355/F9) Figure B3: Canada – proof of vaccination mandates over time Notes: The figure plots the cumulative fraction of provinces and the cumulative fraction of Canada’s population for which a proof of vaccination mandate has been announced. See Table C1 for the exact dates of mandate announcement in each province. ![Figure B4:](http://medrxiv.org/https://www.medrxiv.org/content/medrxiv/early/2021/12/07/2021.10.21.21265355/F10.medium.gif) [Figure B4:](http://medrxiv.org/content/early/2021/12/07/2021.10.21.21265355/F10) Figure B4: Canadian provinces – first doses per 100,000 people Notes: The figure plots the weekly administered COVID-19 vaccine first doses per 100,000 people for dates *t* − 6 to *t*, where *t* is the date on the horizontal axis. The dashed red lines denote the proof of vaccination mandate announcement date for each province. The dotted blue lines denote the mandate implementation (enforcement) date for each province (see Table C1). ![Figure B5:](http://medrxiv.org/https://www.medrxiv.org/content/medrxiv/early/2021/12/07/2021.10.21.21265355/F11.medium.gif) [Figure B5:](http://medrxiv.org/content/early/2021/12/07/2021.10.21.21265355/F11) Figure B5: Robustness Notes: The top left panel shows the estimates ![Graphic][35] for the mandate announcement policy variable *P**it* in equation (1) with different sample end dates and corresponding control groups, relative to the baseline (Sep. 14, in bold). The top right panel shows the coefficient estimate for *P**it* with different initial sample dates (May 1 to July 15, 2021) relative to the baseline (June 15, 2021, in bold). The bottom left panel shows the estimates from a variant of equation (1) when using no lag in the announcement *P**it* (in bold, our baseline) and when using lags of up to 7 days, i.e., using *P**it*−*k* for *k* = 1, 2, …, 7. The bottom right panel displays the adjusted R-squared values corresponding to the different lags. ![Figure B6:](http://medrxiv.org/https://www.medrxiv.org/content/medrxiv/early/2021/12/07/2021.10.21.21265355/F12.medium.gif) [Figure B6:](http://medrxiv.org/content/early/2021/12/07/2021.10.21.21265355/F12) Figure B6: Random assignment of announcement dates Notes: We estimate equation (1) 5,000 times using the Sun and Abraham (2021) treatment effect heterogeneity robust estimator after randomly assigning the date of mandate announcement for each province which has announced a mandate by Sep. 14. The figure plots the histogram of these placebo inference estimates, along with the 2.5-th and 97.5-th percentiles (dashed lines). The solid vertical red line corresponds to the baseline estimate from column (2) in Table 1. ![Figure B7:](http://medrxiv.org/https://www.medrxiv.org/content/medrxiv/early/2021/12/07/2021.10.21.21265355/F13.medium.gif) [Figure B7:](http://medrxiv.org/content/early/2021/12/07/2021.10.21.21265355/F13) Figure B7: Canadian provinces - second doses per 100,000 people Notes: The figure plots the weekly administered COVID-19 vaccine *second* doses per 100,000 people for dates *t* − 6 to *t*, where *t* is the date on the horizontal axis. The dashed red lines denote the vaccination proof mandate announcement date for each province. The dotted blue lines denote the mandate implementation (enforcement) date for each province (see Table C1). ![Figure B8:](http://medrxiv.org/https://www.medrxiv.org/content/medrxiv/early/2021/12/07/2021.10.21.21265355/F14.medium.gif) [Figure B8:](http://medrxiv.org/content/early/2021/12/07/2021.10.21.21265355/F14) Figure B8: Time-series policy estimates – correlations Notes: The figure plots the time-series policy estimates, ![Graphic][36] from Table 3 column (1) against the number of days between mandate announcement and implementation (left) and the percent remaining unvaccinated eligible people at the announcement date (right). The figure is for illustration; no causal claims are made. ![Figure B9:](http://medrxiv.org/https://www.medrxiv.org/content/medrxiv/early/2021/12/07/2021.10.21.21265355/F15.medium.gif) [Figure B9:](http://medrxiv.org/content/early/2021/12/07/2021.10.21.21265355/F15) Figure B9: Canadian provinces - observed vs. no-mandate counterfactual weekly first doses as of October 31, 2021 (time-series estimates) Notes: The figure plots the observed (black diamonds) and the expected no-mandate counterfactual (dashed red lines) log weekly first doses per 100,000 people. We use the estimates from Table 3 to compute the counterfactuals, as specified in (4). The dashed blue vertical lines denote the mandate announcement date for each province. ## Appendix C. Supplementary Information View this table: [Table C1:](http://medrxiv.org/content/early/2021/12/07/2021.10.21.21265355/T10) Table C1: Proof of vaccination mandate announcement and implementation dates View this table: [Table C2:](http://medrxiv.org/content/early/2021/12/07/2021.10.21.21265355/T11) Table C2: Canada – age 12+ eligibility dates for first vaccine dose View this table: [Table C3:](http://medrxiv.org/content/early/2021/12/07/2021.10.21.21265355/T12) Table C3: Vaccine eligible population (age 12 or older) View this table: [Table C4:](http://medrxiv.org/content/early/2021/12/07/2021.10.21.21265355/T13) Table C4: Data sources View this table: [Table C5:](http://medrxiv.org/content/early/2021/12/07/2021.10.21.21265355/T14) Table C5: Proof of vaccination mandates scope ## Footnotes * Major revision incorporating additional data and methodological improvements. * 1 See, e.g., Scobie et al. (2021), Grannis et al. (2021), Andrews et al. (2021) and Gupta et al. (2021). * 2 For example, by early August, all four of Canada’s Western provinces had removed their mask-wearing mandates for public indoor spaces. By mid-September, all re-imposed a mask mandate, either preemptively or after a COVID surge. The largest provinces Ontario and Quebec did not remove their mask mandates. * 3 While such mandates are sometimes colloquially called “vaccine passports”, we deliberately avoid this politicized term. Some mandates accept a recent negative test or past positive test as a substitute of vaccination or allow businesses to opt out if they abide by additional restrictions (e.g., in Alberta). * 4 Several countries have also announced or implemented vaccination mandates *for employees* (USA for all firms with more than 100 employees, Italy for all employees, Canada for all federal employees), and a broader mandate is under consideration in Austria. We do not analyze these alternative mandates. * 5 To avoid potential bias from constrained vaccine supply affecting the pre- or post-mandate pace of vaccination, we use only data after June 15, 2021, when it is safe to assume that any age-eligible person (12 or older in Canada) was able to receive a first dose of COVID-19 vaccine with minimal delay; see Table C2. * 6 In Canada, the provinces are separate public health jurisdictions with extensive powers over health policy while the vaccines are procured by the federal government and allocated to the provinces in proportion to their population. All COVID-19 vaccines used in Canada during the study period, namely BNT162b2 (Pfizer /BioNTech Comirnaty), mRNA-1273 (Moderna SpikeVax) and AZD1222 (Oxford–AstraZeneca Vaxzevria), were initially considered to be two-dose vaccines. * 7 A comparison of Fig. 1 and Fig. B2 suggests that the relatively low French estimate for the initial policy effect may reflect a lag between appointment booking and vaccine administration. * 8 In an RCT study in Sweden, Campos-Mercade et al. (2021) find that a modest payment of SEK 200 (USD 24) was associated with a 4.2 p.p. increase in vaccinations, relative to a baseline rate of 71.6% in the control group, while none of three behavioral nudges had impact. However, the RCT subjects were *yet to become eligible* to be vaccinated, and hence their setting is not comparable to ours, where weeks have elapsed after widespread vaccine availability. * 9 See Table C4 for the data sources and details. We collected the Canadian data from the official provincial dashboards or equivalent sources. We use the [Our World In Data](https://github.com/owid/covid-19-data/tree/master/public/data) dataset for the country data. * 10 Some locations, e.g., British Columbia and Nova Scotia, do not report vaccination data on weekends and then report the total for several days at once (e.g., Monday’s number contains 3 days of data). In these cases, we spread the reported total equally over the affected days. * 11 In Table A3, we also report results using second doses as the outcome. We find no statistically significant effect on second-dose uptake following the announcement of mandate. * 12 We use Sep. 17, 2021 as the mandate announcement date for Newfoundland and Labrador, the date on which the premier (provincial head of government) announced the upcoming mandate. The mandate details were officially unveiled on Oct. 7 after consultations with the business and other sectors. However, using the latter date would be problematic because of a potentially strong anticipation effect following the first announcement. Our main results in Table 1 and Fig. 3 are not affected by this choice. Throughout this paper, “Newfoundland” refers to the province of Newfoundland and Labrador. * 13 Another possible information variable is hospitalizations. However, it is very strongly correlated with the COVID-19 cases and deaths. To avoid multicollinearity, we do not include it in our baseline specification. See Table A1 for results using deaths and hospitalizations as information instead of deaths and cases. * 14 To tackle zero weekly values, which sometimes occur in the smaller provinces for deaths or cases (4.4% of all observations for cases and 10.7% for deaths), we replace log(0) with −1 as in Chernozhukov et al. (2021). * 15 In Canada, the provinces opened registration for first-dose vaccination for any person of age 12+ between May 10, 2021 in Alberta and May 27, 2021 in Nova Scotia, see Table C2. First-dose availability in France, Italy and Germany was similar by mid-June, at least for the 18+ age group. * 16 British Columbia, Ontario, Nova Scotia, Saskatchewan and Newfoundland exhibit a second peak later. * 17 For our main model (difference-in-differences), we perform sensitivity analysis using alternative lags of up to 7 days (see Section 3.3 and Fig. B5); the results affirm our baseline choice of zero lag. * 18 We use the Stata function *boottest* (see Roodman et al., 2019) clustered by province with 4,999 repetitions. Alternative ways of computing the standard errors are displayed in Table A2. * 19 See also Athey and Imbens (2018), de Chaisemartin and D’Haultfoeuille (2018), Callaway and Sant’Anna (2021) and Sun and Abraham (2021). * 20 We use the Stata function *eventstudyinteract* provided by the authors.. * 21 A coefficient estimate *x* is equivalent to 100*x* log points or a 100(*e**x* − 1) percent increase in weekly doses. The smaller *T* = 0 estimate reflects the fact that the outcome variable is a backward-looking weekly sum. * 22 Table A2 also reports alternative standard error specifications: regular clustering at the province level (Stata command “cluster”), wild bootstrap standard errors clustered at the province level and wild bootstrap standard errors two-way clustered by province and date (Stata command “boottest”). * 23 See Hsiang et al. (2020) for a similar lag determination approach. We also checked a specification in which we lag the information variables *I**it* (log weekly cases and deaths) with the same lag as the policy *P**it*, and the results are nearly identical. * 24 The mandates were implemented in all provinces between Sep. 3 and Oct. 22, 2021. * 25 We omit the subscripts *i* for simplicity since all variables refer to the same location. * 26 Using a weekly average of the policy indicator is consistent with the weekly vaccination and information variables *V**t* and *I**t* and improves the fit in the time-series regressions. We also present results without weekly averaging in Tables A5 and A6. * 27 The results are also robust to picking June 15, 2021 as the initial date for the test. * 28 As shown in Giles and Scott (1992), the size of the Chow test is distorted upward (over-rejection of the null) in the presence of positive serial correlation in the error terms. The size distortion is mitigated if the sample split is unequal before vs. after the break point. * 29 The power of the Chow test is weaker in this specification since the first-differenced *V**t* series is a growth rate being used to test for a level shift. The differenced series is also noisier as it captures daily fluctuations. * 30 The estimates’ p-values are calculated using the Newey-West heteroskedasticity and autocorrelation (HAC) robust estimator (Newey and West, 1987) with 3 lags. The lag length was chosen as the closest integer to *T* 1*/*4, where *T* is the sample size. * 31 The ADF test results in column (4) use 13 lags chosen as the integer part of 12(*T/*100)1*/*4, as suggested in Schwert (1989). For fewer lags the test tends to yield smaller p-values. * 32 France’s estimate is sensitive to including log weekly cases in *I**t*. We obtain a larger estimate (![Graphic][37], or 60% increase) when using deaths and hospitalizations as information variables, see Table A5. * 33 The estimate for Quebec is 0.389 and statistically significantly different from zero when we use deaths and hospitalizations as information *I**t*; see Table A5. * 34 We note that with hospitalizations replacing cases as control variable (see column (2) of Table A5), ![Graphic][38] is negative, albeit sometimes without statistical significance, for all provinces but Manitoba and Nova Scotia. Estimates for the latter two provinces show very negative ![Graphic][39], possibly due to the abrupt decrease in vaccinations about four weeks before their mandate announcements (see Fig. B4). Thus, we cannot rule out that a negative change in trend may be quite general for Canadian provinces. * 35 The policy effect estimates are positive but not statistically significantly different from zero in one specification in column (1) and 3 specifications in column (3) of Table A5, out of 26 total specifications. * 36 Since the Sun-Abraham Stata code *eventstudyinteract* does not support computing the regression fitted value, we use the observed values *V**it* in place of ![Graphic][40] in (3), i.e., assume the same residuals as in the data. * 37 In Figure B9, we also display these results in terms of actual vs. counterfactual log weekly doses. * 38 The participants were asked: “If a COVID-19 vaccine is proven safe and effective and is available, will you take it?” * 39 For example, U.S. President Joseph Biden advocated in July 2021 that state and local governments pay $100 to anyone willing to receive a first dose. However, the public health value of vaccination is likely much higher (see Castillo et al., 2021). * 40 For example, one component of the social value of vaccination consists of avoided healthcare costs. Barber and West (2021) estimate that the Ohio vaccine lottery program saved the state USD 66 million in intensive care unit costs. * Received October 21, 2021. * Revision received December 7, 2021. * Accepted December 7, 2021. * © 2021, Posted by Cold Spring Harbor Laboratory The copyright holder for this pre-print is the author. All rights reserved. The material may not be redistributed, re-used or adapted without the author's permission. ## References 1. [1].Alsan, M. and S. Eichmeyer (2021), “Experimental Evidence on the Effectiveness of Non-Experts for Improving Vaccine Demand”, NBER Working Paper No. 28593. 2. [2].Andrews, N., E. Tessier, J. Stowe, C. Gower, F. Kirsebom, R. Simmons, E. Gallagher, M. Chand, K. Brown, S. Ladhani, M. Ramsay and J. Bernal (2021), “Vaccine effectiveness and duration of protection of Comirnaty, Vaxzevria and Spikevax against mild and severe COVID-19 in the UK”, medRxiv preprint. 3. [3].Athey, S. and G. Imbens (2018), “Design-based Analysis in Difference-In-Differences Settings with Staggered Adoption”, NBER Working Paper No. 24963. 4. [4].Barber, A. and J. West (2021), “Conditional Cash Lotteries Increase COVID-19 Vaccination Rates”, working paper, UC Santa Cruz. 5. [5].Brehm, M., P. Brehm and M. Saavedra (2021), “The Ohio Vaccine Lottery and Starting Vaccination Rates”, working paper, Oberlin College. 6. [6].Campos-Mercade, P., A. Meier, F. Schneider, S. Meier, D. Pope, and E. Wengström (2021), “Monetary incentives increase COVID-19 vaccinations”, Science eabm0475. 7. [7].Callaway, B. and P. Sant’Anna (2021), “Difference-in-Differences with Multiple Time Periods.” Journal of Econometrics Forthcoming. 8. [8].Cameron, A., J. Gelbach, and D. Miller (2008), “Bootstrap-based improvements for inference with clustered errors”, Review of Economics and Statistics 90: 414–427. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1162/rest.90.3.414&link_type=DOI) [Web of Science](http://medrxiv.org/lookup/external-ref?access_num=000258260500003&link_type=ISI) 9. [9].Castillo, J., A. Ahuja, S. Athey, A. Baker, E. Budish, T. Chipty, R. Glennerster, S. Kominers, M. Kremer, G. Larson, J. Lee, C. Prendergast, C. Snyder, A. Tabarrok, B. Tan and W. Wiecek (2021), “Market design to accelerate COVID-19 vaccine supply”, Science 371: 1107–1109. [Abstract/FREE Full Text](http://medrxiv.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6Mzoic2NpIjtzOjU6InJlc2lkIjtzOjEzOiIzNzEvNjUzNC8xMTA3IjtzOjQ6ImF0b20iO3M6NTA6Ii9tZWRyeGl2L2Vhcmx5LzIwMjEvMTIvMDcvMjAyMS4xMC4yMS4yMTI2NTM1NS5hdG9tIjt9czo4OiJmcmFnbWVudCI7czowOiIiO30=) 10. [10].Chang, T., M. Jacobson, M. Shah, R. Pramanik, and S. Shah (2021), “Financial Incentives and Other Nudges Do Not Increase COVID-19 Vaccinations among the Vaccine Hesitant”, NBER Working Paper 29403. 11. [11].Chernozhukov, V., H. Kasahara, and P. Schrimpf (2021), “Causal Impact of Masks, Policies, Behavior on Early COVID-19 Pandemic in the U.S.”, Journal of Econometrics 220(1): 23–62. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1016/j.jeconom.2020.09.003&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=33100476&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2021%2F12%2F07%2F2021.10.21.21265355.atom) 12. [12].Chow, G. (1960), “Tests of equality between sets of coefficients in two linear regressions”, Econometrica 591–605. 13. [13].de Chaisemartin, C. and X. D’Haultfœuille (2020), “Two-Way Fixed Effects Estimators with Heterogeneous Treatment Effects”, American Economic Review 110(9): 2964–2996. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1257/aer.20181169&link_type=DOI) 14. [14].Dai, H., S. Saccardo, M. Han, L. Roh, N. Raja, S. Vangala, H. Modi, S. Pandya, M. Sloyan, and D. Croymans (2021), “Behavioural nudges increase COVID-19 vaccinations”, Nature 597: 404–409. [PubMed](http://medrxiv.org/lookup/external-ref?access_num=http://www.n&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2021%2F12%2F07%2F2021.10.21.21265355.atom) 15. [15].Fisher, R. (1935), The Design of Experiments, Oliver and Boyd, Edinburgh. 16. [16].Giles, D. and M. Scott (1992), “Some consequences of using the Chow test in the context of autocorrelated disturbances”, Economics Letters 38(2): 145–150. 17. [17].Goodman-Bacon, A. (2021), “Difference-in-Differences with Variation in Treatment Timing”, Journal of Econometrics Forthcoming. 18. [18].Gostin L. (2021) “COVID-19 Vaccine Mandates – A Wider Freedom”, JAMA Health Forum 2(10):e213852. 19. [19].Grannis, S., E. Rowley, T. Ong, E. Stenehjem, N. Klein, M. DeSilva, A. Naleway, K. Natarajan and M. Thompson (2021), “Interim Estimates of COVID-19 Vaccine Effectiveness against COVID-19-Associated Emergency Department or Urgent Care Clinic Encounters and Hospitalizations Among Adults During SARS-CoV-2 B.1.617.2 (Delta) Variant Predominance – Nine States, June–August 2021”, Morbidity and Mortality Weekly Report 70(37): 1291–1293. 20. [20].Gupta, S., J. Cantor, K. Simon, A. Bento, C. Wing and C. Whaley (2021), “Vaccinations Against COVID-19 May Have Averted Up To 140,000 Deaths In The United States”, Health Affairs 40(9). 21. [21].Hsiang, S., D. Allen, S. Annan-Phan, K. Bell, I. Bolliger, T. Chong, H. Druckenmiller, L. Huang, A. Hultgren, E. Krasovich, P. Lau, J. Lee, E. Rolf, J. Tseng and T. Wu (2020), “The effect of large-scale anti-contagion policies on the COVID-19 pandemic”, Nature 584: 262–267. [PubMed](http://medrxiv.org/lookup/external-ref?access_num=http://www.n&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2021%2F12%2F07%2F2021.10.21.21265355.atom) 22. [22].Hsieh, P. (2021), “Perks and incentives for COVID-19 Vaccination May Backfire”, Forbes, May 28, 2021. 23. [23].Karaivanov, A., S. Lu, H. Shigeoka, C. Chen and S. Pamplona (2021), “Face Masks, Public Policies and Slowing the Spread of COVID-19: Evidence from Canada”, Journal of Health Economics 78, 102475. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1016/J.JHEALECO.2021.102475&link_type=DOI) 24. [24].Klüver, H., F. Hartmann, M. Humphreys, F. Geissler and J. Giesecke (2021), “Incentives can spur COVID-19 vaccination uptake”, Proceedings of the National Academy of Sciences 118(36). 25. [25].Lazarus, J., S. Ratzan, A. Palayew, L. Gostin, H. Larson, K. Rabin, S. Kimball and A. El-Mohandes (2021), “A global survey of potential acceptance of a COVID-19 vaccine”, Nature Medicine 27: 225–228. [PubMed](http://medrxiv.org/lookup/external-ref?access_num=http://www.n&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2021%2F12%2F07%2F2021.10.21.21265355.atom) 26. [26].Linden, A. (2017), “Conducting interrupted time-series analysis for single-and multiple-group comparisons”, The Stata Journal 15(2): 480–500. 27. [27].Newey, W., and K. West (1987), “A Simple, Positive Semi-definite, Heteroskedasticity and Autocorrelation Consistent Covariance Matrix”, Econometrica 55(3): 703–708. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.2307/1913610&link_type=DOI) [Web of Science](http://medrxiv.org/lookup/external-ref?access_num=A1987H597700014&link_type=ISI) 28. [28].Roodman D, M. Nielsen, J. MacKinnon and M. Webb (2019), “Fast and wild: Boot-strap inference in Stata using boottest”, The Stata Journal 19(1):4–60. 29. [29].Scobie, H., A. Johnson, A. Suthar, R. Severson, N. Alden, S. Balter, D. Bertolino, D. Blythe, S. Brady, B. Cadwell, I. Cheng, S. Davidson, J. Delgadillo, K. Devinney, J. Duchin, M. Duwell, R. Fisher, A. Fleischauer, A. Grant, J. Griffin, M. Haddix, J. Hand, M. Hanson, E. Hawkins, R. Herlihy, L. Hicks, C. Holtzman, M. Hoskins, J. Hyun, R. Kaur, M. Kay, H. Kidrowski, C. Kum, K. Komatsu, K. Kugeler, M. Lewis, B.C. Lyons, S. Lyons, R. Lynfield, K. McCaffrey, C. McMullen, L. Milroy, S. Meyer, L. Nolen, M. Patel, S. Pogosjans, H. Reese, A. Saupe, J. Sell, T. Sokol, D. Sosin, E. Stanislawski, K. Stevens, H. Vest, K. White, E. Wilson, A. MacNeil, M. Ritchey and B. Silk (2021), “Monitoring Incidence of COVID-19 Cases, Hospitalizations, and Deaths, by Vaccination Status – 13 U.S. Jurisdictions, April 4–July 17, 2021”, CDC Morbidity and Mortality Weekly Report 70(37): 1284–1290. 30. [30].Sehgal, K. (2021), “Impact of Vax-a-Million lottery on COVID-19 vaccination rates in Ohio”, The American Journal of Medicine Forthcoming. 31. [31].Sun, B. and S. Abraham (2021), “Estimating dynamic treatment effects in event studies with heterogeneous treatment effects.” Journal of Econometrics Forthcoming. 32. [32].Schwert, G. (1989), “Tests for unit roots: A Monte Carlo investigation.” Journal of Business and Economic Statistics, Vol. 7, No. 2. 33. [33].Thaler, R. (2021), “More than nudges are needed to end the pandemic”, The New York Times, August 5, 2021. 34. [34].Walkey, A., A. Law, N. Bosch (2021), “Lottery-Based Incentive in Ohio and COVID-19 Vaccination Rates”, JAMA 326(8): 766–767. [1]: /embed/inline-graphic-1.gif [2]: /embed/inline-graphic-2.gif [3]: /embed/inline-graphic-3.gif [4]: /embed/graphic-3.gif [5]: /embed/inline-graphic-4.gif [6]: /embed/graphic-7.gif [7]: /embed/inline-graphic-5.gif [8]: /embed/inline-graphic-6.gif [9]: /embed/inline-graphic-7.gif [10]: /embed/inline-graphic-8.gif [11]: /embed/inline-graphic-9.gif [12]: /embed/inline-graphic-10.gif [13]: /embed/inline-graphic-11.gif [14]: /embed/inline-graphic-12.gif [15]: /embed/inline-graphic-13.gif [16]: /embed/inline-graphic-14.gif [17]: /embed/graphic-9.gif [18]: /embed/inline-graphic-15.gif [19]: /embed/inline-graphic-16.gif [20]: /embed/inline-graphic-17.gif [21]: /embed/inline-graphic-18.gif [22]: /embed/graphic-10.gif [23]: /embed/inline-graphic-19.gif [24]: /embed/inline-graphic-20.gif [25]: /embed/inline-graphic-21.gif [26]: /embed/inline-graphic-22.gif [27]: /embed/inline-graphic-23.gif [28]: /embed/inline-graphic-24.gif [29]: /embed/inline-graphic-25.gif [30]: /embed/inline-graphic-26.gif [31]: /embed/inline-graphic-27.gif [32]: /embed/inline-graphic-28.gif [33]: /embed/inline-graphic-29.gif [34]: /embed/inline-graphic-30.gif [35]: F11/embed/inline-graphic-31.gif [36]: F14/embed/inline-graphic-32.gif [37]: /embed/inline-graphic-33.gif [38]: /embed/inline-graphic-34.gif [39]: /embed/inline-graphic-35.gif [40]: /embed/inline-graphic-36.gif