Abstract
This paper evaluates the dynamic impact of various policies adopted by US states on the growth rates of confirmed Covid-19 cases and deaths as well as social distancing behavior measured by Google Mobility Reports, where we take into consideration people’s voluntarily behavioral response to new information of transmission risks. Our analysis finds that both policies and information on transmission risks are important determinants of Covid-19 cases and deaths and shows that a change in policies explains a large fraction of observed changes in social distancing behavior. Our counterfactual experiments suggest that nationally mandating face masks for employees on April 1st could have reduced the growth rate of cases and deaths by more than 10 percentage points in late April, and could have led to as much as 17 to 55 percent less deaths nationally by the end of May, which roughly translates into 17 to 55 thousand saved lives. Our estimates imply that removing non-essential business closures (while maintaining school closures, restrictions on movie theaters and restaurants) could have led to -20 to 60 percent more cases and deaths by the end of May. We also find that, without stay-at-home orders, cases would have been larger by 25 to 170 percent, which implies that 0.5 to 3.4 million more Americans could have been infected if stay-at-home orders had not been implemented. Finally, not having implemented any policies could have led to at least a 7 fold increase with an uninformative upper bound in cases (and deaths) by the end of May in the US, with considerable uncertainty over the effects of school closures, which had little cross-sectional variation.
1. Introduction
Accumulating evidence suggests that various policies in the US have reduced social interactions and slowed down the growth of Covid-19 infections.1An important outstanding issue, however, is how much of the observed slow down in the spread is attributable to the effect of policies as opposed to a voluntarily change in people’s behavior out of fear of being infected. This question is critical for evaluating the effectiveness of restrictive policies in the US relative to an alternative policy of just providing recommendations and information such as the one adopted by Sweden. More generally, understanding people’s dynamic behavioral response to policies and information is indispensable for properly evaluating the effect of policies on the spread of Covid-19.
This paper quantitatively assesses the impact of various policies adopted by US states on the spread of Covid-19, such as non-essential business closure and mandatory face masks, paying particular attention to how people adjust their behavior in response to policies as well as new information on cases and deaths.
We present a conceptual framework that spells out the causal structure on how the Covid-19 spread is dynamically determined by policies and human behavior. Our approach explicitly recognizes that policies not only directly affect the spread of Covid-19 (e.g., mask requirement) but also indirectly affect its spread by changing people’s behavior (e.g., stay-at-home order). It also recognizes that people react to new information on Covid-19 cases and deaths, and voluntarily adjust their behavior (e.g., voluntary social distancing and hand washing) even without any policy in place. Our casual model provides a framework to quantitatively decompose the growth of Covid-19 cases and deaths into three components: (1) direct policy effect, (2) policy effect through behavior, and (3) direct behavior effect in response to new information.2
Guided by the causal model, our empirical analysis examines how the weekly growth rates of confirmed Covid-19 cases and deaths are determined by (the lags of) policies and behavior using US state-level data. To examine how policies and information affect people’s behavior, we also regress social distancing measures on policy and information variables. Our regression specification for case and death growths is explicitly guided by a SIR model although our causal approach does not hinge on the validity of a SIR model.
As policy variables, we consider mandatory face masks for employees in public businesses, stay-at-home orders (or shelter-in-place orders), closure of K-12 schools, closure of restaurants except take out, closure of movie theaters, and closure of non-essential businesses. Our behavior variables are four mobility measures that capture the intensity of visits to “transit,” “grocery,” “retail,” and “workplaces” from Google Mobility Reports. We take the lagged growth rate of cases and deaths and the log of lagged cases and deaths at both state-level and national-level as our measures of information on infection risks that affects people’s behavior. We also consider the growth rate of tests, month dummies, and state-level characteristics (e.g., population size and total area) as confounders that have to be controlled for in order to identify the causal relationship between policy/behavior and the growth rate of cases and deaths.
Our key findings from regression analysis are as follows. We find that both policies and information on past cases and deaths are important determinants of people’s social distancing behavior, where policy effects explain more than 50% of the observed decline in the four behavior variables.3 Our estimates suggest that there are both large policy effects and large behavioral effects on the growth of cases and deaths. Except for mandatory masks, the effect of policies on cases and deaths is indirectly materialized through their impact on behavior; the effect of mandatory mask policy is direct without affecting behavior.
Using the estimated model, we evaluate the dynamic impact of the following counterfactual policies on Covid-19 cases and deaths: mandating face masks, allowing non-essential businesses to open, not implementing a stay-at-home order, and removing all policies. The counterfactual experiments show a large impact of those policies on the number of cases and deaths. They also highlight the importance of voluntary behavioral response to infection risks for evaluating the dynamic policy effects.
Figure 1 shows that nationally implementing mandatory face masks for employees in public businesses on April 1st would have reduced the growth rate of cases (top panel) and that of deaths (bottom panel) by more than 10 percentage points in late April. This leads to reductions of 25% and 35% in reported cases and deaths, respectively, by the end of May with a 90 percent confidence interval of [10, 45]% and [17, 55]%, which roughly implies that as many as 17 to 55 thousand lives could have been saved.4 This finding is significant: given this potentially large benefit of reducing the spread of Covid-19, mandating masks is an attractive policy instrument especially because it involves relatively little economic disruption. These estimates contribute to the ongoing efforts towards designing approaches to minimize risks from reopening (Stock, 2020a).
Figure 2 illustrates how allowing non-essential businesses to remain open could have affected the growth of cases. We estimate that non-essential business closures have a small impact on growth rates, with a 90% confidence interval that includes both negative and positive effects. When this effect on growth rates is converted to a change in levels, the point estimates indicate that keeping non-essential businesses open (other than movie theaters, gyms, and keeping restaurants in the “take-out” mode) could have increased cases and deaths by 15% (with a 90 percent confidence interval of − 20% to 60%). These estimates contribute to the ongoing efforts of evaluating various reopening approaches.
In Figure 3, we find that, without stay-at-home orders, the case growth rate would have been nearly 10 percentage points higher in late April. No stay-at-home orders could have led to 80% more cases by the start of June with a 90 precent confidence interval given by 25% to 170%. This implies that 0.5 to 3.4 million more Americans would have been infected without stay-at-home orders, providing suggestive evidence that reopening via removal of stay-at-home orders could lead to a substantial increase in cases and deaths.
In our counterfactual experiment of removing all policies, we find that the results are sensitive to whether the number of past national cases/deaths is included in a specification or not. This sensitivity arises because there is little variation across states in the timing of school closures. This makes the effect of school closures difficult to identify. In Figure 15, we show that in a specification that excludes past national cases (which allow for greater attribution of effects to school closures), the number of cases by the end of May could have increased 7-fold or more with a very large upper bound. On the other hand, as shown in Figure 16, under a specification with past national cases, our counterfactual experiment implies a 0 to 10 fold increase in cases by the end of May. This highlights the uncertainty regarding the impact of all policies versus private behavioral responses to information. Evaluation of re-opening policies needs to be aware of this uncertainty.
A growing number of other papers have examined the link between non-pharmaceutical interventions and Covid-19 cases.5 Hsiang et al. (2020) estimate the effect of policies on the growth rate of cases using data from the United States, China, Iran, Italy, France, and South Korea. In the United States, they find that the combined effect of all policies they consider on the growth rate is − 0.347 (0.061). Courtemanche et al. (2020) use US county level data to analyze the effect of interventions on case growth rates. They find that the combination of policies they study reduced growth rates by 9.1 percentage points 16-20 days after implementation, out of which 5.9 percentage points are attributed to shelter in place orders. Both Hsiang et al. (2020) and Courtemanche et al. (2020) adopted a reduced-form approach to estimate the total policy effect on case growth without using any social distancing behavior measures. In contrast, our study highlights the role of behavioral response to policies and information.
Existing evidence for the impact of social distancing policies on behavior in the US is mixed. Abouk and Heydari (2020) employ a difference-in-differences methodology to find that statewide stay-at-home orders have strong causal impacts on reducing social interactions. In contrast, using data from Google Mobility Reports, Maloney and Taskin (2020) find that the increase in social distancing is largely voluntary and driven by information.6 Another study by Gupta et al. (2020) also found little evidence that stay-at-home mandates induced distancing by using mobility measures from PlaceIQ and SafeGraph. Using data from SafeGraph, Andersen (2020) show that there has been substantial voluntary social distancing but also provide evidence that mandatory measures such as stay-at-home orders have been effective at reducing the frequency of visits outside of one’s home.
Pei, Kandula, and Shaman (2020) use county-level observations of reported infections and deaths in conjunction with mobility data from SafeGraph to estimate how effective reproductive numbers in major metropolitan areas change over time. They conduct simulation of implementing all policies 1-2 weeks earlier and found that it would have resulted in reducing the number of cases and deaths by more than half. However, their study does not explicitly analyze how policies are related to the effective reproduction numbers.
Epidemiologists use model simulations to predict how cases and deaths evolve for the purpose of policy recommendation. As reviewed by Avery et al. (2020), there exist substantial uncertainty about the values of key epidimiological parameters (see also Atkeson, 2020a; Stock, 2020b). Simulations are often done under strong assumptions about the impact of social distancing policies without connecting to the relevant data (e.g., Ferguson et al., 2020). Furthermore, simulated models do not take into account that people may limit their contact with other people in response to higher transmission risks.7 When such a voluntary behavioral response is ignored, simulations would produce exponential spread of disease and would over-predict cases and deaths. Our counterfactual experiments illustrate the importance of this voluntary behavioral change.
Whether wearing masks in public place should be mandatory or not has been one of the most contested policy issues with health authorities of different countries providing contradiction recommendations. Reviewing evidence, Greenhalgh et al. (2020) recognize that there is no randomized controlled trial evidence for the effectiveness of face masks, but they state “indirect evidence exists to support the argument for the public wearing masks in the Covid-19 pandemic.”8 Howard et al. (2020) also review available medical evidence and conclude that “mask wearing reduces the transmissibility per contact by reducing transmission of infected droplets in both laboratory and clinical contexts.” The laboratory findings in Hou et al. (2020) suggest that the nasal cavity may be the initial site of infection followed by aspiration to the lung, supporting the argument “for the widespread use of masks to prevent aersol, large droplet, and/or mechanical exposure to the nasal passages.”
Given the lack of experimental evidence on the effect of masks, conducting observational studies is useful and important. To the best of our knowledge, our paper is the first empirical study that shows the effectiveness of mask mandates on reducing the spread of Covid-19 by analyzing the US state-level data. This finding corroborates and is complementary to the medical observational evidence in Howard et al. (2020). Analyzing mitigation measures in New York, Wuhan, and Italy, Zhang et al. (2020b) conclude that mandatory face coverings substantially reduced infections. Abaluck et al. (2020) find that the growth rates of cases and of deaths in countries with pre-existing norms that sick people should wear masks are lower by 8 to 10% than those rates in countries with no pre-existing mask norms.
Our empirical results contribute to informing the economic-epidemiological models that combine economic models with variants of SIR models to evaluate the efficiency of various economic policies aimed at gradual “reopening” of various sectors of economy. For example, the estimated effects of masks, stay-home mandates, and various other policies on behavior, and of behavior on infection can serve as useful inputs and validation checks in the calibrated macro, sectoral, and micro models (see, e.g., Alvarez, Argente, and Lippi (2020); Baqaee et al. (2020); Fernández-Villaverde and Jones (2020); Acemoglu et al. (2020); Keppo et al. (2020); McAdams (2020) and references therein.) Furthermore, the causal framework developed in this paper could be applicable, with appropriate extensions, to the impact of policies on economic outcomes replacing health outcomes (see, e.g., Chetty et al. (2020); Coibion, Gorodnichenko, and Weber (2020)).
2. The Causal Model for the Effect of Policies, Behavior, and Information on Growth of Infection
2.1. The Causal Model and Its Structural Equation Form
We introduce our approach through the Wright-style causal diagram shown in Figure 4. The diagram describes how policies, behavior, and information interact together:
The forward health outcome, Yi,t+e, is determined last, after all other variables have been determined;
The adopted policies, Pit, affect health outcome Yi,t+e either directly, or indirectly by altering human behavior Bit;
Information variables, Iit, such as lagged values of outcomes can affect human behavior and policies, as well as outcomes;
The confounding factors Wit, which vary across states and time, affect all other variables.
The index i denotes observational unit, the state, and t and t + ℓ denotes the time, where ℓ represents the time lag between infection and case confirmation or death.
Our main outcomes of interest are the growth rates in Covid-19 cases and deaths, behavioral variables include proportion of time spent in transit or shopping and others, policy variables include stay-at-home orders and school and business closures, and the information variables include lagged values of outcome. We provide a detailed description of these variables and their timing in the next section.
The causal structure allows for the effect of the policy to be either direct or indirect – through-behavior or through dynamics; and all of these effects are not mutually exclusive. The structure also allows for changes in behavior to be brought by change in policies and information. These are all realistic properties that we expect from the contextual knowledge of the problem. Policies such as closures of schools, non-essential business, and restaurants, alter and constrain behavior in strong ways. In contrast, policies such as mandating employees to wear masks can potentially affect the Covid-19 transmission directly. The information variables, such as recent growth in the number of cases, can cause people to spend more time at home, regardless of adopted state policies; these changes in behavior in turn affect the transmission of Covid-19.
The causal ordering induced by this directed acyclical graph is determined by the following timing sequence:
information and confounders get determined at t,
policies are set in place, given information and confounders at t;
behavior is realized, given policies, information, and confounders at t;
outcomes get realized at t+ ℓ given policies, behavior, information, and confounders.
The model also allows for direct dynamic effects of information variables on the outcome through autoregressive structures that capture persistence in growth patterns. As highlighted below, realized outcomes may become new information for future periods, inducing dynamics over multiple periods.
Our quantitative model for causal structure in Figure 4 is given by the following econometric structural equation model: which is a collection of functional relations with stochastic shocks, decomposed into observable part δ′W and unobservable part ε. The terms and are the centered stochastic shocks that obey the orthogonality restrictions posed below.
The policies can be modeled via a linear form as well, although linearity is not critical.9
The orthogonality restrictions on the stochastic components are as follows: where we say that V ⊥ U if EV U = 0. This is a standard way of representing restrictions on errors in structural equation modeling.10,11
The observed variables are generated by setting ι = Iit and propagating the system from the last equation to the first:
The system above together with orthogonality restrictions (O) implies the following collection of stochastic equations for realized variables: and
These equations form the basis of our empirical analysis.
As discussed below, the information variable includes case growth. Therefore, an orthogonality restriction holds if the government does not have knowledge on future case growth beyond what is predicted by today’s case growth, policies, behavior, and confounders; even when the government has some knowledge on , the orthogonality restriction may hold if there is a time lag for the government to implement its policies based on .
The orthogonality condition in (PI→Y) is weaker than the orthogonality conditions in (BPI→Y)-(PI→B) in that the former is implied by the latter but not vice versa. The system over-identifies the regression coefficients because (α′β′ + π′) and (α′γ′ + µ′) in (PI→Y) can be also identified from α′, π′, µ′, β′, and γ′ in (BPI→Y)-(PI→B). Comparing the estimates of (α′β′ + π′) and (α′γ′ + µ′) from (PI→Y) with those implied by the estimates of α′, π′, µ′, β′, and γ′ from (BPI→Y)-(PI→B) provides a useful specification test.
Identification and Parameter Estimation
The orthogonality equations imply that these are all projection equations, and the parameters of the SEM are identified by the parameters of these regression equation, provided the latter are identified by sufficient joint variation of these variables across states and time.
The last point can be stated formally as follows. Consider the previous system of equations, after partialling out the confounders: where denotes the residual after removing the orthogonal projection of Vit on Wit. The residualization is a linear operator, implying that (1) follows immediately from the above. The parameters of (1) are identified as projection coefficients in these equations, provided that residualized vectors appearing in each of the equations have non-singular variance, that is
Our main estimation method is the standard correlated random effects estimator, where the random effects are parameterized as functions of observable characteristic, Wit, which include both state-level and time random effects. The state-level random effects are modeled as a function of state level characteristics, and the time random effects are modeled by including month dummies and their interactions with state level characteristics. The stochastic shocks are treated as independent across states i and can be arbitrarily dependent across time t within a state.
A secondary estimation method is the fixed effects estimator, where Wit includes latent (unobserved) state level effects Wi and and time level effects Wt, which must be estimated from the data. This approach is much more demanding of the data and relies on long cross-sectional and time histories. When histories are relatively short, large biases emerge and they need to be removed using debiasing methods. In our context, debiasing changes the estimates substantially, often changing the sign of coefficients.12 However, we find the debiased fixed effect estimates are qualitatively and quantitatively similar to the correlated random effects estimates. Given this finding, we chose to focus on the latter, as it is a more standard and familiar method, and report the former estimates in the supplementary materials for this paper.13
2.2. Information Structures and Induced Dynamics
We consider three examples of information structures: Information variable is a function of time:
Information variable is lagged value of outcome: and finally:
(I) Information variables include time, lagged and integrated values of outcome: with the convention that Yit = 0 for t ≤ 0.
The first information structure captures the basic idea that, as individuals discover more information about covid over time, they adapt to safer modes of behavior (stay-at-home, wear masks, wash hands). Under this structure, information is common across states and exogenously evolves over time, independent of the number of cases. The second structure arises from considering autoregressive components and captures people’s behavioral response to information on cases in the state they reside. Specifically, we model persistence in growth rates, Yi,t+e, through an AR(1) model, which leads to Iit = Yit. This provides useful local, state-specific, information about the forward growth rate and people may adjust their behavior to safer modes when they see a high value. We model this adjustment via the term γ′It in the behavior equation. The third information structure is the combination of the first two structures plus an additional term representing the log of the total number of new cases in the state. We use this information structure in our empirical specification. In this structure, people respond to both global information, captured by a function of time such as month dummies, and local information sources, captured by the local growth rate and the total number of cases. The last element of the information set can be thought of as a local stochastic trend in cases.
All of these examples fold into a specification of the form: with the initialization Ii0 = 0 and Yi0 = 0.14
With any structure of this form, realized outcomes may become new information for future periods, inducing a dynamical system over multiple periods. We show the resulting dynamical system in a causal diagram of Figure 5. Specification of this system is useful for studying delayed effects of policies and behaviors and in considering the counterfactual policy analysis.
2.3. Outcome and Key Confounders via SIR model
Letting Cit denote the cumulative number of confirmed cases in state i at time t, our outcome approximates the weekly growth rate in new cases from t − 7 to t.15 Here Δ denotes the differencing operator over 7 days from t to t − 7, so that ΔCit := Cit − Ci,t−7 is the number of new confirmed cases in the past 7 days.
We chose this metric as this is the key metric for policy makers deciding when to relax Covid mitigation policies. The U.S. government’s guidelines for state reopening recommend that states display a “downward trajectory of documented cases within a 14-day period” (White House, 2020). A negative value of Yit is an indication of meeting this criteria for reopening. By focusing on weekly cases rather than daily cases, we smooth idiosyncratic daily fluctuations as well as periodic fluctuations associated with days of the week.
Our measurement equation for estimating equations (BPI → Y) and (PI → Y) will take the form: where i is state, t is day, Cit is cumulative confirmed cases, Tit is the number of tests over 7 days, Δ is a 7-days differencing operator, ϵit is an unobserved error term. Xi,t−14 collects other behavioral, policy, and confounding variables, depending on whether we estimate (BPI →Y) or (PI → Y), where the lag of 14 days captures the time lag between infection and confirmed case (see the Appendix A.6). Here is the key confounding variable, derived from considering the SIR model below. We describe other confounders in the empirical section.
Our main estimating equation (M-C) is motivated by a variant of SIR model, where we add confirmed cases and infection detection via testing. Let S, ℐ, R, and D denote the number of susceptible, infected, recovered, and dead individuals in a given state. Each of these variables are a function of time. We model them as evolving as where N is the population, β(t) is the rate of infection spread, γ is the rate of recovery or death, and κ is the probability of death conditional on infection.
Confirmed cases, C(t), evolve as where τ (t) is the rate that infections are detected.
Our goal is to examine how the rate of infection β(t) varies with observed policies and measures of social distancing behavior. A key challenge is that we only observed C(t) and D(t), but not ℐ(t). The unobserved ℐ(t) can be eliminated by differentiating (8) and using as
We consider a discrete-time analogue of equation (9) to motivate our empirical specification by relating the detection rate τ (t) to the number of tests Tit while specifying as a linear function of variables Xi,t−14. This results in which is equation (M-C), where Xi,t−14 captures a vector of variables related to β(t).
Structural Interpretation. Early in the pandemic, when the number of susceptibles is approximately the same as the entire population, i.e. Sit/Nit δ 1, the component is the projection of infection rate βi(t) on Xi,t−14 (policy, behavioral, information, and confounders other than testing rate), provided the stochastic component ϵit is orthogonal to Xi,t−14 and the testing variables:
2.4. Growth Rate in Deaths as Outcome
By differentiating (7) and (8) with respect to t and using (9), we obtain
Our measurement equation for the growth rate of deaths is based on equation (10) but account for a 21 day lag between infection and death as where approximates the weekly growth rate in deaths from t − 7 to t in state i.
3. Decomposition and Counterfactual Policy Analysis
3.1. Total Change Decomposition
Given the SEM formulation above, we can carry out the following decomposition analysis, after removing the effects of confounders. For example, we can decompose the total change in the expected outcome, measured at two different time points t + ℓ and o into the sum of three components: where the first two components capture the immediate effect and the third represents the delayed or dynamic effect.
In the three examples of information structure given earlier, we have the following forms for the dynamic effect: for the trend model, and for the lag model, interpreting t/ℓ as lt/ℓJ. For the general model we use, the dynamic effect is
The effects can be decomposed into (a) delayed policy effects via behavior by summing terms containing PEB, (b) delayed policy effects via direct impact by summing terms containing DPE, (c) pure behavior effects, and (d) pure dynamic feedback effects.
3.2. Counterfactuals
We also consider simple counterfactual exercises, where we examine the effects of setting a sequence of counterfactual policies for each state:
We assume that the SEM remains invariant, except of course for the policy equation.16 Given the policies, we propagate the dynamic equations: with the initialization . In stating this counterfactual system of equations, we make the following invariance assumption
Invariance Assumption. The equations of (CF-SEM) remain exactly of the same form as in the (SEM) and (I). That is, under the policy intervention , parameters and stochastic shocks in (SEM) and (I) remain the same as under the original policy intervention {Pit}.
Let and ƿYi,t+e denote the predicted values produced by working with the counterfactual system (CEF-SEM) and the factual system (SEM):
In generating these predictions, we make the assumption of invariance stated above.
Then we can write the difference into the sum of three components:
Similarly to what we had before, the counterfactual dynamic effects take the form: interpreting t/ℓ as ⌊t/ℓ⌋. The effects can be decomposed into (a) delayed policy effects via behavior by summing terms containing PEB, (b) delayed policy effects via direct impact by summing terms containing DPE, (c) pure behavior effects, and (d) pure dynamic feedback effects.
4. Empirical Analysis
4.1. Data
Our baseline measures for daily Covid-19 cases and deaths are from The New York Times (NYT). When there are missing values in NYT, we use reported cases and deaths from JHU CSSE, and then the Covid Tracking Project. The number of tests for each state is from Covid Tracking Project. As shown in Figure 21 in the appendix, there was a rapid increase in testing in the second half of March and then the number of tests increased very slowly in each state in April.
We use the database on US state policies created by Raifman et al. (2020). In our analysis, we focus on 6 policies: stay-at-home, closed nonessential businesses, closed K-12 schools, closed restaurants except takeout, closed movie theaters, and mandate face mask by employees in public facing businesses. We believe that the first four of these policies are the most widespread and important. Closed movie theaters is included because it captures common bans on gatherings of more than a handful of people. We also include mandatory face mask use by employees because its effectiveness on slowing down Covid-19 spread is a controversial policy issue (Howard et al., 2020; Greenhalgh et al., 2020; Zhang et al., 2020b). Table 1 provides summary statistics, where N is the number of states that have ever implemented the policy. We also obtain information on state-level covariates from Raifman et al. (2020), which include population size, total area, unemployment rate, poverty rate, and a percentage of people who are subject to illness.These confounders are motivated by Wheaton and Thompson (2020) who finds that case growth is associated with residential density and per capita income.
We obtain social distancing behavior measures from”Google COVID-19 Community Mobility Reports” (LLC, 2020). The dataset provides six measures of “mobility trends” that report a percentage change in visits and length of stay at different places relative to a baseline computed by their median values of the same day of the week from January 3 to February 6, 2020. Our analysis focuses on the following four measures: “Grocery & pharmacy,” “Transit stations,” “Retail & recreation,” and “Workplaces.”17
Figure 6 shows the evolution of “Transit stations” and “Workplaces,” where thin lines are the value in each state and date while thicker colored lines are quantiles conditional on date. The figures illustrate a sharp decline in people’s movements starting from mid-March as well as differences in their evolutions across states. They also reveal periodic fluctuations associated with days of the week, which motivates our use of weekly measures.
In our empirical analysis, we use weekly measures for cases, deaths, and tests by summing up their daily measures from day t to t − 6. We focus on weekly cases and deaths because daily new cases and deaths are affected by the timing of reporting and testing, and are quite volatile as shown in Figure 17 in the appendix. Aggregating to weekly new cases/deaths/tests smooths out idiosyncratic daily noises as well as periodic fluctuations associated with days of the week. We also construct weekly policy and behavior variables by taking 7 day moving averages from day t − 14 to t − 21 for case growth, where the delay reflects the time lag between infection and case confirmation. The four weekly behavior variables are referred as “Transit Intensity,” “Workplace Intensity,” “Retail Intensity,” and “Grocery Intensity.” Consequently, our empirical analysis uses 7 day moving averages of all variables recorded at daily frequencies. Our sample period is from March 7, 2020 to June 3, 2020.
Table 2 reports that weekly policy and behavior variables are highly correlated with each other, except for the”masks for employees” policy. High correlations may cause multicolinearity problems and could limit our ability to separately identify the effect of each policy or behavior variable on case growth, but this does not prevent us from identifying the aggregate effect of all policies and behavior variables on case or death growth.
Figure 7 shows the portion of states that have each policy in place at each date. For most policies, there is considerable variation across states in the time in which the policies are active. The one exception is K-12 school closures. About 80% of states closed schools within a day or two of March 15th, and all states closed schools by early April. This makes the effect of school closings difficult to separate from aggregate time series variation.
4.2. The Effect of Policies and Information on Behavior
We first examine how policies and information affect social distancing behaviors by estimating a version of (PI→B): where represents behavior variable j in state i at time t. Pit collects the Covid related policies in state i at t. Confounders, Wit, include state-level covariates, month indicators, and their interactions. Iit is a set of information variables that affect people’s behaviors at t. As information, we include each state’s growth of cases (in panel 3a) or deaths (in panel 3b), and log cases or deaths. Additionally, in columns (5)-(8) of each panel, we include national growth and log of cases or deaths.
Table 3 reports the estimates with standard errors clustered at the state level. Across different specifications, our results imply that policies have large effects on behavior. Comparing columns (1)-(4) with columns (5)-(8), the magnitude of policy effects are sensitive to whether national cases or deaths are included as information. The coefficient on school closures is particularly sensitive to the inclusion of national information variables. As shown in Figure 7, there is little variation across states in the timing of school closures. Consequently, it is difficult to separate the effect of school closures from a behavioral response to the national trend in cases and deaths.
The other policy coefficients are less sensitive to the inclusion of national case/death variables. After school closures, stay-at-home orders and restaurant closures have the next largest effect. Somewhat surprisingly, closure of nonessential businesses appears to have a modest effect on behavior. Closing movie theaters has a similar, small effect on behavior. The effect of masks for employees is also small. The comparison of effects across policies should be interpreted with caution. Differences between policy effects are often statistically insignificant; except for masks for employees, the policies are highly correlated and it is difficult to separate their effects.
The row “∑j Policyj “reports the sum of the estimated effect of all policies, which is substantial and can account for a large fraction of the observed declines in behavior variables. For example, in Figure 6, transit intensity for a median state was approximately -50% at its lowest point in early April. The estimated policy coefficients in columns imply that imposing all six policies would lead to roughly 85% (in columns 1-4) or roughly 50% (in columns 5-8) of the observed decline. The large impact of policies on transit intensity suggests that the policies may have reduced the Covid-19 infection by reducing people’s use of public transportation.18
In panel 3b, estimated coefficients of deaths and death growth are generally negative. This suggests that the higher number of deaths reduces social interactions measured by Google Mobility Reports perhaps because people are increasingly aware of prevalence of Covid-19 (Maloney and Taskin, 2020). The coefficients on log cases and case growth in panel 3a are more mixed. In columns (5)-(8) of both panels, we see that national case/death variables have large, negative coefficients. This suggests that behavior responded to national conditions although it is also likely that national case/death variables capture unobserved aggregate time effects beyond information (e.g., latent policy variables and time-varying confounders that are common across states) which are not fully controlled by month dummies.
4.3. The Direct Effect of Policies and Behavior on Case and Death Growth
We now analyze how behavior and policies together influence case and death growth rates. We begin with some simple graphical evidence of the effect of policies on case and death growth. Figure 8 shows average case and death growth conditional on date and whether masks are mandatory for employees. 19 The left panel of the figure shows that states with a mask mandate consistently have 0-0.2 lower case growth than states without. The right panel also illustrates that states with a mask mandate tend to have lower average death growth than states without a mask mandate.
Similar plots are shown for other policies in Figures 23 and 24 in the appendix. The figures for stay-at-home orders and closure of nonessential businesses are qualitatively similar to that for masks. States with these two policies appear to have about 0.1 percentage point lower case growth than states without. The effects of school closures, movie theater closures, and restaurant closures are not clearly visible in these figures. These figures are merely suggestive; the patterns observed in them may be driven by confounders.
We more formally analyze the effect of policies by estimating regressions. We first look at the direct effect of policies on case and death growth conditional on behavior by estimating equation (BPI→Y): where the outcome variable, Yi,t+e, is either case growth or death growth.
For case growth as the outcome, we choose a lag length of ℓ = 14 days for behavior, policy, and information variables to reflect the delay between infection and confirmation of case.20 is a vector of four behavior variables in state i. Pit includes the Covid-related policies in state i that directly affect the spread of Covid-19 after controlling for behavior variables (e.g., masks for employees). We include information variables, Iit, that include the past cases and case growths because the past cases may be correlated with (latent) government policies or people’s behaviors that are not fully captured by our observed policy and behavior variables. We also consider a specification that includes the past cases and case growth at the national level as additional information variables. Wit is a set of confounders that include month dummies, state-level covariates, and the interaction terms between month dummies and state-level covariates.21 For case growth, Wit also includes the test rate growth Δ log(T)it to capture the effect of changing test rates on confirmed cases. Equation (14) corresponds to (M-C) derived from the SIR model.
For death growth as the outcome, we take a lag length of ℓ = 21 days. The information variables Iit include past deaths and death growth rates; Wit is the same as that of the case growth equation except that the growth rate of test rates is excluded from Wit as implied by equation (M-D).
Table 4 shows the results of estimating (14) for case and death growth rates. Column (1) represents our baseline specification while column (2) allows the effect of masks to be different before and after May 1st. Columns (3) and (4) include past cases/deaths and growth rates at national level as additional regressors.
The estimates indicate that mandatory face masks for employees reduce the growth rate of infections and deaths by 8-15 percent, while holding behavior constant. This suggests that requiring masks for employees in public-facing businesses may be an effective preventive measure.22 The estimated effect of masks on death growth is larger than the effect on case growth, but this difference between the two estimated effects is not statistically significant.
Except for mask requirements, policies appear to have little direct effect on case or death growth when behavior is held constant. The one exception is that closing schools has a large and statistically significant coefficient in the death growth regressions. As discussed above, there is little cross-state variation in the timing of school closures, making estimates of its effect less reliable.
The row “∑k wkBehaviork” reports the sum of estimated coefficients weighted by the average of the behavioral variables from April 1st-10th. The estimates of −0.76 and −0.87 for “∑k wkBehaviork” in column (1) imply that a reduction in mobility measures relative to the baseline in January and February have induced a decrease in case and death growth rates by 76 and 83 percent, respectively, suggesting an importance of social distancing for reducing the spread of Covid-19. When including national cases and deaths in information, as shown in columns (3) and (4), the estimated aggregate impact of behavior is substantially smaller, but remains large and statistically significant.
A useful practical implication of these results are that Google Mobility Reports and similar data might be useful as a leading indicator of potential case or death growth. This should be done with caution, however, because other changes in the environment might alter the relationship between behavior and infections. Preventative measures, including mandatory face masks, and changes in habit that are not captured in our data might alter the future relationship between Google Mobility Reports and case/death growth.
The negative coefficients of past cases or deaths in Table 4 is consistent with a hypothesis that higher reported cases and deaths change people’s behavior to reduce transmission risks. Such behavioral changes in response to new information are partly captured by Google mobility measures, but the negative estimated coefficient of past cases or deaths imply that other latent behavioral changes that are not fully captured by Google mobility measures (e.g., frequent hand-washing, wearing masks, and keeping 6ft/2m distancing) are also important for reducing future cases and deaths.
If policies are enacted and behavior changes, then future cases/deaths and information will change, which will induce further behavior changes. However, since the model includes lags of cases/deaths as well as their growth rates, computing a long-run effect is not completely straightforward. We investigate dynamic effects that incorporate feedback through information in section 5.
4.4. The Total Effect of Policies on Case Growth
In this section, we focus our analysis on policy effects when we hold information constant. The estimated effect of policy on behavior in Table 3 and those of policies and behavior on case/death growth in Table 4 can be combined to calculate the total effect of policy as well as its decomposition into direct and indirect effects.
The first three columns of Table 6 show the direct (holding behavior constant) and indirect (through behavior changes) effects of policy under a specification that excludes national information variables. These are computed from the specification with national cases or deaths included as information (columns (1)-(4) of Table 3 and column (1) of Table 4). The estimates imply that all policies combined would reduce the growth rate of cases and deaths by 0.70 and 0.98, respectively, out of which about two-third to three-fourth is attributable to the indirect effect through their impact on behavior. The estimate also indicates that the effect of mandatory masks for employees is mostly direct.
We can also examine the total effect of policies and information on case or death growth, by estimating (PI → Y). The coefficients on policy in this regression combine both the direct and indirect effects.
Table 5 shows the full set of coefficient estimates for (PI → Y). The results are broadly consistent with what we found above. As in Table 3, the effect of school closures is sensitive to the inclusion of national information variables. Also as above, mask mandates have a significant negative effect on growth rates.
In columns (2) and (4) of Table 5, we find that the estimated effect of mask mandates in April is larger than that in May for both case and death regressions. This may reflect a wider voluntary adoption of masks in May than in April — if more people wear masks even without mandatory mask policy, the policy effect of mandating masks for employees becomes weaker.
Table 7 presents the estimates for the specification with past national case/death variables. The effects of school closures and the sum of policies are estimated substantially smaller in Table 7 when national case/death variables are included than in Table 6. This sensitivity reflects the difficulty in identifying the aggregate time effect—which is largely captured by national cases/deaths—given little cross-sectional variation in the timing of school closures across states. On the other hand, the estimated effects of policies other than school closures are similar between Table 6 and Table 7; the effect of other policies are well-identified from cross-sectional variations.
Column “Difference” in Tables 6 and 7 show the difference between the estimate of (PI → Y) in column “PI → Y Coefficient” and the implied estimate from (BPI → Y)-(PI → B) in column “Total.” Differences are generally small and statistically insignificant, broadly supporting the validity of extra orthogonality condition in (BPI →Y). The difference for school closures as well as the sum of all policies in Table 6 is significantly different from zero, which may be due to the aforementioned difficulty in identifying the effect of school closures. There is substantial external epidemiological evidence that suggests that schooling closures may have substantial effects on the spread of the virus: studies like Jones et al. (2020) and Davies et al. (2020) establish that children carry substantial amounts of viral loads and can contribute to the transmission (due to higher contact rate than other age groups).23 The US data does not allow us to pint down the effect of closing schools reliably due to their approximate collinearity with trends in national cases.
Column “Average” of Tables 6 and 7 reports the average of “Total” and “PI → Y Coefficient” columns. The average is an appealing and simple way to combine the two estimates of the total effect: one relying on the causal structure and another inferred from a direct estimation of equation (PI → Y).24 We shall be using the average estimate in generating the counterfactuals in the next section. Turning to the results, the estimates of Tables 6 and 7 imply that all policies combined would reduce Δ log ΔD by 0.97 and 0.40, respectively. For comparison, the median of Δ log ΔDit reached its peak in mid-March of about 1.3 (see Figure 20 in the appendix). Since then it has declined to near 0. Therefore, -0.97 and -0.40 imply that policy changes can account for roughly one-third to two-third of the observed decrease in death growth. The remainder of the decline is likely due to changes in behavior from information.
5. Empirical Evaluation of Counterfactual Policies
We now turn our focus to dynamic feedback effects. Policy and behavior changes that reduce case and death growth today can lead to a more optimistic, riskier behavior in the future, attenuating longer run effects. We perform the main counterfactual experiments using the average of two estimated coefficients as reported in column “Average” of Table 6 under a specification that excludes the number of past national cases and deaths from information variables. In the appendix, we also report additional counterfactual experiment results with the specification that includes the national information variables, and find that they are very similar. The results on mask policies, business closures, stay-at-home orders are robust with respect to this variation (see Figures 10-13 in the appendix). On the other hand, the results on removing all policies, particularly closure of schools, reported in the next section, are sensitive to the inclusion of national information variables, highlighting the large uncertainty regarding the size of the effect. In Figures 9-13 below, the top panel presents the result on cases while the bottom panel presents the result on deaths.
5.1. Business Mask Mandate
We first consider the impact of a nationwide mask man-date for employees beginning on April 1st. As discussed earlier, we find that mask mandates reduce case and death growth even when holding behavior constant. In other words, mask mandates may reduce infections with relatively little economic disruption. This makes mask mandates a particularly attractive policy instrument. In this section we examine what would have happened to the number of cases if all states had imposed a mask mandate on April 1st.25
For illustrative purpose, we begin by focusing on Washington State. The left column of Figure 9 shows the observed, estimated average, and counterfactual average of Δ log ΔC (top panel) and Δ log ΔD (bottom panel). To compute the estimated and counterfactual paths, we use the estimate in column “Average” of Table 6. We set initial Δ log ΔC and log ΔC to their values first observed in the state we are simulating. We hold all other regressors at their observed values. Error terms are drawn with replacement from the residuals. We do this many times and report the average over draws of the residuals. The shaded region is a point-wise 90% confidence interval. The left column shows that the fit of the estimated and observed growth rate is quite good.
The middle column of Figure 9 shows the change in growth rate from mandating masks on April 1st. The shaded region is a 90% pointwise confidence interval. As shown, mandating masks on April 1st lowers the growth of cases or deaths 14 or 21 days later by 0.1 to 0.15. This effect then gradually declines due to information feedback. Mandatory masks reduce past cases or deaths, which leads to less cautious behavior, attenuating the impact of the policy. The reversal of the decrease in growth in late April is due to our comparison of a mask mandate on April 1st with Washington’s actual mask mandate in early May. By late April, the counterfactual mask effect has decayed through information feedback, and we are comparing it the undecayed impact of Washington’s actual, later mask mandate.
The right column of Figure 9 shows how the changes in case and death growth translate into changes in cases and deaths. The estimates imply that mandating masks on April 1st would have led to 500 fewer cases and 250 fewer deaths in Washington by the start of June.
The results for other states are similar to those for Washington. In the appendix, Figures 25 and 26 display similar results for Massachusetts and Illinois. Figure 10 shows the average change in cases and deaths across states, where the top panel shows the effect on cases and the bottom panel shows the effect on deaths. The point estimates indicate that mandating masks on April 1st could have led to 25% fewer cumulative cases and 37% fewer cumulative deaths by the end of May with their 90 percent intervals given by [10, 47]% and [18, 55]%, respectively. The result roughly translates into 18 to 55 thousand saved lives.
5.2. Non-essential Business Closures
A particularly controversial policy is the closure of non-essential businesses. We now examine a counterfactual where non-essential businesses are never closed. Figure 11 shows the effect of leaving non-essential businesses open in Washington. The point estimate implies that the closure of non-essential businesses reduced cases and deaths by a small amount. However, this estimate is relatively imprecise; 90% confidence intervals for the change in cases and deaths from leaving non-essential businesses open by the end of May are [-250,700] and [-100,1200], respectively.
Figure 12 shows the national effect of leaving non essential businesses open on cases and deaths. For cases, the estimates imply that with non-essential businesses open, cases would be about -15 to 60% higher in late May. The results for deaths are similar but less precise.
5.3. Stay-at-home orders
We next examine a counterfactual where stay-at-home orders had been never issued. Figure 13 shows the average effect of no stay-at-home orders. On average, without stay-at-home orders, case growth rate would have been nearly 0.1 higher in late April. This translates to 80% [25%,170%] more cases by the start of June. The results for deaths are similar, but slightly less precise, with no increase included in a 90 percent confidence interval.
6. Counterfactual Effect of Removing All Policies and its Sensitivity
We now consider the impact of changing from the observed policies to none. Figure 15 shows the average across states of the change in case growth and relative increase in cases under a specification without past national case variables. Removing policies leads to an increase of above 0.2 in case growth throughout April and May. The confidence interval is fairly wide, and its upper bound includes a very large increase in cases by the end of May. The right panel displays the national increase in aggregate cases without any policy intervention. The estimates imply at least a 7 fold increase in cases with a large upper bound by the end of May, or at least 14 million additional cases. The estimated impact on deaths is larger than cases, and even more imprecise.
The effect of removing all policies includes the effect of school closures. The visual evidence on growth rates for states with and without school closures, presented blow, suggest that there may be a potentially large effect, though the history is very short. The main results presented in Section 3 also support the hypothesis that the school closures were important at lowering the growth rates. This evidence is consistent with the emerging prevalence of Covid-19 among children aged 10-17, pointing that although their transmission and susceptibility rates are twice lower than adults in the group 20-30, their contact rates are much higher (Davies et al. (2020)). This type of evidence, as well as evidence that children carry amounts of viral loads similar to those in the older age groups (Jones et al. (2020)), led Germany to make the early decision of closing schools.
As discussed above, there is little variation across states in the timing of school closures. Consequently, the effect of school closures is difficult to identify statistically, because it is hard to separate it from aggregate time effect, and its estimate is sensitive to an inclusion of some aggregate variables such as national cases. To support this point, Figure 16 shows the effect of removing all policies on cases based on the estimates with national cases included as information. When national case variables are included in the specification, the estimated effect of school closures, and hence that of removing all policies, is much smaller with a 90% confidence interval of [0,10] fold increases.
Given this sensitivity, we conclude that there still exists a lot of uncertainty as to the effect of removing all policies, especially schooling. The impact of not implementing any policies on cases and deaths can be quite large, but the effect of school closures, hence that of removing all policies, is not well identified statistically from the US state-level data alone, because of the lack of cross-sectional variations. Any analyses of re-opening plans need to be aware of this uncertainty. An important research question is how to resolve this uncertainty using additional data sources.
7. Conclusion
This paper assesses the effects of policies on the spread of Covid-19 in the US using state-level data on cases, tests, policies, and social distancing behavior measures from Google Mobility Reports. Our findings are summarized as follows.
First, our empirical analysis indicates that mandating face masks has reduced the spread of Covid-19 without affecting people’s social distancing behavior measured by Google Mobility Reports. Our counterfactual experiment based on the estimated model suggests that if all states had have adopted mandatory face mask policies on April 1st of 2020, then the number of deaths by the end of May would have been smaller by as much as 17 to 55 percent, which roughly translates to 17 to 55 thousand saved lives.
Second, we find that keeping non-essential businesses open would have led to a -20 to 60% higher number of cases while not implementing stay-at-home orders would have increased cases by 25 to 170 % nationally by the start of June.
Third, we find considerable uncertainty over the impact of all policies combined on case or death growth because it is difficult to identify the effect of school closures from the US state-level data due to the lack of cross-sectional variations in the timing of school closures across states.
Fourth, our analysis shows that people voluntarily reduce their visits to workplace, retails, grocery stores, and limit their use of public transit when they receive information on a higher number of new cases and deaths. This suggests that individuals make decisions to voluntarily limit their contact with others in response to greater transmission risks, leading to an important feedback mechanism that affects future cases and deaths. Model simulations that ignore this voluntary behavioral response to information on transmission risks would over-predict the future number of cases and deaths.
Beyond these findings, our paper presents a useful conceptual framework to investigate the relative roles of policies and information on determining the spread of Covid-19 through their impact on people’s behavior. Our causal model allows us to explicitly define counterfactual scenarios to properly evaluate the effect of alternative policies on the spread of Covid-19. More broadly, our causal framework can be useful for quantitatively analyzing not only health outcomes but also various economic outcomes (Bartik et al., 2020; Chetty et al., 2020).
Data Availability
All data used in this manuscript is available in public domain as stated in the data appendix of the manuscript.
Appendix A. Data Construction
A.1. Measuring ΔC and Δ log ΔC
We have three data sets with information on daily cumulative confirmed cases in each state. As shown in Table 8, these cumulative case numbers are very highly correlated. However, Table 9 shows that the numbers are different more often than not.
Figure 17 shows the evolution of new cases in each of these three datasets. In all cases, daily changes in cumulative cases displays some excessive volatility. This is likely due to delays and bunching in testing and reporting of results. Table 10 shows the variance of log new cases in each data set, as well as their correlations. As shown, the correlations are approximately 0.9. The NYT new case numbers have the lowest variance.26 In our subsequent results, we will primarily use the case numbers from The New York Times.
For most of our results, we focus on new cases in a week instead of in a day. We do this for two reasons as discussed in the main text. First, a decline of new cases over two weeks has become a key metric for decision makers. Secondly, aggregating to weekly new cases smooths out the noise associated with the timing of reporting and testing.
Table 11 reports the correlation and variance of weekly log new cases across the three data sets. Figure 18 shows the evolution of weekly new cases in each state over time.
A.2 Deaths
Table 12 reports the correlation and variance of weekly deaths in the three data sets. Figure 19 shows the evolution of weekly deaths in each state. As with cases, we use death data from The New York Times in our main results.
A.3. Tests
Our test data comes from The Covid Tracking Project. Figure 21 shows the evolution of tests over time.
A.4. Social Distancing Measures
In measuring social distancing, we focus on Google Mobility Reports. This data has international coverage and is publicly available. Figure 22 shows the evolution of the four Google Mobility Reports variables that we use in our analysis.
A.5. Policy Variables
We use the database on US state policies created by Raifman et al. (2020). As discussed in the main text, our analysis focuses on seven policies. For stay-at-home orders, closed nonessential businesses, closed K-12 schools, closed restaurants except takeout, and closed movie theaters, we double-checked any state for which Raifman et al. (2020) does not record a date. We filled in a few missing dates. Our modified data is available here. Our modifications fill in 1 value for school closures, 2 for stay-at-home orders, 3 for movie theater closure, and 4 for non-essential business closures. Table 13 displays all 25 dated policy variables in Raifman et al. (2020)’s database with our modifications described above.
A.6. Timing
There is a delay between infection and when a person is tested and appears in our case data. MIDAS (2020) maintain a list of estimates of the duration of various stages of Covid-19 infections. The incubation period, the time from infection to symptom onset, is widely believed to be 5 days. For example, using data from Wuhan, Li et al. (2020) estimate a mean incubation period of 5.2 days. Siordia (2020) reviews the literature and concludes the mean incubation period is 3-9 days.
Estimates of the time between symptom onset and case reporting or death are less common. Using Italian data, Cereda et al. (2020) estimate an average of 7.3 days between symptom onset and reporting. Zhang et al. (2020a) find an average of 7.4 days using Chinese data from December to early February, but they find this period declined from 8.9 days in January to 5.4 days in the first week of February. Both of these papers on time from symptom onset to reporting have large confidence intervals covering approximately 1 to 20 days.
Studying publicly available data on infected persons diagnosed outside of Wuhan, Linton et al. (2020) estimate an average of 15 days from onset to death. Similarly, using publicly available reports of 140 confirmed Covid-19 cases in China, mostly outside Hubei Province, Sanche et al. (2020) estimate the time from onset to death to be 16.1 days.
Based on the above, we expect a delay of roughly two weeks between changes in behavior or policies, and changes in reported cases while a corresponding delay of roughly three weeks for deaths.
A.7. Counterfactuals for Massachusetts and Illinois
Figures 25 and 26 present the fit of estimated cases as well as the counterfactual effect of mandating masks on April 1st in Massachusetts and Illinois, respectively. Figures 27 and 28 show the counterfactual effect of leaving non-essential business open in Massachusetts and Illinois, respectively.
A.8. Counterfactuals with National Cases as Information Variables
Figures 29-31 present the results of counterfactual analyses that include the national cases/deaths as the information variables. To create this figure, we repeat the same counterfactual simulation that we did for Washington with each state. For each state, we hold national cases constant, but endogenize state specific information. Thus, these figures should be interpreted as an average of state specific counterfactuals, and not a national counterfactual.
The counterfactual results of mask policies, shelter-in-place, and closing non-essential businesses remain robust with respect to the inclusion of national case/death variables. This contrasts to the resulting counterfactual of removing all policies discussed in section 6.
Footnotes
Email address: vchern{at}mit.edu
Email address: hkasahar{at}mail.ubc.ca
Email address: schrimpf{at}mail.ubc.ca
We are grateful to Daron Acemoglu, V.V. Chari, Raj Chetty, Christian Hansen, Glenn Ellison, Ivan Fernandez-Val, David Green, Ido Rosen, Konstantin Sonin, James Stock, and Ivan Werning for helpful comments. We also thank Chiyoung Ahn, Joshua Catalano, Jason Chau, Samuel Gyetvay, Sev Chenyu Hou, Jordan Hutchings, and Dongxiao Zhang for excellent research assistance. All mistakes are our own.
↵1 See Courtemanche et al. (2020), Hsiang et al. (2020), Pei, Kandula, and Shaman (2020), Abouk and Heydari (2020), and Wright et al. (2020).
↵2 The causal model is framed using the language of structural equations models and causal diagrams of econometrics (Wright (1928); Haavelmo (1944); Heckman and Vytlacil (2007); see Greenland, Pearl, and Robins (1999), Peters, Janzing, and Bernhard (2017), and Hernán and Robins (2020) for modern developments, especially in computer science and epidemiology), with natural unfolding potential outcomes representation (Rubin, 1974; Tinbergen, 1930; Neyman, 1925; Imbens and Rubin, 2015). As such it naturally converses in all languages for causal inference.
↵3 The behavior accounts for the other half. This is in line with theoretical study by Gitmez, Sonin, and Wright (2020) that investigates the role of private behavior and negative external effects for individual decisions over policy compliance as well as information acquisition during pandemics.
↵4 As of May 27, 2020, the US Centers for Disease Control and Prevention reports 99,031 deaths in the US.
↵5 We refer the reader to Avery et al. (2020) for a comprehensive review of a larger body of work researching Covid-19; here we focus on few quintessential comparisons on our work with other works that we are aware of.
↵6 Specifically, they find that of the 60 percentage point drop in workplace intensity, 40 percentage points can be explained by changes in information as proxied by case numbers, while roughly 8 percentage points can be explained by policy changes.
↵7 See Atkeson (2020b) and Stock (2020b) for the implications of the SIR model for Covid-19 in the US. Fernández-Villaverde and Jones (2020) estimate a SIRD model in which time-varying reproduction numbers depend on the daily deaths to capture feedback from daily deaths to future behavior and infections.
↵8 The virus remains viable in the air for several hours, for which surgical masks may be effective. Also, a substantial fraction of individual who are infected become infectious before showing symptom onset.
↵9 Under some additional independence conditions, this can be replaced by an arbitrary non-additive function , such that the unconfoundedness condition stated in the next footnote holds.
↵10 An alternative useful starting point is to impose the Rubin-Rosenbaum type unconfoudedness condition: which imply, with treating stochastic errors as independent additive components, the orthogonal conditions stated above.
↵11 The structural equations of this form are connected to triangular structural equation models, appearing in microeconometrics and macroeconometrics (SVARs), going back to the work of Strotz and Wold (1960).
↵12 This is a pre-cautionary message that may be useful for other researchers using fixed effects estimators in the context of Covid-19 analysis. We recommend using debiased fixed effects estimators, see e.g., Chen, Chernozhukov, and Fernández-Val (2019) for expository treatment.
↵13 The similarity of the debiased fixed effects and correlated random effects served as a useful specification check. Moreover, using the fixed effects estimators only yielded minor gains in predictive performances, as judging by the adjusted R2’s, providing another useful specification check.
↵14 This initialization is appropriate in our context for analyzing pandemics from the very beginning, but other initializations could be appropriate in other contexts. The lagged values of behavior variable may be also included in the information set.
↵15 We may show that log(ΔCit) − log(ΔCi,t−7) approximates the average growth rate of cases from t − 7 to t.
↵16 It is possible to consider counterfactual exercises in which policy responds to information through the policy equation if we are interested in endogenous policy responses to information. Although this is beyond the scope of the current paper, counterfactual experiments with endogenous government policy would be important, for example, to understand the issues related to the lagged response of government policies to higher infection rates due to incomplete information.
↵17 The other two measures are “Residential” and “Parks.” We drop “Residential” because it is highly correlated with both “Workplaces” and “Retail & recreation” at correlation coefficients of -0.98. We also drop “Parks” because it does not have clear implication on the spread of Covid-19.
↵18 Analyzing the New York City’s subway ridership, Harris (2020) finds a strong link between public transit and spread of infection.
↵19 We take 14 and 21 day lags of mask policies for case and death growths, respectively, to identify the states with a mask mandate because policies affect cases and deaths with time lags. See our discussion in the Appendix A.6.
↵20 As we review in the Appendix A.6, a lag length of 14 days between exposure and case reporting, as well as a lag length of 21 days between exposure and deaths, is broadly consistent with currently available evidence.
↵21 Month dummies also represent the latent information that is not fully captured by the past cases and growths.
↵22 Note that we are not evaluating the effect of universal mask-wearing for the public but that of mask-wearing for employees. The effect of universal mask-wearing for the public could be larger if people comply with such a policy measure. Tian et al. (2020) considered a model in which mask wearing reduces the reproduction number by a factor (1 − e · pm)2, where e is the efficacy of trapping viral particles inside the mask and pm is the percentage of mask-wearing population. Given an estimate of R0 = 2.4, Howard et al. (2020) argue that 50% mask usage and a 50% mask efficacy level would reduce the reproduction number from 2.4 to 1.35, an order of magnitude impact.
↵23 The evidence presented in Jones et al. (2020) has lead German to make the decision to close schools early.
↵24 Averaging the two estimates theoretically reduces noise, albeit in our case the reductions are small. Another approach would be to use precision averaging, which would give similar result. Finally, another approach would be to use generalized method of moments to estimate all of the equations jointly. We don’t pursue this approach since it is likely to be non-robust under local deviations from correct specification; simple model averaging is more appealing in this case.
↵25 We feel this is a very plausible counterfactual policy. In a paper made publicly available on April 1st, Abaluck et al. (2020) argued for mask usage based on comparisons between countries with and without pre-existing norms of widespread mask usage.
↵26 This comparison is somewhat sensitive to how you handle negative and zero cases when taking logs. Here, we replaced log(0) with −1. In our main results, we work with weekly new cases, which are very rarely zero.