Estimation of effects of contact tracing and mask adoption on COVID-19 transmission in San Francisco: a modeling study ====================================================================================================================== * Lee Worden * Rae Wannier * Seth Blumberg * Alex Y. Ge * George W. Rutherford * Travis C. Porco ## Abstract The current COVID-19 pandemic has spurred concern about what interventions may be effective at reducing transmission. The city and county of San Francisco imposed a shelter-in-place order in March 2020, followed by use of a contact tracing program and a policy requiring use of cloth face masks. We used statistical estimation and simulation to estimate the effectiveness of these interventions in San Francisco. We estimated that self-isolation and other practices beginning at the time of San Francisco’s shelter-in-place order reduced the effective reproduction number of COVID-19 by 35.4% (95% CI, −20.1%–81.4%). We estimated the effect of contact tracing on the effective reproduction number to be a reduction of approximately 44% times the fraction of cases that are detected, which may be modest if the detection rate is low. We estimated the impact of cloth mask adoption on reproduction number to be approximately 8.6%, and note that the benefit of mask adoption may be substantially greater for essential workers and other vulnerable populations, residents return to circulating outside the home more often. We estimated the effect of those interventions on incidence by simulating counterfactual scenarios in which contact tracing was not adopted, cloth masks were not adopted, and neither contact tracing nor cloth masks was adopted, and found increases in case counts that were modest, but relatively larger than the effects on reproduction numbers. These estimates and model results suggest that testing coverage and timing of testing and contact tracing may be important, and that modest effects on reproduction numbers can nonetheless cause substantial effects on case counts over time. Key words * COVID-19 * San Francisco * California * Contact tracing * PPE ## Introduction The current COVID-19 pandemic has spurred concern about what interventions may be effective at reducing transmission. In San Francisco and several nearby counties, an official order to shelter in place1 took effect on March 17, 2020, directing people to stay at home and avoid all but essential gatherings, travel, and business. Schools and some day care facilities and public places such as parks have additionally been closed. On March 19, a similar stay-at-home order was issued covering the entire state of California.2 More recently, San Francisco has introduced a program of contact tracing, and has begun to require the use of cloth face masks beginning April 18, 2020.3 At the time of this writing, the shelter-in-place order has been extended through the month of May. The accumulation of new COVID-19 cases in San Francisco appears to have slowed since late March. Because of the danger of widespread transmission of SARS-Cov-2 in terms of illness and loss of life and potential overloading of health care resources, and hardships associated with self-isolation, it can be important to estimate the effect of epidemic control measures on transmission of the disease. We used simulation models to estimate the effect of the March 17 shelter-in-place and related changes on COVID-19 transmission rates in San Francisco. While other models have attempted to estimate the impact of quarantine and isolation [5–8, 10, 18–21, 23, 25, 27, 30–38, 40, 44, 46–48] or used complex models to look at the impact of various interventions [11–13, 39, 45] none have yet combined mask adoption and test-and-treat fit to local geographic data. We estimated the effects of contact tracing and widespread mask adoption on COVID-19 transmission rates in San Francisco, and projected case counts forward four weeks with and without contact tracing and mask adoption to estimate their effect on numbers of cases. ## Methods ### Data County-level cumulative case counts are reported by individual counties, frequently on a daily basis. These have been aggregated by the New York Times.4 ### Transmission model Estimation of parameters and projection of case counts into the future were done using a stochastic renewal process model that simulates a population of infected individuals, some of whom are detected and included in reported case counts. The key assumptions were as follows. #### The time-varying reproduction number (*R**t*) is unknown The model assumed a constant value of *R**t* ranging from 0.3 to 5 until March 17, 2020, and three separate constant values of *R**t* in the same range after March 17, with discontinuous changes on April 8 and April 18, reflecting the adoption of San Francisco’s shelter in place, contact tracing, and cloth mask policies. It produced estimates of *R**t* by selecting from these possibilities whichever values were best able to match the case counts reported to date in the Bay Area. #### The incubation period is approximately 5–6 days The incubation interval was modeled using a log-normal distribution with mean 5.6 days and standard deviation 4.2 days. #### Transmission can begin before the onset of symptoms Transmission was assumed to occur roughly from two days before symptom onset to several days after system onset. #### Delays in case reporting are variable Reporting of cases was assumed to occur after a variable period of delay, most often around 4–5 days after symptom onset, but with a tail extending out to several weeks after symptom onset. #### The rate of reporting of true COVID-19 cases is unknown The reporting rate was allowed to range from 1.1% reporting (the lower bound value of 1 in 85 which appeared in the initial draft of a recent Santa Clara county study [3], dated 17 April 2020, and subsequently revised) to 60% reporting. The model selects whichever values are best able to reproduce the case counts reported to date in the Bay Area. For more detail, see the Appendix. ### Estimation of effect of contact tracing on transmission We estimated the impact of contact tracing on transmission using the same estimates of the incubation period, timing of transmission events, and delay from symptom onset to case detection as in the above model (see Appendix for details). Contact tracing consists of identifying contacts *y* who may have been infected by a confirmed case *x* and attempting to isolate them to prevent them from transmitting to other people. If contact tracing happens the day a case *x* is detected, the success of contact tracing can be modeled by estimating how often the detection date of case *x* predates the dates of transmission from contacts *y*. The interval from symptom onset of *x* to dates of transmission from contacts *y* is a sum of random variables (Figure 1): the time from symptom onset of *x* to transmission to a contact *y* (which may be negative), plus the incubation interval to symptom onset of *y*, plus the interval from that to transmission from *y*. ![Figure 1:](http://medrxiv.org/https://www.medrxiv.org/content/medrxiv/early/2020/06/11/2020.06.09.20125831/F1.medium.gif) [Figure 1:](http://medrxiv.org/content/early/2020/06/11/2020.06.09.20125831/F1) Figure 1: Schematic of timing of events involved in contact tracing. Contact tracing of a confirmed case (*x*) aims at preventing transmission from contacts (*y*) of that case. It can succeed when potential transmission events occur after case detection (lavender shaded area). This requires the interval from symptom onset to case confirmation (purple arrow) to be shorter than the time to transmission to a contact (red arrows, upper line) plus the incubation period of a contact (light blue arrow, lower line) plus the time to transmission from a contact (red arrows, lower line). By Monte Carlo sampling we found that the detection interval is exceeded by the interval to transmission from contacts in approximately 44% of cases. We conducted sensitivity analysis of these assumptions by altering the mean time to case detection downward from 8.9 days to 5 days, and upward to 13 days, while leaving the logSD parameter unchanged. We found detection predating transmission to contacts of contacts in 64% and 29% of cases, respectively. Thus, we assumed that contact tracing can prevent 44% of transmission from a primary case. We modeled contact tracing by a reduction in reproduction number of 0.44 *p**d*, where *p**d* is the probability that a given case is detected. San Francisco’s contact tracing program, aside from a brief early rollout, went into effect gradually in early April 2020. We approximate this for modeling purposes by a start date of April 8, 2020. We used the above estimate to model what would have happened in the absence of the contact tracing program by modeling case counts assuming that reproduction numbers are inflated by a factor of ![Graphic][1] from April 8 onward, where ![Graphic][2] is the rate of case detection estimated by the model. ### Estimation of the effect of cloth mask adoption on transmission We estimated the effect of wearing cloth facial masks in the community and workplaces in reducing transmission [2, 15, 17, 26, 29, 41]. We assumed the population to be 80% compliant with mask wearing policy, that cloth masks reduce the probability of an infected individual transmitting to an uninfected and unmasked individual by 30%, and that an uninfected individual is only 10% protected by wearing a cloth mask, based on studies showing that the primary benefit of wearing cloth or surgical masks is to protect the environment from the wearer rather than the wearer from the environment [2, 15, 41]. These probabilities were combined to yield an overall reduction of transmission probability in workplaces as well as the community of 30.1%. These estimates were then used to estimate the overall population reduction in transmission when mask wearing is implemented in the communities and workplaces. We used estimates of contact and transmission rates from influenza models to estimate the contribution of the neighborhood and workplace to effective transmission [14]. We also used the mean length of the infectious period and a mean household size of 2.69 in the San Francisco Bay Area [1] to estimate the reduction in effective transmission within the household due to depletion of susceptibles over the infectious period, to more accurately estimate effective contribution of household transmission to the overall transmission. Based upon a 75% reduction [12] in effective contact rates in the workplace and community domains under Shelter-in-Place orders, we estimate that 71% of transmission occurs in households, 17% in the neighborhood and 12% in the workplace. From extending these assumption, we estimate that masks will be worn during only 29% of otherwise effective transmissions, and thus masks will reduce effective transmission rate by 8.6%. We note that this estimate reflects assumptions that the interactions affected by mask usage—contacts in neighborhoods and workplaces—are substantially reduced by the practice of sheltering in place. If communities return to work and to circulating in public more, the use of masks will surely have more effect. We note also that the benefit of masks may be much greater among people who are less able to self isolate, such as essential workers or unhoused individuals. We used this estimate to model the effect of mask use on epidemic dynamics by modeling a scenario in which masks were not adopted on April 18, the start date of San Francisco’s cloth mask policy, by assuming that reproduction numbers are inflated from April 18 on, by a factor of 1*/*(1 − 0.086), or approximately 1.094, and by modeling the case in which both contact tracing and cloth masks were not adopted, by combining this inflation with the inflation described above for contact tracing. ## Results We estimated effective instantaneous reproduction numbers *R**t* under the above mentioned model assumptions of piecewise constant values, reflecting a possible changing effect of social distancing and other protective measures (Figure 2). Our model estimated a decline in reproduction numbers, from a mean value of 1.87 before 17 March (95% central interval, 1.38–2.62) to 1.15 (95% central interval, 0.37–1.86) between 17 March and 7 April. San Francisco’s shelter-in-place policy and related measures were estimated to have led to a mean 35.4% reduction in effective reproduction number (95% central interval, −20.1%–81.4%). ![Figure 2:](http://medrxiv.org/https://www.medrxiv.org/content/medrxiv/early/2020/06/11/2020.06.09.20125831/F2.medium.gif) [Figure 2:](http://medrxiv.org/content/early/2020/06/11/2020.06.09.20125831/F2) Figure 2: Model estimates of effective *R**t* and number of cases, fit to San Francisco counts and in three counterfactual scenarios. Top Left: model fit to San Francisco counts; Top Right: supposing contact tracing did not begin April 8, 2020; Bottom Left: supposing adoption of cloth masks did not begin April 18, 2020; Bottom Right: supposing both contact tracing and cloth mask adoption did not happen. Model assumes *R**t* constant except for instantaneous changes on March 17, April 8, and April 18, 2020. Ribbons show mean and 95% central interval of effective *R**t* values and median and 95% central interval of model case counts, weighted by importance sampling (see Methods). Second, we estimated how the recent course of the outbreak might have been altered by the adoption of contact tracing and masks. We used the renewal process model to generate estimates of time-varying reproduction numbers, overall incidence, and other parameters from daily reported case counts from January 2020 through May 19, 2020. We compared the model fit to true reported cases to three counterfactual scenarios for Bay Area transmission during those dates (Figures 2 and 3). The model’s mean estimated reproduction number *R**t* declined from 1.85 to 1.13 in San Francisco following widespread sheltering in place, consistent with substantial reduction in transmission as a direct result of the intervention. A median count of 36.7 reported cases per day was estimated over the final week May 13–May 19, 2020 in the fit to San Francisco reported data, compared to medians of 40.9 daily cases in the counterfactual scenario without contact tracing, 41.9 daily cases in the scenario without mask adoption, and 52.7 daily cases in the scenario without both contact tracing and masks. ![Figure 3:](http://medrxiv.org/https://www.medrxiv.org/content/medrxiv/early/2020/06/11/2020.06.09.20125831/F3.medium.gif) [Figure 3:](http://medrxiv.org/content/early/2020/06/11/2020.06.09.20125831/F3) Figure 3: Distributions of model case counts over the week May 13–May 19, 2020, with and without interventions. Estimated from model outcomes using Gaussian kernel smoothing with bandwidth of 20 cases. Vertical bars represent median number of cases. ## Discussion Despite a substantial estimated decline in transmission rate, represented by change in reproduction number at the time of sheltering in place, San Francisco has not achieved unambiguous subcriticality and thus we cannot conclude that the epidemic is ebbing. We have estimated that reductions in transmission associated with both the contact tracing program and the adoption of cloth masks may be modest, but we note that because the reproduction number *R**t* is an exponential growth rate, modest differences in *R**t* can lead to substantial differences in the course of an outbreak. We also note that while the effects of both interventions on *R**t* may be modest, it is for different reasons. The impact of contact tracing on the overall rate of transmission may be smaller than it could be for two reasons: because contact tracing is carried out on individuals who receive positive test results, who may be a fraction of the true number of cases, and because fast spread of the infection combined with delays in case detection may make it difficult to isolate contacts before they pass on the virus. Cloth masks, on the other hand, which can reduce transmission substantially in neighborhood and workplace settings, are estimated to have a modest impact on transmission during shelter in place measures simply because neighborhood and workplace contacts are contributing less transmission. It is likely that masks can reduce transmission more substantially if social distancing practices are lessened, and that they can be important in reducing transmission to essential workers, including healthcare workers, and among populations who may have substantial contact with strangers such as unhoused communities. Our estimate for contact tracing points to the importance of widespread testing in controlling the spread of this disease. In addition, it highlights the importance of timing to the effectiveness of contact tracing. Contact tracing may be most effective in interrupting transmission when applied to seed cases who are identified very soon after symptom onset (if not before), and to their most recent contacts. There might be some benefit to contact tracing some individuals prospectively without waiting for a positive test result, to gain the advantage of time at the cost of some accuracy. We note also that contact tracing has multiple goals and benefits beyond reducing transmission, including locating cases and giving people access to guidance and testing and treatment. We note that our group found a similar modest effect of contact tracing in measles control, because the much higher transmissibility means that much transmission may be to casual or anonymous contacts who are hard to identify, as well as because high vaccination rates imply that many contacts will have already been vaccinated [24]. This model exhibits the following limitations. We assumed constant reproduction numbers *R**t* before and after the adoption of San Francisco’s shelter in place policy, so this model cannot detect more detailed changes in *R**t*. The model assumes uniform dynamics across all cases in a simulation of a county, not accounting for specific geographic and demographic heterogeneity. The city and county of San Francisco is modeled in isolation, without migration or transmission across county lines (since we anticipate more transmission within than between counties). Detection rates are assumed to be constant per capita; a gradually rising detection rate can cause an upward bias [28]. If testing is limited by available resources, the assumption of a per capita rate may not be justified. Alternative hypotheses for the unknown interval distributions of generation time and time to detection should be evaluated. In particular, the impact of the amount of transmission occurring before onset of symptoms, and the tail of long times to detection, should be examined carefully. The distribution of generation intervals is affected by censoring of transmission after cases’ detection dates, which shifts generation intervals to shorter times, so that our baseline interval distribution should ideally be for generation times in the absence of detection, but our estimates are taken from populations with some amount of detection. This could lead to bias toward shorter generation times than is accurate. Heterogeneity in transmission rates between communities within the city, and across racial differences, appears to be very important as vulnerable populations and specifically people of color are disproportionately affected, and should be considered explicitly where possible. ## Data Availability This manuscript used only publicly available data. ## Acknowledgements LW and TCP acknowledge support from the US NIH NIGMS MIDAS program, R01-GM130900. The views, opinions, assumptions and conclusions or any other information set out in this article are solely those of the authors and do not necessarily reflect those of the NIH. ## Appendix ### Stochastic model implementation The simulation model constructed a stochastic time series of case counts by day, based on assumptions about transmission rates and time intervals. Let the number of transmission events (equivalently, the number of cases infected) on day *i* be denoted *t**i*. Each run of the simulation began with some number of index cases infected on day 1. For each day *i*, the model estimated secondary cases from the *t**i* cases infected on day *i*. Each secondary case was assigned an infection date *j > i*, and it was added to the count *t**j*. Case detection was modeled as follows. Let *d**i* denote the number of cases that would be detected on day *i* if detection were perfect. We assumed cases are detected with and independent and identical probability of *p**d* per case. Each primary case that was infected on day *i* as above was assigned a counterfactual detection date *k* at the same time its secondary cases were simulated. All cases were added to the count *d**k* of potential detections. For successful detections, no secondary cases whose infection date falls after day *k* were simulated. Time series generated by this process are assigned a likelihood score reflecting their similarity to the series of case counts reported by health departments. The count of reported new cases by day was smoothed for this purpose using a five day moving average. Given a series *C**i* of smoothed reported new cases by day, the likelihood was the binomial probability of detecting *C**i* cases given *d**i* cases to be detected and detection rate *p**d*. The likelihood assigned to a simulation time series overall was constructed from the mean of daily log likelihoods over all the daily counts that were used in scoring. For scoring, case counts before the first date on which the number of new cases was greater than two were omitted, and all days from that day forward were used for scoring. The assignment of model days *i* to calendar dates was made by assigning the first day of simulation to a random date 1 to 21 days before the first scoring date, to allow for model populations with differing values of *R**t* to take differing amounts of time to arrive at case counts matching the scoring values. ### Epidemiological assumptions We built our COVID model from an earlier simulation model, which was used to represent measles or Ebola virus disease transmission [42, 43]. In simulating transmission of SARS-CoV-2 from individual to individual, we used several assumptions. We first assumed independent and identically distributed random times for the incubation interval, i.e., the number of days from infection of an individual to symptom onset. Given that interval, the time to case detection is an independent identically distributed offset from the date of symptom onset, as are all transmission events from that individual. The number of secondary cases per case is assumed to be negative binomially distributed, and independent between cases. The mean number of cases per case (the effective reproduction number *R**t*) is taken to be constant except for specific changes, reflecting recommendations for social distancing. Bay Area counties were recommended to begin social distancing on 17 March 2020. *R**t* takes a single value before 17 March and three constant values there-after, in the same range, with discontinuous changes on 8 April and 18 April, representing the dates of adoption of contact tracing and cloth masks. The model selects values from those ranges based on their ability to reproduce the reported case counts in Bay Area counties. Finally, the rate of detection of COVID-19 cases is unknown, and may be changing over time depending on test availability. Detection probability per individual ranges from 0.011 to 0.6 both before and after 10 March, and those two values are selected separately based on matching Bay Area case counts. The model uses the above assumptions to generate stochastic time series of numbers of all infected individuals, and of the smaller numbers who are detected (reported). The detection rate is used as a binomial likelihood function to assign likelihoods to model timeseries and the parameter values that generated them, which is used in sampling/importance resampling [22] to construct a posterior distribution of parameters and outcomes. Simulation outcomes projected forward in time are used with this importance distribution to construct probabilistic forecasts. ### Parameterization **The distribution of number of secondary cases per primary case** is assumed to be negative binomial, with mean *R**t* and dispersion parameter *k* [4]. The value of *R**t* can vary by day of transmission. We are assuming that *R**t* takes on four values, constant except for instantaneous changes on 17 March 2020, 8 April 2020, and 18 April 2020, reflecting the dates of introduction of San Francisco’s shelter in place policy, contact tracing program, and cloth mask policy, respectively. These constant values are uniformly distributed from 0.3 to 3.0 in each of these periods. The dispersion parameter *k* is assumed constant in time, at a value sampled uniformly from 0.1 to 0.8 (representing distributions with more tail density than the geometric distribution, as has been estimated in other diseases, i.e. presence of some frequency of superspreading events). **The distribution of number of days from infection to symptom onset**, i.e. the incubation period, was assumed to be log-normally distributed with mean 5.6 days and standard deviation 4.2 days [16]. **The distribution of number of days from symptom onset to a transmission event**, which may be negative reflecting presymptomatic transmission, was modeled by −2.5 days plus a gamma distributed number of days with scale parameter 1.5 and shape parameter 2.1 [16]. This assumption was modified by using this distribution to model transmission events relative to either the symptom onset date or 3 days after infection, whichever is later. **The distribution of number of days from symptom onset to becoming a reported case**, the detection interval distribution, is assumed to be log-normally distributed with mean 8.9 days and standard deviation 7 days, to reflect the possibility that some cases may be detected soon after symptom onset and others may be detected several weeks later. **The detection probability** is assumed constant, taken from a uniform distribution from 0.011 to 0.6. **One index case** is assumed to seed each simulation realization, with an infection date uniformly sampled 1 to 21 days before the first recorded case count used for likelihood scoring. ### Calculation of effective reproduction number Central estimates and confidence intervals on daily counts and parameter values are constructed by importance sampling as follows. Likelihoods are transformed into a probability distribution by normalizing to 1: ![Formula][3] where *l**x* is the likelihood of realization *x*. Estimates for future cumulative case counts are constructed using the importance sampled model series of new counts by day, by adding the cumulative new counts on days after the last reported date to the last reported count. The effective reproduction number by day can be recorded in at least two ways. First, the effective reproduction number of each case with a given date of infection is the actual number of cases infected by that case, ![Formula][4] where *t*(*x, y*) is one if case *x* is the source of infection for case *y* infection, and zero otherwise. The effective “case reproduction number” on a given day is the average of those of the cases infected that day: ![Formula][5] where *i*(*x*) is the date of infection of case *x*. Second, a measure of *instantaneous* effective reproduction number by day [9], measuring transmission occurring on a given day rather than transmission from cases infected on a given day, but in units of cases per case, is ![Formula][6] These two quantities averaged over all days of the model will give the same overall average *R*. The second estimator gives a more timely indication of changes in transmission rate. The model estimates of reproduction number by day reported in this paper are constructed using the latter method, computed from the actual number of transmission events generated by the simulation per day. ## Footnotes * 1 [https://www.sfdph.org/dph/alerts/files/HealthOrderC19-07-%20Shelter-in-Place.pdf](https://www.sfdph.org/dph/alerts/files/HealthOrderC19-07-%20Shelter-in-Place.pdf), [http://www.acphd.org/media/561969/faqs-order-shelter-in-place-20200324.pdf](http://www.acphd.org/media/561969/faqs-order-shelter-in-place-20200324.pdf), retrieved May 3, 2020. * 2 [https://covid19.ca.gov/img/Executive-Order-N-33-20.pdf](https://covid19.ca.gov/img/Executive-Order-N-33-20.pdf), retrieved May 3, 2020. * 3 [https://sfmayor.org/article/san-francisco-issues-new-policy-face-coverings](https://sfmayor.org/article/san-francisco-issues-new-policy-face-coverings), retrieved May 3, 2020. * 4 [https://github.com/nytimes/covid-19-data](https://github.com/nytimes/covid-19-data), last accessed April 30, 2020. * Received June 9, 2020. * Revision received June 9, 2020. * Accepted June 11, 2020. * © 2020, Posted by Cold Spring Harbor Laboratory This pre-print is available under a Creative Commons License (Attribution 4.0 International), CC BY 4.0, as described at [http://creativecommons.org/licenses/by/4.0/](http://creativecommons.org/licenses/by/4.0/) ## References 1. [1].Census 2000 SF1, SF3, DP1-DP4, Census 2010 DP-1, American Community Survey 2006-2010. 2. [2]. A. Balazy, S. M. Toivola, D. A. Adhikari, S. K. Sivasubramani, T. Reponen, and S. A. Grinshpun. Do N95 respirators provide 95% protection level against airborne viruses, and how adequate are surgical masks? American Journal of Infection Control, 34(2):51–57, 2006. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1016/j.ajic.2005.08.018&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=16490606&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2020%2F06%2F11%2F2020.06.09.20125831.atom) [Web of Science](http://medrxiv.org/lookup/external-ref?access_num=000235919100001&link_type=ISI) 3. [3]. E. Bendavid, B. Mulaney, N. Sood, S. Shah, E. Ling, R. Bromley-Dulfano, C. Lai, Z. Weissberg, R. Saavedra, J. Tedrow, D. Tversky, A. Bogan, T. Kupiec, D. Eichner, R. Gupta, J. Ioannidis, and J. Bhattacharya. COVID-19 antibody seroprevalence in Santa Clara County, California. medRxiv, 2020. 4. [4]. S. Blumberg, W. T. A. Enanoria, J. O. Lloyd-Smith, T. M. Lietman, and T. C. Porco. Identifying postelimination trends for the introduction and transmissibility of measles in the United States. American Journal of Epidemiology, 179(11):1375–1382, 2014. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1093/aje/kwu068&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=24786800&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2020%2F06%2F11%2F2020.06.09.20125831.atom) [Web of Science](http://medrxiv.org/lookup/external-ref?access_num=000337027400012&link_type=ISI) 5. [5]. D. Caccavo. Chinese and Italian COVID–19 outbreaks can be correctly described by a modified SIRD model. medRxiv, 2020. 6. [6]. K. Chatterjee, K. Chatterjee, A. Kumar, and S. Shankar. Healthcare impact of COVID– 19 epidemic in India: A stochastic mathematical model. Medical Journal of the Armed Forces of India, 2020. 7. [7]. S. C. Choi and M. Ki. Estimating the reproductive number and the outbreak size of Novel Coronavirus disease (COVID-19) using mathematical model in Republic of Korea. Epidemiology and Health, page e2020011, 2020. 8. [8]. G. Chowell, R. Dhillon, and D. Srikrishna. Getting to zero quickly in the 2019–nCov epidemic with vaccines or rapid testing. medRxiv, 2020. 9. [9]. A. Cori, N. M. Ferguson, C. Fraser, and S. Cauchemez. A new framework and software to estimate time-varying reproduction numbers during epidemics. American Journal of Epidemiology, 178(9):1505–1512, November 2013. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1093/aje/kwt133&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=24043437&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2020%2F06%2F11%2F2020.06.09.20125831.atom) 10. [10]. N. Crokidakis. Data analysis and modeling of the evolution of COVID–19 in Brazil, 2020. 11. [11]. S. E. Eikenberry, M. Mancuso, E. Iboi, T. Phan, K. Eikenberry, Y. Kuang, E. Kostelich, and A. B. Gumel. To mask or not to mask: Modeling the potential for face mask use by the general public to curtail the COVID–19 pandemic. medRxiv, 2020. 12. [12]. N. M. Ferguson, D. Laydon, G. Nedjati-Gilani, N. Imai, K. Ainslie, M. Baguelin, S. Bhatia, A. Boonyasiri, Z. Cucunubá, G. Cuomo-Dannenburg, A. Dighe, I. Dorigatti, H. Fu, K. Gaythorpe, W. Green, A. Hamlet, W. Hinsley, L. C. Okell, S. van Elsland, H. Thompson, R. Verity, E. Volz, H. Wang, Y. Wang, P. G. T. Walker, C. Walters, P. Winskill, C. Whittaker, C. A. Donnelly, S. Riley, and A. C. Ghani. Impact of non-pharmaceutical interventions (NPIs) to reduce COVID-19 mortality and healthcare demand. 2020. 13. [13]. G. Giordano, F. Blanchini, R. Bruno, P. Colaneri, A. Di Filippo, A. Di Matteo, M. Colaneri, and the COVID19 IRCCS San Matteo Pavia Task Force. A SIDARTHE model of COVID–19 epidemic in Italy, 2020. 14. [14]. J. J. Grefenstette, S. T. Brown, R. Rosenfeld, J. DePasse, N. T. B. Stone, P. C. Cooley, W. D. Wheaton, A. Fyshe, D. D. Galloway, A. Sriram, H. Guclu, T. Abraham, and D. S. Burke. FRED (a framework for reconstructing epidemic dynamics): an opensource software system for modeling infectious diseases and control strategies using census-based populations. BMC Public Health, 13:940, 2013. 15. [15]. S. Guha, B. McCaffrey, P. Hariharan, and M. R. Myers. Quantification of leakage of sub-micron aerosols through surgical masks and facemasks for pediatric use. Journal of occupational and environmental hygiene, 14(3):214–223, 2017. 16. [16]. Xi He, Eric H. Y. Lau, Peng Wu, Xilong Deng, Jian Wang, Xinxin Hao, Yiu Chung Lau, Jessica Y. Wong, Yujuan Guan, Xinghua Tan, Xiaoneng Mo, Yanqing Chen, Baolin Liao, Weilie Chen, Fengyu Hu, Qing Zhang, Mingqiu Zhong, Yanrong Wu, Lingzhai Zhao, Fuchun Zhang, Benjamin J. Cowling, Fang Li, and Gabriel M. Leung. Temporal dynamics in viral shedding and transmissibility of COVID-19. Nature Medicine, 26(5):672–675, May 2020. Number: 5 Publisher: Nature Publishing Group. [PubMed](http://medrxiv.org/lookup/external-ref?access_num=http://www.n&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2020%2F06%2F11%2F2020.06.09.20125831.atom) 17. [17]. Jeremy Howard, Austin Huang, Zhiyuan Li, Zeynep Tufekci, Vladimir Zdimal, Helene-Mari van der Westhuizen, Arne von Delft, Amy Price, Lex Fridman, Lei-Han Tang, Viola Tang, Gregory L. Watson, Christina E. Bax, Reshama Shaikh, Frederik Questier, Danny Hernandez, Larry F. Chu, Christina M. Ramirez, and Anne W. Rimoin. Face Masks Against COVID-19: An Evidence Review. April 2020. Publisher: Preprints. 18. [18]. B. Ivorra, M. Ruiz Ferrández, M. Vela-Perez, and A. M. Ramos. Mathematical modeling of the spread of the coronavirus disease 2019 (COVID–19) taking into account the undetected infections. The case of China. Communications in nonlinear science and numerical simulation, 04 2020. 19. [19]. W. Jia, K. Han, Y. Song, W. Cao, S. Wang, S. Yang, J. Wang, F. Kou, P. Tai, J. Li, M. Liu, and Y. He. Extended SIR prediction of the epidemics trend of COVID–19 in Italy and compared with Hunan, China. medRxiv, 2020. 20. [20]. S. Kim, Y. B. Seo, and E. Jung. Prediction of COVID–19 transmission dynamics using a mathematical model considering behavior changes. Epidemiology and Health, ():e2020026–, 2020. 21. [21]. A. J. Kucharski, T. W. Russell, C. Diamond, Y. Liu, J. Edmunds, S. Funk, R. M. Eggo, F. Sun, M. Jit, J. D. Munday, N. Davies, A. Gimma, K. van Zandvoort, H. Gibbs, J. Hellewell, C. I. Jarvis, S. Clifford, B. J. Quilty, N. I. Bosse, S. Abbott, P. Klepac, and S. Flasche. Early dynamics of transmission and control of COVID-19: a mathematical modelling study. Lancet Infectious Diseases, 2020. 22. [22].1. A. Gelman and 2. X. L. Meng K. H. Li. The Sampling/Importance Resampling algorithm. In A. Gelman and X. L. Meng, editors, Applied Bayesian Modeling and Causal Inference from IncompleteData Perspectives: An Essential Journey with Donald Rubin’s Statistical Family, pages 265–276. Wiley, 2004. 23. [23]. R. Li, W. Lu, X. Yang, P. Feng, O. Muqimova, X. Chen, and G. Wei. Prediction of the epidemic of COVID–19 based on quarantined surveillance in China. medRxiv, 2020. 24. [24]. F. Liu, W. T. A. Enanoria, J. Zipprich, S. Blumberg, K. Harriman, S. F. Ackley, W. D. Wheaton, J. L. Allpress, and T. C. Porco. The role of vaccination coverage, individual behaviors, and the public health response in the control of measles epidemics: an agentbased simulation for California. BMC Public Health, 15:447, 2015. 25. [25]. X. Liu, G. J. D. Hewings, S. Wang, M. Qin, X. Xiang, S. Zheng, and X. Li. Modeling the situation of COVID–19 and effects of different containment strategies in China with dynamic differential equations and parameters estimation. medRxiv, 2020. 26. [26]. M. M. Mansour and G. C. Smaldone. Respiratory source control versus receiver protection: Impact of facemask fit. Journal of Aerosol Medicine and Pulmonary Drug Delivery, 26(3):131–137, 2013. PMID: 23544951. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1089/jamp.2012.0998&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=23544951&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2020%2F06%2F11%2F2020.06.09.20125831.atom) 27. [27]. W. K. Ming, J. Huang, and C. J. P. Zhang. Breaking down of healthcare system: Mathematical modelling for controlling the novel coronavirus (2019–nCoV) outbreak in Wuhan, China. bioRxiv, 2020. 28. [28]. R. Omori, K. Mizumoto, and G. Chowell. Changes in testing rates could mask the novel coronavirus disease (COVID–19) growth rate. International Journal of Infectious Diseases, 94:116–118, 2020. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1016/j.ijid.2020.04.021&link_type=DOI) 29. [29]. Kimberly A. Prather, Chia C. Wang, and Robert T. Schooley. Reducing transmission of SARS-CoV-2. Science, May 2020. Publisher: American Association for the Advancement of Science Section: Perspective. 30. [30]. X. Rong, L. Yang, H. Chu, and M. Fan. Effect of delay in diagnosis on transmission of COVID–19. Mathematical Biosciences and Engineering, 17(mbe-17-03-149):2725, 2020. 31. [31]. L. Russo, C. Anastassopoulou, A. Tsakris, G. N. Bifulco, E. F. Campana, G. Toraldo, and C. Siettos. Tracing DAY-ZERO and forecasting the fade out of the COVID–19 outbreak in Lombardy, Italy: A compartmental modelling and numerical optimization approach. medRxiv, 2020. 32. [32]. R. Sameni. Mathematical modeling of epidemic diseases: A case study of the COVID–19 coronavirus, 2020. 33. [33]. P. Shi, S. Cao, and P. Feng. SEIR transmission dynamics model of 2019 nCoV coronavirus with considering the weak infectious ability and changes in latency duration. medRxiv, 2020. 34. [34]. P. Shi, S. Cao, and P. Feng. Study on the epidemic development of corona virus disease-19 (COVID–19) in Hubei province by a modified SEIR model. medRxiv, 2020. 35. [35]. P. X. Song, L. Wang, Y. Zhou, J. He, B. Zhu, F. Wang, L. Tang, and M. Eisenberg. An epidemiological forecast model and software assessing interventions on COVID-19 epidemic in China. medRxiv, 2020. 36. [36]. T. Sun and D. Weng. Estimating the effects of asymptomatic and imported patients on COVID–19 epidemic using mathematical modeling. Journal of Medical Virology. 37. [37]. Y. Tao. Maximum entropy method for estimating the reproduction number: An investigation for COVID–19 in China. medRxiv, 2020. 38. [38]. P. Teles. Predicting the evolution of SARS-Covid-2 in Portugal using an adapted SIR model previously used in South Korea for the MERS outbreak, 2020. 39. [39]. A. Tuite, D. N. Fisman, and A. L. Greer. Mathematical modeling of COVID–19 transmission and mitigation strategies in the population of Ontario, Canada. medRxiv, 2020. 40. [40]. V. Volpert, M. Banerjee, and S. Petrovskii. On a quarantine model of coronavirus infection and data analysis, 2020. 41. [41]. M. E. Wood, R. E. Stockwell, G. R. Johnson, K. A. Ramsay, L. J. Sherrard, N. Jabbour, E. Ballard, P. O’Rourke, T. J. Kidd, C. E. Wainwright, L. D. Knibbs, P. D. Sly, L. Morawska, and S. C. Bell. Face masks and cough etiquette reduce the cough aerosol concentration of pseudomonas aeruginosa in people with cystic fibrosis. American Journal of Respiratory and Critical Care Medicine, 197(3):348–355, 2018. PMID: 28930641. [PubMed](http://medrxiv.org/lookup/external-ref?access_num=28930641&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2020%2F06%2F11%2F2020.06.09.20125831.atom) 42. [42]. L. Worden, S. F. Ackley, J. Zipprich, K. Harriman, W. T. A. Enanoria, R. Wannier, and T. C. Porco. Measles transmission during a large outbreak in California. Epidemics, 30:100375, 2020. 43. [43]. L. Worden, R. Wannier, N. A. Hoff, K. Musene, B. Selo, M. Mossoko, E. Okitolonda-Wemakoy, J. J. Muyembe Tamfum, G. W. Rutherford, T. M. Lietman, A. W. Rimoin, T. C. Porco, and J. D. Kelly. Projections of epidemic transmission and estimation of vaccination impact during an ongoing Ebola virus disease outbreak in Northeastern Democratic Republic of Congo, as of Feb. 25, 2019. PLoS Neglected Tropical Diseases, 13(8):e0007512, 2019. 44. [44].Xinhai X. L, X. Zhao, and Y. Sun. The lockdown of Hubei province causing different transmission dynamics of the novel coronavirus (2019–nCoV) in Wuhan and Beijing. medRxiv, 2020. 45. [45]. L. Zhang, M. Shen, X. Ma, S. Su, W. Gong, J. Wang, Y. Tao, Z. Zou, R. Zhao, J. Lau, W. Li, F. Liu, K. Ye, Y. Wang, G. Zhuang, and C. K. Fairley. What is required to prevent a second major outbreak of the novel coronavirus SARS-CoV-2 upon lifting the metropolitan-wide quarantine of Wuhan city, China. medRxiv, 2020. 46. [46]. Y. Zhang, B. Jiang, J. Yuan, and Y. Tao. The impact of social distancing and epicenter lockdown on the COVID–19 epidemic in mainland China: A data-driven SEIQR model study. medRxiv, 2020. 47. [47]. S. Zhao and H. Chen. Modeling the epidemic dynamics and control of COVID–19 outbreak in China. medRxiv, 2020. 48. [48]. X. Zhou, Z. Wu, R. Yu, S. Cao, W. Fang, Z. Jiang, F. Yuan, C. Yan, and D. Chen. Modelling-based evaluation of the effect of quarantine control by the Chinese government in the coronavirus disease 2019 outbreak. medRxiv, 2020. [1]: /embed/inline-graphic-1.gif [2]: /embed/inline-graphic-2.gif [3]: /embed/graphic-4.gif [4]: /embed/graphic-5.gif [5]: /embed/graphic-6.gif [6]: /embed/graphic-7.gif