Influenza may facilitate the spread of SARS-CoV-2
=================================================

* Matthieu Domenech de Cellès
* Jean-Sébastien Casalegno
* Bruno Lina
* Lulla Opatowski

## Abstract

As in past pandemics, co-circulating pathogens may play a role in the epidemiology of coronavirus disease 2019 (COVID-19), caused by the novel severe acute respiratory syndrome coronavirus 2 (SARSCoV-2). Here we hypothesized that influenza interacted with SARS-CoV-2 during the early 2020 epidemic of COVID-19 in Europe. We developed a population-based model of SARS-CoV-2 transmission, combined with mortality incidence data in four European countries, to test a range of assumptions about the impact of influenza. We found consistent evidence for a 2–2.5-fold population-level increase in SARSCoV-2 transmission associated with influenza during the period of co-circulation. These results suggest the need to increase vaccination against influenza, not only to reduce the burden due to influenza viruses, but also to counteract their facilitatory impact on SARS-CoV-2.

## Main Text

The current pandemic of coronavirus disease 2019 (COVID-19), caused by the novel severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2), has led to global alarm. Following the first case reports in December 2019 in Wuhan, China [1], SARS-CoV-2 rapidly spread across the globe and has resulted in approximately 19 million cases and 700,000 deaths worldwide, as of August 6, 2020 [2]. Because of the current lack of prophylactic or therapeutic treatments, the pandemic has caused the implementation of unprecedented control measures, which culminated in the lockdown of several billion people in over 100 countries during April–May 2020 [3]. Although a number of fixed (e.g., greater age, male sex) and chronic (e.g., hypertension, diabetes) risk factors of mortality have now been identified [4], the time-varying drivers of COVID-19 epidemiology remain poorly understood. Experience gained from past pandemics has highlighted the potentially large contribution of co-circulating pathogens to the burden of an emerging disease [5]. Despite the relevance for epidemic forecasting and for designing control strategies, the impact of co-circulating pathogens on SARSCoV-2 epidemiology has remained largely unexplored [6].

Respiratory viruses—including SARS-CoV-2 and other coronaviruses, rhinoviruses, influenza viruses, etc.—form a large class of viruses that cause seasonal infections of the respiratory tract in humans. Mounting evidence indicates that their epidemiologies are not independent, as a result of interaction mechanisms that may operate at different scales and that can be classified as either facilitatory or antagonistic [7, 8]. The interaction between the respiratory syncytial virus (RSV) and influenza may provide an example of antagonism. Indeed, experimental evidence in ferrets has shown that influenza viruses induce an antiviral state that transiently limits secondary infection with RSV [9], an effect postulated to explain the delayed epidemic of RSV during the 2009 influenza pandemic [10, 11]. Although such antagonistic interactions appear, to date, to be the most common among respiratory viruses [8], experimental evidence indicates that co-infections may have a facilitatory effect, for example by increasing viral growth [12]. Increased transmission of influenza during co-infection with other respiratory viruses was also proposed to explain the multiple waves during the 1918 influenza pandemic [13]. Interestingly, according to recent evidence a viral respiratory infection (in particular with influenza viruses) can up-regulate the expression of ACE2—the cognate receptor of SARS-CoV-2 in human cells—in the respiratory epithelium [14]. This suggests that respiratory viruses could affect the epidemiology of SARS-CoV-2. Here, we hypothesized that influenza—which peaked in February 2020 and therefore co-circulated during the early spread of COVID-19 in Europe (Fig. 1B)—interacted with SARS-CoV-2.

![Figure 1:](http://medrxiv.org/https://www.medrxiv.org/content/medrxiv/early/2020/09/09/2020.09.07.20189779/F1.medium.gif)

[Figure 1:](http://medrxiv.org/content/early/2020/09/09/2020.09.07.20189779/F1)

Figure 1: Potential drivers of SARS-CoV-2 transmission in Belgium, Italy, Norway, and Spain.
A: time plot of the stringency index, a country-level aggregate measure of the number and of the strictness of non-pharmaceutical control measures implemented by governments. The vertical dashed line indicates the start of the nationwide lockdown [16]. B: time plot of influenza incidence, calculated as the product of the incidence of influenza-like illnesses and of the fraction of samples positive to any influenza virus (see also Fig. S1 for a time plot of the latter two variables). The vertical dashed lines delimitate the period of overlap between SARS-CoV-2 and influenza, defined as the period between the assumed start date of SARS-CoV-2 community transmission and 6 weeks after the epidemic peak of influenza [46]. In each country, the time series displayed were incorporated as covariates, which modulated the transmission rate of SARS-CoV-2 in our model (see Methods). In B, the *y*-axis values differ for each panel.

To test this hypothesis, we developed a stochastic, population-based model of SARS-CoV-2 transmission and of COVID-19 mortality [15, 16, 17]. Our model incorporated a realistic distribution of the generation time (mean 6.5 days, coefficient of variation 0.58, see Fig. S2 and Ref. [18]) and of the time from symptom onset to death (mean 17.8 days, coefficient of variation 0.45 [19]), under the assumption that 1% of all infections resulted in death [16]. A novel feature of our model was the inclusion of the stringency index, an aggregate measure of the number and of the strictness of non-pharmaceutical control measures (e.g., restrictions on travel, school or work closure, lockdown) implemented by governments in response to COVID-19 (Fig. 1A and ref. [3]). Specifically, we mapped the stringency index into a relative reduction in SARSCoV-2 transmission using a simple linear scaling function, whose slope represented the impact of control measures (see Methods). To assess the potential impact of influenza, we also incorporated renormalized time series of influenza incidence as drivers of SARS-CoV-2 transmission into our model. Using state-of-the-art statistical inference methods [20, 21], we systematically evaluated how different hypotheses about the impact of influenza explained the observed dynamics of COVID-19 mortality.

Based on influenza data availability from the World Health Organization (WHO, Figs. 1B, S1 and ref. [22]), we conducted our analysis in four European countries (Belgium, Italy, Norway, and Spain), where COVID-19 mortality peaked in March–April 2020 (Refs. [23, 24, 25, 26] and Fig. 2B). The results were unequivocal: we found consistent evidence that, during the period of co-circulation, influenza was associated with an average 2–2.5-fold population-level increase in SARS-CoV-2 transmission (Table 1). After controlling for the impact of influenza, our estimates of the basic reproduction number (*R*) ranged from 2 (Italy and Spain) to 3.3 (Belgium). Although the increased transmission associated with influenza early during the SARS-CoV-2 epidemic explained the data significantly better (Table 1), a model without influenza led to higher *R* estimates (range 2.5–5, Fig. 2A), consistent with those of a previous study [16]. Also in line with [16], we found consistent evidence for a marked impact of non-pharmaceutical control measures (Table 1), which were associated with a decrease in SARS-CoV-2 transmission below the reproduction threshold from mid-March to early June 2020 (Fig. 2A). Visual inspection of simulations suggested that our model correctly captured the dynamics of COVID-19 mortality in every country (Fig. 2B). A more detailed model–data comparison of summary statistics confirmed that our model accurately predicted the peak time, the peak number and the total number of deaths, and the death growth exponent [27], except in Spain where the latter statistic was systematically under-estimated (Table S5). Our model-based estimates of the total proportion of individuals infected with SARS-CoV-2 (as of 4 May 2020, Table 1) were also comparable with those of a previous modeling study [16] and of a seroprevalence study conducted in early May in Spain [28]. Hence, our model appeared to precisely recapitulate the epidemiology of SARS-CoV-2 morbidity and mortality over a period of *∼*4 months.

![Figure 2:](http://medrxiv.org/https://www.medrxiv.org/content/medrxiv/early/2020/09/09/2020.09.07.20189779/F2.medium.gif)

[Figure 2:](http://medrxiv.org/content/early/2020/09/09/2020.09.07.20189779/F2)

Figure 2: Dynamics of SARS-CoV-2 transmission and of COVID-19 mortality in Belgium, Italy, Norway, and Spain.
A: time plot of the estimated effective reproductive number (*Re*). In each panel, the black line represents the maximum likelihood estimate and the grey ribbon the 95% confidence interval (calculated based on the likelihood profile of the influenza impact parameter, cf. Table 1) in each country. The dotted black line represents the effective reproduction number estimated from a model without influenza(i.e., with the influenza impact parameter fixed to 0 and the other parameters estimated from the data). The horizontal grey line is at *Re* = 1. B: time plot of the simulated and observed numbers of daily deaths caused by SARS-CoV-2. In each panel, the light grey lines represent 1,000 model simulations, with one simulation highlighted in dark grey; the black line represents the actual death counts. In A and B, the *x*-axis and the *y*-axis values differ for each panel.

View this table:
[Table 1:](http://medrxiv.org/content/early/2020/09/09/2020.09.07.20189779/T1)

Table 1: Model parameter estimates in Belgium, Italy, Norway, and Spain. For the proportion infected as of May 4, the numbers between parentheses represent a 95% prediction interval, based on 1,000 simulations at the maximum likelihood estimate. For the other parameters, they represent an approximate 95% confidence interval, calculated using either the profile likelihood [47] (parameter *eβF*) or a parametric bootstrap (other parameters). SE: standard error, calculated using 5 replicate particle filters, each with 20,000 particles, at the maximum likelihood estimate.

To verify the robustness of our results, we conducted three additional analyses (see Supplementary Results). First, we estimated an extended model in which influenza was allowed to modulate the lethality, in addition to the transmission, of SARS-CoV-2 (Table S2). Compared with the base model, we found little support for such a model in Belgium, Italy, and Norway (log-likelihood difference [∆log *L*] in the range 0.0–0.4, likelihood ratio test P-value in the range 0.37–1.00). In Spain, however, the parameter estimates suggested that influenza was associated with both increased transmission and lethality, but the statistical evidence was weak (∆log *L* = 3.2, *P* = 0.01). Second, we estimated another model, in which the reduction of SARS-CoV-2 transmission was allowed to scale non-linearly with the stringency index (Table S3). We found little statistical evidence that such a model outperformed the simple linear scaling function in Belgium, Norway, and Spain (∆log *L ∈* [0.1, 1.5], *P ∈* [0.08, 0.65]). In Italy, however, we found strong evidence (∆log *L* = 21.3, *P* < 10−3) for super-linear scaling at low values of the stringency index (Fig. S3), although our estimate of the impact of influenza was unchanged. This result may reflect the impact of the early lockdown in part of Lombardy, which preceded the one in Italy as a whole by a few weeks [29]. Third, to take into account potential spatial effects in the transmission dynamics of SARS-CoV-2 in Italy and in Spain [29, 28], we relaxed the assumption of homogeneous mixing (Table S4 and Refs. [30, 31]). In Italy (∆log *L* = 26.1, *P* < 10−3), but not in Spain (∆log *L* = 0.0, *P* = 1), we found evidence that the force of infection scaled sub-linearly with SARS-CoV-2 infection prevalence. This result may be explained by the progressive spread of SARS-CoV-2 from northern to southern regions of Italy [29]. Crucially, however, our estimate of the impact of influenza was unchanged in both countries. In addition, we found that our parameter estimates varied little when testing alternative hypotheses about the fixed value of the average generation time, of the onset-to-death time, and of the infection fatality ratio (Table S6). In sum, our main result about the impact of influenza remained robust to a variety of alternative assumptions regarding the epidemiological traits of SARS-CoV-2 and the modeled impact of control measures.

Our model makes at least two testable predictions. First, even though our results did not allow to distinguish between higher transmissibility or higher susceptibility in individuals co-infected with influenza and SARS-CoV-2, previous experimental work suggests that the latter mechanism may operate, as a result of up-regulation of the ACE2 receptor caused by influenza infection [14]. Hence, we predict that a recent influenza infection should be an independent risk factor for subsequent SARS-CoV-2 infection. Estimates of the frequency of co-detection of influenza and SARS-CoV-2 by polymerase chain reaction (PCR) testing in nasopharyngeal swabs were highly variable in previous studies (range 0–60% [6, 32]). Although the marked seasonality of influenza in temperate regions likely explains in part the low frequency found in some studies [32], we propose that differences in the natural history of influenza and SARS-CoV-2 infections also lead to a systematic under-estimation of co-infection. Specifically, because the incubation period of SARS-CoV-2 infection (estimated to average 5.7 days [33]) exceeds that of influenza (A, 1.4 days or B, 0.6 days [34]), it is likely that, by the time SARS-CoV-2 infection becomes detectable, influenza no longer is. To make that statement more precise, we calculated the probability of detectability of a co-infection, with influenza first then SARS-CoV-2 (Table S7). Assuming that influenza is detectable by PCR up to 4–5 days after [35], and SARS-CoV-2 from 2–4 days before [36], symptom onset, we find that a large, 30–50% of co-infections may not be detectable at all. These results may help explain the low frequency of co-detection found in some studies [37], and suggest that the time window of co-detectability may be too short to adequately infer the association between influenza and SARS-CoV-2 using PCR testing. Serological studies comparing the prevalence of antibodies against influenza in SARS-CoV-2 cases and non-cases may therefore be required to test the prediction that influenza is a risk factor for SARS-CoV-2 infection. Second, we predict that individuals vaccinated against influenza should be at lower risk of SARS-CoV-2 infection than those unvaccinated. The findings of a negative association between influenza vaccine coverage and COVID-19 mortality in ecological studies (in Italy [38] and in other countries [39]) and of a lower risk of SARS-CoV-2 infection in influenza vaccinees in a US prospective study [40] are consistent with our prediction, but further epidemiological investigations are needed. Importantly, our results can explain these findings as the direct effect of influenza vaccines on influenza infection, instead of indirect effects on non-influenza pathogens (e.g., as a result of trained immunity) [41].

Our study has a number of important limitations. First, for simplicity and as in other studies [15, 17, 16], our model was not age-structured, even though many aspects of COVID-19 and of influenza epidemiology— like disease severity and lethality—vary markedly with age [19]. The susceptibility to SARS-CoV-2 infection was also found to increase with age [42], a finding potentially explained by lower baseline expression of the ACE2 receptor in children [43]. Another testable prediction of our model, therefore, is that influenza should be associated with a transient increase in susceptibility to SARS-CoV-2 infection, commensurate with the variations of influenza incidence over age. Second, we modeled the impact of non-pharmaceutical control measures using a simple, linear function scaling the stringency index to the reduction of SARS-CoV-2 transmission. Even though this simple hypothesis provided a more parsimonious fit (except in Italy), that result may be specific to Europe, where control measures gradually increased in number and in intensity (Fig. 1A). In general, the association is likely non-linear (e.g., if a high-impact intervention like a lockdown is implemented early on), and we therefore recommend testing a variety of scaling functions. Third, we did not specifically model fully asymptomatic cases, which may represent a large fraction of SARS-CoV-2 infections [17]. The omission of asymptomatic infections may lead to biased *R* estimates if their duration significantly differs from that of symptomatic infections [44]. A previous study, however, estimated that the duration of both types of infection is comparable [17], such that our estimates should be robust in more complex model structures. Finally, we assessed only the impact of influenza, because of its high prevalence and period of overlap with SARS-CoV-2 in early 2020 in Europe and of the availability of high-quality data [22]. Nevertheless, other respiratory viruses, like RSV and rhinoviruses, may also interact with SARSCoV-2 and should be considered [14], especially if SARS-CoV-2 continues to spread widely during new seasons in temperate regions of the Northern hemisphere.

In conclusion, our results suggest that influenza virus infection increases the transmission of SARS-CoV-2 and facilitated its spread during the early 2020 epidemic of COVID-19 in Europe. Hence, an increase in the uptake of influenza vaccines may be called for, not only to reduce hospitalizations due to influenza infections [32, 45], but also to reduce their downstream impact on SARS-CoV-2 transmission and on COVID-19 mortality. More generally, taking into account the microbial environment of SARS-CoV-2 may be essential, not only to better understand its epidemiology, but also to enhance current and future infection control strategies.

## Data Availability

All data and R codes will be made available via a Dryad digital repository and are available upon request.

## Funding

No specific funding was used for this study.

## Authors contributions

MDdC conceived of the study design and performed the analysis. JSC and BL provided content expertise. LO conceived of the study design and oversaw the analysis.

## Competing interests

MDdC received postdoctoral funding (2017–2019) from Pfizer and consulting fees from GSK. JSC declares no competing interests. BL is chair of the ISC for the Global Influenza Surveillance Network, and co-chair of the Global Influenza and RSV initiative; he is also a member of the French COVID-19 Scientific Committee (no personal income for all these activities). LO has received consulting fees from WHO for work on antimicrobial resistance.

## Data and materials availability

All data and R codes will be made available via a Dryad digital repository and are available upon request of the reviewers.

## Supplementary Materials

### S1 Materials and Methods

#### Data

##### Stringency index data

Country-level time series of the stringency index were available from the Oxford COVID-19 Government Response Tracker, developed at the University of Oxford and described elsewhere [3]. Briefly, the stringency index provides an aggregate measure of the number and of the strictness of non-pharmaceutical control measures implemented by governments in response to the COVID-19 epidemic. The stringency index is defined as the average of 9 normalized ordinal variables, which quantify the strength (e.g., recommended or required) and the scope (e.g., targeted or general) of closure and containment measures (8 variables) and of health measures (1 variable). The resulting index allows to quantify the strength of control measures in a systematic way, on a scale ranging from 0 (no interventions) to 100 (maximum number and maximal intensity of control measures). Of note, however, the stringency index does not quantify the impact of control measures, which likely varied across countries [16]. In formulating our model, we therefore modeled the relationship between the stringency index and the relative reduction in SARS-CoV-2 transmission using a non-decreasing function, whose parameters represented the impact of control measures and were estimated from the data.

##### Influenza incidence data

Virological data on the weekly numbers of samples tested and of samples positive to any influenza virus were available from the FluNet database, compiled by the WHO (Fig. S1A). Parallel syndromic data on the weekly incidence rate of influenza-like illnesses (ILI) were available from the FluID database, also compiled by the WHO (Fig. S1B). Those data were deemed high-quality and used in a previous study on influenza forecasting in the countries considered here [22]. The weekly incidence rate of influenza was then calculated as the product of ILI incidence and of the fraction of samples positive to any influenza virus (Fig. 1B). Because the magnitude of influenza incidence thus calculated varied markedly across countries (e.g., as a result of different surveillance systems and case definitions), we rescaled each time series by its average during the period of co-circulation of influenza and SARS-CoV-2 (Fig. 1B). The resulting time series was therefore dimensionless and equalled 1 when influenza equalled its average value during that period.

![Figure S1:](http://medrxiv.org/https://www.medrxiv.org/content/medrxiv/early/2020/09/09/2020.09.07.20189779/F3.medium.gif)

[Figure S1:](http://medrxiv.org/content/early/2020/09/09/2020.09.07.20189779/F3)

Figure S1: Syndromic ILI data (A) and virological influenza data (B) in Belgium, Italy, Norway, and Spain.
In A, the red bars represent the numbers of samples positive to any influenza virus and the grey bars those negative.

##### COVID-19 mortality data

Data on the daily number of deaths caused by SARS-CoV-2 (counted by date of death) were available from national public health public institutes, in Belgium (Sciensano [23]), in Italy (*Dipartimento della Protezione Civile* [24]), and in Spain (*Instituto de Salud Carlos III*, official data with historical corrections compiled by the media DATADISTA [26]). In Norway, the data were available from the worldwide database compiled by the European Center for Disease Control and Prevention [25]. Following a previous study [16], and to avoid a possible bias caused by the dominance of deaths due to non-locally acquired infections early in the epidemic, we included observed deaths from the date after which the cumulative observed death count exceeded 10. Data points before that date were treated as missing and were assigned a conditional log-likelihood of 0, such that they did not contribute to the overall log-likelihood. The data were not further pre-processed, except in Italy, where a negative death count was reported on 24 June 2020 and was treated as missing and also assigned a log-likelihood of 0.

#### Transmission model

##### Model formulation

We formulated a variant of the standard Susceptible–Exposed–Infected–Recovered transmission model [48], using the method of stages to allow for a realistic distribution of the latent, infectious, and onset-to-death periods [49, 50]. Specifically, we assumed that the latent and infectious periods were Erlang-distributed with shape parameter 2 and mean 1*/σ* = 4 days and 1*/γ* = 5 days, respectively [17]. The resulting generation time *Tg* (i.e., the time from infection of a primary case to transmission to a secondary case) had a mean of 6.5 days and a coefficient of variation of 0.58 (see Fig. S2 for the full distribution and the details of the calculation), consistent with empirical observations and with the values fixed in a previous modeling study [18, 16]. To model the impact of the gradual implementation of non-pharmaceutical control measures (e.g., border closure, school closure, lockdown), we mapped the stringency index (denoted by *s*(*t*)) to the time-varying relative reduction in transmission of SARS-CoV-2 (denoted by *rβ*(*t*)). Specifically, we used the following simple linear scaling function, with saturation: ![Formula][1]</img>  

Here the parameter *b* quantifies how fast the transmission rate of SARS-CoV-2 decreases as the stringency index increases. Hence, this parameter can be interpreted as a measure of the impact of non-pharmaceutical control measures on SARS-CoV-2 transmission. The deterministic variant of the model was represented by the following set of differential equations: ![Formula][2]</img>  ![Formula][3]</img>  

The force of infection (that is, the per capita rate at which susceptible individuals contract infection [48]), *λ*(*t*), was modeled as: ![Formula][4]</img>  ![Formula][5]</img>  ![Formula][6]</img>  ![Formula][7]</img>  where *R* represents the basic reproduction number of SARS-CoV-2, *Re*(*t*) the time-varying effective reproduction number, *N* the population size (assumed constant during the study period), and *F* (*t*) the renormalized time series of influenza incidence, incorporated as a covariate into the model (Fig. 1). With this formulation, the parameter *βF* quantifies the impact of influenza on SARS-CoV-2 transmission: *βF* > 0 if influenza increases transmission, *βF* < 0 if influenza decreases transmission, and *βF* = 0 if influenza has no impact on transmission (null hypothesis). More specifically, the average incidence of influenza during the period of co-circulation with SARS-CoV-2 corresponds to *F* (*t*) = 1, such that *eβF* represents the average relative variation of SARS-CoV-2 transmission associated with influenza (null hypothesis: *eβF* = 1). In the main text and in the following text, we report the estimates of *eβF* to facilitate the interpretation of the impact of influenza. In writing equation (2), we implicitly assume that the impact of influenza on SARS-CoV-2 transmission, if any, is short-lived and does not extend long after influenza infection.

Finally, we incorporated an observation model that related the dynamics of SARS-CoV-2 infection to that of COVID-19 mortality, taking into account the fact that only a fraction of infections results in death and that, among those, death occurs some time after symptom onset [19, 33, 16]. We assumed an average duration of pre-symptomatic of 2.5 days, resulting in an average incubation duration of 6.5 days, in broad agreement with previous empirical studies [36, 33]. Hence, individuals in the first infected state (*I*1) were considered pre-symptomatic, and the onset of symptoms was assumed to coincide with the transition from *I*1 to *I*2. The onset-to-death time was then assumed to be Erlang distributed with shape parameter 5 and mean 1*/κ* = 17.8 days (coefficient of variation of 0.45), the value estimated in a previous epidemiological study [19]. In sensitivity analysis, we also tested a mean onset-to-death time of 1*/κ* = 13 days, the lower bound estimated in a meta-analysis [33]. According to previous studies, the infection fatality ratio (IFR) typically ranges from 0.5% to 1% [51, 19]. We fixed the IFR to *µ* = 0.01 in the base model, but we considered an alternative value of 0.005 in a sensitivity analysis. Given those assumptions, the observation model was modeled by the following set of ordinary differential equations: ![Formula][8]</img>  

Here *DM* is the simulated number of daily deaths, modeled as an accumulator variable and reset to 0 at the end of each day. The observed number of daily deaths, *DO*, was modeled using a negative binomial distribution with mean *DM* and over-dispersion ![Graphic][9]</img>, a standard distribution used in a number of previous modeling studies [16, 52].

As in Flaxman et al. [16], simulations were started 30 days before the date from which the cumulative observed death count first exceeded 10. At that date, we assumed that *E*1(0) individuals had been exposed to SARS-CoV-2; other individuals were assumed susceptible to infection (i.e., *S*(0) = *N* − *E*1(0)), and all other compartments were initialized to 0.

The stochastic variant of the model was implemented as a continuous-time Markov process approximated via a multinomial modification of the *τ*-leap algorithm [31], with a fixed time step of 10−1 day.

![Figure S2:](http://medrxiv.org/https://www.medrxiv.org/content/medrxiv/early/2020/09/09/2020.09.07.20189779/F4.medium.gif)

[Figure S2:](http://medrxiv.org/content/early/2020/09/09/2020.09.07.20189779/F4)

Figure S2: Model-based distribution of the generation time.
For our model, the density function of the generation time is given by [53, 54]: ![Graphic][10]</img>. The resulting distribution is bell-shaped, with mean ![Graphic][11]</img> and coefficient of variation 0.58.

##### Model estimation

The following five parameters were estimated from the data: 

1.  The basic reproduction number, *R*. According to a previous meta-analysis [55], this parameter was searched in the interval 2–10.

2.  The impact of non-pharmaceutical control measures, *b*. The lower bound of the search interval of this parameter was fixed to 0.5, such that the maximal value of the stringency index (*s* = 100) corresponded to a minimal reduction of SARS-CoV-2 transmission of 50% [16].

3.  The impact of influenza on SARS-CoV-2 transmission, *βF* (search interval: ℝ).

4.  The initial number of individuals exposed to SARS-CoV-2, *E*1(0) (search interval: 0–104).

5.  The over-dispersion in death reporting, *kD* (search interval: ℝ+).

A summary list of fixed and estimated model parameters is presented in Table S1

All parameters were transformed to be estimated on an unconstrained scale, using a log transformation for positive parameters and the extended logistic function ![Graphic][12]</img> for parameters constrained in the interval [*a, b*]. The maximum iterated filtering algorithm (MIF2 [20]), implemented in the R package pomp [21, 56], was used to estimate model parameters. The estimation was completed in several steps, starting with trajectory matching to identify good starting parameters for MIF2, followed by 100 independent runs of MIF2 to locate the maximum likelihood estimate (MLE). The profile likelihood was calculated to verify the convergence of MIF2 and to derive an approximate 95% confidence interval for the parameter *βF* [47]. For the other parameters, a parametric bootstrap was used to calculate approximate 95% confidence intervals, by re-estimating the parameters for each of 200 synthetic datasets simulated at the MLE [57, 58].

View this table:
[Table S1:](http://medrxiv.org/content/early/2020/09/09/2020.09.07.20189779/T2)

Table S1: 
List of model parameters.

### S2 Supplementary results

#### Model with impact of influenza on both transmission and lethality

To test the hypothesis that influenza increases COVID-19 lethality, in addition to SARS-CoV-2 transmission, we extended our base model so that influenza was also allowed to modulate the IFR. Specifically, we replaced the constant IFR *µ* by the time-varying parameter: ![Formula][13]</img>  where *µF ∈* ℝ quantifies the impact of influenza on COVID-19 mortality and was estimated from the data. The results are presented in Table S2 and are discussed in the main text.

View this table:
[Table S2:](http://medrxiv.org/content/early/2020/09/09/2020.09.07.20189779/T3)

Table S2: Point parameter estimates of an extended model with impact of influenza on both transmission and mortality.
*∗*Log-likelihood difference (P-value, from a log-likelihood ratio test) with the base model presented in Table 1.*†*Parameter not identified.

#### Model with non-linear function mapping the stringency index to the relative reduction in transmission

Although we assumed a simple linear scaling in our base model, it can also be hypothesized that the reduction of SARS-CoV-2 transmission scales non-linearly with the stringency index. For example, super-linear scaling for low values of the stringency index may occur if a potentially high-impact intervention (e.g., lockdown) is implemented early on, such that a modest increase in the stringency index results in a marked decrease in SARS-CoV-2 transmission. Conversely, sub-linear scaling may also be plausible if potentially low-impact interventions (e.g., border closure) are implemented first. To test those hypotheses, we considered an alternative, non-linear scaling function of the form: ![Formula][14]</img>  where *f*(*x*) = (1+*e−x*)−1 is the logistic function. Here the extra parameter *b*2 controls the slope at the origin, with *b*2 < 1 representing super-linear scaling at low values of the stringency index, and *b*2 > 1 super-linear scaling. For *b*2 = 1, ![Graphic][15]</img>), such that the base model with linear scaling is nested within this more general model. The corresponding parameter estimates are presented in Table S3; the scaling function estimated in Italy is also plotted in Fig. S3 and further discussed in the main text.

View this table:
[Table S3:](http://medrxiv.org/content/early/2020/09/09/2020.09.07.20189779/T4)

Table S3: Point parameter estimates of an extended model with a non-linear scaling function for the stringency index.
*∗*Log-likelihood difference (P-value from a log-likelihood ratio test) with the base model presented in Table 1.

![Figure S3:](http://medrxiv.org/https://www.medrxiv.org/content/medrxiv/early/2020/09/09/2020.09.07.20189779/F5.medium.gif)

[Figure S3:](http://medrxiv.org/content/early/2020/09/09/2020.09.07.20189779/F5)

Figure S3: Estimated shape of the scaling function in Italy.
The dashed grey line represents the identity line.

#### Model extension with inhomogeneous mixing

To model spatial effects in the dynamics of SARS-CoV-2 transmission in Italy and in Spain [29, 28], we implemented an extended model in which we relaxed the assumption of homogeneous mixing [30]. Here we assumed that the force of infection could scale non-linearly with SARS-CoV-2 infection prevalence [31]: ![Formula][16]</img>  where the mixing coefficient *α ≥* 0 was estimated from the data. Given that ![Graphic][17]</img> 1 represents sub-linear scaling and *α* < 1 super-linear scaling. The results of those experiments are presented in Table S4 and further discussed in the main text.

View this table:
[Table S4:](http://medrxiv.org/content/early/2020/09/09/2020.09.07.20189779/T5)

Table S4: 
**Point parameter estimates of an extended model with** inhomogeneous mixing. *Loglikelihood difference (P-value) with the base model presented in Table 1.

#### Model fit to data summary statistics

To evaluate the model fit in more detail, we examined the model– data agreement on a number of statistics that summarized important aspects of the mortality data—that is, probes [59, 21]). Specifically, we considered the following probes: 

*   Peak time (in days relative to the start of the study period).

*   Peak daily number of deaths.

*   Total number of deaths.

*   Epidemic growth exponent. According to a previous study [27], we assumed that, until the peak time, the daily number of deaths grew algebraically, i.e., *D*(*t*) ∝ *tα*. We then estimated the growth exponent *α* using a log-log linear regression model.

The observed and simulated probe values are summarized in Table S5 and discussed in the main text.

View this table:
[Table S5:](http://medrxiv.org/content/early/2020/09/09/2020.09.07.20189779/T6)

Table S5: Model–data comparison on probes.
The values highlighted in red indicate model-based probes that did not enclose the observed data probe value.

#### Sensitivity analyses

To verify the robustness of our results, we conducted a number of sensitivity analyses. Specifically, we modified the value of 3 fixed model parameters (infection fatality ratio, average onset-todeath time, and average generation time) and we repeated the estimations as before. As shown in Table S6, the estimate of the impact of influenza on SARS-CoV-2 transmission (*eβF*) remained consistently above 1 for all scenarios tested.

View this table:
[Table S6:](http://medrxiv.org/content/early/2020/09/09/2020.09.07.20189779/T7)

Table S6: 
Sensitivity analyses.

#### Probability that an influenza–SARS-CoV-2 co-infection is detectable

To calculate the probability that a co-infection with influenza then SARS-CoV-2 can be be detected, we ran a simulation study. Assuming that influenza infection occurred first, we first generated a sample of influenza incubation periods from a log-Normal distribution with median 1.4 days and dispersion 1.51, based on the results of a previous review [34]. We then generated a sample of detection periods, assuming that influenza could be shed (and therefore detected) up to 4–5 days after symptom onset [35]. Second, we generated a sample of SARS-CoV-2 infection times, uniformly between the time of infection and the end time of detectability of influenza. Finally, we generated a sample of SARS-CoV-2 incubation periods (from a Gamma distribution with mean 5.7 days [33] and coefficient of variation 0.86 [16]) and of SARS-CoV-2 detection start times, assuming that SARS-CoV-2 could be detected from 2 to 4 days before symptom onset [36]. In each simulation, we calculated the probability that co-detection can be detected as the fraction of the sample for which the maximal detection time of influenza exceeded the minimal detection time of SARS-CoV-2. The results are presented in Table S7 and discussed in the main text.

View this table:
[Table S7:](http://medrxiv.org/content/early/2020/09/09/2020.09.07.20189779/T8)

Table S7: Probability that an influenza–SARS-CoV-2 co-infection can be detected.
The results are based on sample size of 105; replicate simulations gave identical results, such that the estimates may be considered exact.

## Acknowledgements

We thank Arturo Zychlinsky and Klaus Osterrieder for helpful comments on the manuscript. Computations underlying the present analysis were performed at the Max Planck Computing and Data Facility (MPCDF)

*   Received September 7, 2020.
*   Revision received September 7, 2020.
*   Accepted September 9, 2020.


*   © 2020, Posted by Cold Spring Harbor Laboratory

This pre-print is available under a Creative Commons License (Attribution-NonCommercial-NoDerivs 4.0 International), CC BY-NC-ND 4.0, as described at [http://creativecommons.org/licenses/by-nc-nd/4.0/](http://creativecommons.org/licenses/by-nc-nd/4.0/)

## References

1.  [1].Zhu N, Zhang D, Wang W, Li X, Yang B, Song J, et al. A Novel Coronavirus from Patients with Pneumonia in China, 2019. N Engl J Med. 2020 02;: 382(8): 727–733.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1056/NEJMoa2001017&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=http://www.n&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2020%2F09%2F09%2F2020.09.07.20189779.atom) 

2.  [2].Johns Hopkins University Center for Systems Science and Engineering (JHU CCSE). Novel Coronavirus (COVID-19) Cases Data;. Available from: [https://data.humdata.org/dataset/novel-coronavirus-2019-ncov-cases](https://data.humdata.org/dataset/novel-coronavirus-2019-ncov-cases).
    
    

3.  [3].Hale T, Webster S, Petherick A, Phillips T, Kira B. Oxford covid-19 government response tracker. Blavatnik School of Government Working Paper. May 25, 2020 May 25; Available from: [http://www.bsg.ox.ac.uk/covidtracker](http://www.bsg.ox.ac.uk/covidtracker).
    
    

4.  [4].Williamson EJ, Walker AJ, Bhaskaran K, Bacon S, Bates C, Morton CE, et al. Factors associated with COVID-19-related death using OpenSAFELY. Nature. 2020 Jul;.
    
    

5.  [5].Morens DM, Taubenberger JK, Fauci AS. Predominant role of bacterial pneumonia as a cause of death in pandemic influenza: implications for pandemic influenza preparedness. J Infect Dis. 2008 Oct; 198(7): 962–70.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1086/591708&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=18710327&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2020%2F09%2F09%2F2020.09.07.20189779.atom) 
    
    [Web of Science](http://medrxiv.org/lookup/external-ref?access_num=000258979100003&link_type=ISI) 

6.  [6].Thindwa D, Garcia Quesada M, Liu Y, Bennett J, Cohen C, Knoll MD, et al. Use of seasonal influenza and pneumococcal polysaccharide vaccines in older adults to reduce COVID-19 mortality. Vaccine. 2020 07; 38(34): 5398–5401.
    
    

7.  [7].DaPalma T, Doonan BP, Trager NM, Kasman LM. A systematic approach to virus-virus interactions. Virus Res. 2010 Apr; 149(1): 1–9.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1016/j.virusres.2010.01.002&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=20093154&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2020%2F09%2F09%2F2020.09.07.20189779.atom) 

8.  [8].Opatowski L, Baguelin M, Eggo RM. Influenza interaction with cocirculating pathogens and its impact on surveillance, pathogenesis, and epidemic profile: A key role for mathematical modelling. PLoS Pathog. 2018 02; 14(2): e1006770.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1371/journal.ppat.1006770&link_type=DOI) 

9.  [9].Chan KF, Carolan LA, Korenkov D, Druce J, McCaw J, Reading PC, et al. Investigating Viral Interference Between Influenza A Virus and Human Respiratory Syncytial Virus in a Ferret Model of Infection. J Infect Dis. 2018 07; 218(3): 406–417.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1093/infdis/jiy184&link_type=DOI) 

10. [10].Casalegno JS, Ottmann M, Bouscambert-Duchamp M, Valette M, Morfin F, Lina B. Impact of the 2009 influenza A(H1N1) pandemic wave on the pattern of hibernal respiratory virus epidemics, France, 2009. Euro Surveill. 2010 Feb;15(6).
    
    

11. [11].Mak GC, Wong AH, Ho WYY, Lim W. The impact of pandemic influenza A (H1N1) 2009 on the circulation of respiratory viruses 2009-2011. Influenza Other Respir Viruses. 2012 May;6(3): e6–10.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1111/j.1750-2659.2011.00323.x&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=22212717&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2020%2F09%2F09%2F2020.09.07.20189779.atom) 
    
    [Web of Science](http://medrxiv.org/lookup/external-ref?access_num=000302715200003&link_type=ISI) 

12. [12].Goto H, Ihira H, Morishita K, Tsuchiya M, Ohta K, Yumine N, et al. Enhanced growth of influenza A virus by coinfection with human parainfluenza virus type 2. Med Microbiol Immunol. 2016 Jun; 205(3): 209–18.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1007/s00430-015-0441-y&link_type=DOI) 

13. [13].Merler S, Poletti P, Ajelli M, Caprile B, Manfredi P. Coinfection can trigger multiple pandemic waves. J Theor Biol. 2008 Sep;254(2): 499–507.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1016/j.jtbi.2008.06.004&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=18606170&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2020%2F09%2F09%2F2020.09.07.20189779.atom) 
    
    [Web of Science](http://medrxiv.org/lookup/external-ref?access_num=000259251000030&link_type=ISI) 

14. [14].Smith JC, Sausville EL, Girish V, Yuan ML, Vasudevan A, John KM, et al. Cigarette Smoke Exposure and Inflammatory Signaling Increase the Expression of the SARS-CoV-2 Receptor ACE2 in the Respiratory Tract. Dev Cell. 2020 06; 53(5): 514–529.e3.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1016/j.devcel.2020.05.012&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=32425701&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2020%2F09%2F09%2F2020.09.07.20189779.atom) 

15. [15].Kucharski AJ, Russell TW, Diamond C, Liu Y, Edmunds J, Funk S, et al. Early dynamics of transmission and control of COVID-19: a mathematical modelling study. Lancet Infect Dis. 2020 Mar;.
    
    

16. [16].Flaxman S, Mishra S, Gandy A, Unwin HJT, Mellan TA, Coupland H, et al. Estimating the effects of non-pharmaceutical interventions on COVID-19 in Europe. Nature. 2020 Jun;.
    
    

17. [17].Li R, Pei S, Chen B, Song Y, Zhang T, Yang W, et al. Substantial undocumented infection facilitates the rapid dissemination of novel coronavirus (SARS-CoV2). Science. 2020 Mar;.
    
    

18. [18].Bi Q, Wu Y, Mei S, Ye C, Zou X, Zhang Z, et al. Epidemiology and transmission of COVID-19 in 391 cases and 1286 of their close contacts in Shenzhen, China: a retrospective cohort study. Lancet Infect Dis. 2020 Apr;.
    
    

19. [19].Verity R, Okell LC, Dorigatti I, Winskill P, Whittaker C, Imai N, et al. Estimates of the severity of coronavirus disease 2019: a model-based analysis. Lancet Infect Dis. 2020 Mar;.
    
    

20. [20].Ionides EL, Nguyen D, Atchadé Y, Stoev S, King AA. Inference for dynamic and latent variable models via iterated, perturbed Bayes maps. Proc Natl Acad Sci U S A. 2015 Jan;112(3): 719–24.
    
    [Abstract/FREE Full Text](http://medrxiv.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6NDoicG5hcyI7czo1OiJyZXNpZCI7czo5OiIxMTIvMy83MTkiO3M6NDoiYXRvbSI7czo1MDoiL21lZHJ4aXYvZWFybHkvMjAyMC8wOS8wOS8yMDIwLjA5LjA3LjIwMTg5Nzc5LmF0b20iO31zOjg6ImZyYWdtZW50IjtzOjA6IiI7fQ==) 

21. [21].King AA, Nguyen D, Ionides EL. Statistical Inference for Partially Observed Markov Processes via the R Package pomp. Journal of Statistical Software. 2016; 69(1): 1–43.
    
    

22. [22].Kramer SC, Shaman J. Development and validation of influenza forecasting for 64 temperate and tropical countries. PLoS Comput Biol. 2019 02; 15(2): e1006742.
    
    

23. [23].Belgian institute for health (Sciensano), access date: 6 July 2020;. Available from: [https://epistat.wiv-isp.be/Covid/](https://epistat.wiv-isp.be/Covid/).
    
    

24. [24].Dipartimento della Protezione Civile. COVID-19 Italia-Monitoraggio della situazione, date of access: 6 July 2020;. Available from: [https://github.com/pcm-dpc/COVID-19/tree/master/dati-andamento-nazionale](https://github.com/pcm-dpc/COVID-19/tree/master/dati-andamento-nazionale).
    
    

25. [25].European Centre for Disease Prevention and Control. Geographic distribution of COVID-19 cases worldwide, access date: 6 July 2020;. Available from: [https://www.ecdc.europa.eu/en/publications-data/download-todays-data-geographic-distribution-covid-19-cases-worldwide](https://www.ecdc.europa.eu/en/publications-data/download-todays-data-geographic-distribution-covid-19-cases-worldwide).
    
    

26. [26].DATADISTA. Date of access: 6 July 2020;. Available from: [https://github.com/datadista/datasets/tree/master/COVID19](https://github.com/datadista/datasets/tree/master/COVID19).
    
    

27. [27].Maier BF, Brockmann D. Effective containment explains subexponential growth in recent confirmed COVID-19 cases in China. Science. 2020 05; 368(6492): 742–746.
    
    [Abstract/FREE Full Text](http://medrxiv.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6Mzoic2NpIjtzOjU6InJlc2lkIjtzOjEyOiIzNjgvNjQ5Mi83NDIiO3M6NDoiYXRvbSI7czo1MDoiL21lZHJ4aXYvZWFybHkvMjAyMC8wOS8wOS8yMDIwLjA5LjA3LjIwMTg5Nzc5LmF0b20iO31zOjg6ImZyYWdtZW50IjtzOjA6IiI7fQ==) 

28. [28].Pollán M, Pérez-Gómez B, Pastor-Barriuso R, Oteo J, Hernán MA, Pérez-Olmeda M, et al. Prevalence of SARS-CoV-2 in Spain (ENE-COVID): a nationwide, population-based seroepidemiological study. Lancet. 2020 Jul;.
    
    

29. [29].Gatto M, Bertuzzo E, Mari L, Miccoli S, Carraro L, Casagrandi R, et al. Spread and dynamics of the COVID-19 epidemic in Italy: Effects of emergency containment measures. Proc Natl Acad Sci U S A. 2020 05; 117(19): 10484–10491.
    
    [Abstract/FREE Full Text](http://medrxiv.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6NDoicG5hcyI7czo1OiJyZXNpZCI7czoxMjoiMTE3LzE5LzEwNDg0IjtzOjQ6ImF0b20iO3M6NTA6Ii9tZWRyeGl2L2Vhcmx5LzIwMjAvMDkvMDkvMjAyMC4wOS4wNy4yMDE4OTc3OS5hdG9tIjt9czo4OiJmcmFnbWVudCI7czowOiIiO30=) 

30. [30].McCallum H, Barlow N, Hone J. How should pathogen transmission be modelled? Trends Ecol Evol. 2001 Jun; 16(6): 295–300.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1016/S0169-5347(01)02144-9&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=11369107&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2020%2F09%2F09%2F2020.09.07.20189779.atom) 
    
    [Web of Science](http://medrxiv.org/lookup/external-ref?access_num=000168721800017&link_type=ISI) 

31. [31].He D, Ionides EL, King AA. Plug-and-play inference for disease dynamics: measles in large and small populations as a case study. J R Soc Interface. 2010 Feb;7(43): 271–83.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1098/rsif.2009.0151&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=19535416&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2020%2F09%2F09%2F2020.09.07.20189779.atom) 
    
    [Web of Science](http://medrxiv.org/lookup/external-ref?access_num=000272995800004&link_type=ISI) 

32. [32].Ozaras R, Cirpin R, Duman H, Duran A, Arslan O, Leblebicioglu H. An open call for influenza vaccination pending the new wave of COVID-19. J Med Virol. 2020 Jul;.
    
    

33. [33].Khalili M, Karamouzian M, Nasiri N, Javadi S, Mirzazadeh A, Sharifi H. Epidemiological characteristics of COVID-19: a systematic review and meta-analysis. Epidemiol Infect. 2020 06; 148: e130.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1017/S0950268820001430&link_type=DOI) 

34. [34].Lessler J, Reich NG, Brookmeyer R, Perl TM, Nelson KE, Cummings DAT. Incubation periods of acute respiratory viral infections: a systematic review. Lancet Infect Dis. 2009 May;9(5): 291–300.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1016/S1473-3099(09)70069-6&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=19393959&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2020%2F09%2F09%2F2020.09.07.20189779.atom) 
    
    [Web of Science](http://medrxiv.org/lookup/external-ref?access_num=000265805200017&link_type=ISI) 

35. [35].Carrat F, Vergu E, Ferguson NM, Lemaitre M, Cauchemez S, Leach S, et al. Time lines of infection and disease in human influenza: a review of volunteer challenge studies. Am J Epidemiol. 2008 Apr;167(7): 775–85.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1093/aje/kwm375&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=18230677&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2020%2F09%2F09%2F2020.09.07.20189779.atom) 
    
    [Web of Science](http://medrxiv.org/lookup/external-ref?access_num=000254469500002&link_type=ISI) 

36. [36].Tindale LC, Stockdale JE, Coombe M, Garlock ES, Lau WYV, Saraswat M, et al. Evidence for transmission of COVID-19 prior to symptom onset. Elife. 2020 Jun;9.
    
    

37. [37].Kim D, Quinn J, Pinsky B, Shah NH, Brown I. Rates of Co-infection Between SARS-CoV-2 and Other Respiratory Pathogens. JAMA. 2020 Apr;.
    
    

38. [38].Marín-Hernández D, Schwartz RE, Nixon DF. Epidemiological evidence for association between higher influenza vaccine uptake in the elderly and lower COVID-19 deaths in Italy. J Med Virol. 2020 Jun;.
    
    

39. [39].Arokiaraj MC. Correlation of Influenza Vaccination and the COVID-19 Severity. Available at SSRN 3572814. 2020;.
    
    

40. [40].Jehi L, Ji X, Milinovich A, Erzurum S, Rubin BP, Gordon S, et al. Individualizing Risk Prediction for Positive Coronavirus Disease 2019 Testing: Results from 11,672 Patients. Chest. 2020 Jun;.
    
    

41. [41].Salem ML, El-Hennawy D. The possible beneficial adjuvant effect of influenza vaccine to minimize the severity of COVID-19. Med Hypotheses. 2020 Apr;140: 109752.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1016/j.mehy.2020.109752&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=http://www.n&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2020%2F09%2F09%2F2020.09.07.20189779.atom) 

42. [42].Davies NG, Klepac P, Liu Y, Prem K, Jit M, CMMID COVID-19 working group, et al. Age-dependent effects in the transmission and control of COVID-19 epidemics. Nat Med. 2020 Jun;.
    
    

43. [43].Bunyavanich S, Do A, Vicencio A. Nasal Gene Expression of Angiotensin-Converting Enzyme 2 in Children and Adults. JAMA. 2020 May;.
    
    

44. [44].Park SW, Cornforth DM, Dushoff J, Weitz JS. The time scale of asymptomatic transmission affects estimates of epidemic potential in the COVID-19 outbreak. Epidemics. 2020 06; 31: 100392.
    
    

45. [45].Paget J, Caini S, Cowling B, Esposito S, Falsey AR, Gentile A, et al. The impact of influenza vaccination on the COVID-19 pandemic? Evidence and lessons for public health policies. Vaccine. 2020 Aug;.
    
    

46. [46].Domenech de Cellès M, Arduin H, Varon E, Souty C, Boëlle PY, Lévy-Bruhl D, et al. Characterizing and Comparing the Seasonality of Influenza-Like Illnesses and Invasive Pneumococcal Diseases Using Seasonal Waveforms. Am J Epidemiol. 2018 05; 187(5): 1029–1039.
    
    

47. [47].Raue A, Kreutz C, Maiwald T, Bachmann J, Schilling M, Klingmüller U, et al. Structural and practical identifiability analysis of partially observed dynamical models by exploiting the profile likelihood. Bioinformatics. 2009; 25(15): 1923–1929.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1093/bioinformatics/btp358&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=19505944&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2020%2F09%2F09%2F2020.09.07.20189779.atom) 
    
    [Web of Science](http://medrxiv.org/lookup/external-ref?access_num=000268107100011&link_type=ISI) 

48. [48].Keeling MJ, Rohani P. Modeling infectious diseases in humans and animals. Princeton: Princeton University Press; 2008. Available from: [http://www.loc.gov/catdir/toc/fy0805/2006939548.html](http://www.loc.gov/catdir/toc/fy0805/2006939548.html)
    
    

49. [49].Lloyd AL. Destabilization of epidemic models with the inclusion of realistic distributions of infectious periods. Proc Biol Sci. 2001 May; 268(1470): 985–93.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1098/rspb.2001.1599&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=11370974&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2020%2F09%2F09%2F2020.09.07.20189779.atom) 
    
    [Web of Science](http://medrxiv.org/lookup/external-ref?access_num=000168512700015&link_type=ISI) 

50. [50].Wearing HJ, Rohani P, Keeling MJ. Appropriate models for the management of infectious diseases. PLoS Med. 2005 Jul;2(7): e174.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1371/journal.pmed.0020174&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=16013892&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2020%2F09%2F09%2F2020.09.07.20189779.atom) 

51. [51].Salje H, Tran Kiem C, Lefrancq N, Courtejoie N, Bosetti P, Paireau J, et al. Estimating the burden of SARS-CoV-2 in France. Science. 2020 May;.
    
    

52. [52].King AA, Domenech de Cellès M, Magpantay FMG, Rohani P. Avoidable errors in the modelling of outbreaks of emerging pathogens, with special reference to Ebola. Proc Biol Sci. 2015 May;282(1806): 20150347.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1098/rspb.2015.0347&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=25833863&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2020%2F09%2F09%2F2020.09.07.20189779.atom) 

53. [53].Camacho A, Ballesteros S, Graham AL, Carrat F, Ratmann O, Cazelles B. Explaining rapid reinfections in multiple-wave influenza outbreaks: Tristan da Cunha 1971 epidemic as a case study. Proc Biol Sci. 2011 Dec; 278(1725): 3635–43.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1098/rspb.2011.0300&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=21525058&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2020%2F09%2F09%2F2020.09.07.20189779.atom) 

54. [54].Svensson A. A note on generation times in epidemic models. Math Biosci. 2007 Jul; 208(1): 300–11.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1016/j.mbs.2006.10.010&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=17174352&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2020%2F09%2F09%2F2020.09.07.20189779.atom) 
    
    [Web of Science](http://medrxiv.org/lookup/external-ref?access_num=000248196400017&link_type=ISI) 

55. [55].Alimohamadi Y, Taghdir M, Sepandi M. Estimate of the Basic Reproduction Number for COVID-19: A Systematic Review and Meta-analysis. J Prev Med Public Health. 2020 May;53(3): 151–157.
    
    

56. [56].R Core Team. R:A Language and Environment for Statistical Computing. Vienna, Austria; 2020. Available from: [https://www.R-project.org/](https://www.R-project.org/).
    
    

57. [57].Domenech de Cellès M, Magpantay FMG, King AA, Rohani P. The impact of past vaccination coverage and immunity on pertussis resurgence. Sci Transl Med. 2018 03;10(434).
    
    

58. [58].Domenech de Cellès M, Arduin H, Lévy-Bruhl D, Georges S, Souty C, Guillemot D, et al. Unraveling the seasonal epidemiology of pneumococcus. Proc Natl Acad Sci U S A. 2019 01; 116(5): 1802–1807.
    
    [Abstract/FREE Full Text](http://medrxiv.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6NDoicG5hcyI7czo1OiJyZXNpZCI7czoxMDoiMTE2LzUvMTgwMiI7czo0OiJhdG9tIjtzOjUwOiIvbWVkcnhpdi9lYXJseS8yMDIwLzA5LzA5LzIwMjAuMDkuMDcuMjAxODk3NzkuYXRvbSI7fXM6ODoiZnJhZ21lbnQiO3M6MDoiIjt9) 

59. [59].Wood SN. Statistical inference for noisy nonlinear ecological dynamic systems. Nature. 2010 Aug; 466(7310): 1102–4.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1038/nature09319&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=20703226&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2020%2F09%2F09%2F2020.09.07.20189779.atom) 
    
    [Web of Science](http://medrxiv.org/lookup/external-ref?access_num=000281203600039&link_type=ISI)

 [1]: /embed/graphic-5.gif
 [2]: /embed/graphic-6.gif
 [3]: /embed/graphic-7.gif
 [4]: /embed/graphic-8.gif
 [5]: /embed/graphic-9.gif
 [6]: /embed/graphic-10.gif
 [7]: /embed/graphic-11.gif
 [8]: /embed/graphic-12.gif
 [9]: /embed/inline-graphic-1.gif
 [10]: F4/embed/inline-graphic-2.gif
 [11]: F4/embed/inline-graphic-3.gif
 [12]: /embed/inline-graphic-4.gif
 [13]: /embed/graphic-15.gif
 [14]: /embed/graphic-17.gif
 [15]: /embed/inline-graphic-5.gif
 [16]: /embed/graphic-20.gif
 [17]: /embed/inline-graphic-6.gif