Predictions of COVID-19 dynamics in the UK: short-term forecasting and analysis of potential exit strategies ============================================================================================================ * Matt J. Keeling * Edward M. Hill * Erin E. Gorsich * Bridget Penman * Glen Guyver-Fletcher * Alex Holmes * Trystan Leng * Hector McKimm * Massimiliano Tamborrino * Louise Dyson * Michael J. Tildesley ## Abstract **Background** Efforts to suppress transmission of SARS-CoV-2 in the UK have seen non-pharmaceutical interventions being invoked. The most severe measures to date include all restaurants, pubs and cafes being ordered to close on 20th March, followed by a “stay at home” order on the 23rd March and the closure of all non-essential retail outlets for an indefinite period. Government agencies are presently analysing how best to develop an exit strategy from these measures and to determine how the epidemic may progress once measures are lifted. Mathematical models are currently providing short and long term forecasts regarding the future course of the COVID-19 outbreak in the UK to support evidence-based policymaking. **Methods** We present a deterministic, age-structured transmission model that uses real-time data on confirmed cases requiring hospital care and mortality to provide up-to-date predictions on epidemic spread in ten regions of the UK. The model captures a range of age-dependent heterogeneities, reduced transmission from asymptomatic infections and produces a good fit to the key epidemic features over time. We simulated a suite of scenarios to assess the impact of differing approaches to relaxing social distancing measures from 7th May 2020, on the estimated number of patients requiring inpatient and critical care treatment, and deaths. With regard to future epidemic outcomes, we investigated the impact of reducing compliance, ongoing shielding of elder age groups, reapplying stringent social distancing measures using region based triggers and the role of asymptomatic transmission. **Findings** We find that significant relaxation of social distancing measures from 7th May onwards can lead to a rapid resurgence of COVID-19 disease and the health system being quickly overwhelmed by a sizeable, second epidemic wave. In all considered age-shielding based strategies, we projected serious demand on critical care resources during the course of the pandemic. The reintroduction and release of strict measures on a regional basis, based on ICU bed occupancy, results in a long epidemic tail, until the second half of 2021, but ensures that the health service is protected by reintroducing social distancing measures for all individuals in a region when required. **Discussion** Our work confirms the effectiveness of stringent non-pharmaceutical measures in March 2020 to suppress the epidemic. It also provides strong evidence to support the need for a cautious, measured approach to relaxation of lockdown measures, to protect the most vulnerable members of society and support the health service through subduing demand on hospital beds, in particular bed occupancy in intensive care units. ## Introduction In late 2019, accounts emerged from Wuhan city in China of a virus of unknown origin that was leading to a cluster of pneumonia cases [1]. The virus was identified as a novel strain of coronavirus on 7th January 2020 [2] and the first known death as a result of the disease occurred two days later [1]. Over the next few days, cases were reported in several other cities in China and in other countries around the world including South Korea, Japan and the United States of America. On 23rd January, the Chinese government issued an order for Wuhan city to enter “lockdown”, whereby all public transport was suspended and residents were not allowed to leave the city. Over the next 24 hours, these measures were extended to all the major cities in Hubei province in an attempt to prevent further spread of disease. Whilst the introduction of these severe social distancing measures began to have an effect upon reducing the growth rate of cases in Wuhan [3–5], reported cases outside China continued to grow and by late February the virus, now designated by the World Health Organisation as SARS-CoV-2, and the disease it causes as coronavirus disease 2019 (COVID-19), had spread to Europe, with a growing number of cases being reported in northern Italy [6]. As more countries in Europe and around the world started to experience a dramatic rise in cases, similar measures were put in place in an effort to protect the most vulnerable members of society and to ensure that health services capacities were not exceeded [6, 7]. In the UK, the first cases of COVID-19 were reported on 31st January 2020, in the city of York in the north of England. In the early stages of the UK outbreak, the government focused on a strategy of containment, to reduce the likelihood of large-scale within-country transmission occurring. This strategy involved rapid identification and isolation of infected individuals, achieved through contact tracing and testing of suspect cases. However, by early March it was evident that sustained community transmission was occurring and there was a growing concern that a large epidemic could rapidly overwhelm the health service, resulting in a significant number of deaths. This led to the government considering the introduction of a range of social distancing measures in order to slow the growth of the outbreak, thus delaying and flattening the epidemic peak and reducing the risk of exceeding hospital capacities owing to an influx of COVID-19 patients. On 12th March, the UK officially entered the “delay” phase, with the government declaring that all individuals with a cough or fever should self-isolate for a period of seven days. Over the following days, several major sporting events were cancelled and the public was advised to avoid all non-essential travel and contact with others. With daily cases and deaths continuing to rise, the government introduced its most severe measures: all restaurants, pubs and cafes were ordered to close on 20th March; schools were also ordered to close on 20th March except for the children of key workers; finally a “stay at home” order was issued on the evening of 23rd March together with the closure of all non-essential retail outlets for an indefinite period. By this time the reported number of deaths in the UK had reached 335. As the UK lockdown continues epidemiological modelling becomes a vital tool for analysing potential “exit strategies”, which could allow some relaxation of social distancing measures, whilst minimising the future impact of the disease on the health service. Epidemiologists are critically aware that, should measures be relaxed too rapidly when there are still sufficient susceptible individuals in the population, there is a high risk of a second infection wave that may once again threaten to overwhelm health services. In this paper, we present a novel mathematical model of SARS-CoV-2 transmission that is currently being utilised to provide short and long term forecasts regarding the future course of the COVID-19 outbreak in the UK. Our model uses real-time data on confirmed cases requiring hospital care and mortality to provide up-to-date predictions on epidemic spread in ten regions of the UK. We investigate how compliance with social distancing affects future epidemic outcomes. We compare and contrast different exit strategies, namely: relaxing social distancing by age group, or the regional lifting and imposition of restrictions according to healthcare system capacity. Finally, we explore the sensitivity of our conclusions to a key biological aspect of SARS-CoV2 which remains unknown: whether different age groups differ in their core susceptibility to infection, or their likelihood of displaying symptoms. ## Methods ### Transmission model Here, we describe a compartmental model that has been developed to simulate the spread of SARS-CoV-2 virus (resulting in cases of COVID-19) in the UK population. In the ongoing outbreak in the UK, cases of COVID-19 are confirmed based upon testing, with priority for testing given to patients requiring critical care in hospitals [8] - generating biases and under-reporting. There is evidence to suggest that a significant proportion of individuals who are infected may be asymptomatic or have only mild symptoms [9, 10]. These asymptomatic individuals are still able to transmit infection [11], though it remains unclear whether they do so at a reduced level. Our modelling approach has consequently been designed to elucidate the interplay between symptoms (and hence detection) and transmission of COVID-19. We developed a deterministic, age-structured compartmental model, stratified into five-year age bands. Inclusion of age-structure within the model was considered critically important given the greater number of cases, hospitalisations and deaths amongst older age-groups. Transmission was governed through age-dependent mixing matrices based on UK social mixing patterns [12, 13]. The population was further stratified according to current disease status, following a susceptible-exposed-infectious-recovered (SEIR) paradigm, as well as differentiating by symptoms, quarantining and household status (Fig. 1). Susceptibles (*S*) infected by SARS-CoV-2 entered a latent state (*E*) before becoming infectious. Given that only a proportion of individuals who are infected are tested and subsequently identified, the infectious class in our model was partitioned into symptomatic (and hence potentially detectable), *D*, and asymptomatic (and likely to remain undetected) infections, *U*. We assumed both susceptibility and disease detection were dependent upon age, although the partitioning between these two components is largely indeterminable (additional details are given in Table 1 and Supporting Text S1). We modelled the UK population aggregated to ten regions (Wales, Scotland, Northern Ireland, East of England, London, Midlands, North East and Yorkshire, North West England, South East England, South West England). View this table: [Table 1:](http://medrxiv.org/content/early/2020/07/17/2020.05.10.20083683/T1) Table 1: Key model parameters ![Fig. 1:](http://medrxiv.org/https://www.medrxiv.org/content/medrxiv/early/2020/07/17/2020.05.10.20083683/F1.medium.gif) [Fig. 1:](http://medrxiv.org/content/early/2020/07/17/2020.05.10.20083683/F1) Fig. 1: Disease states and transitions We stratified the population into susceptible, exposed, detectable infectious, undetectable infectious, and removed states. Solid lines correspond to disease state transitions, with dashed lines representing mapping from detectable cases to severe clinical cases that require hospital treatment, critical care (ICU), or result in death. The model was partitioned into five-year age bands. See Table 1 for a listing of model parameters. Note, we have not included quarantining and household status on this depiction of the system. A drawback of the standard SEIR ordinary differential equation (ODE) formation in which all individuals mix randomly in the population is that it cannot readily account for the isolation of households. For example, if all transmission outside the household is set to zero in a standard ODE model, then an outbreak can still occur as within-household transmission allows infection between age-groups and does not account for local depletion of susceptibles within the household evironment. We addressed this limitation by extending the standard SEIR models such that first infections within a house-hold (*E**F*, *D**F*, *U* *F*) are treated differently from subsequent infections (*E**S*, *D**S*, *U* *S*). To account for the depletion of susceptibles in the household, we made the approximation that all within household transmission is generated by the first infection within the household (for further details, see Supporting Text S1). ### Case severity parameterisation The model is concerned with epidemiological processes and so predicts the number of symptomatic and asymptomatic infections on each day. However, in order to provide evidence regarding the future impact of the outbreak in the UK, it is crucial to be able to predict the number of severe cases that may require hospital or critical care. We utilised two processes in order to estimate hospitalisation rates: (i) we estimated the proportion of clinical cases in each age group that would require hospitalisation by comparing the age distribution of hospital admission to the age structure of early detected cases assuming these detected cases were an unbiased sample of symptomatic individuals; (ii) we used age independent distributions to determine the time between onset of symptoms and hospitalisation. A similar process was repeated for admission into intensive care units. Both of these distributions were drawn from the COVID-19 Hospitalisation in England Surveillance System (CHESS) data set that collects detailed data on patients infected with COVID-19 [14]. Information on the distributions of length of stay in both intensive care units (ICUs) and hospital was used to translate admissions into bed occupancy - which adds a further delay between the epidemio-logical dynamics and quantities of interest. In terms of matching the available data and quantities of interest, we also use the prediction of symptomatic infections to drive the estimated daily number of deaths within hospitals. The risk of death is again captured with an age-dependent probability, while the distribution of delays between hospital admission and death is assumed to be age-independent. These two quantities are determined from the Public Health England (PHE) death records. ### Model fitting We fit on a region-by-region basis to four timeseries: (i) new hospitalisations; (ii) hospital bed occupancy; (iii) ICU bed occupancy; (iv) daily deaths (using data on the recorded date of death, where-ever possible). The relative transmission rate from asymptomatic cases (*τ*) and the scaling of whether agestructure case reports were based on age-dependent susceptibility or age-dependent symptoms (*α*) were treated as free parameters. We performed parameter inference using the Metropolis-Hastings algorithm, computing likelihoods assuming the daily count data to be drawn from a Poisson distribution. At the outset of each iteration, based on the *α* and *τ* instances at that moment, we first set the recovery rate *γ*, age-dependent susceptibilites (*σ**a*) and age-dependent probabilities of displaying symptoms (*d**a*). We achieved this through calibration to early age-stratified UK data from 1st February 2020 to 1st April 2020; initial assumptions were an *R* of 2.7 and doubling time of 3.3 days, but these are allowed to vary between regions. After a burn-in of 250,000 particles, the algorithm was run for a further 250,000 iterations. We thinned the generated parameter sets by a factor of 100, giving 2,500 parameter sets representing samples from the parameter posterior distributions. ### Modelling intervention scenarios In order to capture the impact of social distancing measures that were introduced in the UK (on 23rd March) to reduce transmission, we scaled down the mixing matrices associated with schools, work and other activities while increasing the within household transmission matrix (see Supporting Text S2). This approach allowed us to flexibly vary the effectiveness of different social distancing measures and investigate the impact of compliance with social distancing (*ϕ*) upon the future spread of disease. We considered a range of compliance levels, scaling from zero (no-compliance) to one (maximal compliance), as well as inferring the compliance parameter from the available data (*ϕ* = 0.53(0.36 *−* 0.70) across all regions). Another prominent intervention measure to reduce the spread of infection has been household quarantining, whereby an entire household is instructed to self-quarantine when any member of that household starts to show symptoms of infection. To incorporate household quarantining measures into the ODE formulation, we added a quarantined class into our model, whereby a fraction (*H*) of the first detectable infection in any household (and therefore by definition a symptomatic case) is quarantined as are all their subsequent household infections. Accounting for the effect of household saturation also ensures that subsequent household infections do not contribute to further transmission. For a complete description of the model equations, see Supporting Text S1. We used this model framework to perform a series of analyses assessing the impact of social distancing strategies on the future spread of infection. Unless otherwise stated, all interventions shown represent the mean dynamics from the posterior parameters inferred by a Monte Carlo Markov Chain (MCMC) fitting scheme; where practical credible intervals are also shown. ### Short term projections under current lockdown measures To provide a baseline for comparison of our intervention scenarios, we initially simulated our model to investigate the impact of the current intervention policies, continuing from their introduction on 23rd March 2020. We simulated the model from 1st March 2020 to 30th April 2020 and compared the results to a scenario where no lockdown measures were ever introduced. To quantify prediction uncertainty, a total of 200 simulations were run for each scenario (lockdown activated or no lockdown imposed) using distinct parameter sets produced by the MCMC procedure, representing samples from the posterior parameter distributions. We focused our attention on estimates of deaths as well as hospitalisation and ICU bed occupancy, as key public-health considerations. ### Age-independent relaxation of lockdown measures To investigate the longer term impact of the epidemic, we explored several scenarios in which control measures are relaxed on 7th May. The first scenario investigated a policy whereby social distancing measures were relaxed on 7th May for all individuals, regardless of age. To reflect the uncertainty in the degree of relaxation of the lockdown at this point, we varied our social distancing compliance parameter (*ϕ* = 0, 0.25, 0.5, 0.75, 1), which allowed us to consider how the epidemic trajectory may be affected for a range of relaxation policies. In these simulations we assumed that any remaining social distancing measures were fully removed at the end of 2020. ### Age-dependent relaxation of lockdown measures Given the far higher fatality levels observed in the elderly, we next investigated policies imposing age-dependence upon the relaxation criteria. Specifically, we allowed all social distancing measures to be lifted from 7th May for any individual below a certain age (this age threshold was varied between 45 to 75 year old). For those above the age threshold, we assumed that social distancing measures remained in place until the end of 2020. Simulations were then run to the end of 2021, to capture any subsequent waves of infection. For each age threshold under consideration, we again consider the cumulative deaths, as well as cumulative hospital and ICU bed occupancy. We differentiate between these health impacts that occur when age-specific restrictions are in place and when all restrictions are lifted. We also focus of the number of days in which ICU bed occupancy exceeds 4,000, as a measure of the immediate severity of the outbreak and the pressure on the health services. ### Full relaxation of lockdown measures with region-based reintroduction Our penultimate set of simulations considered an adaptive intervention strategy, whereby lockdown measures were fully relaxed on 7th May, but then reintroduced when occupancy of intensive care units exceeded a given capacity and relaxed again when ICU occupancy declines. To account for regional variation in the outbreak and local hospital capacities, we assumed that control measures would operate locally, using the ten regions. We therefore used a pro-rata threshold, which equated to 3,000 occupied beds on a nationwide scale, as a trigger for reintroducing or relaxing controls (see Table S2). Given the sizeable delay between the implementation of controls and their effects on ICU occupancy, the dynamics only predicted a low number of switches between control and relaxation. We gathered regional predictions of daily deaths, ICU bed occupancy and hospital bed occupancy, with simulations run to the end of 2023. ### Sensitivity analysis When evaluating the impact of lockdown measures, we are reliant upon recorded data on confirmed cases, hospital admissions and ICU occupancy in order to infer parameters of our model. However, there is still ongoing uncertainty in the relative level of transmission from asymptomatic individuals (*τ*) and the mechanisms driving age-specific detection rates (*α*). A range of *α* and *τ* parameter values are all able to generate predictions that closely match the available data. We therefore carried out a sensitivity analysis to these two parameters, investigating the impact of applying lockdown measures for specific age groups, as these parameters vary. We allowed *τ*, the relative level of transmission from asymptomatic individuals, to vary between 0 and 0.5; while *α* varied between 0 and 1. For large *α*, higher proportions of confirmed cases in a particular age group is as a result of greater susceptibility; whereas low vales of *α* indicate that a higher proportions of confirmed cases is due to greater severity of symptoms. This key parameter interacts with the relative transmission from asymptomatic infection (*τ*), although *τ* plays a minimal role when *α* is small. To assess the impact of these parameters on the effectiveness of lockdown measures, we computed the early epidemic growth rate under restrictions that target four specific age-groupings: (i) pre-school children under 5 (PS), (ii) school-aged children and young adults, 5-20 (S), (iii) adults between the age of 20 and 70 (A) and (iv) the elderly over 70 (E). ## Results ### Reductions in clinical case burden under current lockdown measures versus no intervention Our model predicts that, should the current lockdown policies be continued, the number of daily deaths would peak in April across all regions before starting to decline (Fig. 2). England and Wales are found to be most severely affected, with the highest number of predicted deaths per capita, whilst we predict a lower number of deaths per capita in Scotland and Northern Ireland (noting that though our regional model fits generally had strong correspondence with the data, the fit to Scotland was weaker). All English regions show similar behaviour, other than the South East and South West, where we predict a lower number of deaths (Fig. 2). We observe similar behaviour in the levels of hospital and intensive care unit occupancy throughout this period (Fig. S1 and Fig. S2). Our model predicts that, under continued total lockdown, the average total deaths would be approximately 39,000 (Table 2). View this table: [Table 2:](http://medrxiv.org/content/early/2020/07/17/2020.05.10.20083683/T2) Table 2: Summary of Model Outputs. *=epidemic would continue ![Fig. 2:](http://medrxiv.org/https://www.medrxiv.org/content/medrxiv/early/2020/07/17/2020.05.10.20083683/F2.medium.gif) [Fig. 2:](http://medrxiv.org/content/early/2020/07/17/2020.05.10.20083683/F2) Fig. 2: Regional projections for deaths per 100,000 with and without imposition of lockdown. In each panel: filled markers correspond to observed data (squares are for reported deaths, circles are for date of death), solid lines correspond to the mean outbreak over a sample of posterior parameters; shaded regions depict prediction intervals, with darker shading representing stricter confidence (dark shading - 50%, moderate shading - 90%, light shading - 99%); red dashed lines illustrate the mean projected trajectory had no lockdown measures being introduced. (Prediction were produced on 23rd April, using data up to 21st April). If the epidemic in the UK had been allowed to progress with no introduction of lockdown measures, our model predicts that the epidemic would have continued to grow throughout April, with deaths exceeding 200,000 by the end of 2021 (Table 2). This provides strong evidence to support the necessity of the social distancing measures that were introduced in order to reduce the growth rate of the epidemic and ensure that the health service is not overwhelmed with admissions. ### Measured age-independent relaxation protocols to reduce health system burden Evaluating a policy whereby social distancing measures were relaxed to different degrees from 7th May for all individuals, we found that for a significant relaxation of lockdown the epidemic rapidly resurges with a peak in daily deaths of over 4,000 occurring in late June (Fig. 3, top panel). We project intensive care unit occupancy to near 10,000 by the end of June (Fig. 3, second panel), implying that significant release of lockdown measures would not be advisable. For more measured relaxation protocols, we found that, whilst there may be a slight resurgence in cases in the short term, hospital and ICU occupancy remained within capacity. However, whilst the forecasts from these simulations suggest that keeping most lockdown measures in place can have a positive impact upon reducing cases and deaths in the short-term, we note that, when lockdown measures are subsequently released in 2021 a large second infection wave is predicted. These results imply that should the outbreak have to be contained by non-pharmaceutical interventions alone, then a second wave of infections is somewhat inevitable as isolation measures are reduced. Of the scenarios investigated here, intermediate levels of relaxation (*ϕ* = 0.5) until 2021 followed by complete cessation of lockdown generates the least deaths (approximately 152 thousand over both years). ![Fig. 3:](http://medrxiv.org/https://www.medrxiv.org/content/medrxiv/early/2020/07/17/2020.05.10.20083683/F3.medium.gif) [Fig. 3:](http://medrxiv.org/content/early/2020/07/17/2020.05.10.20083683/F3) Fig. 3: Clinical case projections for differing strengths of relaxing lockdown measures We assume social distancing measures were relaxed on 7th May for all individuals. The paler lines correspond to the dynam- ics using differing levels of relaxation (*ϕ* = 0, 0.25, 0.5, 0.75, 1), with *ϕ* = 0 (lightest line weight) corresponding to a total removal of social distancing measures, and *ϕ* = 1 (heaviest line weight) representing a continuation of lockdown measures. Shaded regions represent the 95% posterior prediction intervals. We display statistics on daily counts of **(Row one)** deaths; **(Row two)** ICU occupancy; **(Row three)** hospital occupancy. At the start of 2021, all remaining social distancing measures are removed (the “no control” phase). ### Assessment of age-based shielding strategies We next analysed the lifting of social distancing measures on 7th May for all individuals below a certain age, with social distancing measures remaining in place for the remainder of the population until the end of 2020. We observe that continuing lockdown for anyone over the age of 45 for the duration of 2020 results in the lowest number of deaths and number of admissions into hospital and ICU wards during that year (Fig. 4, first column). However, upon release of these lockdown measures we observed a significant second wave in 2021 as a substantial number in the over 45 age group are susceptible allowing a new outbreak (Fig. 4, second column). When isolation is only in place for older age groups (for example the over 70s), a large initial wave of infection occurs during 2020, but a subsequent secondary wave is not observed. Considering the combined impact from 2020-2021, we find that a strategy of continuing lockdown measures for anyone over the age of 65 minimises the total number of deaths, while hospital and ICU occupancy is minimised by continuing lockdown for anyone over the age of 60 although the overall effect of this is marginal (Fig. 4, third column). We predict that continuing lockdown for the over 60s throughout 2020 whilst relaxing measures of the remainder of the population results in, on average, 138,000 deaths by the end of 2021 (Table 2). Finally, we note that the total number of days for which ICU bed occupancy exceeds 4,000 increases with the age-threshold; this implies that while the elderly are the most vulnerable and the most likely to need critical care, an uncontrolled outbreak in the younger population can still place severe demands upon the health service (Fig. 4, third row). ![Fig. 4:](http://medrxiv.org/https://www.medrxiv.org/content/medrxiv/early/2020/07/17/2020.05.10.20083683/F4.medium.gif) [Fig. 4:](http://medrxiv.org/content/early/2020/07/17/2020.05.10.20083683/F4) Fig. 4: Impact of age-based shielding strategies on outbreak burden. In these simulations, social distancing measures were lifted on 7th May for all individuals below an age threshold, with social distancing measures remaining in place for the remainder of the population until the end of 2020. No interventions were applied post-lockdown release, with simulations continued until the end of 2022. Box plots per considered age threshold convey median values for each statistic and extent of spread. Solid lines depict the profile of median estimates across age threshold space. The following statistics were computed for the period 23rd March 2020 to the end of 2021: **(Row one)** cumulative deaths; **(Row two)** cumulative ICU bed occupancy; **(Row three)** amount of days ICU occupancy exceeded 4000; **(Row four)** cumulative hospital bed occupancy. We stratify the outputs occurring across the considered time horizon in three ways: **(Column one)** during lockdown; **(Column two)** after lockdown; **(Column three)** combined (entire time horizon). ### Utility of reintroducing lockdown measures regionally with ICU occupancy triggers Relaxing the lockdown from 7th May allows subsequent secondary waves of infection to begin, but a local increase in ICU occupancy triggers the reintroduction of social distancing measures on a region-by-region basis (Fig. 5). This results in multiple regional waves of infection, gradually becoming smaller and more asynchronous over time. The consequence of this adaptive strategy is that the total number of deaths and confirmed cases gradually reduce over a long period of time (Fig. 5, top and bottom panels), with the epidemic reaching low levels in mid 2021. As a result this policy balances the overall demand on the health services against the need to exit the epidemic without a substantive second wave. ![Fig. 5:](http://medrxiv.org/https://www.medrxiv.org/content/medrxiv/early/2020/07/17/2020.05.10.20083683/F5.medium.gif) [Fig. 5:](http://medrxiv.org/content/early/2020/07/17/2020.05.10.20083683/F5) Fig. 5: Clinical case projections under an adaptive intervention strategy with regionally activated lockdowns (responding to ICU occupancy). In all simulations we assumed social distancing measures were relaxed on 7th May for all individuals, with subsequent reintroduction of lockdown measures at a regional level (in the seven English regions, Scotland, Wales, and Northern Ireland) if ICU occupancy exceeds 45 ICU cases per million within the given region. Thick solid lines correspond to the mean outbreak over a sample of posterior parameters, with shaded regions corresponding to the 95% prediction intervals. The paler lines correspond to the dynamics in the individual regions. We display statistics on daily counts of **(Row one)** deaths ; **(Row two)** ICU bed occupancy; **(Row three)** hospital bed occupancy. ### Role of asymptomatics crucial in determining the effect of age-based lockdown relaxation measures Finally, we investigate the impact of applying lockdown measures for specific age groups, whilst varying *τ*, the relative level of transmission from asymptomatic individuals, and *α*, the scaling determining whether the age-dependence in cases comes from susceptibility (*α* = 1) or symptoms (*α* = 0). We observe that, regardless of the values of *τ* and *α*, applying control on only a single age group (PS, S, A or E) results in large-scale epidemics (Fig. 6). Similarly ineffective strategies are observed when combining PS control with one of S, A or E. However, control of school aged children, adults and the elderly, results in epidemics that are under control for all values of *τ* and *α*. ![Fig. 6:](http://medrxiv.org/https://www.medrxiv.org/content/medrxiv/early/2020/07/17/2020.05.10.20083683/F6.medium.gif) [Fig. 6:](http://medrxiv.org/content/early/2020/07/17/2020.05.10.20083683/F6) Fig. 6: Sensitivity of intervention measures to *τ* and *α*. Each panel represents the application of lockdown measures to combinations of specific age groups (PS - PreSchool (0-4yrs), S - School (5-20yrs), A - Adults (21-70yrs), E - Elderly (over 70 yrs). The colour of each square represents the growth rate of the epidemic under the specified age-specific policies. All values less than 0 imply that the epidemic is under control. Columns distinguish inclusion or exclusion of PS and S groupings in lockdown coverage: **(Column one)** coverage includes PS, not S; **(Column two)** coverage includes S, not PS; **(Column three)** coverage includes both PS and S; **(Column four)** neither PS or S included in lockdown. Should we exempt the elderly from lockdown we find that, for high levels of *α*, large epidemics are observed, whereas if the true value of *τ* is high and *α* is small, applying control on the younger age groups and releasing lockdown on the elderly can result in epidemics that will rapidly die out. In contrast, if we relax lockdown on school children but keep it in place for other age groups, we note that this only has a positive effect upon the epidemic if the true value of *α* is high, or the true value of *τ* is low. If *α* is low and *τ* is high, then this implies that the age-dependence of reported cases is primarily as a result of clinical symptoms rather than susceptibility and the transmission rate of asymptomatic cases is high. Therefore, school children will play a much larger role in transmission, implying that a policy of re-opening school would cause a much larger epidemic. These results reinforce the need to resolve uncertainty regarding the role of asymptomatic individuals in the infection process in order to establish the optimal intervention strategy. ### Potential exit strategies comparison Our findings are summarised in Table 2, where we focus on deaths (and the associated QALY losses), hospital occupancy and the scale of the lockdown as a measure of potential economic burden. QALYs (Quality Adjusted Life Years) are a standard measure in health economics which accounts for the number of life years lost due to an illness or disease, which also takes into account quality of life. Hence, under the QALY framework deaths in younger individuals have greater impact than deaths of older individuals due to the additional years of life lost (for further details, see the Supporting Text S3). Our lockdown scale measures the pro rata number of days the population is under lockdown; so if 50% of the population is under lockdown for 200 days, we report a value of 100 (50% *×* 200). A completely uncontrolled outbreak is predicted to lead to around 200,000 deaths, approximately 2 million QALY losses but no lockdown impacts. If the current controls are maintained until the end of 2020, then we predict 39,000 deaths this year, but a further 159,000 if controls were then completely removed. Regional switching and age-dependent strategies provide alternative exit strategies in the absence of pharmaceutical interventions. Of these, the age-dependent shielding of those age 60 or over generates the lowest mortality and also the lowest lockdown scale, thereby minimising socio-economic disruption. However, it is unclear if a protracted lockdown of this age-group would be practical, ethical or politically acceptable. ## Discussion In this paper, we have developed an age-structured compartmental SARS-CoV-2 transmission model that has been used to make short-term predictions and analyse the effectiveness of the current social distancing measures that have been implemented in the UK. We have also extended our model to investigate a suite of alternate policies to establish whether some relaxation of intervention measures may be considered as part of potential exit strategies. Our model shows that, without the introduction of the large scale social distancing measures that were introduced on 23rd March, the epidemic would have continued to grow exponentially and hospital and ICU occupancy would have rapidly exceeded capacity. However, under current policies, the epidemic is expected to peak in April for all regions of the UK, before starting to decline. One of the most important questions in the current epidemic is when and how social distancing measures might be relaxed. We consistently find that any relaxation of control measures in the short term leads to a rapid resurgence of COVID-19 disease with the health system potential being overwhelmed by a sizeable second epidemic wave (Fig. 3). In contrast, moderate or no adjustments to current social distancing measures allows hospital and ICU occupancy to remain within capacity over the duration of the outbreak. It is apparent from the data on confirmed cases and deaths as a result of COVID-19 disease that the risks associated with infection increase with age [15–17]. We therefore also investigated the impact of age-specific control policies, whereby lockdown measures remained in place for all individuals over a certain age until the end of 2020. We found that, whilst some marginal gains can be made should everyone over the age of 60 be put under isolation measures, extending this policy to include younger age groups increases the risk of a second wave occurring when measures are relaxed. Furthermore, we projected critical care to be stretched and ICU bed occupancy to exceed 4,000 during the course of the pandemic in all but the most wide-ranging age-specific lockdown policies (Fig. 4). As a note of caution, our sensitivity analysis shows that the effectiveness of any age-specific intervention policy is critically dependent upon the precise role of asymptomatic individuals in the epidemic. Undocumented infection has been inferred to have facilitated the spread of SARS-CoV-2 in China [18]. We note that government advice upon self-quarantining focuses upon individuals who show symptoms of COVID-19 (primarily a fever and a dry persistent cough) and therefore, should asymptomatic (or pre-symptomatic) infections play a significant role in the transmission process, such a policy may not be as effective as thought due to the potential for ongoing transmission through asymptomatic cases. In practice, to minimise the risk of a second large epidemic wave occurring in the UK, adaptive policies may need to be considered. To that end, we examined a more bespoke intervention policy whereby measures were relaxed and re-introduced on a regional basis, with a defined trigger for the reintroduction of interventions when ICU occupancy exceeded a certain level. This results in a longer epidemic tail, until the second half of 2021, but ensures that the health service is protected by reintroducing social distancing measures for all individuals in a region when required. Several countries around the world have now seen significant epidemics of COVID-19 and many have implemented severe lockdown policies in an effort to contain the disease. In China and other countries in East Asia, once the epidemic was regarded to be under control, in seeking to prevent the occurrence of a large second infection wave the relaxation of isolation measures has been implemented in a gradual fashion. Our model findings support the need for this form of relaxation policy. We recognise that there is a need for certain measures to be lifted as soon as is feasible, for a range of practical, social and economic reasons. However, government agencies should be prepared to resume lockdown if needed, based upon the the progression of the epidemic following relaxation. Identifying triggers, such as ICU occupancy exceeding a certain threshold, may be beneficial in allowing decision makers to follow a clear set of guidelines for controls to be reintroduced. The identification of such triggers will be based upon the objective of an intervention measure and the ability to resolve epidemiological uncertainty as the outbreak progresses. To this end, formal adaptive management approaches may help to facilitate the establishment of state dependent intervention strategies [19]. The model described is necessarily a simplified representation of reality based on several assumptions and has various limitations. Data informing contact structure for the UK were measured historically [12]. Were contact patterns in early 2020 (pre-lockdown) to substantially differ from the preexisting data, the influence of projected intervention effects may be impacted. Similarly, while we can infer the compliance to the currently imposed rules, we have limited understand of how people will behave if the controls are released — will they remain wary of potentially infectious situations, or will they compensate for the time in lockdown. Throughout we have assumed that mixing patterns would return to their pre-pandemic norm. Heterogeneities in compliance and in infection patterns, such as increased transmission in hospitals and institutions may affect the outcome of the measures considered. We note that the estimates of deaths resulting from an individual strategy does not take into account the potential for increased deaths due to exceeding hospital or ICU capacities, and so may underestimate deaths from strategies resulting in high occupancies. In addition, though there have been recorded instances of superspreading events for COVID-19 [20], our model does not explicitly account for such dynamics. However, beyond the early stages of the outbreak the dynamics at the population-level are generally driven by the average pattern of social mixing, rather than individual level variation. All the strategies we have considered here assume that an exit strategy will have to rely on non-pharmaceutical intervention. In this case, a second (or subsequent) wave of infections follows any return to normality while there is sufficient susceptibility in the population. We are therefore faced with three potential exit solutions: 1) Seek a measured reduction in restrictions that minimises the impact of the unfolding outbreak, but acknowledging that the majority of the population will become infected (although not symptomatic); 2) Accept a substantial and long-term change to our social interactions (practising far better prevention of transmission), such that the reproductive ratio of the virus is constantly held below one - electronic and traditional methods of tracing and isolation [21] fall into this category; or 3) rely on the development of an effective vaccine, in which case the best approach may be to extend the lockdown, reducing infection until mass vaccination can occur. In conclusion, the current pandemic of COVID-19 has resulted in the introduction of strict social distancing measures in the UK and many other countries around the world. Government agencies are currently analysing how best to develop an exit strategy from these measures and to determine how the epidemic may progress once measures are lifted. Our work provides strong evidence to support the need for a cautious, measured approach to relaxation, in order to provide necessary support for the health service and to protect the most vulnerable members of society. ## Data Availability Data on cases were obtained from the COVID-19 Hospitalisation in England Surveillance System (CHESS) data set that collects detailed data on patients infected with COVID-19. Data on COVID-19 deaths were obtained from Public Health England. These data contain confidential information, with public data deposition non-permissible for socioeconomic reasons. The CHESS data resides with the National Health Service (www.nhs.gov.uk) whilst the death data are available from Public Health England (www.phe.gov.uk). ## Author contributions **Conceptualisation:** Matt J. Keeling. **Data curation:** Matt J. Keeling; Glen Guyver-Fletcher; Alexander Holmes, Massimiliano Tamborrino. **Formal analysis:** Matt J. Keeling. **Investigation:** Matt J. Keeling. **Methodology:** Matt J. Keeling. **Software:** Matt J. Keeling; Edward M. Hill; Louise Dyson; Michael J. Tildesley. **Validation:** Matt J. Keeling; Edward M. Hill; Louise Dyson; Michael J. Tildesley. **Visualisation:** Matt J. Keeling. **Writing - original draft:** Michael J. Tildesley; Edward M. Hill; Louise Dyson; Matt J. Keeling. **Writing - review & editing:** Matt J. Keeling; Edward M. Hill; Louise Dyson; Erin E. Gorsich; Bridget Penman; Trystan Leng; Glen Guyver-Fletcher; Alexander Holmes, Massimiliano Tamborrino; Hector McKimm; Michael J. Tildesley. ## Financial disclosure This work has been funded by the Engineering and Physical Sciences Research Council through the MathSys CDT [grant number EP/S022244/1]. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript. The corresponding author had full access to the data in the study and final responsibility for the decision to submit the manuscript for publication. ## Ethical considerations The data were supplied from the CHESS database after anonymisation under strict data protection protocols agreed between the University of Warwick and Public Health England. The ethics of the use of these data for these purposes was agreed by Public Health England with the Government’s SPI-M(O) / SAGE committees. ## Data availability Data on cases were obtained from the COVID-19 Hospitalisation in England Surveillance System (CHESS) data set that collects detailed data on patients infected with COVID-19. Data on COVID-19 deaths were obtained from Public Health England. These data contain confidential information, with public data deposition non-permissible for socioeconomic reasons. The CHESS data resides with the National Health Service ([www.nhs.gov.uk](http://www.nhs.gov.uk)) whilst the death data are available from Public Health England ([www.phe.gov.uk](http://www.phe.gov.uk)). ## Competing interests All authors declare that they have no competing interests. ## Supporting information items **Supporting Text S1** Description of the complete system of model equations. **Supporting Text S2** Details on the mechanisms underpinning social distancing measures within the model framework. **Supporting Text S3** Explanation of the QALY losses computation. **Table S1** **EQ-5D index population norms for England**. **Table S2** **UK population aggregated to ten regions (rounded to nearest 10,000)**. With regard to our intervention scenario in which regional ICU occupancy triggered the reintroduction and relaxation of social distancing measures within that region, the final column lists each of the regional ICU bed occupancy thresholds (equating to 45 occupied ICU beds per one million population). **Fig. S1** **Regional projections for hospitalisations per 100,000 with and without imposition of lockdown**. In each panel: filled markers correspond to observed data (squares are for reported deaths, circles are for death of death), solid lines correspond to the mean outbreak over a sample of posterior parameters; shaded regions depict prediction intervals, with darker shading representing stricter confidence (dark shading - 50%, moderate shading - 90%, light shading - 99%); dashed lines illustrate the mean projected trajectory had no lockdown measures being introduced. **Fig. S2** **Regional projections for ICU bed occupancy per 100,000 with and without imposition of lockdown**. In each panel: filled markers correspond to observed data (squares are for reported deaths, circles are for death of death), solid lines correspond to the mean outbreak over a sample of posterior parameters; shaded regions depict prediction intervals, with darker shading representing stricter confidence (dark shading - 50%, moderate shading - 90%, light shading - 99%); dashed lines illustrate the mean projected trajectory had no lockdown measures being introduced. ## Acknowledgements The authors would like to thank the RAMP Rapid Review Group for their useful comments on this manuscript. * Received May 10, 2020. * Revision received July 17, 2020. * Accepted July 17, 2020. * © 2020, Posted by Cold Spring Harbor Laboratory This pre-print is available under a Creative Commons License (Attribution-NonCommercial-NoDerivs 4.0 International), CC BY-NC-ND 4.0, as described at [http://creativecommons.org/licenses/by-nc-nd/4.0/](http://creativecommons.org/licenses/by-nc-nd/4.0/) ## References 1. [1].Zhu N, Zhang D, Wang W, Li X, Yang B, et al. A Novel Coronavirus from Patients with Pneumonia in China, 2019. N. Engl. J. Med. 382(8):727–733 (2020). doi:10.1056/NEJMoa2001017. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1056/NEJMoa2001017&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=31978945&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2020%2F07%2F17%2F2020.05.10.20083683.atom) 2. [2].World Health Organization. Novel Coronavirus (2019-nCoV) Situation Report – 1. (2020). URL [https://www.who.int/docs/default-source/coronaviruse/situation-reports/20200121-sitrep-1-2019-ncov.pdf?sfvrsn=20a99c104](https://www.who.int/docs/default-source/coronaviruse/situation-reports/20200121-sitrep-1-2019-ncov.pdf?sfvrsn=20a99c104). [Online] (Accessed: 23 June 2020). 3. [3].Kucharski AJ, Russell TW, Diamond C, Liu Y, Edmunds J, et al. Early dynamics of transmission and control of COVID-19: a mathematical modelling study. Lancet Infect. Dis. page 2020.01.31.20019901 (2020). doi:10.1016/S1473-3099(20)30144-4. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1016/S1473-3099(20)30144-4&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=32171059&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2020%2F07%2F17%2F2020.05.10.20083683.atom) 4. [4].Wang C, Liu L, Hao X, Guo H, Wang Q, et al. Evolving Epidemiology and Impact of Non-pharmaceutical Interventions on the Outbreak of Coronavirus Disease 2019 in Wuhan, China. medRxiv page 2020.03.03.20030593 (2020). doi:10.1101/2020.03.03.20030593. [Abstract/FREE Full Text](http://medrxiv.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6NzoibWVkcnhpdiI7czo1OiJyZXNpZCI7czoyMToiMjAyMC4wMy4wMy4yMDAzMDU5M3YxIjtzOjQ6ImF0b20iO3M6NTA6Ii9tZWRyeGl2L2Vhcmx5LzIwMjAvMDcvMTcvMjAyMC4wNS4xMC4yMDA4MzY4My5hdG9tIjt9czo4OiJmcmFnbWVudCI7czowOiIiO30=) 5. [5].Prem K, Liu Y, Russell TW, Kucharski AJ, Eggo RM, et al. The effect of control strategies to reduce social mixing on outcomes of the COVID-19 epidemic in Wuhan, China: a modelling study. Lancet Public Heal. (2020). doi:10.1016/S2468-2667(20)30073-6. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1016/S2468-2667(20)30073-6&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=32220655&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2020%2F07%2F17%2F2020.05.10.20083683.atom) 6. [6].Cereda D, Tirani M, Rovida F, Demicheli V, Ajelli M, et al. The early phase of the COVID-19 outbreak in Lombardy, Italy. ArXiv e-prints (2020). 7. [7].Cowling BJ, Ali ST, Ng TWY, Tsang TK, Li JCM, et al. Impact assessment of non-pharmaceutical interventions against COVID-19 and influenza in Hong Kong: an observational study. medRxiv page 2020.03.12.20034660 (2020). doi:10.1101/2020.03.12.20034660. [Abstract/FREE Full Text](http://medrxiv.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6NzoibWVkcnhpdiI7czo1OiJyZXNpZCI7czoyMToiMjAyMC4wMy4xMi4yMDAzNDY2MHYxIjtzOjQ6ImF0b20iO3M6NTA6Ii9tZWRyeGl2L2Vhcmx5LzIwMjAvMDcvMTcvMjAyMC4wNS4xMC4yMDA4MzY4My5hdG9tIjt9czo4OiJmcmFnbWVudCI7czowOiIiO30=) 8. [8].Public Health England. Priorities for SARS-CoV-2 (COVID-19) testing. (2020). URL [https://www.gov.uk/government/publications/wuhan-novel-coronavirus-initial-investigation-of-possible-cases/priority-for-sars-cov-2-covid-19-testing](https://www.gov.uk/government/publications/wuhan-novel-coronavirus-initial-investigation-of-possible-cases/priority-for-sars-cov-2-covid-19-testing). [Online] (Accessed: 23 June 2020). 9. [9].Mizumoto K, Kagaya K, Zarebski A, Chowell G. Estimating the asymptomatic proportion of coronavirus disease 2019 (COVID-19) cases on board the Diamond Princess cruise ship, Yoko-hama, Japan, 2020. Eurosurveillance 25(10) (2020). doi:[https://doi.org/10.2807/1560-7917.ES](https://doi.org/10.2807/1560-7917.ES). 2020.25.10.2000180. 10. [10].Lu X, Zhang L, Du H, Zhang J, Li YY, et al. SARS-CoV-2 Infection in Children. N. Engl. J. Med. (2020). doi:10.1056/NEJMc2005073. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1056/NEJMc2005073&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=32187458&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2020%2F07%2F17%2F2020.05.10.20083683.atom) 11. [11].Bai Y, Yao L, Wei T, Tian F, Jin DY, et al. Presumed Asymptomatic Carrier Transmission of COVID-19. JAMA (2020). doi:10.1001/jama.2020.2565. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1001/jama.2020.2565&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=32083643&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2020%2F07%2F17%2F2020.05.10.20083683.atom) 12. [12].Mossong J, Hens N, Jit M, Beutels P, Auranen K, et al. Social Contacts and Mixing Patterns Relevant to the Spread of Infectious Diseases. PLoS Med. 5(3):e74 (2008). doi:10.1371/journal.pmed.0050074. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1371/journal.pmed.0050074&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=18366252&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2020%2F07%2F17%2F2020.05.10.20083683.atom) 13. [13].Prem K, Cook AR, Jit M. Projecting social contact matrices in 152 countries using contact surveys and demographic data. PLOS Comput. Biol. 13(9):e1005697 (2017). doi:10.1371/journal.pcbi.1005697. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1371/journal.pcbi.1005697&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=28898249&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2020%2F07%2F17%2F2020.05.10.20083683.atom) 14. [14].Public Health England. COVID-19 Hospitalisation in England Surveillance System (CHESS) – daily reporting. (2020). URL [https://www.england.nhs.uk/coronavirus/wp-content/uploads/sites/52/2020/03/phe-letter-to-trusts-re-daily-covid-19-hospital-surveillance-11-march-2020.pdf](https://www.england.nhs.uk/coronavirus/wp-content/uploads/sites/52/2020/03/phe-letter-to-trusts-re-daily-covid-19-hospital-surveillance-11-march-2020.pdf). [Online] (Accessed: 23 June 2020). 15. [15]. Guan Wj, Ni Zy, Hu Y, Liang Wh, Ou Cq, et al. Clinical Characteristics of Coronavirus Disease 2019 in China. N. Engl. J. Med. (2020). doi:10.1056/NEJMoa2002032. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1056/NEJMoa2002032&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=32109013&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2020%2F07%2F17%2F2020.05.10.20083683.atom) 16. [16].Verity R, Okell LC, Dorigatti I, Winskill P, Whittaker C, et al. Estimates of the severity of COVID-19 disease. medRxiv page 2020.03.09.20033357 (2020). doi:10.1101/2020.03.09.20033357. [Abstract/FREE Full Text](http://medrxiv.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6NzoibWVkcnhpdiI7czo1OiJyZXNpZCI7czoyMToiMjAyMC4wMy4wOS4yMDAzMzM1N3YxIjtzOjQ6ImF0b20iO3M6NTA6Ii9tZWRyeGl2L2Vhcmx5LzIwMjAvMDcvMTcvMjAyMC4wNS4xMC4yMDA4MzY4My5hdG9tIjt9czo4OiJmcmFnbWVudCI7czowOiIiO30=) 17. [17].Dudel C, Riffe T, Acosta E, van Raalte AA, Myrskyla M. Monitoring trends and differences in COVID-19 case fatality rates using decomposition methods: Contributions of age structure and age-specific fatality. medRxiv page 2020.03.31.20048397 (2020). doi:10.1101/2020.03.31.20048397. [Abstract/FREE Full Text](http://medrxiv.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6NzoibWVkcnhpdiI7czo1OiJyZXNpZCI7czoyMToiMjAyMC4wMy4zMS4yMDA0ODM5N3Y0IjtzOjQ6ImF0b20iO3M6NTA6Ii9tZWRyeGl2L2Vhcmx5LzIwMjAvMDcvMTcvMjAyMC4wNS4xMC4yMDA4MzY4My5hdG9tIjt9czo4OiJmcmFnbWVudCI7czowOiIiO30=) 18. [18].Li R, Pei S, Chen B, Song Y, Zhang T, et al. Substantial undocumented infection facilitates the rapid dissemination of novel coronavirus (SARS-CoV2). Science (80-.). page eabb3221 (2020). doi:10.1126/science.abb3221. [Abstract/FREE Full Text](http://medrxiv.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6Mzoic2NpIjtzOjU6InJlc2lkIjtzOjEyOiIzNjgvNjQ5MC80ODkiO3M6NDoiYXRvbSI7czo1MDoiL21lZHJ4aXYvZWFybHkvMjAyMC8wNy8xNy8yMDIwLjA1LjEwLjIwMDgzNjgzLmF0b20iO31zOjg6ImZyYWdtZW50IjtzOjA6IiI7fQ==) 19. [19].Shea K, Tildesley MJ, Runge MC, Fonnesbeck CJ, Ferrari MJ. Adaptive Management and the Value of Information: Learning Via Intervention in Epidemiology. PLoS Biol. 12(10):e1001970 (2014). doi:10.1371/journal.pbio.1001970. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1371/journal.pbio.1001970&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=25333371&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2020%2F07%2F17%2F2020.05.10.20083683.atom) 20. [20].Liu Y, Eggo RM, Kucharski AJ. Secondary attack rate and superspreading events for SARS-CoV-2. Lancet 395(10227):e47 (2020). doi:10.1016/S0140-6736(20)30462-1. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1016/S0140-6736(20)30462-1&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=32113505&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2020%2F07%2F17%2F2020.05.10.20083683.atom) 21. [21].Ferretti L, Wymant C, Kendall M, Zhao L, Nurtay A, et al. Quantifying SARS-CoV-2 trans-mission suggests epidemic control with digital contact tracing. Science (80-.). page eabb6936 (2020). doi:10.1126/science.abb6936. [Abstract/FREE Full Text](http://medrxiv.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6Mzoic2NpIjtzOjU6InJlc2lkIjtzOjE3OiIzNjgvNjQ5MS9lYWJiNjkzNiI7czo0OiJhdG9tIjtzOjUwOiIvbWVkcnhpdi9lYXJseS8yMDIwLzA3LzE3LzIwMjAuMDUuMTAuMjAwODM2ODMuYXRvbSI7fXM6ODoiZnJhZ21lbnQiO3M6MDoiIjt9)