A Net Benefit Approach for the Optimal Allocation of a COVID-19 Vaccine
=======================================================================

* Erin Kirwin
* Ellen Rafferty
* Kate Harback
* Jeff Round
* Christopher McCabe

## Abstract

**OBJECTIVE** We implement a model-based approach to identify the optimal allocation of a COVID-19 vaccine in the province of Alberta, Canada.

**METHODS** We develop an epidemiologic model to evaluate allocation strategies defined by age and risk target groups, coverage, effectiveness, and cost of vaccine. The model simulates hypothetical immunization scenarios within a dynamic context, capturing concurrent public health strategies and population behaviour changes.

**RESULTS** In a scenario with 80% vaccine effectiveness, 40% population coverage, and prioritisation of those over the age of 60 at high-risk of poor outcomes, active cases are reduced by 17% and net monetary benefit increased by $263 million dollars, relative to no vaccine. Concurrent implementation of policies such as school closure and senior contact reductions have similar impacts on incremental net monetary benefit ($352 vs. 292 million, respectively) when there is no prioritisation given to any age or risk group. When older age groups are given priority, the relative benefit of school closures is much larger ($214 vs. 118 million). Results demonstrate that the rank ordering of different prioritisation options varies by prioritisation criteria, vaccine effectiveness and coverage, and concurrently implemented policies.

**CONCLUSIONS** Our results have three implications: (i) optimal vaccine allocation will depend on the public health policies in place at the time of allocation and the impact of those policies on population behaviour; (ii) outcomes of vaccine allocation policies can be greatly supported with interventions targeting contact reduction in critical sub-populations; and (iii) identification of the optimal strategy depends on which outcomes are prioritised.

Keywords
*   COVID-19
*   SARS-CoV-2
*   Cost-effectiveness
*   Net Benefit
*   Vaccine
*   Immunisation
*   Mathematical Modelling
*   Epidemiologic Modelling
*   Risk

## Introduction

Coronavirus disease 2019 (COVID-19) is a severe, novel virus that has spread globally. On 30 January 2020, the World Health Organization (WHO) declared a Public Health Emergency of International Concern and declared a Pandemic on 11 March 2020 [1]. As of 12 March 2021, there have been over 118 million confirmed cases and more than 2.6 million deaths worldwide [1].

While there are several non-pharmaceutical interventions (NPIs) available to reduce transmission among populations, the introduction of effective vaccines is expected to significantly improve decision makers ability to protect health care systems and the economy whilst gaining control of community transmission of COVID-19. Recommended NPIs for COVID-19 mitigation include hand hygiene, mask wearing, physical distancing in various locations, travel restrictions, testing, contact tracing, isolation of cases, and quarantine of close contacts. As vaccines become available, a key challenge for decision makers will be how to concurrently allocate limited vaccine stockpiles, and select optimal combinations of NPIs to mitigate the health risks of COVID-19 while meeting population needs to access the health system for diagnosis and treatment of other conditions, minimising the loss of economic activity, and promoting social well-being.

There are currently more than 200 COVID-19 vaccination products in development, with several in phase III trials, and several have been approved for use in Canada [2, 3]. These vaccines may reduce disease burden by preventing infection in exposed individuals, reducing severity of infection in infected individuals, and/or preventing secondary infections. Within individual health systems, decision makers will need to prioritise access to initially limited vaccine stockpiles [4-6]. Discussions on how to make these prioritisation decisions are well advanced in both the policy and research realms [7-14]. In addition to supply constraints, optimal vaccine allocation will also depend upon population factors such as disease risk, capacity to benefit from vaccine, likelihood of transmission, vaccine effectiveness and vaccine uptake.

The optimal allocation of vaccines will also vary according to the objectives of decision makers. Health economic models of the effectiveness and cost effectiveness of different combinations of NPIs and vaccines can enable more informed vaccine allocation decisions, by capturing the dynamic relationship between vaccine characteristics, allocation strategies, NPIs, and population behaviours. Whilst hundreds of models have been developed internationally to support decision making and public health messaging, only a handful of evaluations of vaccine allocation and prioritization strategies have been published to date [13, 15-18]. Only one of the studies evaluates scenarios with concurrent public health mitigation strategies [13]. None of the studies consider interventions targeting individuals by both age and risk group, with well-defined vaccine allocation policies or health economic outputs, limiting their value to decision makers.

The aim of this paper is to introduce a model-based evaluation of vaccine allocation, analysing strategies defined by age and risk target groups, coverage, and effectiveness, within a dynamic context considering other public health strategies and population behaviour change. Several potential outcomes can be selected as the objective outcome for the optimization problem. Here we consider total number of cases, hospitalizations, and incremental net monetary benefit (NMB). The NMB framework synthesizes multiple model outcomes: mortality, morbidity, and cost of illness. We evaluate hypothetical retrospective scenarios to test a NMB approach to vaccine allocation.

## 1. Methods

We developed the COVID-19 Risk Assessment Model (CRAM), a transmission dynamic ordinary differential equation compartmental susceptible-exposed-infected-recovered (SEIR) model. We calibrated CRAM to the time variant state of public health interventions and human behaviour, using data from Alberta, Canada. To evaluate the risks and outcomes associated with each strategy, scenarios are characterised by a combination of public health interventions that change over time, in comparison to a baseline scenario. Using CRAM we can estimate active cases, hospitalisations, total cost, Quality Adjusted Life Years (QALYs), and NMB. CRAM was programmed in Wolfram Mathematica, version 12.1.

### 2.1 Model Structure

CRAM is stratified into 16 age groups (five-year ranges up to 75+ years). Each of these 16 groups is divided further into two risk groups (high-risk and not high-risk), where risk is based on probability of a poor outcome due to COVID-19. An additional group is used to represent the Long-Term Care (LTC) population, which is made up of a subset of high-risk individuals aged 75 years and older. This results in 33 non-null age-risk groups.

CRAM has five overarching compartments: Susceptible (which includes Susceptible; Susceptible, No Distancing; Vaccine; and Vaccine Failure), Exposed, Infected (composed of Pre-Symptomatic; LTC; Community; Hospital; and Pre-Isolation), Isolation, and Recovered (comprised of Immunised; Recovered; and Dead) (see Figure 1). The model structure was developed to produce outcomes of interest to decision-makers and to leverage the highest quality data available in real-time during the COVID-19 pandemic. Model inputs are provided in Section 2.2.

![Figure 1.](http://medrxiv.org/https://www.medrxiv.org/content/medrxiv/early/2021/05/10/2020.11.30.20240986/F1.medium.gif)

[Figure 1.](http://medrxiv.org/content/early/2021/05/10/2020.11.30.20240986/F1)

Figure 1. CRAM Structure
**Fig1** ‘Isolation’ compartment is infectious, but does not contribute to the force of infection. Figure intended for colour printing

A fraction of the population is initially allocated to the Exposed compartment, with the remaining population allocated to the Susceptible compartment. Susceptible individuals are vaccinated subject to unique scenarios defined by the following characteristics: (i) program start date, (ii) number of doses available, (iii) the daily immunization delivery capacity and (iv) age and risk group prioritisation policy. Vaccine prioritisation policies allow access to different age and risk groups on different dates. Once vaccinated, after the period required to develop antibodies, individuals move either to the Immunised compartment (with no probability of infection or transmission), or to the Vaccine Failure compartment (with equal probability of infection and transmission to others in the susceptible compartment) as a function of the vaccine effectiveness. Vaccine Failures remain susceptible.

Susceptible individuals are exposed to the virus as a function of the force of infection which is determined by the transmissibility of the virus, seasonal variations in transmission, number of persons infected, and rate of contact between individuals across age groups. Susceptible individuals exposed to the virus move to the Exposed compartment and following the latent period move from the Exposed to Infected.

Depending on public health guidance, some individuals may move from the Susceptible compartment to the Susceptible, No Distancing compartment which allows for higher rates of contact. For example, children who are not high-risk move to the Susceptible, No Distancing compartment to reflect the higher rates of contact from in-person education.

On entry to the Infected compartment, individuals are Pre-Symptomatic. That is, cases in the community that are shedding virus but not experiencing or displaying symptoms. At the end of the pre-symptomatic period, individuals are allocated to Community or Hospital compartments, dependent on their age and risk group. If a case isolation policy is in place, a subset of the Community compartment will move to the Pre-Isolation and subsequently the Isolation compartments, where they remain for the remaining infectious period. All cases contribute to the force of infection prior to moving to the Isolation compartment, but individuals in the Isolation compartment do not contribute to the force of infection. The Isolation compartment represents the isolation of cases but not the isolation of close contacts.

Entry into LTC and Hospital varies by age group, with individuals from the LTC age-risk group moving from the pre-symptomatic to the infected LTC compartment. Individuals move from the LTC compartment at the end of the infectious period to either the Recovered or Dead compartments. Entry into the Hospital compartment is a function of age and risk, fit by an exponential regression on admissions by age, and adjusted for risk by an odds ratio. The Hospital compartment includes COVID inpatient cases and those admitted to intensive care units (ICUs). At the end of either the infectious period or the hospital length of stay (LOS), individuals move from the Community, LTC or Hospital compartment to either the Recovered, or Dead compartment, at a proportion dependent upon their risk group.

We used a synthetic contact matrix disaggregated into four locations: home, workplace, school, and other, where other comprises all remaining possible locations [19]. Disaggregating the total contact matrix by location allows for adjustments in contact rates reflecting policy interventions. For example, we can apply work-based interventions to specific age groups by adjusting the work contact matrix at various points in time. The total contact matrix is generated by summing the contacts for each age group across each of the matrices. Contact reductions for seniors aged 75 years and older and for high-risk individuals are applied directly to the total contact matrix. Outcomes (cases, hospitalizations, deaths) are tabulated from 01 October, 2020 to 06 February, 2021, spanning 92 days. The Electronic Supplementary Material (ESM) reports model equations and assumptions.

### 2.2 Model Inputs

CRAM was parameterised wherever possible with data from Alberta, including estimates for the total population by age group and risk of severe outcome, hospitalisation rate by age group, and LOS for hospitalised cases. Alberta’s population is the youngest of all Canadian provinces, making age distribution important to capture in the model [20]. Odds ratios for the risk of hospitalisation were estimated by risk group using logistic regression. Active cases in the model include both diagnosed and undiagnosed cases, fitted using seroprevalence data provided by Alberta Health. Details of all model inputs are provided in Table 1.

View this table:
[Table 1.](http://medrxiv.org/content/early/2021/05/10/2020.11.30.20240986/T1)

Table 1. Epidemiologic Parameters

Data from the Google Community Mobility report [21] were used as key inputs for contact reductions in workplaces and other locations. A rapid expert elicitation exercise was conducted to obtain estimates for unknown model parameters. We adapted elicitation methods and training materials from the Sheffield Elicitation Framework (SHELF) [22] to undertake rapid elicitations for the reduction in contacts for seniors aged 75 years and older, high-risk individuals, reduction in contacts in home locations, and expected return-to-school rates and in-school contact reductions by age group. Detailed results of the elicitations are reported in the ESM.

### 2.37 Economic Inputs

The study is conducted from a Canadian health system payer perspective. All costs are converted to 2020 Canadian dollars, and discounted at an annual rate of 1.5%, according to CADTH guidelines [26]. Cost inputs include hospitalisation, incremental LTC costs for infection prevention measures, and the cost of purchasing and administering a vaccine. Health utility losses include disutility from infection, hospitalisations and LTC infections (during stay and following discharge), and deaths. We assessed outcomes using the NMB framework [27]. We apply the health opportunity costs estimated for Canada [28], using the value of $30,000 per QALY.

Evidence related to health utility for COVID-19 is currently limited but rapidly emerging. [29] Given the lack of evidence at the time of writing, we identified utility impacts of similar conditions. We estimated disutility for community COVID-19 infections from an EQ-5D survey of individuals with lab confirmed influenza B infections, stratified by age group [30]. Because hospitalised COVID-19 cases are often diagnosed with pneumonia, we used disutility estimates for viral pneumonia inpatients [31] to estimate in-facility treatment utility losses, as well as utility losses for the year following facility discharge. We estimated QALY losses from premature death using the life table approach developed by Briggs et al. [32], adjusting for baseline utility and discounting. Costs related to community infections are not included. We estimated incremental direct costs associated with COVID-19 hospitalisation based on published Alberta per-diem costs, as well as the incremental cost of infection prevention and control for LTC cases. We also estimate utility decrements for ‘chronic’ or ‘long’ infections (ESM). Cost and utility decrement estimates are given in Table 2. Estimates are applied to the relevant compartments, and the resulting incremental NMB (iNMB) is estimated for each policy scenario.

View this table:
[Table 2.](http://medrxiv.org/content/early/2021/05/10/2020.11.30.20240986/T2)

Table 2. Cost and Utility Parameters

### 2.4 Model Fitting

We fit five parameters: virus transmissibility, the probability of hospitalisation, infections in LTC, and the probability of death from either facility or community infections. Using a deterministic version of the model defined with mean values of each input parameter we fit observed surveillance data for daily hospital census counts, as well as cumulative daily death and LTC counts from 01 October 2020, to 06 February 2021. Given the interdependence in the fitting parameters, we used simultaneous fitting methods by optimizing model fit over a Latin hypercube generated from plausible values for each parameter. Optimal parameter values were identified when the sum of the normalised difference in model and observed outcomes was minimised.

### 2.5 Outputs

CRAM samples from the probability distributions of model inputs, as either the best fitting 10% of simulations from the model fitting, or as estimated from the parameter source (Tables 1 & 2), to account for outcome uncertainty over 200 iterations, and then generates model outputs from the sampled values. This number of iterations was selected after comparing output stability across different numbers of iterations, for details, see the ESM. Outputs include cumulative estimates for the mean number of active cases, total infections, and hospitalisations, with credibility intervals to present uncertainty over simulations. The outputs include expected NMB, so that comparisons without the use of ratios can be made [27]. For each of the vaccine scenarios, iNMB is estimated relative to the baseline with no vaccine.

### 2.6 Scenario Analysis

In the reference scenario (1), no vaccine is available, and all contact matrixes and time variant inputs are held constant at the last observed value from model fitting. Specifically, we maintained contact reductions at the values determined through the expert elicitation for ‘home’ locations, as well as for seniors and high-risk individuals, and a fall return to school. Moreover, we kept the final observation of reduction in time spent in workplaces and ‘other’ locations from the Google Community Mobility reports consistent over the model run. In all scenarios, the vaccine is ‘sterilizing’, meaning that effective vaccine protects individuals from infection.

A range of NPIs can be estimated by CRAM. Policies which impact contact rates in the home, workplace, school and other locations for different age groups can be simulated through reductions on the corresponding contact matrix. Similarly, broad age-based interventions can be applied to the total contact matrix. In this paper, we considered school closure via a complete reduction in school-based contacts, and policies with increased physical distancing for seniors by reducing contact rates for those aged 75 and older by 50%.

Vaccine scenarios represent different vaccine allocation strategies, as well as various vaccine characteristics (i.e., effectiveness and coverage), as described in Table 3. Vaccine scenarios are characterised by the maximum number of doses that can be delivered per day, the start date of the vaccine program, the definition of the priority group, the interval (if any) between access for the priority group and the general population, the effectiveness of the vaccine, and vaccine coverage as a proportion of the total population. The estimates of vaccine effectiveness used in the analysis do not directly align to any of the currently approved vaccine products in Canada or elsewhere, nor does the price or timing of allocation align to the initial approval or distribution of licensed vaccines.

View this table:
[Table 3.](http://medrxiv.org/content/early/2021/05/10/2020.11.30.20240986/T3)

Table 3. Vaccine Scenarios

If the number of individuals eligible for immunisation exceeded the maximum number of doses that could be delivered on a given day, the maximum number of doses were pro-rated across each eligible age and risk group daily. This means that a group representing 5% of the eligible population would receive 5% of the total number of doses available on a given day.

To examine the impact of variations in vaccine effectiveness, we included scenario 7, where effectiveness varies by age. It is assumed that the vaccine is 60% effective over the age of 60, and 80% effective otherwise. In all other scenarios, effectiveness is constant across age groups. The scenario with 80% effectiveness approximates preliminary results from three phase three trials which have reported efficacy ranging from approximately 70 to 94% [38-40].

In each of the scenarios (1-11), we assumed a simple 30-day interval in access for the prioritized population groups and the general population, starting on 01 November 2020. Depending on the prioritization policy, this could lead to a gap of days during which no immunization would be provided. Extrapolating from the maximum estimate of vaccines per day in Alberta from [41], we assumed that up to 80,000 individuals can be immunised daily. Each of the scenario comparisons implicitly contains the baseline scenario (2) with age and risk-based prioritisation, 80% effectiveness, and 40% coverage, as a common reference point across scenarios. Scenarios that prioritise based on age give first access to those aged 55 and over, while programs that prioritise high-risk individuals prioritise all high-risk individuals irrespective of age.

Scenario 11 is defined with low vaccine effectiveness (40%) and coverage (20%). For both scenario 11 and the baseline scenario (2), we modelled additional public health measures, including a 50% reduction in contacts for seniors, and complete school closures (each policy implemented on 01 October 2020). For both sub-scenarios (school closures and seniors contact reduction), we assumed no additional costs or QALY losses. These simulations compare the impact vaccine policies in combination with other mitigation strategies, albeit for a small range of potential policy combinations.

## 3. Results

We used the CRAM to produce outputs for each vaccine scenario. For all scenarios, mean values, and either standard deviation or a 90% credibility interval are presented. In the no vaccine scenario, total cases were shown to remain relatively low in the initial period, but increase rapidly over time. In the vaccine baseline scenario (scenario 2), active cases are reduced by 17%. The impact of population vaccine coverage on outcomes demonstrates improved outcomes with greater population vaccine coverage, as expected. When coverage is 70%, cases are significantly reduced by 38%. Interestingly, with 70% coverage, iNMB decreases relative to baseline (Table 4, $216 vs 263 million). This indicates decreasing returns to scale, related to approaching herd immunity. The impact of vaccine effectiveness on outcomes behaved in the expected manner, where NMB increases alongside effectiveness. With 40% effectiveness, the availability of a vaccine reduces cumulative cases by 10%, while with 60% effectiveness, cumulative cases decrease by 14%. These results are summarised in Table 4 and Figure 2.

![Figure 2.](http://medrxiv.org/https://www.medrxiv.org/content/medrxiv/early/2021/05/10/2020.11.30.20240986/F2.medium.gif)

[Figure 2.](http://medrxiv.org/content/early/2021/05/10/2020.11.30.20240986/F2)

Figure 2. Scenario Results - Active Cases
**Fig2** For scenario definitions, see main text

Vaccine prioritisation strategies demonstrated dynamic results. Prioritizing both high-risk and individuals over the age of 55 had the smallest impact on infections and produced the second lowest value for iNMB. Equal prioritisation to all age and risk groups minimised cumulative cases and had the greatest iNMB value. Prioritisation based on risk levels alone had the second highest iNMB value. Prioritization by age group had the second greatest reduction in cases, but the lowest reduction in iNMB relative to the scenario with no vaccine. The variability in results demonstrates the need for decision makers to clearly identify their objective when determining vaccine allocation strategies.

The results of the concurrent NPI scenarios (Table 5) demonstrate several important relationships. First, the relative ranking of each prioritisation scenario varied depending on the outcome of interest. For example, in the worst case scenarios 11a and 11b, risk based prioritization had the second best iNMB and number of hospitalizations, but the second worst number of cases (Figure 3, Table 5).

![Figure 3.](http://medrxiv.org/https://www.medrxiv.org/content/medrxiv/early/2021/05/10/2020.11.30.20240986/F3.medium.gif)

[Figure 3.](http://medrxiv.org/content/early/2021/05/10/2020.11.30.20240986/F3)

Figure 3. Concurrent Non-Pharmaceutical Intervention Results – Active Cases
**Fig3** For scenario definitions, see main text

Second, the impact of prioritisation strategies varies greatly depending on concurrent public health interventions. School closures and senior contact reductions have similar impacts on iNMB when there is no prioritisation given to any age or risk group (Table 5, iNMB 352 vs. 292 million, respectively, ratio 1.2:1), but when older groups are given priority, the benefit of school closures is much larger than reducing contacts for seniors (Table 5, iNMB 214 vs. 118 million, respectively, ratio 1.8:1).

Third, we found that the relative ranking of the prioritisation scenarios changed dynamically between the baseline scenario (Table 4) and the concurrent NPI scenarios (Table 5). In all scenarios, giving equal priority to all age and risk groups maximised iNMB, and minimized cases and hospitalizations in all concurrent NPI scenarios. Conversely, prioritizing older and high-risk individuals had the greatest reduction in hospitalizations in the baseline scenario with no concurrent NPIs.

### 3.1 Coverage, Effectiveness, and Prioritisation Scenario Results

View this table:
[Table 4:](http://medrxiv.org/content/early/2021/05/10/2020.11.30.20240986/T4)

Table 4: Scenario Results

### 3.2 Low Effectiveness and Coverage Scenarios: Concurrent Public Health Responses

View this table:
[Table 5.](http://medrxiv.org/content/early/2021/05/10/2020.11.30.20240986/T5)

Table 5. Concurrent Non-Pharmaceutical Intervention Results

## 4. Discussion

Our results demonstrate the conflicts faced by decision makers when determining which policy objectives to pursue. In addition to the expected result that the choice of optimal vaccine allocation strategy is dependent on the primary outcome of interest, we also show the importance of considering time-variant epidemiological conditions, NPIs in place while a vaccine stockpile is allocated, vaccine coverage and effectiveness, population prioritisation policies, and timing of vaccine availability.

Cumulative cases and iNMB vary greatly depending upon which concurrent strategies are in place. The optimum vaccine allocation strategy is sensitive to whether policies target morbidity reductions (cases, hospitalizations) or NMB outcomes. The choice over which outcomes to optimize is a reflection of values, and/or of specific concerns (such as hospital capacity) at the time of decision making. Depending on contact patterns and case burden, increases in cases do not imply equivalent marginal increases in hospitalizations, and vice-versa. Similarly, outcomes such as hospitalizations have different impacts by age and risk group, which are not captured in count-based measures. The NMB measure combines the QALY losses and health system costs related to multiple outcomes (cases, hospitalizations, deaths).

With the exception of Chen et al. [13], other studies do not consider concurrent or future public health policies/ and or behavioural factors. We consider this an important oversight, as vaccine roll outs will take place in the context of other public health interventions and variation in behavioural responses. Ignoring this dynamic would risk misallocating the limited and highly valuable vaccine supply. Similarly, very few other studies have examined allocation by age and risk, [13,15,17] which are key factors in vaccine allocation discussions.

Our study applies a health system perspective and incurs immunisation costs, whereas a societal perspective is expected to broadly increase NMB in immunisation scenarios relative to a health system perspective as broader social, economic, and health impacts are considered. For example, the societal cost of school closures are not captured in model results. The model is run for a short time frame such that the full benefits of immunisation are not fully realised, and important dynamics such as waning immunity are unknown and not considered in this analysis. Despite these limitations, the large NMB loss estimates for all scenarios demonstrate the magnitude of the harm caused by the COVID-19 pandemic, and the relative impact of vaccination on NMB in the short term.

Some results from our analysis are unexpected and warrant further explanation. The impact of a lower vaccine effectiveness in those aged 60 and over appears relatively small. This is likely due to the expectation that physical distancing is maintained at a higher level for seniors throughout the period of analysis. If public health guidance or population attitudes shift such that seniors have increasing contact rates, lower effectiveness for older age groups would have a greater impact.

The results for the ‘no prioritization’ strategy is non-intuitive. While age and risk groups that are older or high-risk have a greater risk of hospitalisation or death from COVID, these outcomes interact dynamically with greater transmission, driven by higher rates of contact, in young and low risk age groups. With increasing evidence of COVID-19 vaccines reducing the probability of viral transmission [42, 40], there is an argument that immunizing those with greater rates of contact will confer greater population level benefits [43]. This dynamic may also be due to relatively high coverage in the scenarios evaluated. These effects may not be as strong with coverage lower than 40%, as evaluated in our baseline scenarios. With sufficient evidence to support sterilizing immunity, this is an important finding as the implication will be that individuals who cannot avoid contact (due to their employment, socioeconomic status, or living situation) should be prioritized for immunization to minimize onwards transmission and increase protection at a population level.

We have modelled ‘all or nothing’ vaccine effectiveness. Other authors have shown that evaluating ‘leaky’ effectiveness impacted upon the dynamics of the population impact [17]. This would not change the importance of the dynamic relationships our analysis elucidates but would impact upon the relative magnitude of different policy strategies. Future analyses with CRAM could incorporate evidence-based vaccine effectiveness and the identification of critical coverage thresholds needed to achieve herd immunity.

Our analysis assumes only susceptible individuals are immunized and does not consider the potential role of serological testing for guiding vaccination strategies [17]. The assumption that only susceptible individuals are tested implies that an accurate method of case identification is in place, and more realistic evaluations intended to inform policies must consider the likely population distribution of recovered cases, to ensure realistic modelling of immunizing both susceptible and recovered individuals.

Furthermore, evidence of marginal vaccine effectiveness on recovered individuals would be required. As stated in the introduction, the aim of this paper is to develop a model-based approach to vaccine allocation, analysing strategies defined by age and risk target groups, coverage, and effectiveness, within a dynamic context considering NPIs and population behaviour change. To this end, we evaluated intentionally hypothetical scenarios to avoid direct application of our results rather than our approach to vaccine allocation. Analyses designed to inform decision making must reflect the context within decisions are being made: current epidemiology, the timing of vaccine allocation, vaccine supply, delivery capacity, product effectiveness, proposed dose intervals, inter-dose effectiveness, concurrent NPIs, and population behaviour.

Our results have three key policy implications: (i) that optimal vaccine allocation will depend on the public health policies, epidemiology, and human behaviours in place at the time of allocation; (ii) the effectiveness and efficiency of vaccine allocation policies can be greatly enhanced by co-interventions that target contact reduction in critical sub-populations; and (iii) the identification of the optimal strategy depends on which outcomes are prioritised.

Future analyses conducted to inform policy directly should reflect these findings. It is critical to identify which outcomes are prioritized in vaccine allocation. Decision makers must not only consider the interventions and behaviours in place at the time of allocation, but also those which could be in place in the future. Whereas our paper evaluates changes to NPIs in separate scenarios, optimal allocation will depend on public health policy, epidemiology, and human behaviour. This creates a dynamic decision-making environment where different combinations and degrees of implementation should be compared for all NPIs. Similarly, it is likely that real-world decision problems will involve the allocation of multiple vaccines, targeting different segments of the population with different availability over time. The full suite of policy options (both NPIs and vaccine allocation options) and combinations thereof must be examined to identify an optimal solution.

Public health policies that can be implemented alongside vaccine allocation must be considered within a clear framework reflecting social values and equity. For example, in our model NMB is improved relative to baseline when seniors continue to reduce their number of contacts, and if vaccines are allocated without prioritizing older and high-risk population groups. However, this would mean that the people with the greatest risk of disease and poor outcomes would also bear the highest burden through additional social isolation. Therefore, the suite of public health policy policies to be implemented alongside the vaccine should be determined prior to dynamic policy optimisation [8].

## Supporting information

Supplementary Material [[supplements/240986_file02.pdf]](pending:yes)

## Data Availability

All data sources for the model are listed directly in the manuscript.

## Declarations

### Competing Interests

Erin Kirwin, Ellen Rafferty, Kate Harback, Jeff Round, and Christopher McCabe have no conflicts of interest that are directly relevant to the content of this article.

### Availability of data and material

All data sources documented.

### Funding

The IHE is funded in part by the Alberta Ministry of Health.

### Code availability

Available from authors upon request.

### Author Contributions

All authors were involved in the conception of the study. EK designed, programmed, and calibrated the model. EK, ER and KH contributed to the collection of data. EK wrote the first draft of the manuscript with ER, KH, JR and CM critically revising for important intellectual content. All authors read and approved the final manuscript.

## Acknowledgments

The authors acknowledge Dr. Marie Varughese and Li Huang for providing epidemiologic data for model input. We also thank Joana Gomes da Costa for assistance in identifying information related to chronic COVID. We acknowledge earlier work on influenza modelling in Alberta, the Pandemic Risk Assessment Model, with Dr. Douglas Dover.

## Footnotes

*   Second Draft of paper uploaded, with new analytic window to highlight the intentionally hypothetical retrospective nature of the analysis.

*   Received November 30, 2020.
*   Revision received May 9, 2021.
*   Accepted May 10, 2021.


*   © 2021, Posted by Cold Spring Harbor Laboratory

The copyright holder for this pre-print is the author. All rights reserved. The material may not be redistributed, re-used or adapted without the author's permission.

## References

1.  1.World Health Organization. WHO Coronavirus Disease (COVID-19) Dashboard. 2021. [https://covid19.who.int/?gclid=Cj0KCQjw3ZX4BRDmARIsAFYh7ZLuu8BFL-gYbXtg5OMm4L\_P4oqdQ7gbHn9wgTBVlIIaKzHD0bPfRU0aAhoWEALw_wcB](https://covid19.who.int/?gclid=Cj0KCQjw3ZX4BRDmARIsAFYh7ZLuu8BFL-gYbXtg5OMm4L_P4oqdQ7gbHn9wgTBVlIIaKzHD0bPfRU0aAhoWEALw_wcB). Accessed 2021-03- 12 2021.
    
    

2.  2.World Health Organization. The push for a COVID-19 vaccine. 2020. [https://www.who.int/emergencies/diseases/novel-coronavirus-2019/covid-19-vaccines?gclid=CjwKCAjwz6\_8BRBkEiwA3p02VfNzp6CQFFczxUolOmCLjurVQzu8eglhw54TctCLTwDrLoW1ONAfrRoCQFwQAvD\_BwE](https://www.who.int/emergencies/diseases/novel-coronavirus-2019/covid-19-vaccines?gclid=CjwKCAjwz6_8BRBkEiwA3p02VfNzp6CQFFczxUolOmCLjurVQzu8eglhw54TctCLTwDrLoW1ONAfrRoCQFwQAvD_BwE). Accessed 2021/03/12.
    
    

3.  3.Government of Canada. Drug and vaccine authorizations for COVID-19: List of applications received. 2021. [https://www.canada.ca/en/health-canada/services/drugs-health-products/covid19-industry/drugs-vaccines-treatments/authorization/applications.html#wb-auto-4](https://www.canada.ca/en/health-canada/services/drugs-health-products/covid19-industry/drugs-vaccines-treatments/authorization/applications.html#wb-auto-4). Accessed 2021/03/12.
    
    

4.  4.Hassoun N. How to Distribute a COVID-19 Vaccine Ethically. Scientific American. 2020 2020/9/25.
    
    

5.  5.Kupferschmidt K. WHO unveils global plan to fairly distribute COVID-19 vaccine, but challenges await. Science Magazine. 2020 2020/9/21.
    
    

6.  6.Weintraub R, Yadav P, Berkley S. A Covid-19 Vaccine Will Need Equitable, Global Distribution. Harvard Business Review. 2020 2020/4/2.
    
    

7.  7.Gayle H, Foege W, Brown L, Kahn B, Committee on Equitable Allocation of Vaccine for the Novel C, Board on Health Sciences P et al. Framework for Equitable Allocation of COVID-19 Vaccine. Washington (DC): National Academies Press (US); 2020.
    
    

8.  8.Roope LSJ, Buckell J, Becker F, Candio P, Violato M, Sindelar JL et al. How Should a Safe and Effective COVID-19 Vaccine be Allocated? Health Economists Need to be Ready to Take the Baton. Pharmacoecon Open. 2020;4(4):557–61. doi:10.1007/s41669-020-00228-5.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1007/s41669-020-00228-5&link_type=DOI) 

9.  9.Persad G, Peek ME, Emanuel EJ. Fairly Prioritizing Groups for Access to COVID-19 Vaccines. JAMA. 2020. doi:10.1001/jama.2020.18513.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1001/jama.2020.18513&link_type=DOI) 

10. 10.Emanuel EJ, Persad G, Kern A, Buchanan A, Fabre C, Halliday D et al. An ethical framework for global vaccine allocation. Science. 2020;369(6509):1309–12. doi:10.1126/science.abe2803.
    
    [Abstract/FREE Full Text](http://medrxiv.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6Mzoic2NpIjtzOjU6InJlc2lkIjtzOjEzOiIzNjkvNjUwOS8xMzA5IjtzOjQ6ImF0b20iO3M6NTA6Ii9tZWRyeGl2L2Vhcmx5LzIwMjEvMDUvMTAvMjAyMC4xMS4zMC4yMDI0MDk4Ni5hdG9tIjt9czo4OiJmcmFnbWVudCI7czowOiIiO30=) 

11. 11.Emanuel EJ, Persad G, Upshur R, Thome B, Parker M, Glickman A et al. Fair Allocation of Scarce Medical Resources in the Time of Covid-19. N Engl J Med. 2020;382(21):2049–55. doi:10.1056/NEJMsb2005114.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1056/NEJMsb2005114&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=32202722&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2021%2F05%2F10%2F2020.11.30.20240986.atom) 

12. 12.Buckner JH, Chowell G, Springborn MR. Optimal Dynamic Prioritization of Scarce COVID-19 Vaccines. medRxiv. 2020. doi:10.1101/2020.09.22.20199174.
    
    [Abstract/FREE Full Text](http://medrxiv.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6NzoibWVkcnhpdiI7czo1OiJyZXNpZCI7czoyMToiMjAyMC4wOS4yMi4yMDE5OTE3NHY1IjtzOjQ6ImF0b20iO3M6NTA6Ii9tZWRyeGl2L2Vhcmx5LzIwMjEvMDUvMTAvMjAyMC4xMS4zMC4yMDI0MDk4Ni5hdG9tIjt9czo4OiJmcmFnbWVudCI7czowOiIiO30=) 

13. 13.Chen X, Li M, Simchi-Levi D, Zhao T. Allocation of COVID-19 Vaccines Under Limited Supply. SSRN Electronic Journal. 2020. doi:10.2139/ssrn.3678986.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.2139/ssrn.3678986&link_type=DOI) 

14. 14.Liu Y, Salwi S, Drolet BC. Multivalue ethical framework for fair global allocation of a COVID- 19 vaccine. J Med Ethics. 2020;46(8):499–501. doi:10.1136/medethics-2020-106516.
    
    [Abstract/FREE Full Text](http://medrxiv.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6OToibWVkZXRoaWNzIjtzOjU6InJlc2lkIjtzOjg6IjQ2LzgvNDk5IjtzOjQ6ImF0b20iO3M6NTA6Ii9tZWRyeGl2L2Vhcmx5LzIwMjEvMDUvMTAvMjAyMC4xMS4zMC4yMDI0MDk4Ni5hdG9tIjt9czo4OiJmcmFnbWVudCI7czowOiIiO30=) 

15. 15.Matrajt L, Eaton J, Leung T, Brown ER. Vaccine optimization for COVID-19: Who to vaccinate first? Sci Adv. 2020;7(6). doi:10.1126/sciadv.abf1374.
    
    [FREE Full Text](http://medrxiv.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6MzoiUERGIjtzOjExOiJqb3VybmFsQ29kZSI7czo4OiJhZHZhbmNlcyI7czo1OiJyZXNpZCI7czoxMjoiNy82L2VhYmYxMzc0IjtzOjQ6ImF0b20iO3M6NTA6Ii9tZWRyeGl2L2Vhcmx5LzIwMjEvMDUvMTAvMjAyMC4xMS4zMC4yMDI0MDk4Ni5hdG9tIjt9czo4OiJmcmFnbWVudCI7czowOiIiO30=) 

16. 16.Meehan MT, Cocks DG, Caldwell JM, Trauer JM, Adekunle AI, Ragonnet RR et al. Age- targeted dose allocation can halve COVID-19 vaccine requirements. Infectious Diseases (except HIV/AIDS). 2020. doi:10.1101/2020.10.08.20208108.
    
    [Abstract/FREE Full Text](http://medrxiv.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6NzoibWVkcnhpdiI7czo1OiJyZXNpZCI7czoyMToiMjAyMC4xMC4wOC4yMDIwODEwOHYyIjtzOjQ6ImF0b20iO3M6NTA6Ii9tZWRyeGl2L2Vhcmx5LzIwMjEvMDUvMTAvMjAyMC4xMS4zMC4yMDI0MDk4Ni5hdG9tIjt9czo4OiJmcmFnbWVudCI7czowOiIiO30=) 

17. 17.Bubar KM, Reinholt K, Kissler SM, Lipsitch M, Cobey S, Grad YH et al. Model-informed COVID-19 vaccine prioritization strategies by age and serostatus. Science. 2021;371(6532):916– 21. doi:10.1126/science.abe6959.
    
    [Abstract/FREE Full Text](http://medrxiv.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6Mzoic2NpIjtzOjU6InJlc2lkIjtzOjEyOiIzNzEvNjUzMi85MTYiO3M6NDoiYXRvbSI7czo1MDoiL21lZHJ4aXYvZWFybHkvMjAyMS8wNS8xMC8yMDIwLjExLjMwLjIwMjQwOTg2LmF0b20iO31zOjg6ImZyYWdtZW50IjtzOjA6IiI7fQ==) 

18. 18.Moghadas SM, Vilches TN, Zhang K, Nourbakhsh S, Sah P, Fitzpatrick MC et al. Evaluation of COVID-19 vaccination strategies with a delayed second dose. medRxiv. 2021. doi:10.1101/2021.01.27.21250619.
    
    [Abstract/FREE Full Text](http://medrxiv.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6NzoibWVkcnhpdiI7czo1OiJyZXNpZCI7czoyMToiMjAyMS4wMS4yNy4yMTI1MDYxOXYzIjtzOjQ6ImF0b20iO3M6NTA6Ii9tZWRyeGl2L2Vhcmx5LzIwMjEvMDUvMTAvMjAyMC4xMS4zMC4yMDI0MDk4Ni5hdG9tIjt9czo4OiJmcmFnbWVudCI7czowOiIiO30=) 

19. 19.Prem K, Cook AR, Jit M. Projecting social contact matrices in 152 countries using contact surveys and demographic data. PLoS Comput Biol. 2017;13(9):e1005697. doi:10.1371/journal.pcbi.1005697.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1371/journal.pcbi.1005697&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=28898249&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2021%2F05%2F10%2F2020.11.30.20240986.atom) 

20. 20.Statistics Canada. CANSIM Table 17-10-0005-01 Population estimates on July 1st, by age and sex. 2021.
    
    

21. 21.Google. COVID-19 Community Mobility Reports. 2021. [https://www.google.com/covid19/mobility/data\_documentation.html?hl=en](https://www.google.com/covid19/mobility/data_documentation.html?hl=en). Accessed 2021/02/12.
    
    

22. 22.Oakley J, O’Hagan A. SHELF: The Sheffield Elicitation Framework. 2013.
    
    

23. 23.Grassly NC, Fraser C. Seasonal infectious disease epidemiology. Proc Biol Sci. 2006;273(1600):2541–50. doi:10.1098/rspb.2006.3604.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1098/rspb.2006.3604&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=16959647&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2021%2F05%2F10%2F2020.11.30.20240986.atom) 
    
    [Web of Science](http://medrxiv.org/lookup/external-ref?access_num=000240729900019&link_type=ISI) 

24. 24.Davies NG, Klepac P, Liu Y, Prem K, Jit M,  group CC-w et al. Age-dependent effects in the transmission and control of COVID-19 epidemics. Nat Med. 2020;26(8):1205–11. doi:10.1038/s41591-020-0962-9.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1038/s41591-020-0962-9&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=32546824&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2021%2F05%2F10%2F2020.11.30.20240986.atom) 

25. 25.Public Health Agency of Canada. COVID-19: PHAC Modelling Group Weekly Report2020 2020/7/3.
    
    

26. 26.Canadian Agency for Drugs and Technologies in Health. Guidelines for the Economic Evaluation of Health Technologies: Canada. 2017.
    
    

27. 27.Stinnett AA, Mullahy J. Net health benefits: a new framework for the analysis of uncertainty in cost-effectiveness analysis. Med Decis Making. 1998;18(2 Suppl):S68–80. doi:10.1177/0272989X98018002S09.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1177/0272989X98018002S09&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=9566468&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2021%2F05%2F10%2F2020.11.30.20240986.atom) 

28. 28.Ochalek J, Lomas J, Claxton K. Assessing health opportunity costs for the Canadian health care systems. 2018. [http://www.pmprb-cepmb.gc.ca/CMFiles/Consultations/new\_guidelines/Canada\_report\_2018-03-14\_Final.pdf](http://www.pmprb-cepmb.gc.ca/CMFiles/Consultations/new\_guidelines/Canada_report_2018-03-14_Final.pdf).
    
    

29. 29.Poteet S, Craig BM. QALYs for COVID-19: A Comparison of US EQ-5D-5L Value Sets. Patient. 2021. doi:10.1007/s40271-021-00509-z.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1007/s40271-021-00509-z&link_type=DOI) 

30. 30.Fragaszy EB, Warren-Gash C, White PJ, Zambon M, Edmunds WJ, Nguyen-Van-Tam JS et al. Effects of seasonal and pandemic influenza on health-related quality of life, work and school absence in England: Results from the Flu Watch cohort study. Influenza Other Respir Viruses. 2018;12(1):171–82. doi:10.1111/irv.12506.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1111/irv.12506&link_type=DOI) 

31. 31.Mangen MJ, Huijts SM, Bonten MJ, de Wit GA. The impact of community-acquired pneumonia on the health-related quality-of-life in elderly. BMC Infect Dis. 2017;17(1):208. doi:10.1186/s12879-017-2302-3.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1186/s12879-017-2302-3&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=http://www.n&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2021%2F05%2F10%2F2020.11.30.20240986.atom) 

32. 32.Briggs AH, Goldstein DA, Kirwin E, Meacock R, Pandya A, Vanness DJ et al. Estimating (quality-adjusted) life-year losses associated with deaths: With application to COVID-19. Health Econ. 2021;30(3):699–707. doi:10.1002/hec.4208.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1002/hec.4208&link_type=DOI) 

33. 33.Moreno-Perez O, Merino E, Leon-Ramirez JM, Andres M, Ramos JM, Arenas-Jimenez J et al. Post-acute COVID-19 syndrome. Incidence and risk factors: A Mediterranean cohort study. J Infect. 2021;82(3):378–83. doi:10.1016/j.jinf.2021.01.004.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1016/j.jinf.2021.01.004&link_type=DOI) 

34. 34.Alberta Health. Interactive Health Data Application - Health Costing Data. 2021. [http://www.ahw.gov.ab.ca/IHDA\_Retrieval/selectSubCategory.do](http://www.ahw.gov.ab.ca/IHDA_Retrieval/selectSubCategory.do). Accessed 2020/11/15.
    
    

35. 35.Statistics Canada. CANSIM Table 18-10-0005-01, Consumer Price Index, annual average, not seasonally adjusted. 2021.
    
    

36. 36.van Rijt AM, Dik JH, Lokate M, Postma MJ, Friedrich AW. Cost analysis of outbreaks with Methicillin-resistant Staphylococcus aureus (MRSA) in Dutch long-term care facilities (LTCF) PLoS One. 2018;13(11):e0208092. doi:10.1371/journal.pone.0208092.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1371/journal.pone.0208092&link_type=DOI) 

37. 37.Gray M. Canada spent $24M on COVID-19 vaccines received in January: StatCan. CTV News. 2021.
    
    

38. 38.Polack FP, Thomas SJ, Kitchin N, Absalon J, Gurtman A, Lockhart S et al. Safety and Efficacy of the BNT162b2 mRNA Covid-19 Vaccine. N Engl J Med. 2020;383(27):2603–15. doi:10.1056/NEJMoa2034577.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1056/NEJMoa2034577&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=33301246&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2021%2F05%2F10%2F2020.11.30.20240986.atom) 

39. 39.Baden LR, El Sahly HM, Essink B, Kotloff K, Frey S, Novak R et al. Efficacy and Safety of the mRNA-1273 SARS-CoV-2 Vaccine. N Engl J Med. 2021;384(5):403–16. doi:10.1056/NEJMoa2035389.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1056/NEJMoa2035389&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=33378609&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2021%2F05%2F10%2F2020.11.30.20240986.atom) 

40. 40.Voysey M, Clemens SAC, Madhi SA, Weckx LY, Folegatti PM, Aley PK et al. Safety and efficacy of the ChAdOx1 nCoV-19 vaccine (AZD1222) against SARS-CoV-2: an interim analysis of four randomised controlled trials in Brazil, South Africa, and the UK. Lancet. 2021;397(10269):99–111. doi:10.1016/S0140-6736(20)32661-1.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1016/S0140-6736(20)32661-1&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=33306989&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2021%2F05%2F10%2F2020.11.30.20240986.atom) 

41. 41.Dover DC, Kirwin EM, Hernandez-Ceron N, Nelson KA. Pandemic Risk Assessment Model (PRAM): a mathematical modeling approach to pandemic influenza planning. Epidemiol Infect. 2016;144(16):3400–11. doi:10.1017/S0950268816001850.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1017/S0950268816001850&link_type=DOI) 

42. 42.Petter E, Mor O, Zuckerman N, Oz-Levi D, Younger A, Aran D et al. Initial real world evidence for lower viral load of individuals who have been vaccinated by BNT162b2. bioRxiv. 2021. doi:10.1101/2021.02.08.21251329.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1101/2021.02.08.21251329&link_type=DOI) 

43. 43.Mulberry N, Tupper P, Kirwin E, McCabe C, Colijn C. Vaccine rollout strategies: The case for vaccinating essential workers early. bioRxiv. 2021. doi:10.1101/2021.02.23.21252309.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1101/2021.02.23.21252309&link_type=DOI)