Childhood immune imprinting to influenza A shapes birth year-specific risk during seasonal H1N1 and H3N2 epidemics
==================================================================================================================

* Katelyn M Gostic
* Rebecca Bridge
* Shane Brady
* Cécile Viboud
* Michael Worobey
* James O Lloyd-Smith

## Abstract

Across decades of co-circulation in humans, influenza A subtypes H1N1 and H3N2 have caused seasonal epidemics characterized by different age distributions of cases and mortality. H3N2 causes the majority of relatively severe, clinically attended cases in high-risk elderly cohorts, and the majority of overall deaths, whereas H1N1 causes fewer deaths overall, and cases shifted towards young and middle-aged adults. These contrasting age profiles may result from differences in childhood exposure to H1N1 and H3N2 or from differences in evolutionary rate between subtypes. Here we analyze a large epidemiological surveillance dataset to test whether childhood immune imprinting shapes seasonal influenza epidemiology, and if so, whether it acts primarily via immune memory of a particular influenza subtype or via broader immune memory that protects across subtypes. We also test the impact of evolutionary differences between influenza subtypes on age distributions of cases. Likelihood-based model comparison shows that narrow, within-subtype imprinting shapes seasonal influenza risk alongside age-specific risk factors. The data do not support a strong effect of evolutionary rate, or of broadly protective imprinting that acts across subtypes. Our findings emphasize that childhood exposures can imprint a lifelong immunological bias toward particular influenza subtypes, and that these cohort-specific biases shape epidemic age distributions. As a result, newer and less “senior” antibody responses acquired later in life do not provide the same strength of protection as responses imprinted in childhood. Finally, we project that the relatively low mortality burden of H1N1 may increase in the coming decades, as cohorts that lack H1N1-specific imprinting eventually reach old age.

**Author Summary** Influenza viruses of subtype H1N1 and H3N2 both cause seasonal epidemics in humans, but with different age-specific impacts. H3N2 causes a greater proportion of cases in older adults than H1N1, and more deaths overall. People tend to gain the strongest immune memory of influenza viruses encountered in childhood, and so differences in H1N1 and H3N2’s age-specific impacts may reflect that individuals born in different eras of influenza circulation have been imprinted with different immunological risk profiles. Another idea is that H3N2 may be more able to infect immunologically experienced adults because it evolves slightly faster than H1N1 and can more quickly escape immune memory. We analyzed a large epidemiological data set and found the clearest signal that birth year-specific differences in childhood immune imprinting, not differences in evolutionary rate, explain differences in H1N1 and H3N2’s age-specific impacts. These results can help epidemiologists understand how epidemic risk from specific influenza subtypes is distributed across the population and predict how population risk may shift as differently imprinted birth years grow older. Further, these results provide immunological clues to which facets of immune memory become biased in childhood, and then later play a strong role in protection during seasonal influenza epidemics.

## Introduction

Childhood influenza exposures leave an immunological imprint, which has reverberating, lifelong impacts on immune memory. Foundational work on original antigenic sin (1) and antigenic seniority (2) showed that individuals maintain the highest antibody titers against influenza strains encountered in childhood. But how these serological patterns map to functional immune protection, and shape birth year-specific risk during outbreaks, remains an active area of inquiry. One open question is the breadth of cross-protection provided by immune memory imprinted in childhood.

We define immune imprinting as a lifelong bias in immune memory of, and protection against, the strains encountered in childhood. Such biases most likely become entrenched as subsequent exposures back-boost existing memory responses, rather than stimulating true *de novo* responses (3). By providing particularly robust protection against certain antigenic subtypes, or clades, imprinting can provide immunological benefits, but perhaps at the cost of equally strong protection against variants encountered later in life. For example, every modern influenza pandemic has spared certain birth cohorts, presumably due to cross-protective memory primed in childhood (4–10). Recently, we showed that imprinting also protects against novel, emerging avian influenza viruses of the same phylogenetic group as the first childhood exposure (9,11). Imprinting may additionally shape birth year-specific risk from seasonal influenza (12–14), but the importance of broadly protective immunity remains unclear in this context.

Until recently, narrow cross-protective immunity specific to variants of a single hemagglutinin (HA) subtype has been considered the primary mode of defense against seasonal influenza. Lymphocyte memory of variable epitopes on the HA head (i.e. sites at which hemagglutinin antigens of different subtypes show limited homology) drives this narrow, within-subtype protection, which is the main mechanism of protection from the inactivated influenza vaccine. But a growing body of evidence shows protection may also be driven by memory of other influenza antigens (e.g. neuraminidase, NA) (15–17), or by immune response to conserved epitopes, many of which are found on the HA stalk (11,18–21). (Antibodies that target conserved HA epitopes can provide broad protection across multiple HA subtypes in the same phylogenetic group (18,20,22), where HA group 1 contains hemagglutinin subtypes H1 and H2, while group 2 contains H3 (11,19,23). H1, H2 and H3 are the only HA subtypes that have circulated seasonally in humans since 1918.)

Together, these insights suggest that within a single host, imprinting probably induces multiple levels of bias in immune memory, to both conserved (broadly protective) and variable (narrowly protective) sites on various influenza antigens. The functional role of any single layer of imprinted immune memory depends on both immunodominance hierarchies and epidemic context. Here, we examine which layers of imprinted memory impact risk from seasonal influenza.

Within-subtype immunity to HA is known to shape seasonal influenza’s epidemiology and evolution (24). But because this type of narrow immunity decays rapidly in the face of antigenic drift, it would not be expected to shape cohort-specific imprinting protection across an entire human lifetime (25,26). Conversely, broad, HA group-level immune memory arises when lymphocytes target conserved HA epitopes. Responses to these conserved epitopes should be stable over time, and can play a strong role in defense against unfamiliar influenza strains (e.g. novel, avian or pandemic subtypes (11,18,20,22,27,28)). Broad, HA group-level responses are not traditionally thought to play a strong role in defense against familiar, seasonal influenza subtypes, but have recently been identified as an independent correlate of protection against seasonal influenza (21), and might play a particularly strong role against drifted seasonal strains whose variable HA epitopes have become unrecognizable. Thus, childhood immune imprinting may determine which birth cohorts are primed for effective defense against seasonal strains with conserved HA epitopes characteristic of group 1 or group 2, or with variable HA epitopes characteristic of a particular subtype (H1, H2, etc.). A similar line of reasoning may apply to immunity against NA, although much less attention has been paid to this antigen.

Since 1977, two distinct subtypes of influenza A, H1N1 and H3N2, have circulated seasonally in humans, with striking but poorly understood differences in their age-specific impact (9,12–14,29). These differences could be associated with childhood imprinting: older cohorts were almost certainly exposed to H1N1 in childhood (since it was the only subtype circulating in humans from 1918-1957), and now seem to be preferentially protected against modern seasonal H1N1 variants (9,12–14). Likewise, younger adults have the highest probabilities of childhood imprinting to H3N2 (***Fig. 1***), which is consistent with relatively low numbers of clinically attended H3N2 cases in these cohorts. Alternatively, differences in the evolutionary dynamics of H1N1 and H3N2 could explain the observed age profiles. Subtype H3N2 exhibits slightly faster drift in its antigenic phenotype than H1N1, and as a result, H3N2 may be better able to escape pre-existing immunity in immunologically experienced adults, whereas H1N1 may be relatively restricted to causing cases in immunologically inexperienced children (30).

![Figure 1.](http://medrxiv.org/https://www.medrxiv.org/content/medrxiv/early/2019/09/26/19001834/F1.medium.gif)

[Figure 1.](http://medrxiv.org/content/early/2019/09/26/19001834/F1)

Figure 1. Model and expectations under different imprinting hypotheses.
**(A)** Reconstructed, birth year-specific probabilities of imprinting (representative example specific to cases observed in 2015). Throughout the manuscript, group 1 HA subtypes are represented in blue and group 2 subtypes in red. **(B**) Expected imprinting protection against H1N1 or H3N2 under the three tested models. (**C**) Cartoon of expected age distribution of any influenza case, before controlling for subtype-specific imprinting. The shape of this curve is purely hypothetical, but each of our tested models combined demographic age distribution with a fitted, age-specific risk step function to generate similar, data-driven curves. (**D**-**F)** Fraction of each birth year unprotected by their childhood imprinting (from A) determines the shape of birth year-specific risk. (**G-I)** A linear combination of age-specific risk (C), and birth year-specific risk (D-F) give the expected age distribution of H1N1 or H3N2 cases under each model.

We analyzed a large surveillance data set of relatively severe, clinically attended influenza cases to test whether cohort effects from childhood imprinting primarily act against variable epitopes, only providing narrow cross-protection against closely related HA or NA variants of the same subtype, or against more conserved epitopes, providing broad cross-protection across HA subtypes in the same phylogenetic group (***Fig. 1A-B***). We fitted a suite of models to data using maximum likelihood and compared models using AIC. In a separate analysis, we considered the hypothesis that differences in evolutionary rate of H1N1 and H3N2, rather than imprinting effects, shape differences in age distribution. Our results have implications for long-term projections of seasonal influenza risk in elderly cohorts (13), who suffer the heaviest burdens of influenza-related morbidity and mortality, and whose imprinting status will shift through time as cohorts born during different inter-pandemic eras grow older.

## The Data

The Arizona Department of Health Services (ADHS) provided a dataset containing 9,510 seasonal H1N1 and H3N2 cases from their statewide surveillance system. Cases of all ages were confirmed to subtype by PCR and/or culture, primarily from virologic testing at the Arizona State Public Health Laboratory (ASPHL). The ADHS surveillance system aims to characterize circulating strains from patients across the state with medically attended influenza. Although surveillance does not target specific at-risk groups, relatively severe cases (especially those tested at hospital labs) are overrepresented in our data, as these cases are most likely to be medically attended and confirmed to subtype, thus meeting our study inclusion criteria. This is because confirmation to subtype requires a second-line test (PCR or culture); rapid tests are more common, but do not indicate subtype.

Although the exact collection setting of individual specimens was not always recorded, ADHS staff internally reviewed reporting source and provider organization of cases in our data to estimate that roughly 76% were reported and/or submitted by hospital labs or may have originated at hospital-associated outpatient clinics. A previous ADHS analysis of subtyped 2016 influenza A data matched to hospital discharge data found that nearly half of cases reported from hospital labs (if extrapolated to other seasons, roughly 38% of the overall data) were severe enough to warrant hospital admission. The rest (also roughly 38% of the overall data, if extrapolated) were discharged without admission. To obtain a broader representation of clinically attended cases from across the state, ADHS collaborates with county health departments, commercial laboratories, and outpatient clinics to receive specimens. We estimate that roughly 8% of the data originated in outpatient settings. The remaining 17% of cases were either tested at commercial labs, or were tested at ASPHL, but with unknown origin. Ultimately, these data allow us to analyze drivers of relatively severe, clinically attended cases, but our results cannot be assumed to generalize to mild or asymptomatic cases.

Cases were observed across 22 years of influenza surveillance, from the 1993-1994 influenza season through the 2014-2015 season, although sample sizes increased dramatically after the 2009 pandemic (***Table 1***). Sampling changed slightly starting in 2004, when commercial labs were first mandated to report positive tests to the state (31), but the vast majority of cases analyzed (9150/9451) were observed from the 2004-2005 season onwards, after this change had been implemented.

View this table:
[Table 1.](http://medrxiv.org/content/early/2019/09/26/19001834/T1)

Table 1. Confirmed cases in surveillance data from Arizona Department of Health Services.
Data representing the first and second waves of the 2009 H1N1 pandemic (2008-2009 and 2009-2010 seasons) were excluded.

Following CDC standards, ADHS defines the influenza season as epidemiological week 40 (around early October) through week 39 of the following year (32). The 2008-2009 and 2009-2010 influenza seasons spanned the first and second wave, respectively, of the 2009 H1N1 pandemic. We did not analyze cases observed during this time period, because age distributions of cases and molecular drivers of immune memory differed during the 2009 pandemic from the normal drivers of seasonal influenza’s immuno-epidemiology of interest to this study (14,18,22). From the dataset of 9,510 seasonal cases (defined as any case observed outside the 2008-2009 or 2009-2010 season), we excluded 58 cases with birth years before 1918 (whose imprinting status could not be inferred unambiguously), and one case whose year of birth was recorded in error. Ultimately, we analyzed 9,541 cases.

### Confirmed cases in surveillance data from Arizona Department of Health Services

Data representing the first and second waves of the 2009 H1N1 pandemic (2008-2009 and 2009-2010 seasons) were excluded.

## The Model

### Reconstructed imprinting patterns

We reconstructed birth year-specific probabilities of childhood imprinting to H1N1, H2N2 or H3N2 using methods described previously (11). These probabilities are based on patterns of first childhood exposure to influenza A and reflect historical circulation (***Fig. 1A***). Most individuals born between pandemics in 1918 and 1957 experienced a first influenza A virus (IAV) infection by H1N1, and middle-aged cohorts born between pandemics in 1957 and 1968 almost all were first infected by H2N2 (note that because the first influenza exposure may occur after the first year of life, individuals born in the years leading up to a pandemic have some probability of first infection by the new pandemic subtype, ***Fig. 1A***). Ever since its emergence in 1968, H3N2 has dominated seasonal circulation in humans, and caused the majority of first infections in younger cohorts. However, H1N1 has also caused some seasonal circulation since 1977, and has imprinted a fraction of all cohorts born since the mid-1970s (***Fig. 1A***).

Reconstructions assumed children age 0-12 in the year of case observation might not yet have been exposed to any influenza virus. Interactions between imprinting and vaccination of naïve infants are plausible, but poorly understood (11,33). We did not consider childhood vaccination effects here; only a small percentage of individuals in the ADHS data were born at a time when healthy infants were routinely vaccinated against influenza.

### Expected age distributions under alternate imprinting models

If HA subtype-level imprinting protection shapes seasonal influenza risk, primary exposure to HA subtype H1 or H3 in childhood should provide lifelong protection against modern variants of the same HA subtype. If imprinting protection acts primarily against specific NA subtypes, lifelong protection will be specific to N1 or to N2 (***Fig. 1B***). Alternatively, if broad HA group-level imprinting shapes seasonal influenza risk, then cohorts imprinted to HA subtype H1 or H2 (both group 1) should be protected against modern, seasonal H1N1 (also group 1), while only cohorts imprinted to H3 (group 2) would be protected against modern, seasonal H3N2 (also group 2) (***Fig. 1B***). Collinearities between the predictions of different imprinting models (***Fig. 1D-I***) were inevitable, given the limited diversity of influenza antigenic subtypes circulating in humans over the past century (reflected in ***Fig. 1A***). Note that middle-aged cohorts, which were first infected by H2N2, are crucial, because they provide the only leverage to differentiate between imprinting at the HA subtype, NA subtype or HA group-level level (***Fig. 1B***).

Our approach distinguishes between age-specific risk factors related to health and social behavior, and birth year-specific effects related to imprinting. Specifically, age-specific risk could be influenced by medical factors like age-specific vaccine coverage, age-specific risk of severe disease, age-related changes in endocrinology and immunosenescence, or by behavioral factors like age-assorted social mixing, and age-specific healthcare seeking behavior. These factors should have similar impacts on any influenza subtype. In contrast, imprinting effects are subtype-specific. Thus, we fit a step function to characterize the shape of age-specific risk of any confirmed influenza case. Simultaneously, we modeled residual, subtype-specific differences in risk as a function of birth year, to focus on the possible role of childhood imprinting. Each tested model used a linear combination of age-specific risk (***Fig. 1C***) and birth year-specific risk (***Fig. 1D-F***) to generate an expected distribution of H1N1 or H3N2 cases (***Fig. 1G-I***). Note that for a given birth cohort, age-specific risk changed across progressive years of case observation (as the cohort got older), whereas birth year-specific risk was constant over time.

To test quantitatively whether observed subtype-specific differences in incidence were most consistent with imprinting at the HA subtype, NA subtype or HA group level, or with no contribution of imprinting, we fitted a suite of models to each data set using a multinomial likelihood and then performed model selection using AIC. AIC is used to compare the relative strength of statistical support for a set of candidate models, each fitted to the same data, and favors parsimonious models that fit the data well (34,35). Technical details are provided in the ***Methods***.

### Tested models

We fit a set of four models to the ADHS data set. The simplest model contained only age-specific risk (abbreviated A), and more complex models added effects from imprinting at the HA subtype level (S), at the HA group level (G), or at the NA subtype level (N): abbreviated AS, AG, and AN, respectively. The age-specific risk curve took the form of a step function, in which relative risk was fixed to 1 in age bin 0-4, and one free parameter was fit to represent relative risk in each of the following 12 age bins: {5-10, 11-17, 18-24, 25-31, 32-38, 39-45, 46-52, 53-59, 60-66, 67-73, 74-80, 81+}. Within models that contained imprinting effects, the fraction of individuals in each single year of birth with protective childhood imprinting was assumed proportional to reductions in risk. Two additional free parameters quantified the relative risk of a confirmed H1N1 or H3N2 case, given imprinting protection against that seasonal subtype.

### Effect of influenza evolutionary rate on age profiles

We used publicly available data from *Nextstrain* (36,37), and from one previously published study (38), to calculate annual antigenic advance, which we defined as the antigenic distance between strains of a given lineage (pre-2009 H1N1, post-2009 H1N1 or H3N2) that circulated in consecutive seasons (***Methods***). The “antigenic distance” between two influenza strains is used as a proxy for similarity in antigenic phenotype, and potential for immune cross-protection. A variety of methods have been developed to estimate antigenic distance using serological data, genetic data, or both (37–39).

To assess the impact of antigenic evolutionary rate on the epidemic age distribution, we tested whether the proportion of cases in children increased in seasons associated with large antigenic changes. If the rate of antigenic drift is a strong driver of age-specific influenza risk, then the fraction of influenza cases observed in children should be negatively related to annual antigenic advance (30). In other words, strains that have not changed much antigenically since the previous season should be unable to escape pre-existing immunity in immunologically experienced adults, and more restricted to causing cases in immunologically inexperienced children; strains that have changed substantially will be less restricted to children.

## Results

### Subtype-specific differences in age distribution

Seasonal H3N2 epidemics consistently caused more clinically attended cases in older cohorts, while H1N1 caused a greater proportion of cases in young and middle-aged adults (***Figs. 2, S1-S2***). These patterns were apparent whether we compared H3N2 epidemic age distributions with those caused by the pre-2009 seasonal H1N1 lineage, or with the post-2009 lineage. Observed patterns are consistent with the predicted effects of cohort-specific imprinting (***Fig. 1***), and with previously reported differences in age distribution of seasonal H1N1 and H3N2 incidence (12–14,29). See ***Fig. 2*** for seasons where H1N1 and H3N2 co-circulated in substantial numbers, and ***Figs. S1-S2*** for the entire dataset and alternate smoothing parameters.

![Figure 2.](http://medrxiv.org/https://www.medrxiv.org/content/medrxiv/early/2019/09/26/19001834/F2.medium.gif)

[Figure 2.](http://medrxiv.org/content/early/2019/09/26/19001834/F2)

Figure 2. Observed age distributions, Arizona.
Points show fraction of confirmed H1N1 or H3N2 cases observed in each single year of age. Lines show a smoothing spline fit to observed distributions. **(A)** All confirmed cases in the data (aggregate across all seasons). (**B-G**) Age distributions from individual seasons in which both H1N1 and H3N2 circulated (seasons with ≥ 50 confirmed cases of each subtype are shown here. See Fig. S1 for all seasons).

#### Imprinting model selection

The data showed a strong preference for NA subtype-level imprinting over HA subtype-level imprinting (ΔAIC=34.54), and effectively no statistical support for broad, HA group-level imprinting (ΔAIC=249.06), or for an absence of imprinting effects (ΔAIC=385.42) ***(Fig. 3, Table 2***). Visual assessment of model fits (***Fig. 3C-D***) confirmed that models containing imprinting effects at the narrow, NA or HA subtype levels provided the best fits to data. The lack of support for the no-imprinting model suggests that imprinting from the first exposure shapes lifelong seasonal influenza risk, just as it does avian-origin influenza (10, 12). However, imprinting appears to act more narrowly against seasonal influenza than against avian influenza, providing cross protection only to a specific NA or HA subtype, instead of broader, HA group-level protection. This result is consistent with the idea that immunodominance of variable HA epitopes limits the breadth of immune cross protection deployed against familiar, seasonal influenza subtypes (20,22).

View this table:
[Table 2.](http://medrxiv.org/content/early/2019/09/26/19001834/T2)

Table 2. Maximum likelihood parameter estimates and 95% profile confidence intervals from each model fit to ADHS data.
All estimated parameters represent the relative risk of a confirmed case, given the factors listed in the left-hand column. Model name abbreviations specific which factors were included. A = age-specific risk, N = NA subtype-level imprinting, S = HA subtype-level imprinting, G = HA group-level imprinting.

![Figure 3.](http://medrxiv.org/https://www.medrxiv.org/content/medrxiv/early/2019/09/26/19001834/F3.medium.gif)

[Figure 3.](http://medrxiv.org/content/early/2019/09/26/19001834/F3)

Figure 3. Model fits and model selection.
**(A)** Fitted effects of age, after normalization to demographic age distribution and **(B)** imprinting effects from model AN, which provided the best fit to data. **(C-D)** Model fits to observed age distributions of H1N1 (**C)** and H3N2 **(D**) cases. Model name abbreviations indicate which factors were included: A = age-specific risk, N = NA subtype-level imprinting, S = HA subtype-level imprinting, G = HA group-level imprinting. All models included demographic age distribution.

As expected (see ***Fig. 1G-I***), predictions from the two best models were highly collinear, except in their risk predictions among middle-aged, H2N2-imprinted cohorts (birth years 1957-1968), and some other minor differences arising from normalization across birth-years.

### Maximum likelihood parameter estimates and 95% profile confidence intervals from each model fit

All estimated parameters represent the relative risk of a confirmed case, given the factors listed in the left-hand column. Age-specific risk parameters could take any value, but we only considered imprinting protection values between 0 and 1, as it would be illogical for protective imprinting to cause an increase in relative risk. Model name abbreviations specific which factors were included. A = age-specific risk after normalizing to demographic age distribution, N = NA subtype-level imprinting, S = HA subtype-level imprinting, G = HA group-level imprinting.

### Fitted risk patterns

Fitted age-specific risk curves took similar forms in all tested models. After controlling for demographic age distribution, estimated age-specific risk was highest in children and the elderly, consistent with the buildup of immune memory across childhood, and waning immune function in the aged (***Fig. 3A*** shows the fitted curve from the best model). Estimates of imprinting parameters were less than one, indicating some reduction in relative risk (***Table 2***). Within the best model, estimated reductions in relative risk from childhood imprinting were stronger for H1N1 (0.34, 95% CI 0.29-0.42) than for H3N2 (0.71, 95% CI 0.62-0.82). In the second-best model, AS (subtype-specific imprinting), estimated reductions in H3N2 risk were particularly weak, and the confidence interval overlapped the null value of 1. ***Table 2*** shows parameter estimates and 95% profile confidence intervals from all models fitted.

### Effect of evolutionary rate

To test for effects of evolutionary rate on epidemic age distribution, we searched for decreases in the proportion of cases among children in seasons associated with antigenic novelty, when highly drifted strains might be more able to infect immunologically experienced adults. (We defined children as ages 0-10, and verified internally that our analysis of evolutionary rate was insensitive to our exact choice of age range for children). Consistent with this expectation, the data showed a slight negative but not significant association between annual antigenic advance and the fraction of H3N2 cases observed in children (***Fig. 4A***). However, note that no clear relationship emerged between antigenic novelty and the fraction of cases observed in any age group including older children (>10) and adults (***Fig. 4A***). These are the cohorts in which epidemiological data show the clearest differences between H1N1 and H3N2’s age-specific impacts (***Fig. 2***); if rate of antigenic evolution is a dominant driver of age-specific differences in incidence, we would have expected to see clearer evidence of evolutionary rate effects within adults cohorts, not just between adults and the youngest children. The data contained too few influenza seasons with sufficient numbers of confirmed H1N1 cases to support meaningful Spearman correlation coefficients for either pre-2009 or post-2009 seasonal H1N1 lineages.

![Figure 4.](http://medrxiv.org/https://www.medrxiv.org/content/medrxiv/early/2019/09/26/19001834/F4.medium.gif)

[Figure 4.](http://medrxiv.org/content/early/2019/09/26/19001834/F4)

Figure 4. Effect of antigenic advance on age distribution.
**(A)** Relationship between annual antigenic advance and the fraction of cases observed in children (0-10), or in adult age groups. Each data point represents a single influenza season in which at least 100 confirmed cases of a given subtype were observed. Blue label shows Spearman correlation between the fraction of H3N2 cases observed in each age group and annual antigenic advance. Blue dashes show linear trend fitted using lm() in R. **(B)** Season-specific age distributions of cases, colored by antigenic advance since the previous season.

Furthermore, if evolutionary rate is the dominant driver of subtype-specific differences in epidemic age distribution, then when subtypes H1N1 and H3N2 show similar degrees of annual antigenic advance, their age distributions of cases should appear more similar. However, the data showed that differences in H1N1 and H3N2’s age-specific impacts did not converge when lineages showed similar annual advance. When comparing the fraction of cases observed in specific age classes, H1N1 data consistently clustered separately from H3N2, with H1N1 consistently causing fewer cases at the extremes of age (children 0-10 and elderly adults 71-85), but more cases in middle-aged adults, regardless of antigenic novelty (***Fig. 4A***). Smoothed density plots showed no clear relationship between annual antigenic advance and age distribution (***Fig. 4B***). Overall, the data showed a weak, but not significant signal that relatively severe, clinically attended cases may be more restricted to young children when antigenic novelty is low, but the data did not show strong evidence that the magnitude of annual antigenic drift is a systematic driver of epidemic age distribution across the entire population.

## Discussion

We analyzed a large epidemiological surveillance dataset and found that seasonal influenza subtypes H1N1 and H3N2 cause different age distributions of relatively severe, clinically attended cases, confirming previously reported patterns (12–14). We analyzed several possible drivers of these differences side-by-side, and found the greatest support for imprinting protection against seasonal influenza viruses of the same NA or HA subtype as the first influenza strain encountered in childhood (12,13). The data did not support strong effects from broader HA group-level imprinting, as recently detected for novel zoonotic or pandemic viruses (9,11), or from differences in rates of antigenic evolution (30). Our results suggest individuals retain a lifelong bias in immune memory, and that this imprint is not erased even after decades of exposure to or vaccination against dissimilar influenza subtypes.

External evidence corroborates the idea that birth year, rather than age, drives subtype-specific differences in seasonal influenza risk. When H3N2 first emerged in 1968, it caused little or no excess mortality in the elderly, who had putatively been exposed, as children or young adults, to an H3 virus that had circulated in the late 1800s (7,9). Meanwhile, H1N1-imprinted cohorts (those ∼10-50 years old at the time) experienced considerable excess mortality in the 1968 pandemic (7). Now, fifty years later, the same H1N1-imprinted cohorts continue to experience excess H3N2 morbidity and mortality as older adults (12–14,29) (***Fig. 2***).

In model comparison, the data supported childhood imprinting to NA. Although NA is not as intensively studied as HA, these results emphasize the increasingly recognized importance of both antigens as drivers of protection against seasonal influenza (15–17). Realistically, some combination of effects from both HA and NA subtype-level imprinting probably shapes seasonal influenza risk; both models of imprinting produced similar fits to data, and far outperformed other models in terms of AIC (Fig. 3). Unfortunately, due to the limited diversity of seasonal influenza strains that have circulated in humans over the past century, collinearities between even the relatively simple models tested here prevented us from testing more complicated models of combined effects from imprinting to multiple antigens. Deeper insights into the respective roles of HA and NA will most likely need to come from focused immunological cohort studies, in which individual histories of influenza infection are recorded and can be studied alongside changes in serology, PBMCs, and/or the B cell repertoire (33). Alternatively, the development of immunological biomarkers for diagnosis of imprinting status in individual patients could substantially increase the power of epidemiological inference.

We did not detect a clear relationship between annual antigenic advance and epidemic age distribution, although small sample sizes may have limited our statistical power. We did detect a weak trend, consistent with the idea that influenza cases are more restricted to immunologically inexperienced children in seasons of low antigenic advance, as previously proposed (30). But the data did not reveal a clear relationship between antigenic advance and the fraction of cases occurring in adult age groups, where epidemiological data reveal distinct subtype-specific differences in impact. Perhaps antigenic advance shapes how cases are distributed between children and adults, but has small or inconsistent impacts within the adult population. We speculate that clearer relationships between antigenic advance and epidemic age distribution might emerge if methods to estimate antigenic distance were able to incorporate effects such as immune history (40), glycosylation (40,41), and immunity to antigens other than HA (16,17,42).

The exact immunological drivers of imprinting protection against seasonal influenza remain unclear, but these results provide some new clues. Traditionally, within-subtype cross-protection is thought to decay quickly with antigenic drift. Strains that circulated more than 14 years apart rarely show measurable cross-protective titers by the hemagglutination inhibition (HI) assay (38). The short timescale of immune memory to variable HA head epitopes stands in contrast to patterns observed in our study and others (12–14), where within-subtype immune memory imprinted in childhood appears to persist for an entire human lifetime, remaining evident even in the oldest cohorts. We speculate that within-subtype imprinting protection may involve epitopes that are more conserved, and stable over time, than those typically measured in HI assays (which inform most existing estimates of antigenic distance, but may disproportionately measure antibodies to variable, immunodominant epitopes on the HA head (21,22)). Across a lifetime of exposures to diverse H1N1 and H3N2 variants, repeated back-boosting of antibodies to intermediately conserved sites on HA or NA (i.e. sites conserved within but not across HA and NA subtypes), could explain the longevity of subtype-level imprinting protection. This is consistent with recent evidence that the immune repertoire shifts to focus on more conserved influenza epitopes as we age (25,26).

Another possibility is that, memory B cell clones developed during the first childhood influenza exposure may later adapt via somatic hypermutation to “follow” antigenic targets as they drift over time (25,28). However, this would be inconsistent with new evidence suggesting memory B cells are relatively fixed in phenotype, and have little potential for ongoing affinity maturation (43,44). Thus, the first influenza exposure in life may fill a child’s memory B cell repertoire with clones that serve in the future as prototypes that can be rapidly and effectively tailored to recognize drifted influenza strains of the same subtype. Finally, the role of CD4+ T cells in imprinting is unclear, but T cell memory and T cell help to B cells within germinal centers both play at least some role in the development of the immune repertoire (45).

Signals of imprinting protection are anomalously strong in the current cohort of elderly adults, as reflected by higher estimates of imprinting protection to H1N1 than H3N2. The oldest subjects in our data, born slightly after 1918, and would not have encountered an influenza virus of any subtype other than H1N1 until roughly age 30. Repeated early-life exposures to diverse H1N1 variants may have reinforced and expanded the breadth of H1N1-specific immune memory (5,46). But this strong H1N1 protection seems to come at a cost; even after decades of seasonal H3N2 exposure, and vaccination, older cohorts have evidently failed to develop equally strong protection against H3N2. HA group 1 antigens (e.g. H1) appear to induce narrower immune responses, and less cross-group protection than structurally distinct HA group 2 antigens (e.g. H3) (23). Perhaps elderly cohorts imprinted to group 1 antigens have been trapped in narrower responses that offer exceptional protection against strains similar to that of first exposure but relatively poor adaptability to other subtypes.

We speculate that imprinting protection, which currently limits the number of severe, clinically-attended H1N1 cases in the elderly, also limits the mortality impact of H1N1 viruses. Although pre- and post-2009 H1N1 lineages have caused slightly different profiles of age-specific mortality (13), neither H1N1 lineage causes nearly as many deaths as H3N2 in high-risk elderly cohorts (13,29,47). On the one hand, if strong subtype-specific biases from imprinting remain in future cohorts of elderly adults, our results would corroborate the idea that mortality from H1N1 may increase as protection in the elderly shifts from H1N1 toward other subtypes (9,13). On the other hand, given that cohorts born after 1968 have had much more varied early life exposures to both H1N1 and H3N2, these cohorts may show a greater ability to act as immunological generalists as they become elderly, capable of effective defense against multiple subtypes.

Our study has several limitations. Relatively severe, clinically attended cases are much more likely to be detected, confirmed to subtype, and included in our data than mild cases. Thus, while our results show a clear relationship between subtype-level imprinting and risk of relatively severe, clinically attended influenza, the relationship between imprinting and mild or asymptomatic cases could not be determined from available data.

Given the limited number of variables recorded in the data, we could not model explicitly the impact of individual risk factors such as the presence of comorbidities, patient sex, or vaccination status. All these factors are known to shape immunity and influenza risk (48), and all may cause individual imprinting outcomes to vary from the average, population trends measured by our study. Understanding how these patient-level covariates modulate imprinting and other aspects of immunity is the next frontier in this line of research. For now, working within the constraints of the available data, we designed the age-specific risk component of the model to capture empirically the combined effects of several risk factors that could not be modeled individually. Additionally, we analyzed the relative count of H1N1 to H3N2 cases within each single year of birth, not absolute incidence, to control for minor age-specific biases in sampling, which are almost inevitably present in any large data set.

Another limitation was the low number of confirmed cases available in the pre-2009 era. Large, detailed data sets collected continuously over decades provide the greatest power to separate the effects of age from birth year. We emphatically echo earlier calls (49) for more systematic sharing of single year-of-age influenza surveillance data, standardization of sampling effort, and reporting of age-specific denominators, which could substantially boost the scientific community’s ability to link influenza’s genetic and antigenic properties with epidemiological outcomes. Additionally, collection and reporting of covariates such as sex, vaccination status and the presence of comorbidities in surveillance data would help us understand how patient-level variables modulate imprinting, and immunity in general (50,51).

Altogether, this analysis confirms that the epidemiological burden of H1N1 and H3N2 is shaped by cohort-specific differences in childhood imprinting (9,12,13,52), and that this imprinting acts at the HA or NA subtype level against seasonal influenza. The lack of support for broader, HA group-level imprinting effects emphasizes the consequences of immunodominance of influenza’s most variable epitopes, and the difficulty of deploying broadly protective memory B cell responses against familiar, seasonal strains. Overall, these findings advance our understanding of how antigenic seniority shapes cohort-specific risk during epidemics. The fact that elderly cohorts show relatively weak immune protection against H3N2, even after living through decades of seasonal exposure to or vaccination against H3N2, suggests that antibody responses acquired in adulthood do not provide the same strength or durability of immune protection as responses primed in childhood. Immunological experiments that consider multiple viral exposures, and cohort studies in which individual histories of influenza infection are tracked from birth, promise to illuminate how B cell and T cell memory develop across a series of early life exposures. In particular, these studies may provide clearer insights than epidemiological data into which influenza antigens, epitopes and immune effectors play the greatest role in immune imprinting, and how quickly subtype-specific biases become entrenched across the first or the first few exposures.

## Materials and Methods

### Estimation of age from birth year in ADHS data

The data contained three variables, influenza season, birth year and confirmed subtype. For most cases, birth year was extracted directly from the reported date of birth in patient medical records, but age was not known. We estimated patient age at the time case observation using the formula [year of observation]-[birth year]. To ensure that the minimum estimated age was 0, the second year in the influenza season of case observation was considered the calendar year of observation (e.g. 2013 for the 2012-2013 season).

### Splines

In ***Figure 2***, smoothing splines were fit to aid visual interpretation of noisy data. We fit splines using the command *smooth*.*spline(x = AGE, y = FRACTIONS, spar = 0*.*8)* in R version 3.5.0. Variables *AGE* and *FRACTIONS* were vectors whose entries represented single years of age, and the fraction of cases observed in the corresponding age group. The smoothing parameter 0.8 was chosen to provide a visually smooth fit. Alternative smoothing parameter choices (0.6 & 1.0) are shown in ***Figs. S1-S2***. Although the choice of smoothing parameter changed the shape of each fitted spline, qualitative differences between splines fitted to H1N1 or H3N2 were insensitive.

### Model formulation

For each unique season in which cases were observed, define *p* as a vector whose entries represent the expected probability that a randomly drawn H1N1 or a randomly drawn H3N2 case was observed in an individual born in year *b*. Each model defined, *p* as a linear combination of age-specific risk, birth year-specific risk (i.e. imprinting effects). All tested models were nested within the equation:![Formula][1]</img> 

To include risk factors that only modulated risk from one subtype, we included indicator functions ***1******H1N1*** and ***1******H3N2***, which took value 1 if *p* described the expected age distribution of H1N1 or H3N2 cases, respectively, and 0 otherwise.

#### Demographic age distribution (D)

The population of Arizona aged slightly across the study period, so we controlled for shifting demography in all tested models. Demographic age distribution was obtained from intercensal estimates of total population (both sexes) for the state of Arizona, based on the 2000 and 2010 census (53). The US Census Bureau reports population estimates for ages 0-84, but only provides an aggregate estimate for ages 85+. We impute the number of individuals in each single year of age over 85 using a linear model fit to data on age 75-84, with a minimum threshold of 1000 individuals per single year of age. State-specific population estimates were not available prior to the 2000 census, so we substituted estimates from the year 2000 for cases observed in the 1993-94, and the 1994-95 seasons. Vector *D* represented the fraction of the total population at the time of case observation that fell in a given birth year.

#### Age-specific risk (A)

Age-specific risk was defined as a step function, in which relative risk was fixed to value 1 in an arbitrarily chosen age bin, and then *z*-1 free parameters, denoted *r*2 to *r**z*, were fit to describe relative risk in all other age bins. Below, ***1******i*** are indicator functions specifying whether each vector entry is a member of age bin *i*.![Formula][2]</img> 

To obtain the predicted fraction of cases observed in each single year of birth, we normalized so that the product of vectors representing demographic age distribution, and age-specific risk, (*DA* in equation 1) summed to 1. Thus, vector *DA* can be interpreted as the expected distribution of cases of any influenza case (either subtype), in the absence of birth year-specific biases from imprinting.

#### Imprinting (I)

An indicator function defined whether a given prediction vector described risk of confirmed H1N1 or H3N2. Let *f**IHxNy* be vectors describing the fraction of cases of each birth year that were protected against strain *HxNy* by their childhood imprinting. We defined *r**IHxNy* as free parameters describing the risk of confirmed *HxNy*, given imprinting protection. Finally, the factor describing the effect of imprinting (I) was defined as:![Formula][3]</img> 

### Likelihood

We used equations 1-equation3 to generate predicted case age distributions (*p*) for each influenza season (s) in which cases were observed in the data. Then, the likelihood was obtained as a product of multinomial densities across all seasons. If *n**s* represents the total number of cases observed in a given season, *x**0cs*,…*x**mcs* each represent the number of cases observed in each single year of birth, and if *p**0cs*…*p**mcs* each represent entries in the model’s predicted birth year-distribution of cases, then the likelihood is given by:![Formula][4]</img> 

### Model fitting and model comparison

We fit models containing all possible combinations of the above factors to influenza data from each season in the data. We simultaneously estimated all free parameter values using the optim() function in R, with method L-BFGS-B. Imprinting parameters could take values in [0,1], representing the possibility of a reduction in risk. Age-specific risk parameters could take any value greater than 0. We calculated likelihood profiles and 95% profile confidence intervals for each free parameter. Confidence intervals were defined using the method of likelihood ratios (34).

### Antigenic advance

We obtained antigenic distance estimates from *Nextstrain (nextstrain*.*org) (36,54)*, and from source data from Figure 3 in Bedford et al. (38). *Nextstrain* calculates antigenic distance using genetic data from GISAID (55), and using methods described by Neher et al. (37). We analyzed “CTiter” estimates from *Nextstrain*, which correspond to Neher et al.’s “tree model” method, and are most directly comparable to pre-2009 H1N1 estimates from (38). We repeated analyses using estimates from the similar “substitution model” method and verified that our choice of antigenic distance metric did not meaningfully impact our results. The negative Spearman correlation between antigenic advance and proportion of cases in children was lower, but still non-significant when using the substitution model (p=0.06); all other differences were unremarkable. Datasets from *Nextstrain* and Bedford et al. both contained redundant antigenic distance estimates for the H3N2 lineage, but only Bedford et al. analyzed the pre-2009 H1N1 lineage, and only *Nextstrain* data analyzed the post-2009 H1N1 lineage. The antigenic distance estimates reported by Bedford et al. were roughly proportional to those reported on *Nextstrain*, but greater in absolute magnitude (37). To enable visualization of all three lineages on the same plot axes, we rescaled pre-2009 H1N1 estimates from Bedford et al. using the formula *d**Nextstrain* = 0.47*d**Bedford*. The scaling factor was chosen so that directly-comparable H3N2 distance estimates obtained using each method spanned the same range (***Fig. S3***). The *Nextstrain* data files used in this analysis are archived within our analysis code.

## Data Availability

All data analyzed in this study, and all code necessary to perform analyses and generate figures, is freely available and archived in the Zenodo repository https://zenodo.org/badge/latestdoi/160883450. (Clearly labeled subdirectories contain the data).

[https://zenodo.org/badge/latestdoi/160883450](https://zenodo.org/badge/latestdoi/160883450) 

## Code and data availability

Code to perform all reported analyses and construct all plots, and all relevant data (Arizona surveillance data and relevant antigenic advance data) is archived at [https://zenodo.org/badge/latestdoi/160883450](https://zenodo.org/badge/latestdoi/160883450).

## Disclaimer

This work does not necessarily represent the views of the US government or the NIH.

## Competing interests

The authors declare no competing interests.

## Ethics Statement

This study analyzed only existing epidemiological data, which was completely anonymized.

## Author contributions

MW, KG and JLS conceived of the questions and modeling analysis. CV and MW provided crucial assistance with data access and study design. SB and RB supervised data curation and advised the modeling arm of our team about compatibility between the data and analysis strategy. KG wrote the code and performed analyses, with supervision from JLS, and drafted the manuscript. All authors provided input on analysis and interpretation of the results, and helped revise and edit the manuscript text.

## Acknowledgements

We are grateful to Ken Komatsu and Kristen Herrick for their assistance with data access, and to Trevor Bedford for assistance accessing and interpreting antigenic distance data from *Nextstrain*. We thank Lone Simonsen for helpful discussions. KG was supported by the National Institutes of Health (F31AI134017, T32-GM008185). JLS was supported by NSF grants OCE-1335657 and DEB-1557022, SERDP RC-2635, and DARPA PREEMPT D18AC00031. MW was supported by the David and Lucile Packard Foundation. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.

## Footnotes

*   * jlloydsmith{at}ucla.edu

*   Received July 8, 2019.
*   Revision received September 15, 2019.
*   Accepted September 26, 2019.


*   © 2019, Posted by Cold Spring Harbor Laboratory

This pre-print is available under a Creative Commons License (Attribution 4.0 International), CC BY 4.0, as described at [http://creativecommons.org/licenses/by/4.0/](http://creativecommons.org/licenses/by/4.0/)

## References

1.  1.Francis T. On the Doctrine of Original Antigenic Sin. Proc Am Philos Soc. 1960;104(6):572–8.
    
    

2.  2.Lessler J, Riley S, Read JM, Wang S, Zhu H, Smith GJD, et al. Evidence for Antigenic Seniority in Influenza A (H3N2) Antibody Responses in Southern China. PLOS Pathog. 2012 Jul 19;8(7):e1002802.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1371/journal.ppat.1002802&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=22829765&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2019%2F09%2F26%2F19001834.atom) 

3.  3.Henry C, Palm A-KE, Krammer F, Wilson PC. From Original Antigenic Sin to the Universal Influenza Virus Vaccine. Trends Immunol. 2018;39(1):70–9.
    
    

4.  4.Xu R, Ekiert DC, Krause JC, Hai R, Crowe JE, Wilson IA. Structural Basis of Preexisting Immunity to the 2009 H1N1 Pandemic Influenza Virus. Science. 2010 Apr 16;328(5976):357–60.
    
    [Abstract/FREE Full Text](http://medrxiv.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6Mzoic2NpIjtzOjU6InJlc2lkIjtzOjEyOiIzMjgvNTk3Ni8zNTciO3M6NDoiYXRvbSI7czozOToiL21lZHJ4aXYvZWFybHkvMjAxOS8wOS8yNi8xOTAwMTgzNC5hdG9tIjt9czo4OiJmcmFnbWVudCI7czowOiIiO30=) 

5.  5.Hancock K, Veguilla V, Lu X, Zhong W, Butler EN, Sun H, et al. Cross-Reactive Antibody Responses to the 2009 Pandemic H1N1 Influenza Virus. N Engl J Med Boston. 2009 Nov 12;361(20):1945–52.
    
    

6.  6.Simonsen L, Spreeuwenberg P, Lustig R, Taylor RJ, Fleming DM, Kroneman M, et al. Global Mortality Estimates for the 2009 Influenza Pandemic from the GLaMOR Project: A Modeling Study. PLOS Med. 2013 Nov 26;10(11):e1001558.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1371/journal.pmed.1001558&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=24302890&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2019%2F09%2F26%2F19001834.atom) 

7.  7.Simonsen L, Reichert TA, Miller MA. The virtues of antigenic sin: consequences of pandemic recycling on influenza-associated mortality. Int Congr Ser. 2004 Jun 1;1263:791–4.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1016/j.ics.2004.01.029&link_type=DOI) 

8.  8.Ma J, Dushoff J, Earn DJD. Age-specific mortality risk from pandemic influenza. J Theor Biol. 2011 Nov 7;288:29–34.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1016/j.jtbi.2011.08.003&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=21856313&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2019%2F09%2F26%2F19001834.atom) 
    
    [Web of Science](http://medrxiv.org/lookup/external-ref?access_num=000295563700004&link_type=ISI) 

9.  9.Worobey M, Han G-Z, Rambaut A. Genesis and pathogenesis of the 1918 pandemic H1N1 influenza A virus. Proc Natl Acad Sci. 2014 Jun 3;111(22):8107–12.
    
    [Abstract/FREE Full Text](http://medrxiv.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6NDoicG5hcyI7czo1OiJyZXNpZCI7czoxMToiMTExLzIyLzgxMDciO3M6NDoiYXRvbSI7czozOToiL21lZHJ4aXYvZWFybHkvMjAxOS8wOS8yNi8xOTAwMTgzNC5hdG9tIjt9czo4OiJmcmFnbWVudCI7czowOiIiO30=) 

10. 10.Gagnon A, Miller MS, Hallman SA, Bourbeau R, Herring DA, Earn DJD, et al. Age-Specific Mortality During the 1918 Influenza Pandemic: Unravelling the Mystery of High Young Adult Mortality. PLoS ONE. 2013 Aug 5 [cited 2019 Apr 4];8(8). Available from: [https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3734171/](https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3734171/)
    
    

11. 11.Gostic KM, Ambrose M, Worobey M, Lloyd-Smith JO. Potent protection against H5N1 and H7N9 influenza via childhood hemagglutinin imprinting. Science. 2016 Nov 11;354(6313):722–6.
    
    [Abstract/FREE Full Text](http://medrxiv.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6Mzoic2NpIjtzOjU6InJlc2lkIjtzOjEyOiIzNTQvNjMxMy83MjIiO3M6NDoiYXRvbSI7czozOToiL21lZHJ4aXYvZWFybHkvMjAxOS8wOS8yNi8xOTAwMTgzNC5hdG9tIjt9czo4OiJmcmFnbWVudCI7czowOiIiO30=) 

12. 12.Khiabanian H, Farrell GM, George KS, Rabadan R. Differences in Patient Age Distribution between Influenza A Subtypes. PLOS ONE. 2009 Aug 31;4(8):e6832.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1371/journal.pone.0006832&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=19718262&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2019%2F09%2F26%2F19001834.atom) 

13. 13.Budd AP, Beacham L, Smith CB, Garten RJ, Reed C, Kniss K, et al. Birth Cohort Effects in Influenza Surveillance Data: Evidence that First Influenza Infection Affects Later Influenza-Associated Illness. J Infect Dis.
    
    

14. 14.Lemaitre M, Carrat F. Comparative age distribution of influenza morbidity and mortality during seasonal influenza epidemics and the 2009 H1N1 pandemic. BMC Infect Dis. 2010 Jun 9;10(1):162.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1186/1471-2334-10-162&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=20534113&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2019%2F09%2F26%2F19001834.atom) 

15. 15.Huang QS, Bandaranayake D, Wood T, Newbern EC, Seeds R, Ralston J, et al. Risk Factors and Attack Rates of Seasonal Influenza Infection: Results of the Southern Hemisphere Influenza and Vaccine Effectiveness Research and Surveillance (SHIVERS) Seroepidemiologic Cohort Study. J Infect Dis. 2019 Jan 9;219(3):347–57.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1093/infdis/jiy443&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=30016464&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2019%2F09%2F26%2F19001834.atom) 

16. 16.Cowling BJ, Sullivan SG. The Value of Neuraminidase Inhibition Antibody Titers in Influenza Seroepidemiology. J Infect Dis. 2019 Jan 9;219(3):341–3.
    
    

17. 17.Memoli MJ, Shaw PA, Han A, Czajkowski L, Reed S, Athota R, et al. Evaluation of Antihemagglutinin and Antineuraminidase Antibodies as Correlates of Protection in an Influenza A/H1N1 Virus Healthy Human Challenge Model. mBio. 2016 Apr 19;7(2).
    
    

18. 18.Wrammert J, Koutsonanos D, Li G-M, Edupuganti S, Sui J, Morrissey M, et al. Broadly cross-reactive antibodies dominate the human B cell response against 2009 pandemic H1N1 influenza virus infection. J Exp Med. 2011 Jan 17;208(1):181–93.
    
    [Abstract/FREE Full Text](http://medrxiv.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6MzoiamVtIjtzOjU6InJlc2lkIjtzOjk6IjIwOC8xLzE4MSI7czo0OiJhdG9tIjtzOjM5OiIvbWVkcnhpdi9lYXJseS8yMDE5LzA5LzI2LzE5MDAxODM0LmF0b20iO31zOjg6ImZyYWdtZW50IjtzOjA6IiI7fQ==) 

19. 19.Pica N, Hai R, Krammer F, Wang TT, Maamary J, Eggink D, et al. Hemagglutinin stalk antibodies elicited by the 2009 pandemic influenza virus as a mechanism for the extinction of seasonal H1N1 viruses. Proc Natl Acad Sci U S A. 2012;109(7):2573–8.
    
    [Abstract/FREE Full Text](http://medrxiv.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6NDoicG5hcyI7czo1OiJyZXNpZCI7czoxMDoiMTA5LzcvMjU3MyI7czo0OiJhdG9tIjtzOjM5OiIvbWVkcnhpdi9lYXJseS8yMDE5LzA5LzI2LzE5MDAxODM0LmF0b20iO31zOjg6ImZyYWdtZW50IjtzOjA6IiI7fQ==) 

20. 20.Krammer F. Novel universal influenza virus vaccine approaches. Curr Opin Virol. 2016 Apr;17:95–103.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1016/j.coviro.2016.02.002&link_type=DOI) 

21. 21.Ng S, Nachbagauer R, Balmaseda A, Stadlbauer D, Ojeda S, Patel M, et al. Novel correlates of protection against pandemic H1N1 influenza A virus infection. Nat Med. 2019 Jun;25(6):962–7.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1038/s41591-019-0463-x&link_type=DOI) 

22. 22.Andrews SF, Huang Y, Kaur K, Popova LI, Ho IY, Pauli NT, et al. Immune history profoundly affects broadly protective B cell responses to influenza. Sci Transl Med. 2015 Dec 2;7(316):316ra192–316ra192.
    
    [Abstract/FREE Full Text](http://medrxiv.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6MTE6InNjaXRyYW5zbWVkIjtzOjU6InJlc2lkIjtzOjE0OiI3LzMxNi8zMTZyYTE5MiI7czo0OiJhdG9tIjtzOjM5OiIvbWVkcnhpdi9lYXJseS8yMDE5LzA5LzI2LzE5MDAxODM0LmF0b20iO31zOjg6ImZyYWdtZW50IjtzOjA6IiI7fQ==) 

23. 23.Zost SJ, Wu NC, Hensley SE, Wilson IA. Immunodominance and Antigenic Variation of Influenza Virus Hemagglutinin: Implications for Design of Universal Vaccine Immunogens. J Infect Dis. 2019 Apr 8;219(Supplement_1):S38–45.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1093/infdis/jiy696&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=30535315&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2019%2F09%2F26%2F19001834.atom) 

24. 24.Grenfell BT, Pybus OG, Gog JR, Wood JLN, Daly JM, Mumford JA, et al. Unifying the Epidemiological and Evolutionary Dynamics of Pathogens. Science. 2004 Jan 16;303(5656):327–32.
    
    [Abstract/FREE Full Text](http://medrxiv.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6Mzoic2NpIjtzOjU6InJlc2lkIjtzOjEyOiIzMDMvNTY1Ni8zMjciO3M6NDoiYXRvbSI7czozOToiL21lZHJ4aXYvZWFybHkvMjAxOS8wOS8yNi8xOTAwMTgzNC5hdG9tIjt9czo4OiJmcmFnbWVudCI7czowOiIiO30=) 

25. 25.Henry C, Zheng N-Y, Huang M, Cabanov A, Rojas KT, Kaur K, et al. Influenza Virus Vaccination Elicits Poorly Adapted B Cell Responses in Elderly Individuals. Cell Host Microbe. 2019 Mar;25(3):357-366.e6.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1016/j.chom.2019.01.002&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=30795982&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2019%2F09%2F26%2F19001834.atom) 

26. 26.Ranjeva S, Subramanian R, Fang VJ, Leung GM, Ip DKM, Perera RAPM, et al. Age-specific differences in the dynamics of protective immunity to influenza. Nat Commun. 2019 Apr 10;10(1):1–11.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1038/s41467-019-09078-0&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=30602773&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2019%2F09%2F26%2F19001834.atom) 

27. 27.Miller MS, Gardner TJ, Krammer F, Aguado LC, Tortorella D, Basler CF, et al. Neutralizing Antibodies Against Previously Encountered Influenza Virus Strains Increase over Time: A Longitudinal Analysis. Sci Transl Med. 2013 Aug 14;5(198):198ra107–198ra107.
    
    [Abstract/FREE Full Text](http://medrxiv.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6MTE6InNjaXRyYW5zbWVkIjtzOjU6InJlc2lkIjtzOjE0OiI1LzE5OC8xOThyYTEwNyI7czo0OiJhdG9tIjtzOjM5OiIvbWVkcnhpdi9lYXJseS8yMDE5LzA5LzI2LzE5MDAxODM0LmF0b20iO31zOjg6ImZyYWdtZW50IjtzOjA6IiI7fQ==) 

28. 28.Tesini BL, Kanagaiah P, Wang J, Hahn M, Halliley JL, Chaves FA, et al. Broad Hemagglutinin-Specific Memory B Cell Expansion by Seasonal Influenza Virus Infection Reflects Early-Life Imprinting and Adaptation to the Infecting Virus. J Virol. 2019 Apr 15;93(8):e00169–19.
    
    

29. 29.Thompson WW, Shay DK, Weintraub E, Brammer L, Cox N, Anderson LJ, et al. Mortality associated with influenza and respiratory syncytial virus in the United States. JAMA. 2003 Jan 8;289(2):179–86.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1001/jama.289.2.179&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=12517228&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2019%2F09%2F26%2F19001834.atom) 
    
    [Web of Science](http://medrxiv.org/lookup/external-ref?access_num=000180226400028&link_type=ISI) 

30. 30.Bedford T, Riley S, Barr IG, Broor S, Chadha M, Cox NJ, et al. Global circulation patterns of seasonal influenza viruses vary with antigenic drift. Nature. 2015 Jul;523(7559):217–20.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1038/nature14460&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=26053121&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2019%2F09%2F26%2F19001834.atom) 

31. 31.Arizona Department of Health Services. 2015–2016 Influenza Summary [Internet]. [cited 2019 May 23]. Available from: [https://www.azdhs.gov/documents/preparedness/epidemiology-disease-control/flu/surveillance/2015-2016-influenza-summary.pdf](https://www.azdhs.gov/documents/preparedness/epidemiology-disease-control/flu/surveillance/2015-2016-influenza-summary.pdf)
    
    

32. 32.National Notifiable Diseases Surveillance System, Division of Health Informatics and Surveillance, National Center for Surveillance, Epidemiology and Laboratory Services. MMWR Week Fact Sheet [Internet]. [cited 2019 May 23]. Available from: [https://www.n.cdc.gov/nndss/document/MMWR\_Week\_overview.pdf](https://www.n.cdc.gov/nndss/document/MMWR_Week_overview.pdf)
    
    

33. 33.Erbelding EJ, Post DJ, Stemmy EJ, Roberts PC, Augustine AD, Ferguson S, et al. A Universal Influenza Vaccine: The Strategic Plan for the National Institute of Allergy and Infectious Diseases. J Infect Dis. 2018 Jul 2;218(3):347–54.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1093/infdis/jiy103&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=29506129&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2019%2F09%2F26%2F19001834.atom) 

34. 34.Bolker BM. Ecological Models and Data in R. Princeton University Press; 2008. p409 p.
    
    

35. 35.Burnham KP, Anderson DR. Model Selection and Multimodel Inference: A Practical Information-Theoretic Approach. 2nd ed. New York: Springer-Verlag; 2002
    
    

36. 36.Hadfield J, Megill C, Bell SM, Huddleston J, Potter B, Callender C, et al. Nextstrain: real-time tracking of pathogen evolution. Bioinformatics. 2018 Dec 1;34(23):4121–3.
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=http://www.n&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2019%2F09%2F26%2F19001834.atom) 

37. 37.Neher RA, Bedford T, Daniels RS, Russell CA, Shraiman BI. Prediction, dynamics, and visualization of antigenic phenotypes of seasonal influenza viruses. Proc Natl Acad Sci. 2016 Mar 22;113(12):E1701–9.
    
    [Abstract/FREE Full Text](http://medrxiv.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6NDoicG5hcyI7czo1OiJyZXNpZCI7czoxMjoiMTEzLzEyL0UxNzAxIjtzOjQ6ImF0b20iO3M6Mzk6Ii9tZWRyeGl2L2Vhcmx5LzIwMTkvMDkvMjYvMTkwMDE4MzQuYXRvbSI7fXM6ODoiZnJhZ21lbnQiO3M6MDoiIjt9) 

38. 38.1.  Losick R
    
    Bedford T, Suchard MA, Lemey P, Dudas G, Gregory V, Hay AJ, et al. Integrating influenza antigenic dynamics with molecular evolution. Losick R, editor. eLife. 2014 Feb 4;3:e01914.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.7554/eLife.01914&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=24497547&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2019%2F09%2F26%2F19001834.atom) 

39. 39.Smith DJ, Lapedes AS,  Jong JC de, Bestebroer TM, Rimmelzwaan GF, Osterhaus ADME, et al. Mapping the Antigenic and Genetic Evolution of Influenza Virus. Science. 2004 Jul 16;305(5682):371–6.
    
    [Abstract/FREE Full Text](http://medrxiv.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6Mzoic2NpIjtzOjU6InJlc2lkIjtzOjEyOiIzMDUvNTY4Mi8zNzEiO3M6NDoiYXRvbSI7czozOToiL21lZHJ4aXYvZWFybHkvMjAxOS8wOS8yNi8xOTAwMTgzNC5hdG9tIjt9czo4OiJmcmFnbWVudCI7czowOiIiO30=) 

40. 40.Cobey S, Hensley SE. Immune history and influenza virus susceptibility. Curr Opin Virol. 2017 Feb 1;22:105–11.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1016/j.coviro.2016.12.004&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=28088686&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2019%2F09%2F26%2F19001834.atom) 

41. 41.Linderman SL, Chambers BS, Zost SJ, Parkhouse K, Li Y, Herrmann C, et al. Potential antigenic explanation for atypical H1N1 infections among middle-aged adults during the 2013–2014 influenza season. Proc Natl Acad Sci. 2014 Nov 4;111(44):15798–803.
    
    [Abstract/FREE Full Text](http://medrxiv.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6NDoicG5hcyI7czo1OiJyZXNpZCI7czoxMjoiMTExLzQ0LzE1Nzk4IjtzOjQ6ImF0b20iO3M6Mzk6Ii9tZWRyeGl2L2Vhcmx5LzIwMTkvMDkvMjYvMTkwMDE4MzQuYXRvbSI7fXM6ODoiZnJhZ21lbnQiO3M6MDoiIjt9) 

42. 42.Chen Y-Q, Wohlbold TJ, Zheng N-Y, Huang M, Huang Y, Neu KE, et al. Influenza Infection in Humans Induces Broadly Cross-Reactive and Protective Neuraminidase-Reactive Antibodies. Cell. 2018 Apr 5;173(2):417-429.e10.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1016/j.cell.2018.03.030&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=29625056&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2019%2F09%2F26%2F19001834.atom) 

43. 43.Andrews SF, Chambers MJ, Schramm CA, Plyler J, Raab JE, Kanekiyo M, et al. Activation Dynamics and Immunoglobulin Evolution of Pre-existing and Newly Generated Human Memory B cell Responses to Influenza Hemagglutinin. Immunity. 2019 Aug 20;51(2):398-410.e5.
    
    

44. 44.Matsuda K, Huang J, Zhou T, Sheng Z, Kang BH, Ishida E, et al. Prolonged evolution of the memory B cell response induced by a replicating adenovirus-influenza H5 vaccine. Sci Immunol. 2019 Apr 19;4(34):eaau2710.
    
    [Abstract/FREE Full Text](http://medrxiv.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6MTA6ImltbXVub2xvZ3kiO3M6NToicmVzaWQiO3M6MTM6IjQvMzQvZWFhdTI3MTAiO3M6NDoiYXRvbSI7czozOToiL21lZHJ4aXYvZWFybHkvMjAxOS8wOS8yNi8xOTAwMTgzNC5hdG9tIjt9czo4OiJmcmFnbWVudCI7czowOiIiO30=) 

45. 45.Ramiscal RR, Vinuesa CG. T-cell subsets in the germinal center. Immunol Rev. 2013;252(1):146–55.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1111/imr.12031&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=23405902&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2019%2F09%2F26%2F19001834.atom) 

46. 46.Rozo M, Gronvall GK. The Reemergent 1977 H1N1 Strain and the Gain-of-Function Debate. mBio. 2015 Sep 1;6(4):e01013–15.
    
    

47. 47.Dushoff J, Plotkin JB, Viboud C, Earn DJD, Simonsen L. Mortality due to Influenza in the United States—An Annualized Regression Approach Using Multiple-Cause Mortality Data. Am J Epidemiol. 2006 Jan 15;163(2):181–7.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1093/aje/kwj024&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=16319291&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2019%2F09%2F26%2F19001834.atom) 
    
    [Web of Science](http://medrxiv.org/lookup/external-ref?access_num=000234434500010&link_type=ISI) 

48. 48.Lewnard JA, Cobey S. Immune History and Influenza Vaccine Effectiveness. Vaccines. 2018 Jun;6(2):28.
    
    

49. 49.Gagnon A, Acosta E, Miller MS. Reporting and evaluating influenza virus surveillance data: An argument for incidence by single year of age. Vaccine. 2018 Oct 8;36(42):6249–52.
    
    

50. 50.Klein SL, Flanagan KL. Sex differences in immune responses. Nat Rev Immunol. 2016 Oct;16(10):626–38.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1038/nri.2016.90&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=27546235&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2019%2F09%2F26%2F19001834.atom) 

51. 51.vom Steeg LG, Klein SL. Sex and sex steroids impact influenza pathogenesis across the life course. Semin Immunopathol. 2019 Mar 1;41(2):189–94.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1007/s00281-018-0718-5&link_type=DOI) 

52. 52.Glezen WP, Keitel WA, Taber LH, Piedra PA, Clover RD, Couch RB. Age Distribution of Patients with Medically-Attended Illnesses Caused by Sequential Variants of Influenza A/H1N1: Comparison to Age-Specific Infection Rates, 1978–1989. Am J Epidemiol. 1991 Feb 1;133(3):296–304.
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=2000847&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2019%2F09%2F26%2F19001834.atom) 
    
    [Web of Science](http://medrxiv.org/lookup/external-ref?access_num=A1991EY29700010&link_type=ISI) 

53. 53.US Census Bureau. Index of program surveys, population estimates [Internet]. [cited 2019 Aug 21]. Available from: [https://www2.census.gov/programs-surveys/popest/](https://www2.census.gov/programs-surveys/popest/)
    
    

54. 54.Sagulenko P, Puller V, Neher RA. TreeTime: Maximum-likelihood phylodynamic analysis. Virus Evol. 2018 Jan 8 4(1).
    
    

55. 55.Bogner P, Capua I, Lipman DJ, Cox NJ. A global initiative on sharing avian flu data. Nature. 2006 Aug;442(7106):981.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1038/442981a&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=16943817&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2019%2F09%2F26%2F19001834.atom) 
    
    [Web of Science](http://medrxiv.org/lookup/external-ref?access_num=000240142000026&link_type=ISI)

 [1]: /embed/graphic-7.gif
 [2]: /embed/graphic-8.gif
 [3]: /embed/graphic-9.gif
 [4]: /embed/graphic-10.gif