Causal attribution fractions for epidemiological studies, applied to a UK Biobank study of smoking and BMI ========================================================================================================== * Anthony J. Webster ## Abstract Epidemiological studies often use proportional hazard models to estimate associations between potential risk factors and disease risk. It is emphasised that when the “backdoor criteria” from causal-inference applies, if diseases are sufficiently rare, then the proportional hazard model can be used to estimate causal associations. When the “frontdoor criteria” applies (allowing causal estimates with unmeasured confounders), similar estimates are found to mediation analyses with measured confounders. Reasons for this are discussed. An attribution fraction is constructed using the average causal effects (ACE) of exposures on the population, and simple methods for its evaluation are suggested. It differs from the attribution fraction used by the World Health Organisation (WHO), except for specific circumstances where the latter can agree or provide a bound. A counterfactual argument determines an individual’s attribution fraction *A**f* in terms of proportional hazard estimates, as *A**f* = 1− 1*/R*, where *R* is an individual’s relative risk. Causally meaningful attribution fractions cannot be constructed for all known risk factors or confounders, but there are important cases where they can. As an example, systematic proportional hazards studies with UK Biobank data estimate the attribution fractions of smoking and BMI for 226 diseases. The attribution of risk is characterised in terms of disease chapters from the International Classification of Diseases (ICD-10), and the diseases most strongly attributed to smoking and BMI are identified. The result is a quantitative characterisation of the causal influence of smoking and BMI on the landscape of disease incidence in the UK Biobank population. ## Introduction The original aim of this research was to quantify the modifiability of disease risks by several behaviours and physical characteristics, such as smoking and body mass index (BMI). Risks are often quantified with attributable fractions and relative risks [1, 2], that are estimated using proportional hazard models [2, 3]. However, there are several ways of defining and estimating attributable fractions [2, 4, 5], and estimates of relative risks do not generally have a causal interpretation [2]. The recently established theory of causal inference [6, 7] is used to identify common situations where relative risk estimates from proportional hazard models provide estimates of causal associations. These can then be used to form attributable fractions that characterise the causal influence of exposures on disease risk. A causal analysis limits the exposures whose associations can be given a causal interpretation. Fortunately these included smoking and BMI, that are widely acknowledged to have a strong influence on a wide range of diseases. Whereas statistics is the science of finding and describing patterns in data, epidemiology is the science of using statistics to make correct inferences. Although epidemiologists are careful to describe their results in terms of “associations”, the purpose of epidemiology is to detect and quantify causal associations, e.g. between lifestyles and health [2, 8]. Recently the science of causal inference [6, 7, 9], has developed to allow estimates of causal associations to be made, without data from randomised control trials (RCTs). By exploring the relationship between causal estimates that are made with the “backdoor criteria” and the “do” calculus [6, 7], and conventional epidemiological estimates of relative risks using proportional hazards [3], it is shown that if formulated and interpreted correctly, many conventional epidemiological studies [2, 3] will correctly estimate causal associations. It is also shown how proportional hazards estimates can be applied to situations that satisfy the “frontdoor” criteria, and how the results can coincide with mediation analyses [9]. An attribution fraction is suggested that uses estimates of causal associations. It is closely related to the average causal effect (ACE) [6, 7], and it can agree with existing expressions when these are combined with estimates of causal associations [1, 4]. An attribution fraction for an individual is also formulated using a counterfactual argument that combines the “effect of treatment on the treated” [6, 7] and proportional hazard estimates, that gives a simple and widely used expression in terms of an individual’s relative risk. As an example of the approach with importance for public health policy, the attribution of disease incidence to smoking and BMI was considered for the UK Biobank cohort of over 500,000 UK men and women [10]. Attribution fractions for smoking and BMI were estimated for 226 diseases with statistically significant associations after adjusting for multiple testing, using conventional proportional hazards models that are adjusted for known confounding factors. The results emphasise the heterogeneous influence of risk factors, with protective associations for several diseases. They also emphasise the pathogenic influence of smoking and BMI on some diseases, with 11 having an attributable fraction of 0.5 or greater. ### Causal inferences #### Relative risks and the “backdoor criteria” Consider how disease risk may be influenced by the established common risk factors of education, socio-economic status, BMI, alcohol, and smoking (figure 1). It seems likely that for many diseases, education and socio-economic status could influence disease risk through the modifiable risk factors of BMI, alcohol, and smoking, in addition to any direct risk. In those circumstances education and socio-economic status are confounders (denoted with a vector *Z*), that influence both disease risk and the values of BMI, alcohol, and smoking (denoted with a vector *X*). For this causal model illustrated in figure 1, it is possible to estimate the consequences of setting BMI, alcohol, and smoking to a specific value *X* = *x*, corresponding to do(*X* = *x*) using the “do” notation of Pearl [6, 7]. The situation corresponds to the well-known situation described by the “adjustment” formula, that states, ![Formula][1] where for continuous variables, the sums are treated as integrals. The formula is constructed to account for the confounding influence of *Z* on both *X* and disease risk, and differs from that given by conventional probability theory, that would have *P* (*Z* = *z*|*X* = *x*) instead of *P* (*Z* = *z*). Take *Y* = 1 to denote presence of disease, and *Y* = 0 its absence, so that, ![Formula][2] where *F* (*t, x, z*) is the distribution function (with covariates *x, z*), so that, ![Formula][3] where in going from the 2nd to 3rd line we assume sufficiently rare diseases, as is the case for the first hospital admission for most diseases in UK Biobank [10, 12], and in going from the 3rd to the 4th lines we assume that the proportional hazards assumption [3] is valid for the disease being studied, with *η**x* and *η**z* being the linear predictor functions1 for the (possibly) multivariate variables *x* and *z*. For a probability density *f* = *dF/dt* and hazard function ![Graphic][4] is the cumulative hazard, and a proportional hazards model assumes that ![Graphic][5]. Now using Eq. 1, ![Formula][6] with ![Graphic][7]. This allows the incidence rates to be calculated for a (possibly hypothetical) situation where we have intervened in some way to set *X* = *x*, in terms of a baseline hazard function that is estimated in the usual way, using observational data in which *Z* can be correlated with both *X* and disease risk. Note that *P* (*Z* = *z*) and *P* (*X* = *x*) are implicitly the population values at the study’s start. ![Figure 1:](http://medrxiv.org/https://www.medrxiv.org/content/medrxiv/early/2021/12/25/2021.12.24.21268368/F1.medium.gif) [Figure 1:](http://medrxiv.org/content/early/2021/12/25/2021.12.24.21268368/F1) Figure 1: Consider the influence of one or more exposures *X*, on diseases *Y*, with confounding variables *Z* that satisfy the “backdoor criteria” [6, 7] (figure a). For example, *X* might include BMI, alcohol, and smoking, with confounders *Z* of socio-economic status and education (figure b). At the baseline values of *x* = *x* and *z* = *z*, by definition *η**x*(*x*) = 0 and *η**z*(*z*) = 0, so Eq. 4 gives *P* (*Y* = 1, *T* < *t* |*X* = *x*, *Z* = *z*) = *H*(*t*). Then with the same approximations used to derive Eq. 4, Eq. 4 can be written in several different ways, for example with, ![Formula][8] When education and socio-economic factors are represented by *Z*, then the factor *A**Z* accounts for changes in risk due to both socio-economic factors and education, and the influence of setting *X* = *x* is calculated through the factor ![Graphic][9]. If we could set *X* equal to the baseline values *x*, the probability distribution would be proportional to the baseline hazard function *H*(*t*), amplified or shrunk by the factor *A**Z*. If the baseline values corresponded to the lowest disease risk, then *A**Z**H*(*t*) would be the lowest possible disease incidence rate that could have been achieved through lifestyle changes. Eq. 5 can be written as, ![Formula][10] This gives a relative risk of disease within time *t* for a population with *X* = *x*, compared with a population with baseline values of *X* = *x*, in terms of estimates from a relative risk from observational studies, that have, ![Formula][11] Appendix A relates the argument to probability densities and hazard functions. The analysis above applies more generally to other examples, and to studies other than those involving disease or health. Similar results will apply whenever *F* (*t, x, z*) can be factored as *H*(*t*)*g*(*x*)*q*(*z*), for some functions *g*(*x*) and *q*(*z*), as was possible here because we consider a proportional hazards model and situations whose the incidence is sufficiently rare that we can approximate *F* (*t, x, z*) ≃ *H*(*t, x, z*). ### Unmeasured confounders and mediation - the “frontdoor criteria” Another important result from causal inference, is the “frontdoor criteria” [6, 7]. A well-known example [7] is assessing the influence of smoking on disease risk in the presence of *unmeasured* confounders that influence both smoking use and disease risk, by using an additional measurement of tar in peoples’ lungs (figure 2). Again we consider the adjustment formula for this situation in the limit of rare diseases, as above, and consider the simple specific example with continuous variables for e.g. average number of cigarettes per day and tar content of lungs. Although the estimated incidence rates will differ from those using proportional hazards models, the causal estimate for the influence of smoking on lung cancer, is the same as we might (with hindsight) have anticipated from mediation studies. ![Figure 2:](http://medrxiv.org/https://www.medrxiv.org/content/medrxiv/early/2021/12/25/2021.12.24.21268368/F2.medium.gif) [Figure 2:](http://medrxiv.org/content/early/2021/12/25/2021.12.24.21268368/F2) Figure 2: The “frontdoor criteria” estimates the causal influence of an exposure do(*X* = *x*), that is mediated by *Z*, in the presence of unmeasured confounders *U* that influence both the disease risk and the exposure *X*. For the situation described in figure 2, the “front door” adjustment formula states [6, 7], ![Formula][12] Using this, and proceeding as before, ![Formula][13] Next consider the specific example where *η**x*′ = *β**x**x*′, *η**z* = *β**z**z, P* (*X* = *x*) is a normal distribution ![Graphic][14], and *P* (*Z* = *z* | *X* = *x*) is a normal distribution ![Graphic][15], where in the latter case *α* is a constant and the mean of *z* is *αx*. Understanding that the sums should be considered as integrals when variables are continuous, then we have, ![Formula][16] and, ![Formula][17] giving, ![Formula][18] The incidence rate at baseline *X* = *x* is determined by the first three terms, and differs from a proportional hazard estimate that is adjusted by either or both, of *x* or *z*. The first two terms are equivalent to a proportional hazards estimate with *x* at the mean exposure *µ**x* and *z* at the baseline value, and the third term quantitatively accounts for the spread in values of *x* and *z* about their mean values. The influence of do(*X* = *x*), is seen in the last term ![Graphic][19], with the change in risk being mediated by *z* in a very simple and intuitive way. For the situation considered here, where there is solely an indirect effect of the exposure through the mediator, this estimate is the same as for a mediation analysis with *measured* confounding [9]. Interestingly, in the equivalent mediation analysis with measured confounding, the influence of measured confounding on the estimate2, does not appear in the resulting expressions for natural direct, and indirect, effects. This appears to explain the agreement between estimates with measured, and unmeasured confounding - for the model of figure 2 in limit of rare diseases and a proportional hazards model, the estimate is (apparently) unaffected by confounding. Equation 9 applies to any situation described by figure 2, and the example given can be generalised, e.g. to multivariate normal distributions. ### Attributable fractions Attributable fractions are intended to describe the proportion of disease incidence that is caused by an exposure, or can be avoided by an intervention. They can be defined in several related but distinct ways [2, 5]. Here the attributable fraction for the situation described by figure 1 is considered. To allow exploration of the causal influence of a subset *X*, of risk factors *X* and *W*, the risk factors are considered to be composed of both *X* and *W*. If *P* (*Y* = 1, *T* < *t*) is the probability of observing a disease at a time *T*, less than *t*, then the average causal effect of risk factors on disease risk in a population compared with baseline risk factors is, *P* (*Y* = 1, *T < t*) − *P* (*Y* = 1, *T* < *t*|do(*X* = *x*)), and the excess fraction is, ![Formula][20] The numerator of 13 is the average causal effect (ACE) [6] of the risk factors *X* on the population’s disease risk, compared with the baseline values *X* = *x*. It is divided by the probability of risk in the population, giving an excess risk fraction, that is referred to here as an attributable fraction. To evaluate this, firstly note that, ![Formula][21] where we assumed the data could be described by a proportional hazards model for sufficiently rare diseases, to allow the approximation ![Graphic][22], where *η**x*, *η**w*, *η**z* are linear predictors respectively involving *x, w*, and *z*. Integrals should be replaced by sums for non-continuous variables. *P* (*Y* = 1, *T* < *t* | do(*X* = *x*)) can be evaluated similarly, and for the example of figure 1 considered here, we can use the backdoor adjustment formula in the second line below, ![Formula][23] Therefore, using Eqs. 14 and 15, the excess fraction is given by, ![Formula][24] where ![Graphic][25] for the baseline variables *x*. The equation is very similar to conventional expressions for attributable fractions that use relative risks [5], that would give an attributable fraction of ![Graphic][26], where *R* is the relative risk. However the expression now involves averages over the population, that include potential correlations with the confounding variables. The WHO uses an attributable fraction that is defined as [1], ![Formula][27] where *P*′(*X* = *x*) is an alternative probability distribution for *X*. If we take *P*′(*X* = *x*) to be a delta function centred on *X* = *x*, with ![Graphic][28], then, ![Formula][29] which is the same as would be obtained by assuming that ![Graphic][30] and ![Graphic][31] are uncorrelated in Eq. 16. Appendix B shows that the *A**W* provides a lower (upper) bound on *A**f* if ![Graphic][32] is positively (negatively) correlated with ![Graphic][33]. In general Eqs. 16 and 17 will differ, and neither should have a causal interpretation unless the causal model satisfies suitable conditions such as those in figure 1 that ensure that causal associations are being estimated. To estimate the integrals in 16, note that ![Graphic][34] and that the variance ![Graphic][35] as *n* → ∞. This allows the integrals to be approximated by a sum over the observed data, which is reasonable if the number of data points is sufficiently large in each level of categorical data considered. For example, in the study of UK Biobank described later with nearly 500,000 participants, the smallest category was for current smokers, but this included over 50,000 smokers. With this approximation, ![Formula][36] That might alternately be written as, ![Formula][37] with, ![Formula][38] which shows that the relative risk is weighted by the influence of confounders and other risk factors, but is similar to conventional expressions attributable fractions with ![Graphic][39]. When there are no confounders or other risk factors than *x*, then the terms in Eq. 21 become 1, and *w**i* = 1*/n*, so that ![Graphic][40] is then just the average of ![Graphic][41] across the population. The expression makes it clear that if the relative risk ![Graphic][42] is positively correlated with the relative risks from the confounding and other potential risk factors ![Graphic][43], then ![Graphic][44], and the attribution fraction is greater when accounting for the confounding and other potential risk factors. To compare the attributable risk between setting *X* = *x*1 and *X* = *x*2, the equivalent expression to Eq. 19 is, ![Formula][45] which is just the conventional result for attributable fraction in terms of the relative risk. ### Number of attributed cases The proportion of disease cases that are attributed to a risk factor is only important if the disease is sufficiently common. The change in the number of cases of disease can be estimated using the estimated attributable fraction and the number of observed cases of disease. If *N* is the population size under consideration, and *P* ≡ *P* (*Y* = 1, *T < t*), *P* ≡ *P* (*Y* = 1, *T < t*|do(*X* = *x*)), then, ![Formula][46] If we approximate *NP* as the observed number of cases in the population being studied *N**obs*, then we can estimate the number of extra (or fewer) cases from the attributable fraction *A**f*, with, ![Formula][47] This gives a simple estimate for the number of cases that are attributable to a risk factor. However, this is the number of attributable cases of hospital admissions, for diseases included by the study’s selection criterion - first admissions in an ICD-10 chapter in this paper. This latter estimate could substantially differ from our perception of the number of hospital admissions caused by a specific disease, that could be dominated by sequences of hospital visits, or result from a different original underlying cause. For that reason, attributable fractions are generally a better measure of the causal influence of risk factors on the risk of disease. If the attributable fraction given by Eq. 19 were negative, then instead of considering (*P* −*P*)*/P*, an alternative would be to consider (*P* −*P*)*/P*. However, provided *A**f* is reasonably small, then the two estimates have approximately the same magnitude, with a change in sign to indicate the direction of effect. Expanding (*P* −*P*)*/P* in terms of *A**f* = (*P*− *P*)*/P*, gives, ![Formula][48] Showing that both expressions are approximately equal in magnitude if *A**f* is small. ### Effect of treatment on the treated (ETT) An alternative attribution fraction, that is of more interest to clinicians or an individual, is the chance of having avoided a disease if you had not been exposed, but were subjected to the same correlated confounding factors that you would have otherwise experienced. This situation is equivalent to estimating the “effect of treatment on the treated” (ETT) [6, 7], but the “treatment” is an exposure to smoking or BMI. For the situation considered here of figure 1, this counterfactual question can be formulated and expressed in terms of observational quantities in a similar way to before. The argument below considers the simpler situation of smokers versus never smoked, or max BMI tertile versus a lower BMI tertile, denoting exposed by *X* = *x*1 and unexposed by *X* = *x*. Using counterfactual notation where ![Graphic][49] indicates the disease status of (e.g.) smokers, and ![Graphic][50] the disease status of non-smokers, then the ETT is defined as [6, 7], ![Formula][51] that can be thought of as estimating the difference between disease risk in smokers and non-smokers, when subjected to the same correlated confounding influences as smokers would experience. Following a previous derivation [7], and incorporating the same proportional hazards assumptions as before, this can be written as, ![Formula][52] where the second term on the second line is usually justified with the backdoor adjustment formula Eq. 1, but corresponds to estimating the probability of disease when *X* = *x* but all other exposures are as they would have been if *X* = *x*1, and the third line uses the approximation of sufficiently rare diseases that the cumulative distribution function can be approximated by the cumulative hazard. Continuing to take the baseline value ![Graphic][53], and dividing by the first term to get an attribution fraction, then gives, ![Formula][54] which solely involves the relative risk ![Graphic][55] for e.g. smoking status, and is the simplest attribution fraction that occurs in the literature. Because survival analyses are designed to estimate the influence of risk on an individual, with hindsight, perhaps Eq. 28 should not have been a surprise? Within the proportional hazards model, smoking will modify your risk of disease, independently of whether any other factors also do. From a population perspective, disease risk is determined by the overall combination of exposures, that will usually be correlated. This is why the attribution fraction for the population needs a more careful estimation that accounts for correlations between the exposures and confounding variables. ### Attribution of disease incidence to smoking and BMI A key requirement for public health policy, is to assess the impact of exposures such as smoking and BMI on health. Depending on the disease, the influence of smoking or BMI can be very different. The associations can change in both magnitude and direction of effect, being harmful for most diseases but protective for some. Their influence is further complicated by the correlation of risk factors with known confounders such as socioeconomic status and education, something that Eq. 19 is intended to account for. To explore the overall influence of smoking and BMI on disease, the attribution of smoking and BMI to the incidence of over 400 hospital diagnosed diseases in men and women was considered using UK Biobank data [10]. The aim was to characterise diseases by their attribution fractions, allowing them to be ranked or classified in terms of their risk modifiability in terms of smoking and BMI. The selection of diseases for study is detailed elsewhere [13], along with further information on the UK Biobank data that was used [10, 13]. Although the survival analyses could be done better by studying each disease in detail and formulating the analysis appropriately, the study here accounts for the strongest confounding factors, while allowing a broad survey of the overall influence of smoking and BMI on disease. The causal model was assumed to be as in figure 1, and the analysis is briefly summarised below. ### Survival analysis The International Classification of Diseases version 10 (ICD-10) [14], classifies disease diagnoses into chapters of related diseases. To minimise the potential for confounding by prior disease, that might modify incidence rates, only the first incidence of disease in each ICD-10 chapter was considered for each individual who lived long enough to experience it. We considered disease diagnoses that were the primary cause of hospital admission and would have passed a threshold of severity to trigger hospital admission, as identified from hospital episode statistics (HES), and recorded with an ICD-10 code. Individuals who reported diabetes at entry to the study were excluded. This ensured that new cases of diabetes would almost entirely involve type II diabetes, with risk most strongly influenced by age and BMI. For each disease studied, data were excluded if the disease occurred before a participant entered the study, or if an individual had a hospital diagnosed cancer other than non-melanoma skin cancer before starting the study. The disease incidence rates are “rare” in the approximate sense needed to estimate attribution fractions [12]. A survival analysis using age as the time variable was left truncated at a participant’s entry to the study, right-censored if there was: death, cancer other than non-melanoma skin cancer, or the study period ended. All diagnoses recorded between entering the study and 31st January 2020 were included, as recorded in UK Biobank HES data on 8th December 2021. Data beyond 31st January 2021 were likely to be influenced by the COVID-19 pandemic and were omitted. Analyses were multiply adjusted using a proportional hazards model, with men and women studied separately, and a causal model assumed as in figure 1. Adjustment considered the established risk factors of: smoking status (never, previous, or current), alcohol consumption (rarely - less than 3 times per month, sometimes - less than 3 times a week but more than 3 per month, regularly - 3 or more times each week), education (degree level, post-16 but below degree, to age 16 or unspecified), socio-economic status (tertiles), height (sex-specific tertiles), BMI (sex-specific tertiles), and for women we also adjusted for: HRT use ever (yes, no), and one or more children (yes, no). Baseline was taken as: never smoker, rarely drink, brisk walking pace, degree-level education, minimum deprivation tertile, minimum height tertile in men (or women), middle BMI tertile in men (or women), and women with no children or HRT use. Only diseases with at least 140 cases were considered. This ensured there were at least 10 cases per parameter to adjust from baseline, even if a parametric e.g. Weibull model with an extra two parameters to fit the baseline hazard function were considered [12]. Sensitivity analyses excluded participants with a broader range of prior diseases, leading to fewer total cases and fewer diseases included in the study. Analyses were multiply adjusted. There were less than 1% missing values, allowing a complete case analysis. Numerical work and plots used R [15], and packages used here included: survival[16] and grr[17]. Attribution fractions for the UK Biobank population were considered for three situations: observed population verus all smoking status as never-smoked, observed population versus middle BMI tertile, and observed population versus never-smoked and middle BMI tertile. The latter case is comparing the correlated exposures of BMI and smoking status in the observed population, to a situation where BMI and smoking are set to their baseline values. Because the baseline BMI tertile is the middle tertile, current smokers could be correlated with either the top or bottom BMI tertile. Frequency of alcohol consumption was adjusted for but not studied, because it is a less precise measure than smoking status or BMI, and it is known to have inconsistent associations with disease risk in different studies. ## Results Plots and tables only included diseases with statistically significant associations for current smoking versus never smoked or maximum versus middle BMI tertile, after an FDR multiple-testing adjustment. Where results involve both smoking and BMI then diseases were included if they are included in either of the smoking-only, or BMI-only results. This left 129 diseases associated with BMI, 153 diseases associated with smoking, and 226 diseases that were associated with either smoking or BMI. To explore the sensitivity of the estimates to the strength of confounding factors, estimates made using Eq. 19 and 18 were compared (figure 5 in the Appendix). As expected, the influences of confounding are more noticeable for smaller attributable fractions, but even in those cases, the estimates rarely differ by more than about 20%. With a handful of exceptions, such as Parkinson’s disease (G20), estimates with Eq. 19 were larger than with 18, as would be expected if the influence of smoking and BMI were positively correlated with the influence of the confounding factors in the model. Figure 3 shows the median attributable fractions for the combined influence of smoking and BMI on the incidence of disease in each ICD-10 chapter, with the width of the bar plots proportional to the number of diseases included in the estimate. Diseases of the respiratory system (X) have the largest median attribution fraction, of about 0.3, closely followed by endocrine, nutritional, and metabolic diseases, that are both almost double the next largest values. Diseases of the skin and subcutaneous tissues (XII) and of the nervous system (VI), both have median attribution fractions near 0.15. Neoplasms and circulatory diseases account for 22% of all the diseases, and have the next largest median attributable fractions. There are seven chapters with median attribution fractions greater than 0.1, and these include 100 diseases, 50 of which are neoplasms and diseases of the circulatory system. ![Figure 3:](http://medrxiv.org/https://www.medrxiv.org/content/medrxiv/early/2021/12/25/2021.12.24.21268368/F3.medium.gif) [Figure 3:](http://medrxiv.org/content/early/2021/12/25/2021.12.24.21268368/F3) Figure 3: Median attributable fractions for each ICD-10 chapter with at least 5 diseases where *A**f* > 0.2. Bar widths are proportional to the number of diseases in each chapter. The 26% of diseases that had *A**f* ≥ 0.2 are listed in table 1. There are 11 diseases with *A**f* ≥ 0.5 and 21 with *A**f* ≥0.35. Given the limitations of the analysis and the potential for regression dilution bias, it is possible that more than 11 diseases could have *A**f* ≥0.5. For diseases with more than half the cases attributed to smoking and BMI, it seems reasonable to regard smoking and BMI as “pathogenic”, in a similar way that strong genetic risk factors are often described as pathogenic. View this table: [Table 1:](http://medrxiv.org/content/early/2021/12/25/2021.12.24.21268368/T1) Table 1: Attributable fractions *A**f* for both smoking and BMI are estimated with Eq. 19, ranked, and listed if *A**f* ≥ 0.2. Colours: *A**f* ≥ 0.5 (red), 0.5 > *A**f* ≥ 0.35 (orange), 0.35 > *A**f* ≥ 0.2 (yellow). Sex: diseases in males (M) or females (F), *N* : total cases, ![Graphic][56] : attributed cases. One third of the 226 diseases had an attributable fraction with |*A**f* |> 0.17, and two thirds had |*A**f* |> 0.06. Although the mean attribution fraction for the combined influence of smoking and BMI was ≃ 15%, the estimated attributable number of extra cases was only ≃ 8%, reflecting the fact that the most common diseases (with the most cases), tended to have smaller attributable fractions. Diseases were ranked in terms of their attribution fractions for smoking and BMI (figure 4). Figure 4 identifies an important point, that even established risk factors such as smoking and BMI can have protective associations with some diseases. The 20 diseases that smoking and BMI have the strongest protective associations with are listed in table 2. There were 12 diseases whose protective association had an attributable fraction with magnitude greater than 0.1, and 3 with magnitude greater than 0.2. Melanoma in situ (D03), had the strongest protective association of -0.29, where the sign is taken to indicate the direction of effect as discussed in “Number of attributed cases”. View this table: [Table 2:](http://medrxiv.org/content/early/2021/12/25/2021.12.24.21268368/T2) Table 2: Diseases with the strongest protective associations, ranked by the proportion of disease attributed to a combination of smoking and BMI (*A**f*). Sex indicates diseases in males (M) or females (F), *N* are total cases, ![Graphic][57] are the number of cases attributed to smoking and BMI, *A**f* is the attributable fraction. View this table: [Table 3:](http://medrxiv.org/content/early/2021/12/25/2021.12.24.21268368/T3) Table 3: The sensitivity analyses found six additional diseases with *A**f* ≥ 0.2, for the combination of both smoking and BMI, that would have appeared in table 1. Sex: diseases in males (M) or females (F), *N* : total cases, ![Graphic][58] : attributed cases. View this table: [Table 4:](http://medrxiv.org/content/early/2021/12/25/2021.12.24.21268368/T4) Table 4: BMI only: Sex indicates diseases in males (M) or females (F), *N* are total cases, ![Graphic][59] are cases attributed to BMI, *A**f* is the attributable fraction for deviations from the mid-tertile of BMI. For obesity, unsurprisingly *A**f* ≃ 1. Reporting errors may have prevented *A**f* = 1 for obesity. View this table: [Table 5:](http://medrxiv.org/content/early/2021/12/25/2021.12.24.21268368/T5) Table 5: Smoking only: Sex indicates diseases in males (M) or females (F), *N* are total cases, ![Graphic][60] are cases attributed to smoking, *A**f* is the attributable fraction. View this table: [Table 6:](http://medrxiv.org/content/early/2021/12/25/2021.12.24.21268368/T6) Table 6: BMI only: Diseases with the strongest protective associations, ranked by attributable fraction (*A**f*). Sex indicates diseases in males (M) or females (F), *N* are total cases, ![Graphic][61] are the number of cases attributed to BMI. ![Figure 4:](http://medrxiv.org/https://www.medrxiv.org/content/medrxiv/early/2021/12/25/2021.12.24.21268368/F4.medium.gif) [Figure 4:](http://medrxiv.org/content/early/2021/12/25/2021.12.24.21268368/F4) Figure 4: For diseases with a statistically significant association with smoking or BMI after an FDR multiple-testing adjustment, attributable fractions *A**f* were calculated with Eq. 19. Lines indicate *A**f* = 0.5 (red), *A**f* = 0.35 (orange), *A**f* = 0.2 (yellow). *A**f* < 0 indicates a protective association. ![Figure 5:](http://medrxiv.org/https://www.medrxiv.org/content/medrxiv/early/2021/12/25/2021.12.24.21268368/F5.medium.gif) [Figure 5:](http://medrxiv.org/content/early/2021/12/25/2021.12.24.21268368/F5) Figure 5: Attributable fractions (*A**f*) for smoking and BMI, estimated with Eqs. 19 (red) and 18 (blue). Eq. 18 is equivalent to the WHO’s *A**f* [1]. Eq. 19 estimates causal associations. Left plot: diseases with the highest 25% *A**f*. Right plot: diseases where Eqs. 18 and 19 differed the most. ![Figure 6:](http://medrxiv.org/https://www.medrxiv.org/content/medrxiv/early/2021/12/25/2021.12.24.21268368/F6.medium.gif) [Figure 6:](http://medrxiv.org/content/early/2021/12/25/2021.12.24.21268368/F6) Figure 6: Median attributable fractions for each ICD-10 chapter with at least 5 diseases where *A**f* > 0.2. Bar widths are proportional to the number of diseases in each chapter. ### Sensitivity analysis Participants with hospital reports of prior cancers other than non-melanoma skin cancers were excluded from the main study, but self-reported cancers or other prior diseases were not. It is possible for example, that a heart attack might be followed by weight loss, and including participants with prior heart attacks could weaken a potential association between BMI and heart disease. In contrast, smoking might increase the risk of some diseases for which a substantial proportion occur before entry into the UK Biobank study. In that case, including participants with the prior disease might strengthen the associations. The question of how best to study sequences of disease is an example where causal understanding is not enough, and new statistical methods or data are likely to be required. It might be an intractable question, due to the vast possible combinations of sequences of 100s of diseases, and it is further complicated by the complex time-dependent exposures and accumulation of genetic mutations that any individual experiences. Therefore a senstivity analysis compared the paper’s main results with a second analysis that excluded participants who had reported any cancer other than non-melanoma skin cancer, or any serious cardiovascular disease of heart disease, stroke, arterial or pulmonary embolisms, or subarachnoid haemorrhage. Differences between the main study and the sensitivity analysis were small (for full details see the Supplementary Material). The difference in attribution fractions between the two studies had a mean and median of -0.006 and -0.005 respectively, and a standard deviation of 0.029. The differences in magnitude were typically equivalent to about 10%. The attribution fractions of six diseases changed by more than 0.05. These included increased attributable fractions for: I50 - heart failure in women (0.40 to 0.48), R29.6 - tendency to fall in men (0.32 to 0.41), and decreases in: C16 - stomach cancer in men (0.27 to 0.21), J10 - influenza in women (0.33 to 0.27), J22 - lower respiratory infections in men (0.24 to 0.17), and N17 - acute renal failure (0.24 to 0.17). Overall the differences were small, but larger than the approximations in Eq. 19 would cause. ## Discussion ### Attribution fractions Similar attribution formulae to that used here have existed in published literature since at least 1998 [4]. A contribution of this paper is to recognise that for a particular causal model such as that in figure 1, the attribution fractions can only be used with a restricted range of potential risk modifiers, whose associations have a causal interpretation. The consideration of attributable fractions from the perspective of causal inference, has helped to highlight several important points: 1. It is not possible to estimate causal associations and attributable fractions for all factors that are thought to be associated with disease risk. For example, if the causal model is not known sufficiently well, then it may not be possible to correctly adjust for confounding. Alternately, if the measurement is too imprecise e.g. socio-economic status is likely to capture the influence of several factors that may include exposure to pollution, poor quality diet, poor living and working conditions, etc, then it may not be possible to estimate a meaningful causal association - for example, someone with an equivalent socio-economic status in a different country would experience different exposures and have different causal factors that influence their health. 2. Estimates of causal associations cannot always be obtained directly from a single multiply-adjusted analysis, and may need several different analyses of the same dataset, as required by the causal model. For example, changes in systolic blood pressure (SBP) can be caused by smoking or BMI, and therefore SBP should not be adjusted for if we are interested in the influence of smoking and BMI on disease risk. In contrast, if our interest was in SBP, then we would need to adjust for BMI and smoking if they can modify disease risk in any way other than through changes in SBP. ### Attribution to smoking and BMI The original intention of this work was to characterise diseases through the overall modifiability of disease risk by established risk factors. To do so as rigorously as possible, a causal model similar to figure 1 was assumed, and the strongest established risk factors of smoking and BMI were considered. Under the model in figure 1, Eq. 19 is intended to provide attribution fractions for the causal increase in disease incidence due to smoking and BMI, while accounting for confounding factors that would also be expected to modify disease incidence. The study considered the most common diseases in UK Biobank, and highlighted two important points: 1. Attribution fractions for smoking, and BMI, are very heterogeneous, and can even involve a reduction in risk (table 2). 2. Some associations are extremely strong, for example with *A**f* > 0.5. The first point highlights a difficulty in optimising lifestyle and drug treatments - changes in lifestyle or medication are likely to have a heterogeneous influence on disease risk, with some risks lowered but others potentially increased. In the same way that some germline genetic risk factors are described as pathogenic when they substantially increase your risk of disease, it seems reasonable to describe the influence of smoking and BMI as “pathogenic”, for diseases with high attributable fractions such as *A**f* > 0.5. Based on the estimates here, eliminating smoking and controlling BMI would be expected to prevent the majority of those diseases in an equivalent population. The attribution fractions allow us to identify the diseases for which a change in lifestyle is likely to have the greatest impact. From a population perspective, eliminating smoking and controlling BMI in an equivalent population would be expected to avoid: the majority of diseases with *A**f* > 0.5 (red in table 1), between one third and one half of diseases with 0.35 > *A**f* > 0.5 (orange in table 1), between one fifth and one third of diseases with 0.2 > *A**f* > 0.35 (yellow in table 1). This slightly ad-hoc categorisation of diseases by their attributable fractions provides an approximate indication of how the patterns of disease would be expected to change if smoking were eliminated and BMI were controlled in a population that was otherwise similar to that in UK Biobank. The attributed fractions would be larger if more of the population were exposed. For examples where a binary exposure X is uncorrelated with W or confounders Z, then Appendix C shows that provided *p*(*R*− 1) ≪1, where *R* is the relative risk and *p* is the proportion of the population that are exposed, then *A**f* ≃*p*(*R*− 1). In that case, if the exposed proportion *p* were halved, then so would the attributable fraction. This highlights a limitation of Eqs. 16, 19, and 17 - they measure the proportion of disease in a population that is attributed to an exposure, but a clinician might be more interested in what proportion of disease in smokers is attributable to smoking, and an individual might be more interested in whether their risk of serious disease or death is substantially changed. Such questions that refer to individuals as opposed to populations might best be tackled with counterfactual arguments and measurements such as Eq. 28. An alternative approach is to consider the “probability of necessity” [6, 7], that in principle allows the assessment of whether it is more probable than not that the disease would not have occurred if you had not been exposed to e.g. smoking. Such approaches allow specific individual cases to be assessed, but do not provide an overall characterisation of an exposure’s influence on population health. When considering the attribution fraction for both smoking and BMI together, the study included diseases with statistically significant associations with either smoking or BMI. In this situation, especially when the number of cases are few, the estimates for one of the two parameters can in principle be both large and imprecise. This has the potential to produce misleading estimates for the joint attribution fraction of both smoking and BMI. A notable example is the strong protective association of smoking with Parkinson’s disease (see table 7), that was substantially weakened in table 2 by the association with BMI, even though the association with BMI was not statistically significant. This appears to be an isolated example, and the potential problem will reduce with more cases, but it highlights the importance of also considering the attribution fractions associated with each separate exposure. View this table: [Table 7:](http://medrxiv.org/content/early/2021/12/25/2021.12.24.21268368/T7) Table 7: Smoking only: Diseases with the strongest protective associations, ranked by attributable fraction (*A**f*). Sex indicates diseases in males (M) or females (F), *N* are total cases, ![Graphic][62] are the number of cases attributed to smoking. ### Meta analyses If estimates are to be used in a meta-analyses of data that have not originated from a randomised control trial, then it is essential to ensure that estimates are of causal associations. It is possible that some reported estimates from observational studies will measure the causal influence of a potential risk factor, such as BMI, alcohol, and smoking in the first example considered here, but this is unlikely to be true for all variables that are adjusted for. If a study has inappropriately adjusted for potential confounding variables, then the data cannot be included in the meta-analysis. The assessment of this requires a good causal understanding of how the risk factor of interest modifies disease risk, and the potential confounding factors that need adjusting for. Disagreement between studies may indicate incomplete understanding of the underlying causal model, with inappropriate or insufficient adjustment for confounding factors. In the common situation where uncertainty of the causal processes linking exposure *X* to disease risk remain, then the standard methods and cautious reporting of conventional epidemiology must remain [2, 8]. ## Conclusions The aim was to characterise how the risk of common diseases are modified by established risk factors, and to identify which disease risks are the most sensitive to them. This requires estimates of causal associations between potential risk factors and disease risk, and it was shown that many conventional epidemiological studies can provide these. This requires a sufficiently good model of the causal processes, and appropriate adjustment for confounders. This limits the range of potential risk factors that can be studied, but will often include important risk factors such as smoking and BMI. The first generic example was a causal model with risk factors *X* that satisfied the “backdoor criteria” [7], a situation that is likely to commonly occur. The second example considered the “frontdoor” criteria, that can allow causal estimations in the presence of unmeasured confounders, when the influence of *X* is mediated by a measurable variable *Z*. In this case, for the simple example considered (with rare disease incidence, and the linear influence of a continuous exposure mediated by a normally distributed continuous variable whose mean is linearly related to the exposure), the causal estimate is the same as you get from a mediation analysis with measured confounders. With hindsight, this might have been anticipated by observing that for this situation in the limit of rare diseases studied with a proportional hazards model, the confounding terms do not appear in the results of mediation studies for natural direct, and indirect, effects [9]. The causal attribution of exposures to population disease risk was considered for the situation corresponding to figure 1, leading to equations 16 and 19. These are similar to the expression used by the World Health Organisation, but accounts for correlations between exposures and confounding factors. The attribution fractions (*A**f*) allowed a simple categorisation of diseases to indicate how the patterns of disease might change if smoking were eliminated and BMI controlled, in an equivalent population to UK Biobank. For the combined influence of smoking and BMI compared to baseline of never smoking and mid-tertile BMI, this identified 11 diseases with *A**f* > 0.5, a further 10 with 0.35 < *A**f* < 0.5, and a total of 59 with *A**f* > 0.2. Similar results were found by a sensitivity analysis. Because a large proportion of the population studied were “unexposed” (non-smoking and a healthy weight), the attribution fraction for e.g. disease in the population attributed to smoking, will often be less than that for an individual. Attribution fractions for individuals are simpler expressions (Eq. 28), because they do not need to account for complex correlations that occur between risk factors in a population. In summary, this article has attempted to link established epidemiological methods [2, 3] with newer techniques in causal inference [6, 7], to help clarify the definition of attribution fractions. This subsequently allowed a quantitative characterisation of the causal associations between smoking, BMI, and the incidence of disease in the UK Biobank cohort [10], using their attribution fractions (*A**f*), and categorising them into groups with similar *A**f*. These help to indicate the expected change in patterns of disease due to changes e.g. to a healthier lifestyle, for an equivalent population. ## Supporting information Supplemental Material [[supplements/268368_file03.pdf]](pending:yes) ## Data Availability The study uses UK Biobank data, that is available by application from: [www.ukbiobank.ac.uk](https://www.ukbiobank.ac.uk) [https://www.ukbiobank.ac.uk](https://www.ukbiobank.ac.uk) ## Data availability UK Biobank data can be accessed by application through [www.ukbiobank.ac.uk](https://www.ukbiobank.ac.uk), and summary data produced during this study will become available from: [https://osf.io/](https://osf.io/) UK Biobank has approval by the Research Ethics Committee (REC) under approval number 16/NW/0274. UK Biobank obtained participant’s consent for the data to be used for health-related research. ## Code availability R code used to produce figures from summary data will become available with the summary data at: [https://osf.io/](https://osf.io/) The full code for use with non-summary data will be returned with other results to UK Biobank (see [www.ukbiobank.ac.uk](https://www.ukbiobank.ac.uk)). ## Competing interests The author declares no competing interests. ## A Probability densities and hazard functions Using Eq. 4 we can calculate the probability density function, ![Formula][63] This allows a hazard function (usually defined as *h* = *f/S* = *f/*(1 − *F*)), to be defined as, ![Formula][64] Alternately, we could have argued that most diseases in UK Biobank are sufficiently rare that we can approximate *f*(*t*) ≃ *h*(*t*), and hence that *h*(*t* |do(*X* = *x*))*δt* ≃ *P* (*Y* = 1, *T* ∈ (*t, t* + *δt*) |do(*X* = *x*)) Therefore for combinations of confounders and risk factors that satisfy the “backdoor criteria” [7] (such as those in figure 1), and disease incidence that is sufficiently rare (which includes most studies of the first incidence of a disease in UK Biobank data [12]), ![Formula][65] This indicates that if we are interested in the relative difference in disease rates that would be caused by changing from the baseline value *X* = *x*, to *X* = *x* (e.g. to reduce risk), then the result is given in terms of the usual relative risk, but without terms in *Z* (corresponding to *Z* = *z*). This indicates that causal inferences for *x* using the relative risk, will be correct in these circumstances. Any confounders *Z* ≠ *z* that may appear in an estimated relative risk, are set at their baseline values *Z* = *z* to estimate Eqs. 31 and 6. Note that hazard functions do not give a probability in the conventional sense, and are not normalised to 1 for example. To ensure the above calculations were done correctly and will e.g. normalise to 1 (within the limits of the approximations made), it was essential for the arguments to have used probabilities (for which the backdoor theorem applies). For a clear exposition of when a particular situation will satisfy the “backdoor criterion”, please refer to the references [6, 7]. ## B Bounds on attribution fractions By definition, if the relative risks ![Graphic][66] and ![Graphic][67] are positively correlated, then ![Graphic][68], where *E* is used to denote expectations. Therefore, using exp(*s*) ≥ 0 for any real-valued *s*, we can rearrange the inequality as, ![Formula][69] Eq. 32 shows that if the relative risks for *x, w*, and *z* are positively correlated, then the attributable fraction for disease risk within the population, is greater than would be estimated using the average relative risk, with estimates using the mean relative risk providing a lower bound. If *x* and *z* are negatively correlated then the ≥ sign is be replaced by ≤. Another quantity that might be considered is the expected value of the attributed fraction ![Graphic][70], that is ![Graphic][71]. Because ![Graphic][72] is concave, Jensen’s inequality gives, ![Formula][73] and as a result, ![Formula][74] If ![Graphic][75] and ![Graphic][76] are positively correlated, then Eqs. 34 and 32 indicate that ![Graphic][77] will also bound Eq. 19. However, this would not be true if ![Graphic][78] and ![Graphic][79] were negatively correlated. ## C Relation to other attributable fractions A recent study [18] with a proportion *p* exposed to a virus, and an estimated relative risk *R*, reported an attribution fraction of *A* = *p*(*R*− 1)*/R*. Here it is briefly outlined when this will approximate Eq. 19. Assume that ![Graphic][80], and ![Graphic][81] are uncorrelated, so that Eq. 16 simplifies to 17, that may be approximated as, ![Formula][82] If we consider a proportion *p* that are exposed with relative risk *R*, and a proportion (1− *p*) that are unexposed, then using Eq. 35, ![Formula][83] where the approximation in the final line follows if *R*− 1 is small enough, as it often can be. A better approximation follows from the second line, where *p*(*R* −1) ≪1 ensures that *A**f* ≃*p*(*R* −1). If *p* ≃ 1, then *A**f* ≃ (*R*− 1)*/R* as usual, as can be seen from the first or second line above. ## D Supplementary tables and figures ## Acknowledgements Thank you to Professor Robert Clarke for suggesting a sensitivity analysis to strengthen the results. This research has been conducted using the UK Biobank resource under application number 42583. Anthony Webster is supported by an intermediate research fellowship from the Nuffield Department of Population Health (NDPH), University of Oxford. ## Footnotes * 1 For a particular *X* = *x*, the linear predictor function is sometimes referred to as the “linear component”, “risk score”, or “prognostic index” [3]. * 2 For a solely indirect effect, *γ*1 = *γ*3 = 0 in Eq. 4.6 on page 101 of [9], and measured confounding is accounted for through the coefficient *γ*4, that does not subsequently appear in the equations for natural direct and indirect effects. * Received December 24, 2021. * Revision received December 24, 2021. * Accepted December 25, 2021. * © 2021, Posted by Cold Spring Harbor Laboratory The copyright holder for this pre-print is the author. All rights reserved. The material may not be redistributed, re-used or adapted without the author's permission. ## References 1. [1].World Health Organization, Global health risks: mortality and burden of disease attributable to selected major risks, World Health Organization (2009). 2. [2]. T.L. Lash, T.J. VanderWeele, S. Haneuse, K.J. Rothman, Modern Epidemiology, Fourth Edition, Wolters Kluwer, (2021). 3. [3]. D. Collett Modelling Survival Data in Medical Research, New York: Chapman and Hall/CRC, 3rd edition, (2014). 4. [4].Rockhill, B. Newman, B. and Weinberg, C. Use and misuse of population attributable fractions American Journal of Public Health, 88, 15–19, (1998). [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.2105/AJPH.88.1.15&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=9584027&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2021%2F12%2F25%2F2021.12.24.21268368.atom) [Web of Science](http://medrxiv.org/lookup/external-ref?access_num=000073804800003&link_type=ISI) 5. [5]. M.A. Mansournia, A. Douglas G, Population attributable fraction, BMJ - British Medical Journal, 360, k757, (2018). 6. [6]. J. Pearl Causality, 2nd ed., John Wilely & Sons Ltd, (2009). 7. [7]. J. Pearl, M. Glymour, N.P. Jewell, Causal Inference In Statistics, Cambridge University Press, (2016). 8. [8].Shimonovich, M., Pearce, A., Thomson, H. et al. Assessing causality in epidemiology: revisiting Bradford Hill to incorporate developments in causal thinking Eur. J. Epidemiol. 36, 873–887 (2021). 9. [9]. T.J. VanderWeele Explanation in Causal Inference, Oxford University Press, (2015). 10. [10]. C. Bycroft et al. The UK Biobank resource with deep phenotyping and genomic data Nature 562, 203–209, (2018). [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1038/s41586-018-0579-z&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=30305743&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2021%2F12%2F25%2F2021.12.24.21268368.atom) 11. [11]. E.T. Jaynes Probability Theory: The Logic of Science, Cambridge University Press, (2003). 12. [12]. A.J. Webster, R. Clarke Sporadic, late-onset, and multistage diseases, medRxiv 2021.12.15.21267843, Cold Spring Harbor Laboratory Press, (2021). 13. [13].Webster, A.J., Gaitskell, K., Turnbull, I., Cairns B.J., Clarke R. Characterisation, identification, clustering, and classification of disease Scientific Reports 11, 5405 (2021). 14. [14].World Health Organisation, International Statistical Classification of Diseases (ICD), [www.who.int/standards/classifications/classification-of-diseases](http://www.who.int/standards/classifications/classification-of-diseases), (2021). 15. [15].R Core Team. R: A Language and Environment for Statistical Computing R Foundation for Statistical Computing, Vienna, Austria, [www.R-project.org](http://www.R-project.org), (2020). 16. [16].Therneau, T.M. A Package for Survival Analysis in R, CRAN.R-project.org/package=survival, (2021). 17. [17].Varrichio, C. grr: Alternative Implementations of Base R Functions, CRAN.R-project.org/package=grr, (2016). 18. [18].Yang, L. Kartsonaki, C, Yao, P. The relative and attributable risks of cardia and non-cardia gastric cancer associated with Helicobacter pylori infection in China: a case-cohort study, The Lancet Public Health, 6, Issue 12, e888 –e896. [1]: /embed/graphic-2.gif [2]: /embed/graphic-3.gif [3]: /embed/graphic-4.gif [4]: /embed/inline-graphic-1.gif [5]: /embed/inline-graphic-2.gif [6]: /embed/graphic-5.gif [7]: /embed/inline-graphic-3.gif [8]: /embed/graphic-6.gif [9]: /embed/inline-graphic-4.gif [10]: /embed/graphic-7.gif [11]: /embed/graphic-8.gif [12]: /embed/graphic-10.gif [13]: /embed/graphic-11.gif [14]: /embed/inline-graphic-5.gif [15]: /embed/inline-graphic-6.gif [16]: /embed/graphic-12.gif [17]: /embed/graphic-13.gif [18]: /embed/graphic-14.gif [19]: /embed/inline-graphic-7.gif [20]: /embed/graphic-15.gif [21]: /embed/graphic-16.gif [22]: /embed/inline-graphic-8.gif [23]: /embed/graphic-17.gif [24]: /embed/graphic-18.gif [25]: /embed/inline-graphic-9.gif [26]: /embed/inline-graphic-10.gif [27]: /embed/graphic-19.gif [28]: /embed/inline-graphic-11.gif [29]: /embed/graphic-20.gif [30]: /embed/inline-graphic-12.gif [31]: /embed/inline-graphic-13.gif [32]: /embed/inline-graphic-14.gif [33]: /embed/inline-graphic-15.gif [34]: /embed/inline-graphic-16.gif [35]: /embed/inline-graphic-17.gif [36]: /embed/graphic-21.gif [37]: /embed/graphic-22.gif [38]: /embed/graphic-23.gif [39]: /embed/inline-graphic-18.gif [40]: /embed/inline-graphic-19.gif [41]: /embed/inline-graphic-20.gif [42]: /embed/inline-graphic-21.gif [43]: /embed/inline-graphic-22.gif [44]: /embed/inline-graphic-23.gif [45]: /embed/graphic-24.gif [46]: /embed/graphic-25.gif [47]: /embed/graphic-26.gif [48]: /embed/graphic-27.gif [49]: /embed/inline-graphic-24.gif [50]: /embed/inline-graphic-25.gif [51]: /embed/graphic-28.gif [52]: /embed/graphic-29.gif [53]: /embed/inline-graphic-26.gif [54]: /embed/graphic-30.gif [55]: /embed/inline-graphic-27.gif [56]: T1/embed/inline-graphic-28.gif [57]: T2/embed/inline-graphic-29.gif [58]: T3/embed/inline-graphic-30.gif [59]: T4/embed/inline-graphic-31.gif [60]: T5/embed/inline-graphic-32.gif [61]: T6/embed/inline-graphic-33.gif [62]: T7/embed/inline-graphic-34.gif [63]: /embed/graphic-42.gif [64]: /embed/graphic-43.gif [65]: /embed/graphic-44.gif [66]: /embed/inline-graphic-35.gif [67]: /embed/inline-graphic-36.gif [68]: /embed/inline-graphic-37.gif [69]: /embed/graphic-45.gif [70]: /embed/inline-graphic-38.gif [71]: /embed/inline-graphic-39.gif [72]: /embed/inline-graphic-40.gif [73]: /embed/graphic-46.gif [74]: /embed/graphic-47.gif [75]: /embed/inline-graphic-41.gif [76]: /embed/inline-graphic-42.gif [77]: /embed/inline-graphic-43.gif [78]: /embed/inline-graphic-44.gif [79]: /embed/inline-graphic-45.gif [80]: /embed/inline-graphic-46.gif [81]: /embed/inline-graphic-47.gif [82]: /embed/graphic-48.gif [83]: /embed/graphic-49.gif