Development and application of an evidence-based directed acyclic graph to evaluate the associations between metal mixtures and cardiometabolic outcomes
========================================================================================================================================================

* Emily Riseberg
* Rachel D. Melamed
* Katherine A. James
* Tanya L. Alderete
* Laura Corlin

## Abstract

**Background** Exposure to individual metals (and metalloids; hereafter ‘metals’) is associated with adverse cardiometabolic outcomes. Specifying analytic models to assess relationships among metal mixtures and cardiometabolic outcomes requires evidence-based models of the (assumed) causal structures; however, such models have not been previously published.

**Methods** We conducted a systematic literature review to develop an evidence-based directed acyclic graph (DAG) identifying relationships among metals, cardiometabolic health indicators, and potential confounders. To evaluate the consistency of the DAG with data from 1797 participants in the San Luis Valley Diabetes Study (SLVDS; mean age=54 years, 53% women, 48% Hispanic), we tested conditional independence statements suggested by the DAG and by 100 DAGs with the same structure but randomly permuted nodes using linear (continuous outcomes), logistic (dichotomous outcomes), or Bayesian kernel machine regression (BKMR; statements with metal coexposures) models. Based on minimally sufficient adjustment sets identified by the DAG, we specified BKMR models assessing associations between urinary metal mixtures and cardiometabolic outcomes in the SLVDS population.

**Results** Twenty-nine articles met the inclusion criteria for the systematic review. From these articles, we developed an evidence-based DAG with 382 testable conditional independence statements (71% supported by SLVDS data). Only 3% of the DAGs with randomly permuted nodes indicated more agreement with the data than our evidence-based DAG. Applying the evidence-based DAG in a pilot analysis, we did not observe evidence for an association among metal mixtures and cardiometabolic outcomes.

**Conclusions** We developed, tested, and applied an evidence-based approach to analyze associations between metal mixtures and cardiometabolic health.

**What this study adds** We conducted a systematic literature review to develop an evidence-based directed acyclic graph (DAG) of the presumed causal relationship between exposure to metal mixtures and cardiometabolic outcomes. Using real data, we evaluated the testable conditional independence statements. The evidence-based DAG outperformed 97% of DAGs with randomly permuted nodes. We applied the evidence-based DAG to select covariates for a pilot analysis. *Environmental Epidemiology* readers can (1) plan future research based on our systematic literature review, (2) use our process to evaluate other evidence-based DAGs, and (3) apply the evidence-based covariates sets to further explore relationships between metal mixtures and cardiometabolic health.

Keywords
*   metal mixtures
*   metal coexposures
*   cardiometabolic
*   Bayesian kernel machine regression
*   directed acyclic graph
*   rural health

## Introduction

Extensive epidemiologic and toxicologic evidence indicates that metals and metalloids [e.g., cadmium (Cd), inorganic arsenic (iAs), manganese (Mn), and tungsten (W); hereafter simplified as ‘metals’] are associated with cardiometabolic outcomes.1–11 Whereas most of the published studies considered exposure to only one metal, numerous calls exist to examine associations between metal mixtures and cardiometabolic outcomes.2, 12–14 Examining the health outcomes associated with metal mixtures would more realistically reflect environmental exposure conditions.15, 16 Yet even analyses that include multiple metals typically only adjust for concentrations of non-target metals (not accounting for interactions among metal mixtures) or use stratified analyses. These stratified analyses, often in the form of associations with low exposure to metal A/low exposure to metal B versus high exposure to metal A/high exposure to metal B, do not capture complex non-linear relationships.2, 17–20

Development of predictive analytic models probing the complex relationships among metal mixtures and cardiometabolic outcomes requires an understanding of the putative underlying causal structure. An evidence-based directed acyclic graph (DAG) is one way to represent such a causal structure. DAGs clarify causal contrasts and explicitly show assumptions about common causes of exposures and outcomes (e.g., dietary sources of metal (co)exposure that also affect cardiometabolic health) that we need to account for in our study design and/or analysis.21–24 DAGs are also useful for identifying minimally sufficient adjustment sets of variables; when DAGs are used in this way, articles should report the assumed DAG.25 Few evidence-based DAGs exist in the environmental epidemiology context due to the need to conduct systematic literature reviews and to empirically test the applicability of the DAG for the study context (as one example, see Corlin et al.26). No evidence-based DAGs have been previously published describing the structure underlying potential metal mixture-cardiometabolic outcome relationships. Such a DAG could help researchers assess how specific environmentally relevant metal mixtures mechanistically affect the development of cardiometabolic outcomes. Therefore, our primary objective was to conduct a systematic literature review to support the development of an evidence-based DAG diagraming the relationships among exposure to metal mixtures, the development of cardiometabolic outcomes, and potential common causes of exposures and outcomes. Our secondary objective was to evaluate this DAG and apply it to a real environmental health context using data from a cohort of adults residing in the rural San Luis Valley of Colorado.

## Methods

### Literature review and directed acyclic graph development

We conducted a systematic search using PubMed, ProQuest, and Embase. The search strategy is detailed in **Figure 1**. The searches for each database were as follows: 

1.  PubMed search: (((((((((inorganic arsenic[MeSH Terms]) OR manganese[MeSH Terms]) OR cadmium[MeSH Terms]) OR uranium[MeSH Terms]) OR tungsten[MeSH Terms])) OR alloy[MeSH Terms])) AND ((cardiovascular disease[MeSH Terms]) OR type 2 diabetes mellitus[MeSH Terms])) AND (((((“meta analysis”[Publication Type]) OR “review”[Publication Type]) OR “systematic review”[Publication Type]) OR “consensus development conference”[Publication Type]) OR “randomized controlled trial”[Publication Type])

2.  ProQuest search: (ti(cardiovascular disease) OR ti(type 2 diabetes)) AND (ti(inorganic arsenic) OR ti(manganese) OR ti(cadmium) OR ti(uranium) OR ti(tungsten))

3.  Embase search: (’cardiovascular disease’/exp OR ‘non insulin dependent diabetes mellitus’/exp) AND (’cadmium’/exp OR ‘inorganic arsenic’/exp OR ‘manganese’/exp OR ‘uranium’/exp OR ‘tungsten’/exp OR ‘alloy’/exp) AND ([systematic review]/lim OR [meta analysis]/lim) AND [2013-2019]/py

![Figure 1.](http://medrxiv.org/https://www.medrxiv.org/content/medrxiv/early/2021/03/08/2021.03.05.21252993/F1.medium.gif)

[Figure 1.](http://medrxiv.org/content/early/2021/03/08/2021.03.05.21252993/F1)

Figure 1. 
Literature review and analysis strategy

In PubMed, we specified our search to only meta-analyses, reviews, systematic reviews, consensus development conferences, or randomized controlled trials. In ProQuest, we further narrowed the search to reviews, which encompassed literature reviews, systematic reviews, and meta-analyses. Finally, in Embase, we searched for systematic reviews and meta-analyses. All searches were restricted to articles published in English within the seven years prior to the review (after September 2013). Articles had to assess one of the five primary metals of interest (As, Cd, Mn, uranium (U), W) as the exposure and a cardiometabolic condition as the outcome. Articles were excluded if they were synthesized in a meta-analysis or review article included in our literature review. We also searched the reference sections of each included article for the terms “mixture” or “alloy,” and included articles that met the search criteria but did not appear in the database searches (n = 1).

From each article included in the review, we collected the following information: authors, year, journal, study population, sample size, location, exposure characteristics (e.g., concentration), outcome, covariates, reported effect estimates, proposed causal pathway/biological mechanism, and reported limitations. Based on the extracted data, we created DAGs using the software DAGitty.27 Each arrow from an exposure to an outcome represented a relationship mentioned in at least one articles from the literature review (**Figure 2**).1, 3, 5, 6, 9, 10, 12–14, 28–47 Each arrow mapping a covariate to either the exposure or the outcome was verified from either an article in the literature review or an alternate source found searching in PubMed (**Appendix A**). The primary DAG is shown in **Figure 2**, and the metal specific DAGs are presented in the supplement (**Supplemental Figures 1-5**).

![Figure 2.](http://medrxiv.org/https://www.medrxiv.org/content/medrxiv/early/2021/03/08/2021.03.05.21252993/F2.medium.gif)

[Figure 2.](http://medrxiv.org/content/early/2021/03/08/2021.03.05.21252993/F2)

Figure 2. Directed acyclic graph representing the putative causal structure for the association between metal mixtures and cardiometabolic outcomes.
Pink nodes are ancestors of both the exposure (metal mixtures) and the outcome (cardiometabolic outcomes). Blue nodes are ancestors of the outcome only. Pink lines are biasing pathways, and green lines are pathways from the exposure to the outcome or an ancestor of the outcome. Drinking water represents metal concentrations in drinking water sources. Ambient air represents inhalation of metals in the air. Figure created in DAGitty.

### Evaluation and application data

To evaluate and apply the evidence-based DAG, we used data from the San Luis Valley Diabetes Study (SLVDS), a prospective cohort study assessing the risk factors for chronic disease among Hispanic and non-Hispanic white adults in rural Colorado. Data collection methods have been detailed elsewhere.48 Briefly, people with diabetes residing in Alamosa or Conejos counties, Colorado were recruited through medical records reviews and local advertisements. People without diabetes were recruited using a stratified random sampling scheme based on residential location in these counties. All participants (with or without diabetes) met three additional eligibility criteria: (1) aged 20-74 years old, (2) able to provide informed consent, and (3) proficient in English or Spanish. Baseline data collection occurred between 1984 and 1988, and follow-up data collection occurred between 1988 and 1998.

Urinary metal exposures used in this analysis were assessed at baseline. Samples (approximately 120 ml) were stored in tubes in a freezer at -80°C until the laboratory analysis was conducted in 2008. An inductively coupled argon plasma instrument with a mass spectrometer was used to detect the metal concentrations with a detection limit of 1 part in 10. Values below limit of detection were defined as the square root of detection limit divided by 2. All laboratory methods met the standards of the Clinical Laboratory Improvement Amendment and Environmental Protection Agency.49 All analyses were adjusted for urinary creatinine concentrations (g/L). Urinary creatinine was quantified using a colorimetric assay by the Jaffe reaction.

Outcomes were assessed at baseline and follow-up study visits. We created a dichotomous variable for having an adverse cardiometabolic outcome. We included people who reported incident: (1) coronary bypass surgery, (2) peripheral vascular surgery, (3) myocardial infarction, (4) stroke, (5) low high-density lipoprotein cholesterol concentration (fasting values <40 mg/dL in men or <50 mg/dL in women), or (6) high triglyceride concentration (fasting values ≥150 mg/dL).50 At baseline, participants self-reported age, sex, ethnicity (Hispanic/non-Hispanic), smoker status (never smoker [<100 lifetime cigarettes]/former smoker [≥100 lifetime cigarettes but not currently smoking]/current smoker [≥100 lifetime cigarettes and currently smoking]), annual gross household income (0-$7,499, $7,500-$19,999, $20,000-$34,999,≥$35,000), educational attainment (<12 years/12 years/>12 years), marital status (living together or married/not in a current domestic partnership or married), employment status (in the labor force and working/not working, retired, or disabled), occupation (agriculture workforce/non-agriculture), physical activity, and diet. Participants’ physical activity at work was classified as sedentary, moderate, or vigorous. Participants’ overall physical activity level accounting for activity during work and non-work time was categorized as sedentary, somewhat active, moderately active, very active, or most active.51 Participants completed a food frequency questionnaire.52, 53 Food intake for each category (i.e. plant-based foods and proteins) was measured as g/day, and alcohol intake was measured as g/week. Drinking water intake was measured as the number of eight-ounce glasses consumed per day. Since the diet variables (kcals, vitamin C, zinc, selenium, vitamin A, beta carotene, folic acid, protein, total fats, saturated fats, monounsaturated fats, polyunsaturated fats, cholesterol, carbohydrates, total sugar, plant-based foods, insoluble, soluble, and total fiber, legumes, and omega-3) were highly correlated, we summarized them by conducting a principal component analysis. We normalized the diet variables by centering and variance-standardizing them. Then, we used singular value decomposition implemented with the numpy linear algebra solver on the normalized dietary data to identify the top two eigenvectors, which together accounted for 53% of the variance. We transformed the participants dietary data by matrix multiplication with the top two eigenvectors to project the dietary data onto the first two principal components.

Additionally, anthropometric and clinical measurements were taken at baseline. Researchers measured participants height and weight, and these measurements were used to calculate body mass index (BMI; obesity defined as BMI >30 kg/m2). Researchers also measured blood pressure three times. The average of the second and third diastolic blood pressure measurements was used in the analysis. We considered individuals to have high blood pressure if the participant self-reported hypertension, self-reported prior or current use of hypertension medication, or was clinically diagnosed with hypertension at the clinic visit. Participants who self-reported current hypertension medication use brought the medication to the clinic visit for confirmation. For consistency with cutoffs at the time of SLVDS data collection, diastolic blood pressure was categorized into four levels: (1) normal (<90 mmHg), (2) mild hypertension (90 - <105 mmHg), (3) moderate hypertension (105 - <155 mmHg), or (4) severe hypertension (≥115 mmHg).54

### Statistical analysis

Our analysis was split into two parts: (1) evaluation of the DAG, and (2) application of the DAG in a pilot analysis. For both parts, we mapped each node in the evidence-based DAG to the corresponding variables in the SLVDS data. There were three exceptions: (1) ambient air quality and soil exposure were unmeasured in the SLVDS; (2) we excluded kidney damage due to the potential for reverse causation;55, 56 and (3) we excluded seafood consumption from analysis based on dietary patterns in this population.

In part one of our analysis, we first tested each conditional independence statement implied by the evidence-based DAG using linear (continuous outcomes), logistic (dichotomous outcomes), ordered factor response logistic (ordinal outcomes), or Bayesian kernel machine regression (BKMR; statements with metal mixtures as an exposure node) models. We considered the conditional independence statement to hold if the regression coefficient was not significant using the Wald test (for linear models, or equivalent statistic for other models). For the BKMR models, we examined the predicted mean and standard deviation for the outcome when the metals were held at their 25th versus 75th percentile values using a z-test. The metals included in this analysis were antimony (Sb), As, barium (Ba), cadmium (Cd), cesium (Cs), chromium (Cr), cobalt (Co), copper (Cu), lead (Pb), Mn, molybdenum (Mo), plutonium (Pt), selenium (Se), thallium (Tl), U, W, and zinc (Zn). If the resulting *p* value was ≥0.05, we did not reject the null hypothesis that the conditional independence statement held. We assessed the proportion of the total testable conditional independence statements that were supported by the data. We then repeated this same process 100 more times, using DAGs with the same structure but randomly permuted nodes. In theory, a lower proportion of the conditional independence statements generated by the DAGs with randomly permuted nodes should be supported by the data than the conditional independence statements generated by the evidence-based DAG. We assessed the fraction of the 100 DAGs with randomly permuted nodes for which this expectation held.

In part two of our analysis, we used DAGitty to identify the three minimally sufficient adjustment sets from the evidence-based DAG. The sets were: (1) age, ethnicity, income, obesity, hypertension, alcohol, drinking water, meat intake, smoking, and plant-based food intake; (2) age, ethnicity, income, obesity, hypertension, alcohol, drinking water, meat intake, smoking, and diet; and (3) age, ethnicity, income, obesity, hypertension, alcohol, meat intake, smoking, diet, sex, and education. We estimated BKMR models for the associations between urinary metals concentrations (total As, Cd, Mn, U, and W; comparing the 75th to the 25th percentile) and the likelihood of having a cardiometabolic outcome (separate models adjusting for each minimally sufficient adjustment set plus urinary creatinine). We conducted sensitivity analyses with the same three sets of covariates: (1) stratifying the models by smoker status (never versus current/former); and (2) accounting for potential collinearity concerns identified by Spearman correlations by removing drinking water intake and plant-based food intake from the first two models. All analyses were conducted in R (R Core Team, Vienna, Austria) or Stata v16 (StataCorp, College Station, Texas). In R, we used the package BKMR.19, 57 Figures were developed using DAGitty and ggplot2 in R.27, 58

## Results

### DAG development

We identified 29 articles that met the criteria for inclusion in the systematic literature review (**Figure 1**). These articles included eight meta-analyses, 16 literature or systematic reviews, three multi-centric cross-sectional studies, one multi-centric cohort study, and one multi-centric case-cohort study. The most commonly included metals were As (n = 13) and Cd (n = 13; **Table 1**). The evidence-based DAG illustrating the putative causal structure relating metal mixture exposures to cardiometabolic outcomes is presented in **Figure 2**. Secondary DAGs illustrating the putative causal structure relating individual metals and cardiometabolic outcomes are presented in **Supplemental Figures 1-5**.

View this table:
[Table 1.](http://medrxiv.org/content/early/2021/03/08/2021.03.05.21252993/T1)

Table 1. 
Literature review summary

### SLVDS sample description

In the SLVDS, there were 1797 participants; however, the sample size for each analysis varied by the availability of data for the variables included in the specific model. Of all participants with metals measurements (n = 1609), 53% were female and 48% were Hispanic (**Table 2**). The mean age was 54 years (standard deviation = 12 years), and 67% had one of the six cardiometabolic outcomes at first follow-up. As shown in **Table 3**, the urinary metal concentrations in the SLVDS participants were higher than those reported in the 1988-1994 and 2015-2016 National Health and Nutrition Examination Surveys (NHANES).

View this table:
[Table 2.](http://medrxiv.org/content/early/2021/03/08/2021.03.05.21252993/T2)

Table 2. 
Characteristics of participants at baseline

View this table:
[Table 3.](http://medrxiv.org/content/early/2021/03/08/2021.03.05.21252993/T3)

Table 3. 
Baseline geometric mean metal concentration (µg/L) among SLVDS participants compared with NHANES 2015-2016 and NHANES 1988-1994 participants

### DAG assessment

In total, the evidence-based DAG indicated 664 conditional independence statements. Based on data availability, there were 382 total testable conditional independence statements and 71% of these were supported by the SLVDS data (*p*≥0.05). The percentage of statements supported by the data depended on the presence of metal mixtures as a node: 67% of the 291 statements without metal mixtures as a node and 85% of the 91 statements with metal mixtures as a node were supported. Of the 100 DAGs with randomly permutated nodes, only three had >71% conditional independence statements supported by the data (**Supplemental Figure 6**).

Several nodes were almost consistently conditionally dependent on other related nodes identified in the DAG. For example, only one conditional independence statement related to cardiometabolic outcomes was significant (i.e., cardiometabolic outcomes was conditionally independent of employment status given age, education, income, physical activity, ethnicity, obesity, marriage status, sex, and diet). All other statements had a *p* ≥0.05 and were dependent. Similarly, when considering alcohol intake as a node, 20 of the 25 conditional independence statements had *p* ≥0.05, indicating the dependence statement was supported by the SLVDS data. Other nodes were less well represented by the data. Of the 18 conditional independence statements related to employment status, over half (56%) were significantly independent. A detailed list of all conditional independence statements and the corresponding *p*-values can be found in **Appendix B**.

### DAG application – pilot analysis

Using any of the three minimally sufficient adjustments sets of covariates identified by the evidence-based DAG, we did not observe strong evidence of an association between metal mixture exposures and the likelihood of having an adverse cardiometabolic outcome (**Figure 3a-c**). The strongest positive associations between any individual metal within the mixture and having a cardiometabolic outcome were observed for Cd in each of the three models. There was no indication of interaction among any metals within the mixture, and the results did not depend on the set of covariates (**Supplemental Figure 7a-c**). In sensitivity analyses stratified by smoker status, results remained relatively unchanged; however, the model using the first set of covariates for never smokers was less stable than all other models (**Supplemental Figures 8a-c and 9a-c**). In sensitivity analyses excluding drinking water intake and plant-based food intake from the relevant sets of covariates, results also remained largely unchanged (**Supplemental Figure 10a- b**).

![Figure 3a.](http://medrxiv.org/https://www.medrxiv.org/content/medrxiv/early/2021/03/08/2021.03.05.21252993/F3.medium.gif)

[Figure 3a.](http://medrxiv.org/content/early/2021/03/08/2021.03.05.21252993/F3)

Figure 3a. 
Exposure-response functions relating urinary metal concentrations to the hazard ratio (interpreted as an odds ratio) of cardiometabolic outcomes. Models adjusted for urinary creatinine (g/L), age, ethnicity (Hispanic/non-Hispanic), income, obesity, hypertension, alcohol (g/week), meat (g/week), smoking (never/former/current), drinking water (eight-ounce glasses/day), and plant-based foods (g/week).

![Figure 3b.](http://medrxiv.org/https://www.medrxiv.org/content/medrxiv/early/2021/03/08/2021.03.05.21252993/F4.medium.gif)

[Figure 3b.](http://medrxiv.org/content/early/2021/03/08/2021.03.05.21252993/F4)

Figure 3b. 
Exposure-response functions relating urinary metal concentrations to the hazard ratio (interpreted as an odds ratio) of cardiometabolic outcomes. Models adjusted for urinary creatinine (g/L), age, ethnicity (Hispanic/non-Hispanic), income, obesity, hypertension, alcohol (g/week), meat (g/week), smoking (never/former/current), drinking water (eight-ounce glasses/day), and diet.

![Figure 3c.](http://medrxiv.org/https://www.medrxiv.org/content/medrxiv/early/2021/03/08/2021.03.05.21252993/F5.medium.gif)

[Figure 3c.](http://medrxiv.org/content/early/2021/03/08/2021.03.05.21252993/F5)

Figure 3c. 
Exposure-response functions relating urinary metal concentrations to the hazard ratio (interpreted as an odds ratio) of cardiometabolic outcomes. Models adjusted for urinary creatinine (g/L), age, ethnicity (Hispanic/non-Hispanic), income, obesity, hypertension, alcohol (g/week), meat (g/day), smoking (never/former/current), diet, sex, and education (<12 years/12 years/>12 years).

## Discussion

We developed, tested, and applied an evidence-based DAG illustrating the putative causal structure underlying associations between exposure to metal mixtures and cardiometabolic health. Our approach to developing the DAG using a systematic literature review was consistent with many of the tenants of DAG development discussed elsewhere.26, 59 Our quantitative assessment of the DAG structure suggested that the evidence-based DAG was a reasonable representation of relationships among variables in a real data set. Furthermore, as demonstrated through our pilot analysis, environmental epidemiologists can apply our evidence-based DAG to transparently, reproducibly, and efficiently investigate longitudinal associations between complex environmental exposures and cardiometabolic health outcomes adjusting for one of three identified sets of covariates.

Through the systematic literature review process, we identified several critical gaps in the literature that could be more effectively and efficiently addressed using our evidence-based DAG and analytic approach (e.g., assessing metal mixtures in relation to incident cardiometabolic health outcomes). Evidence-based DAGs can guide the specification and interpretation of longitudinal models – even in complex metal mixture exposure scenarios.2, 12, 14, 31 Insights into potential biological mechanisms can be derived from evidence-based DAGs, and these DAGs can be used to develop quantitative assessments of mechanistic hypotheses within observational studies.5, 30, 31, 37, 45, 60 Additionally, future work could investigate dose-response relationships between metal mixtures and health outcomes using the BKMR analytic approach we applied.6, 9, 10

Beyond these challenges of multipollutant epidemiology that can be partially addressed through the development and application of evidence-based DAGs, we also identified several issues through our literature review that are unlikely to be handled by DAGs. DAGs can inform study design, exposure assessment priorities, and analytic model specification, but DAGs alone cannot fix fundamental problems with data collection (e.g., measurement error) or challenges of modeling environmental exposures over the life course. For example, several papers in our literature review discussed the use of urinary metal exposures as a limitation (notably one that is also present in our pilot analysis) because urinary exposures do not necessarily reflect total lifetime exposure, or even average exposure over an extended time period depending on the metal of interest and renal functioning.29, 39, 40

Our systematic literature review suggested several mechanisms through which exposure to individual metals could potentially affect cardiometabolic health outcomes; however, future work is needed to understand how metals may interact physically and/or chemically to affect health. For individual metals, much of the literature focuses on how arsenic may be associated with cardiometabolic health through mechanisms mediated by epigenetic changes,29 and through associations with immune function, endothelial dysfunction, and oxidative stress.33, 61 Similarly, there is extensive literature relating cadmium exposure to inflammatory biomarkers, kidney toxicity, endothelial dysfunction, and oxidative stress.38, 42 These types of hypotheses could be further explored using the secondary DAGs we developed for the putative relationships between individual metals and cardiometabolic health outcomes (**Supplemental Figures 1-5**).

Applying the evidence-based DAG we developed to epidemiological analyses will give environmental epidemiologists a defensible, reproducible method to identify and adjust for confounding. To the extent that new research is published challenging or adding to the DAG we show here, we encourage researchers to incorporate the new knowledge and update their covariate sets; indeed, a prime advantage of using DAGs is that we can have a scientific conversation about explicit modeling assumptions.25 For example, others may wish to include hypertension as a cardiometabolic outcome (rather than a node that could be a potential confounder). Nevertheless, given the remarkably similar results observed in our pilot analysis using each of the three minimally sufficient adjustment sets and given the DAG assessment results using the DAGs with randomly permutated nodes, we can suggest that our DAG development process was robust and that the DAG is compatible with real-world data.62

The null results of the pilot analysis may be attributable to several factors. First, it is possible that the null trends overall reflect an averaging of positive and negative effects of components within the mixture. For example, As has been positively associated with hypertension, whereas Mn has been negatively associated with hypertension.63–65 Thus, the averaging of the positive and negative effects could lead to null results. Second, we used total arsenic rather than speciated arsenic. Certain species of inorganic arsenic have been found to be more toxic than forms of inorganic and organic arsenic.33 Third, we did not have data on several nodes for the DAG (i.e., soil and ambient air quality). However, soil is more of a risk to children due to higher absorption rates and smaller sizes,66, 67 and exposure through ambient air is less common in rural areas with reduced industrial activity.68 Fourth, we may have over-adjusted or introduced co-exposure bias amplification when using BKMR; however, our sensitivity analyses suggest that the impact of these issues was minimal. Fifth, our decision to include several types of cardiometabolic health outcomes together (including sub-clinical and clinical outcomes) may have limited our ability to detect true associations with more specific outcomes. Additionally, there are several mechanisms through which individual metals can be associated with certain cardiometabolic outcomes, and these could not be assessed in this pilot analysis. In addition to these potential issues, we note limitations of our pilot analysis such as high urinary metal concentrations in the study population compared to the U.S. population, the lack of diversity in our cohort beyond non-Hispanic and Hispanic White individuals, and the limited transportability of our results to non-rural populations. However, although the pilot analysis results are not transportable outside of populations similar to our target population, the results from our extensive literature review and evidence-based DAG could be applicable to any cohort.

Through our systematic literature review incorporating evidence from multiple search engines, we were able to construct an evidence-based DAG to inform covariate selection and/or study design for future longitudinal analyses of the cardiometabolic health effects of exposure to metal mixtures. We also demonstrated an approach to explicitly state and test assumptions through our application of the evidence-based DAG to the rich SLVDS data set. We encourage other environmental epidemiologists to develop and use such tools to increase the scientific rigor, transparency, and reproducibility of their work.

## Supporting information

Supplemental Figures and Tables [[supplements/252993_file02.docx]](pending:yes)

Appendix A [[supplements/252993_file03.docx]](pending:yes)

Appendix B [[supplements/252993_file04.docx]](pending:yes)

## Data Availability

The San Luis Valley Diabetes Study (SLVDS) summary data can be shared with the scientific community in accordance with the SLVDS data sharing plan (which includes Data Use Agreements and anonymizing of data to protect subject confidentiality). Analytic code is available upon reasonable request from the corresponding author.

## Funding

Eunice Kennedy Shriver National Institute of Child Health & Human Development (NICHD) grant number K12HD092535 (Corlin), Tufts University Department of Public Health and Community Medicine (Corlin and Riseberg), Tufts Institute of the Environment (Riseberg), R00ES027853 (Alderete)

## Author disclosures

The authors report no conflicts of interest.

## Acknowledgements

We would like to thank the participants and staff of the San Luis Valley Diabetes Study.

All the intellectual property and data generated were administered according to policies from the University of Colorado and the NIH, including the NIH Data Sharing Policy and Implementation Guidance of March 5, 2003. The San Luis Valley Diabetes Study (SLVDS) summary data can be shared with the scientific community in accordance with the SLVDS data sharing plan (which includes Data Use Agreements and anonymizing of data to protect subject confidentiality). Analytic code is available upon reasonable request from the corresponding author.

## Abbreviations

As
:   arsenic
BKMR
:   Bayesian kernel machine regression
BMI
:   body mass index
CAD
:   coronary artery disease
Cd
:   cadmium
CHD
:   coronary heart disease
CVD
:   cardiovascular disease
DAG
:   directed acyclic graph
iAs
:   inorganic arsenic
Mn
:   manganese
NHANES
:   National Health and Nutrition Examination Surveys
PAD
:   peripheral artery disease
SLVDS
:   San Luis Valley Diabetes Study
T2DM
:   type 2 diabetes mellitus
U
:   uranium
W
:   tungsten

*   Received March 5, 2021.
*   Revision received March 5, 2021.
*   Accepted March 8, 2021.


*   © 2021, Posted by Cold Spring Harbor Laboratory

This pre-print is available under a Creative Commons License (Attribution-NoDerivs 4.0 International), CC BY-ND 4.0, as described at [http://creativecommons.org/licenses/by-nd/4.0/](http://creativecommons.org/licenses/by-nd/4.0/)

## References

1.  1.Kuo C-C, Moon K, Thayer KA, Navas-Acien A. Environmental Chemicals and Type 2 Diabetes: An Updated Systematic Review of the Epidemiologic Evidence. Curr Diab Rep. 2013;13(6):831–849. doi:10.1007/s11892-013-0432-6
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1007/s11892-013-0432-6&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=24114039&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2021%2F03%2F08%2F2021.03.05.21252993.atom) 

2.  2.Tyrrell J, Galloway TS, Abo-Zaid G, Melzer D, Depledge MH, Osborne NJ. High Urinary Tungsten Concentration Is Associated with Stroke in the National Health and Nutrition Examination Survey 1999–2010. PLOS ONE. 2013;8(11):e77546. doi:10.1371/journal.pone.0077546
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1371/journal.pone.0077546&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=24244278&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2021%2F03%2F08%2F2021.03.05.21252993.atom) 

3.  3.Tellez-Plaza M, Jones MR, Dominguez-Lucas A, Guallar E, Navas-Acien A. Cadmium Exposure and Clinical Cardiovascular Disease: a Systematic Review. Curr Atheroscler Rep. 2013;15(10). doi:10.1007/s11883-013-0356-2
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1007/s11883-013-0356-2&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=23955722&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2021%2F03%2F08%2F2021.03.05.21252993.atom) 

4.  4.Wang W, Xie Z, Lin Y, Zhang D. Association of inorganic arsenic exposure with type 2 diabetes mellitus: a meta-analysis. J Epidemiol Community Health. 2014;68(2):176–184. doi:10.1136/jech-2013-203114
    
    [Abstract/FREE Full Text](http://medrxiv.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6NDoiamVjaCI7czo1OiJyZXNpZCI7czo4OiI2OC8yLzE3NiI7czo0OiJhdG9tIjtzOjUwOiIvbWVkcnhpdi9lYXJseS8yMDIxLzAzLzA4LzIwMjEuMDMuMDUuMjEyNTI5OTMuYXRvbSI7fXM6ODoiZnJhZ21lbnQiO3M6MDoiIjt9) 

5.  5.Edwards J, Ackerman C. A Review of Diabetes Mellitus and Exposure to the Environmental Toxicant Cadmium with an Emphasis on Likely Mechanisms of Action. Curr Diabetes Rev. 2016;12(3):252–258.
    
    

6.  6.Nigra AE, Ruiz-Hernandez A, Redon J, Navas-Acien A, Tellez-Plaza M. Environmental Metals and Cardiovascular Disease in Adults: A Systematic Review beyond Lead and Cadmium. Curr Environ Health Rep. 2016;3(4):416–433. doi:10.1007/s40572-016-0117-9
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1007/s40572-016-0117-9&link_type=DOI) 

7.  7. Shan Zhilei,  Chen Sijing,  Sun Taoping, et al. U-Shaped Association between Plasma Manganese Levels and Type 2 Diabetes. Environ Health Perspect. 2016;124(12):1876–1881. doi:10.1289/EHP176
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1289/EHP176&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=27258818&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2021%2F03%2F08%2F2021.03.05.21252993.atom) 

8.  8.Wu X, Cobbina SJ, Mao G, Xu H, Zhang Z, Yang L. A review of toxicity and mechanisms of individual and mixtures of heavy metals in the environment. Environ Sci Pollut Res. 2016;23(9):8244–8259. doi:10.1007/s11356-016-6333-x
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1007/s11356-016-6333-x&link_type=DOI) 

9.  9.Moon KA, Oberoi S, Barchowsky A, et al. A dose-response meta-analysis of chronic arsenic exposure and incident cardiovascular disease. Int J Epidemiol. 2017;46(6):1924–1939. doi:10.1093/ije/dyx202
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1093/ije/dyx202&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=29040626&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2021%2F03%2F08%2F2021.03.05.21252993.atom) 

10. 10.Tinkov AA, Filippini T, Ajsuvakova OP, et al. Cadmium and atherosclerosis: A review of toxicological mechanisms and a meta-analysis of epidemiologic studies. Environ Res. 2018;162:240–260. doi:10.1016/j.envres.2018.01.008
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1016/j.envres.2018.01.008&link_type=DOI) 

11. 11.Long T, Wang R, Wang J, et al. Plasma metals and cardiovascular disease in patients with type 2 diabetes. Environ Int. 2019;129:497–506. doi:10.1016/j.envint.2019.05.038
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1016/j.envint.2019.05.038&link_type=DOI) 

12. 12.Zhivin S, Laurier D, Canu IG. Health effects of occupational exposure to uranium: Do physicochemical properties matter? Int J Radiat Biol. 2014;90(11):1104–1113. doi:10.3109/09553002.2014.943849
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.3109/09553002.2014.943849&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=25014993&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2021%2F03%2F08%2F2021.03.05.21252993.atom) 

13. 13.Corlin L, Rock T, Cordova J, et al. Health Effects and Environmental Justice Concerns of Exposure to Uranium in Drinking Water. Curr Environ Health Rep. 2016;3(4):434–442. doi:10.1007/s40572-016-0114-z
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1007/s40572-016-0114-z&link_type=DOI) 

14. 14.Li L, Yang X. The Essential Element Manganese, Oxidative Stress, and Metabolic Diseases: Links and Interactions. Oxid Med Cell Longev. 2018;2018. doi:10.1155/2018/7580707
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1155/2018/7580707&link_type=DOI) 

15. 15.Cui Y, Zhu Y-G, Zhai R, Huang Y, Qiu Y, Liang J. Exposure to metal mixtures and human health impacts in a contaminated area in Nanning, China. Environ Int. 2005;31(6):784–790. doi:10.1016/j.envint.2005.05.025
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1016/j.envint.2005.05.025&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=15979144&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2021%2F03%2F08%2F2021.03.05.21252993.atom) 
    
    [Web of Science](http://medrxiv.org/lookup/external-ref?access_num=000231202400003&link_type=ISI) 

16. 16.Pang Y, Peng RD, Jones MR, et al. Metal mixtures in urban and rural populations in the US: The Multi-Ethnic Study of Atherosclerosis and the Strong Heart Study. Environ Res. 2016;147:356–364. doi:10.1016/j.envres.2016.02.032
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1016/j.envres.2016.02.032&link_type=DOI) 

17. 17.Rajpathak S, Rimm EB, Li T, et al. Lower Toenail Chromium in Men With Diabetes and Cardiovascular Disease Compared With Healthy Men. Diabetes Care. 2004;27(9):2211–2216. doi:10.2337/diacare.27.9.2211
    
    [Abstract/FREE Full Text](http://medrxiv.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6NzoiZGlhY2FyZSI7czo1OiJyZXNpZCI7czo5OiIyNy85LzIyMTEiO3M6NDoiYXRvbSI7czo1MDoiL21lZHJ4aXYvZWFybHkvMjAyMS8wMy8wOC8yMDIxLjAzLjA1LjIxMjUyOTkzLmF0b20iO31zOjg6ImZyYWdtZW50IjtzOjA6IiI7fQ==) 

18. 18.Mendy A, Gasana J, Vieira ER. Urinary heavy metals and associated medical conditions in the US adult population. Int J Environ Health Res. 2012;22(2):105–118. doi:10.1080/09603123.2011.605877
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1080/09603123.2011.605877&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=21854105&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2021%2F03%2F08%2F2021.03.05.21252993.atom) 

19. 19.Bobb JF, Valeri L, Claus Henn B, et al. Bayesian kernel machine regression for estimating the health effects of multi-pollutant mixtures. Biostat Oxf Engl. 2015;16(3):493–508. doi:10.1093/biostatistics/kxu058
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1093/biostatistics/kxu058&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=25532525&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2021%2F03%2F08%2F2021.03.05.21252993.atom) 

20. 20.Tsai T-L, Kuo C-C, Pan W-H, et al. The decline in kidney function with chromium exposure is exacerbated with co-exposure to lead and cadmium. Kidney Int. 2017;92(3):710–720. doi:10.1016/j.kint.2017.03.013
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1016/j.kint.2017.03.013&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=28506761&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2021%2F03%2F08%2F2021.03.05.21252993.atom) 

21. 21. A. Francesconi K. Toxic metal species and food regulations—making a healthy choice. Analyst. 2007;132(1):17–20. doi:10.1039/B610544K
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1039/b610544k&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=17180173&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2021%2F03%2F08%2F2021.03.05.21252993.atom) 

22. 22.Rahman MM, Ng JC, Naidu R. Chronic exposure of arsenic via drinking water and its adverse health impacts on humans. Environ Geochem Health. 2009;31(1):189–200. doi:10.1007/s10653-008-9235-0
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1007/s10653-008-9235-0&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=18972068&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2021%2F03%2F08%2F2021.03.05.21252993.atom) 
    
    [Web of Science](http://medrxiv.org/lookup/external-ref?access_num=000263788300003&link_type=ISI) 

23. 23.Davis MA, Gilbert-Diamond D, Karagas MR, et al. A Dietary-Wide Association Study (DWAS) of Environmental Metal Exposure in US Children and Adults. PLOS ONE. 2014;9(9):e104768. doi:10.1371/journal.pone.0104768
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1371/journal.pone.0104768&link_type=DOI) 

24. 24.Leffler PE, Kazantzis G. Chapter 58 - Tungsten. In: Nordberg GF, Fowler BA, Nordberg M, eds. Handbook on the Toxicology of Metals (Fourth Edition). Academic Press; 2015:1297–1306. doi:10.1016/B978-0-444-59453-2.00058-5
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1016/B978-0-444-59453-2.00058-5&link_type=DOI) 

25. 25.Tennant PWG, Murray EJ, Arnold KF, et al. Use of directed acyclic graphs (DAGs) to identify confounders in applied health research: review and recommendations. Int J Epidemiol. Published online October 2020. doi:10.1093/ije/dyaa213
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1093/ije/dyaa213&link_type=DOI) 

26. 26.Corlin L, Ball S, Woodin M, et al. Relationship of Time-Activity-Adjusted Particle Number Concentration with Blood Pressure. Int J Environ Res Public Health. 2018;15(9):2036. doi:10.3390/ijerph15092036
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.3390/ijerph15092036&link_type=DOI) 

27. 27.Textor J, van der Zander B, Gilthorpe MS, Liśkiewicz M, Ellison GT. Robust causal inference using directed acyclic graphs: the R package ‘dagitty.’ Int J Epidemiol. 2016;45(6):1887–1894. doi:10.1093/ije/dyw341
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1093/ije/dyw341&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=http://www.n&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2021%2F03%2F08%2F2021.03.05.21252993.atom) 

28. 28.Afsar B, Elsurer Afsar R, Kanbay A, Covic A, Ortiz A, Kanbay M. Air pollution and kidney disease: review of current evidence. Clin Kidney J. 2019;12(1):19–32. doi:10.1093/ckj/sfy111
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1093/ckj/sfy111&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=30746128&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2021%2F03%2F08%2F2021.03.05.21252993.atom) 

29. 29.Balakrishnan P, Jones MR, Vaidya D, et al. Ethnic, Geographic, and Genetic Differences in Arsenic Metabolism at Low Arsenic Exposure: A Preliminary Analysis in the Multi-Ethnic Study of Atherosclerosis (MESA). Int J Environ Res Public Health. 2018;15(6). doi:10.3390/ijerph15061179
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.3390/ijerph15061179&link_type=DOI) 

30. 30.Beck R, Styblo M, Sethupathy P. Arsenic Exposure and Type 2 Diabetes: MicroRNAs as Mechanistic Links? Curr Diab Rep. 2017;17(3). doi:10.1007/s11892-017-0845-8
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1007/s11892-017-0845-8&link_type=DOI) 

31. 31.Bochud M, Jenny-Burri J, Pruijm M, et al. Urinary Cadmium Excretion Is Associated With Increased Synthesis of Cortico- and Sex Steroids in a Population Study. J Clin Endocrinol Metab. 2018;103(2):748–758. doi:10.1210/jc.2017-01540
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1210/jc.2017-01540&link_type=DOI) 

32. 32.Chowdhury R, Ramond A, O’Keeffe LM, et al. Environmental toxic metal contaminants and risk of cardiovascular disease: systematic review and meta-analysis. BMJ. 2018;362:k3310. doi:10.1136/bmj.k3310
    
    [Abstract/FREE Full Text](http://medrxiv.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6MzoiYm1qIjtzOjU6InJlc2lkIjtzOjE3OiIzNjIvYXVnMjlfNC9rMzMxMCI7czo0OiJhdG9tIjtzOjUwOiIvbWVkcnhpdi9lYXJseS8yMDIxLzAzLzA4LzIwMjEuMDMuMDUuMjEyNTI5OTMuYXRvbSI7fXM6ODoiZnJhZ21lbnQiO3M6MDoiIjt9) 

33. 33.Ellinsworth DC. Arsenic, Reactive Oxygen, and Endothelial Dysfunction. J Pharmacol Exp Ther. 2015;353(3):458–464. doi:10.1124/jpet.115.223289
    
    [Abstract/FREE Full Text](http://medrxiv.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6NDoianBldCI7czo1OiJyZXNpZCI7czo5OiIzNTMvMy80NTgiO3M6NDoiYXRvbSI7czo1MDoiL21lZHJ4aXYvZWFybHkvMjAyMS8wMy8wOC8yMDIxLjAzLjA1LjIxMjUyOTkzLmF0b20iO31zOjg6ImZyYWdtZW50IjtzOjA6IiI7fQ==) 

34. 34.Franceschini N, Fry R, Balakrishnan P, et al. Cadmium body burden and increased blood pressure in middle-aged American Indians: the Strong Heart Study. J Hum Hypertens. 2017;31(3):225–230. doi:10.1038/jhh.2016.67
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1038/jhh.2016.67&link_type=DOI) 

35. 35.Hecht EM, Landy DC, Ahn S, Hlaing WM, Hennekens CH. Hypothesis: Cadmium Explains, in Part, Why Smoking Increases the Risk of Cardiovascular Disease. J Cardiovasc Pharmacol Ther. 2013;18(6):550–554. doi:10.1177/1074248413494815
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1177/1074248413494815&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=24038014&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2021%2F03%2F08%2F2021.03.05.21252993.atom) 

36. 36.Kaur B, Henry J. Chapter Two - Micronutrient Status in Type 2 Diabetes: A Review. In: Henry J, ed. Advances in Food and Nutrition Research. Vol 71. Academic Press; 2014:55–100. doi:10.1016/B978-0-12-800270-4.00002-X
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1016/b978-0-12-800270-4.00002-x&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=24484939&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2021%2F03%2F08%2F2021.03.05.21252993.atom) 

37. 37.Khan F, Momtaz S, Niaz K, Hassan FI, Abdollahi M. Epigenetic mechanisms underlying the toxic effects associated with arsenic exposure and the development of diabetes. Food Chem Toxicol. 2017;107:406–417. doi:10.1016/j.fct.2017.07.021
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1016/j.fct.2017.07.021&link_type=DOI) 

38. 38.Kukongviriyapan U, Apaijit K, Kukongviriyapan V. Oxidative Stress and Cardiovascular Dysfunction Associated with Cadmium Exposure: Beneficial Effects of Curcumin and Tetrahydrocurcumin. Tohoku J Exp Med. 2016;239(1):25–38. doi:10.1620/tjem.239.25
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1620/tjem.239.25&link_type=DOI) 

39. 39.Larsson SC, Wolk A. Urinary cadmium and mortality from all causes, cancer and cardiovascular disease in the general population: systematic review and meta-analysis of cohort studies. Int J Epidemiol. 2016;45(3):782–791. doi:10.1093/ije/dyv086
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1093/ije/dyv086&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=25997435&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2021%2F03%2F08%2F2021.03.05.21252993.atom) 

40. 40.Nong Q, Zhang Y, Guallar E, Zhong Q. Arsenic Exposure and Predicted 10-Year Atherosclerotic Cardiovascular Risk Using the Pooled Cohort Equations in U.S. Hypertensive Adults. Int J Environ Res Public Health. 2016;13(11). doi:10.3390/ijerph13111093
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.3390/ijerph13111093&link_type=DOI) 

41. 41.Sanjeevi N, Freeland-Graves J, Beretvas NS, Sachdev PK. Trace Element Status in Type 2 Diabetes: A Meta-Analysis. J Clin Diagn Res. Published online 2018. doi:10.7860/JCDR/2018/35026.11541
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.7860/JCDR/2018/35026.11541&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=http://www.n&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2021%2F03%2F08%2F2021.03.05.21252993.atom) 

42. 42.Satarug S, Vesey DA, Gobe GC. Kidney Cadmium Toxicity, Diabetes and High Blood Pressure: The Perfect Storm. Tohoku J Exp Med. 2017;241(1):65–87. doi:10.1620/tjem.241.65
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1620/tjem.241.65&link_type=DOI) 

43. 43.Siddiqui K, Bawazeer N, Scaria Joy S. Variation in Macro and Trace Elements in Progression of Type 2 Diabetes. Sci World J. 2014;2014. doi:10.1155/2014/461591
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1155/2014/461591&link_type=DOI) 

44. 44.Solenkova NV, Newman JD, Berger JS, Thurston G, Hochman JS, Lamas GA. Metal Pollutants and Cardiovascular Disease: Mechanisms and Consequences of Exposure. Am Heart J. 2014;168(6):812–822. doi:10.1016/j.ahj.2014.07.007
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1016/j.ahj.2014.07.007&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=25458643&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2021%2F03%2F08%2F2021.03.05.21252993.atom) 

45. 45.Tsinovoi CL, Xun P, McClure LA, et al. Arsenic exposure in relation to ischemic stroke: The REasons for Geographic And Racial Differences in Stroke study. Stroke. 2018;49(1):19–26. doi:10.1161/STROKEAHA.117.018891
    
    [Abstract/FREE Full Text](http://medrxiv.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6OToic3Ryb2tlYWhhIjtzOjU6InJlc2lkIjtzOjc6IjQ5LzEvMTkiO3M6NDoiYXRvbSI7czo1MDoiL21lZHJ4aXYvZWFybHkvMjAyMS8wMy8wOC8yMDIxLjAzLjA1LjIxMjUyOTkzLmF0b20iO31zOjg6ImZyYWdtZW50IjtzOjA6IiI7fQ==) 

46. 46.Tsuji JS, Perez V, Garry MR, Alexander DD. Association of low-level arsenic exposure in drinking water with cardiovascular disease: A systematic review and risk assessment. Toxicology. 2014;323:78–94. doi:10.1016/j.tox.2014.06.008
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1016/j.tox.2014.06.008&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=24953689&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2021%2F03%2F08%2F2021.03.05.21252993.atom) 

47. 47.Wang W, Xie Z, Lin Y, Zhang D. Association of inorganic arsenic exposure with type 2 diabetes mellitus: a meta-analysis. J Epidemiol Community Health Lond. 2014;68(2):176. doi:[http://dx.doi.org/10.1136/jech-2013-203114](http://dx.doi.org/10.1136/jech-2013-203114)
    
    

48. 48.Hamman RF, Marshall JA, Baxter J, et al. Methods and Prevalence of Non-Insulin-Dependent Diabetes Mellitus in a Biethnic Colorado Population. Am J Epidemiol. 1989;129(2):295–311. doi:10.1093/oxfordjournals.aje.a115134
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1093/oxfordjournals.aje.a115134&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=2912042&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2021%2F03%2F08%2F2021.03.05.21252993.atom) 
    
    [Web of Science](http://medrxiv.org/lookup/external-ref?access_num=A1989R953500006&link_type=ISI) 

49. 49.Rivera-Núñez Z, Meliker JR, Meeker JD, Slotnick MJ, Nriagu JO. Urinary arsenic species, toenail arsenic, and arsenic intake estimates in a Michigan population with low levels of arsenic in drinking water. J Expo Sci Environ Epidemiol. 2012;22(2):182–190. doi:10.1038/jes.2011.27
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1038/jes.2011.27&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=21878987&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2021%2F03%2F08%2F2021.03.05.21252993.atom) 

50. 50.Symptoms and Diagnosis of Metabolic Syndrome. American Heart Association. Published 2016. Accessed June 12, 2020. [https://www.heart.org/en/health-topics/metabolic-syndrome/symptoms-and-diagnosis-of-metabolic-syndrome](https://www.heart.org/en/health-topics/metabolic-syndrome/symptoms-and-diagnosis-of-metabolic-syndrome)
    
    

51. 51.Swenson C, Marshall J, Mikulich-Gilbertson S, Baxter J, Morgenstern N. Physical activity in older, rural, Hispanic, and non-Hispanic white adults. Med Sci Sports Exerc. 2005;37:995–1002. doi:10.1249/01.mss.0000166572.91405.f5
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1249/01.mss.0000166572.91405.f5&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=15947725&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2021%2F03%2F08%2F2021.03.05.21252993.atom) 

52. 52.Marshall JA, Hamman RF, Baxter J. High-Fat, Low-Carbohydrate Diet and the Etiology of Non-Insulin-dependent Diabetes Mellitus: The San Luis Valley Diabetes Study. Am J Epidemiol. 1991;134(6):590–603. doi:10.1093/oxfordjournals.aje.a116132
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1093/oxfordjournals.aje.a116132&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=1951264&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2021%2F03%2F08%2F2021.03.05.21252993.atom) 
    
    [Web of Science](http://medrxiv.org/lookup/external-ref?access_num=A1991GL64600005&link_type=ISI) 

53. 53.Marshall JA, Weiss NS, Hamman RF. The role of dietary fiber in the etiology of non-insulin-dependent diabetes mellitus: The San Luis Valley Diabetes Study. Ann Epidemiol. 1993;3(1):18–26. doi:10.1016/1047-2797(93)90005-O
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1016/1047-2797(93)90005-O&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=8287151&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2021%2F03%2F08%2F2021.03.05.21252993.atom) 

54. 54.The Joint National Committee on Detection, Evaluation, and Treatment of High Blood Pressure. The 1980 Report of the Joint National Committee on Detection, Evaluation, and Treatment of High Blood Pressure.; 1980:6.
    
    

55. 55.Agarwal R. Blood Pressure Components and the Risk for End-Stage Renal Disease and Death in Chronic Kidney Disease. Clin J Am Soc Nephrol CJASN. 2009;4(4):830–837. doi:10.2215/CJN.06201208
    
    [Abstract/FREE Full Text](http://medrxiv.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6ODoiY2xpbmphc24iO3M6NToicmVzaWQiO3M6NzoiNC80LzgzMCI7czo0OiJhdG9tIjtzOjUwOiIvbWVkcnhpdi9lYXJseS8yMDIxLzAzLzA4LzIwMjEuMDMuMDUuMjEyNTI5OTMuYXRvbSI7fXM6ODoiZnJhZ21lbnQiO3M6MDoiIjt9) 

56. 56.Said S, Hernandez GT. The link between chronic kidney disease and cardiovascular disease. J Nephropathol. 2014;3(3):99–104. doi:10.12860/jnp.2014.19
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.12860/jnp.2014.19&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=25093157&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2021%2F03%2F08%2F2021.03.05.21252993.atom) 

57. 57.Bobb JF, Claus Henn B, Valeri L, Coull BA. Statistical software for analyzing the health effects of multiple concurrent exposures via Bayesian kernel machine regression. Environ Health Glob Access Sci Source. 2018;17(1):67. doi:10.1186/s12940-018-0413-y
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1186/s12940-018-0413-y&link_type=DOI) 

58. 58.Wickham H. Ggplot2: Elegant Graphics for Data Analysis. Springer-Verlag; 2009.
    
    

59. 59.Ferguson KD, McCann M, Katikireddi SV, et al. Evidence synthesis for constructing directed acyclic graphs (ESC-DAGs): a novel and systematic method for building directed acyclic graphs. Int J Epidemiol. 2020;49(1):322–329. doi:10.1093/ije/dyz150
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1093/ije/dyz150&link_type=DOI) 

60. 60.Corlin L. Novel Methods for Assessing Exposures and Health Effects of Ultrafine Particles and Nitrogen Oxides. ProQuest Diss Theses. Published online 2018. Accessed January 4, 2021. [https://search.proquest.com/pqdtlocal1006853/docview/2055280814/abstract/D309C40A31FC47ACPQ/4](https://search.proquest.com/pqdtlocal1006853/docview/2055280814/abstract/D309C40A31FC47ACPQ/4)
    
    

61. 61.Andrew A, Jewell D, Mason R, Whitfield M, Moore J, Karagas M. Drinking-Water Arsenic Exposure Modulates Gene Expression in Human Lymphocytes from a U.S. Population. Environ Health Perspect. 2008;116(4):524–531. doi:10.1289/ehp.10861
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1289/ehp.10861&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=18414638&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2021%2F03%2F08%2F2021.03.05.21252993.atom) 
    
    [Web of Science](http://medrxiv.org/lookup/external-ref?access_num=000254566500037&link_type=ISI) 

62. 62.Greenland S, Mansournia MA. Limitations of individual causal models, causal graphs, and ignorability assumptions, as illustrated by random confounding and design unfaithfulness. Eur J Epidemiol. 2015;30(10):1101–1110. doi:10.1007/s10654-015-9995-7
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1007/s10654-015-9995-7&link_type=DOI) 

63. 63. Mordukhovich Irina,  Wright Robert O.,  Hu Howard, et al. Associations of Toenail Arsenic, Cadmium, Mercury, Manganese, and Lead with Blood Pressure in the Normative Aging Study. Environ Health Perspect. 2012;120(1):98–104. doi:10.1289/ehp.1002805
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1289/ehp.1002805&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=21878420&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2021%2F03%2F08%2F2021.03.05.21252993.atom) 

64. 64.Abhyankar LN, Jones MR, Guallar E, Navas-Acien A. Arsenic Exposure and Hypertension: A Systematic Review. Environ Health Perspect. 2012;120(4):494–500. doi:10.1289/ehp.1103988
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1289/ehp.1103988&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=22138666&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2021%2F03%2F08%2F2021.03.05.21252993.atom) 
    
    [Web of Science](http://medrxiv.org/lookup/external-ref?access_num=000302476200016&link_type=ISI) 

65. 65.Wu C, Woo JG, Zhang N. Association between urinary manganese and blood pressure: Results from National Health and Nutrition Examination Survey (NHANES), 2011-2014. PLoS ONE. 2017;12(11). doi:10.1371/journal.pone.0188145
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1371/journal.pone.0188145&link_type=DOI) 

66. 66.Ljung K, Selinus O, Otabbong E. Metals in soils of children’s urban environments in the small northern European city of Uppsala. Sci Total Environ. 2006;366(2):749–759. doi:10.1016/j.scitotenv.2005.09.073
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1016/j.scitotenv.2005.09.073&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=16309734&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2021%2F03%2F08%2F2021.03.05.21252993.atom) 

67. 67.Poggio L, Vrščaj B, Schulin R, Hepperle E, Ajmone Marsan F. Metals pollution and human bioaccessibility of topsoils in Grugliasco (Italy). Environ Pollut. 2009;157(2):680–689. doi:10.1016/j.envpol.2008.08.009
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1016/j.envpol.2008.08.009&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=18835073&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2021%2F03%2F08%2F2021.03.05.21252993.atom) 

68. 68.Briffa J, Sinagra E, Blundell R. Heavy metal pollution in the environment and their toxicological effects on humans. Heliyon. 2020;6(9). doi:10.1016/j.heliyon.2020.e04691
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1016/j.heliyon.2020.e04691&link_type=DOI) 

69. 69.Fourth National Report on Human Exposure to Environmental Chemicals Update. Published online 2019:866.
    
    

70. 70.Paschal DC, Ting BG, Morrow JC, et al. Trace Metals in Urine of United States Residents: Reference Range Concentrations. Environ Res. 1998;76(1):53–59. doi:10.1006/enrs.1997.3793
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1006/enrs.1997.3793&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=9466897&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2021%2F03%2F08%2F2021.03.05.21252993.atom) 
    
    [Web of Science](http://medrxiv.org/lookup/external-ref?access_num=000071879800006&link_type=ISI)