Abstract
Mendelian randomization (MR) uses genetic variants as instrumental variables (IVs) to infer the causal effect of a modifiable exposure on the outcome of interest by removing unmeasured confounding bias. However, some genetic variants might be invalid IVs due to violations of core IV assumptions. MR analysis with invalid IVs might lead to biased causal effect estimate and misleading scientific conclusions. To address this challenge, we propose a novel MR method that first Selects valid genetic IVs and then performs Post-selection Inference (MR-SPI) based on two-sample genome-wide summary statistics. We analyze 912 plasma proteins using the large-scale UK Biobank proteomics data in 54,306 participants and identify 7 proteins (TREM2, PILRB, PILRA, EPHA1, CD33, RET, CD55) significantly associated with the risk of Alzheimer’s disease. We employ AlphaFold2 to predict the 3D structural alterations of these 7 proteins due to missense genetic variations, providing new insights into their biological functions in disease etiology.
1 Introduction
In biomedical studies, it is essential to infer the causal effect of a modifiable risk factor on a health outcome of interest1,2. Even though randomized controlled trials (RCTs) serve as the gold standard for causal inference, it is often neither feasible nor ethical to perform RCTs for many harmful exposures. Mendelian randomization (MR) leverages the random assortment of genes from parents to offspring to mimic RCTs to establish causality in observational studies 3,4,5. MR uses genetic variants, typically single-nucleotide polymorphisms (SNPs), as instrumental variables (IVs) to assess the causal association between an exposure and an outcome6. Recently, many MR methods have been developed to investigate causal relationships using genome-wide association study (GWAS) summary statistics data that consist of effect estimates of SNP-exposure and SNP-outcome associations from two non-overlapping sets of samples, which are commonly referred to as the two-sample MR methods7,8,9,10. Since summary statistics are often publicly available and provide abundant information of associations between genetic variants and complex traits/diseases, two-sample MR methods become increasingly popular9,11,12,13.
Conventional MR methods require the genetic variants included in the analysis to be valid IVs for reliable causal inference. A genetic variant is called a valid IV if the following three core IV assumptions hold4,14:
(A1) Relevance: The genetic variant is associated with the exposure;
(A2) Effective Random Assignment: The genetic variant is not associated with any unmeasured confounder of the exposure-outcome relationship; and
(A3) Exclusion Restriction: The genetic variant affects the outcome only through the exposure.
Among the three core IV assumptions (A1) - (A3), only the first assumption (A1) can be tested empirically by selecting genetic variants significantly associated with the exposure in GWAS. However, assumptions (A2) and (A3) cannot be empirically verified in general and may be violated in practice, which may lead to a biased estimate of the causal effect. For example, violation of (A2) may occur due to the presence of population stratification4,15; and violation of (A3) may occur in the presence of the horizontal pleiotropy4,16, which is a widespread biological phenomenon that the genetic variant affects the outcome through other biological pathways that do not involve the exposure in view17,18.
Recently, several two-sample MR methods have been proposed to handle invalid IVs under certain assumptions. The Instrument Strength Independent of Direct Effect (InSIDE) assumption has been proposed and adopted by multiple methods, for example, the random-effects inverse-variance weighted (IVW) method19, MR-Egger20, and MR-RAPS (Robust Adjusted Profile Score) 11. The InSIDE assumption requires that the SNP-exposure effect is asymptotically independent of the horizontal pleiotropic effect when the number of SNPs goes to infinity. However, the InSIDE assumption is often implausible in practice21, and thus the estimate of causal effect might be biased using random-effects IVW, MR-Egger or MR-RAPS10. Another strand of methods imposes assumptions on the proportion of invalid IVs included in the analysis. For example, the weighted median method22 and the Mendelian randomization pleiotropy residual sum and outlier (MR-PRESSO) test23 are based on the majority rule condition that allows up to 50% of the candidate IVs to be invalid. However, the weighted median method and MR-PRESSO might produce unreliable results when more than half of the candidate IVs are invalid10. Besides, the MR-PRESSO outlier test requires that the InSIDE assumption holds and that the pleiotropic effects of genetic instruments have zero mean23. The plurality rule condition, which only requires a plurality of the candidate IVs to be valid, is weaker than the majority rule condition 24,25, and is also termed as the ZEro Modal Pleiotropy Assumption (ZEMPA) 10,26. The plurality rule condition (or ZEMPA assumption) has been applied to some existing two-sample MR methods, for example, the mode-based estimation26, MRMix27 and the contamination mixture method25. Among those methods, MRMix and the contamination mixture method require additional distributional assumptions on the genetic associations, or the ratio estimates to provide reliable causal inference. Despite many efforts, most current MR methods require an ad-hoc set of pre-determined genetic instruments, which is often obtained by selecting genetic variants with strong SNP-exposure associations in GWAS28. Since such traditional way of selecting IVs only requires the exposure data, hence the same set of selected IVs is used for assessing the causal relationships between the exposure in view and different outcomes. Obviously, this one-size-fits-all exposure-specific strategy for selecting IVs might not work well for different outcomes because the underlying genetic architecture may vary across outcomes. For example, the pattern of horizontal pleiotropy might vary across different outcomes. Therefore, it is desirable to develop an automatic algorithm to select a set of valid genetic IVs for a specific exposure-outcome pair.
In this paper, we propose a novel two-sample MR method and algorithm that can automatically Select valid genetic IVs for a specific exposure-outcome pair and then performs honest Post-selection Inference (MR-SPI) for the causal effect of interest. The key idea of MR-SPI is based on the Anna Karenina Principle which states that all valid instruments are alike, while each invalid instrument is invalid in its own way – paralleling Leo Tolstoy’s dictum that “all happy families are alike; each unhappy family is unhappy in its own way”29. In other words, valid instruments will form a group and should provide similar ratio estimates of the causal effect, while the ratio estimates of invalid instruments are more likely to be different from each other. Operationally, MR-SPI consists of the following four steps: (1) select relevant genetic IVs that are associated with the exposure; (2) each selected relevant IV first provides a ratio estimate for the causal effect, and then receives votes on itself to be valid from other relevant IVs whose degrees of violation of assumptions (A2) and (A3) are smaller than a threshold as in equation (4) (thus more likely to be valid) under this ratio estimate of the causal effect; (3) select valid IVs that receive a majority/plurality of votes, or by finding the maximum clique of the voting matrix that encodes whether two relevant IVs mutually vote for each other to be valid IVs; and (4) perform post-selection inference to construct an honest confidence interval for the causal effect that is robust to any potential finite-sample IV selection error.
To the best of our knowledge, MR-SPI is the first two-sample MR method that utilizes both exposure and outcome data to automatically select a set of valid genetic IVs for a specific exposure-outcome pair. Moreover, our proposed selection procedure does not require additional distributional assumptions, for example, normal mixture distributions, to model the SNP-trait associations or ratio estimates25,27, and is more robust to possible violations of parametric distributional assumptions. Extensive simulations show that our MR-SPI method outperforms other competing MR methods under the plurality rule condition. We apply MR-SPI to infer causal relationships among 146 exposure-outcome pairs involving COVID-19 (Coronavirus disease 2019) related traits, ischemic stroke, cholesterol levels and heart diseases, and detect significant associations among them. Furthermore, we employ MR-SPI to perform omics MR (xMR) with 912 plasma proteins using the large-scale UK Biobank proteomics data in 54,306 UK Biobank participants30 and discover 7 proteins significantly associated with the risk of Alzheimer’s disease. We also use AlphaFold231,32,33 to predict the 3D structural changes of these 7 proteins due to missense genetic variations, and then illustrate the structural changes graphically using the PyMOL software (https://pymol.org).
2 Results
2.1 MR-SPI selects valid genetic instruments by a voting procedure
MR-SPI is an automatic procedure to select valid genetic instruments and perform robust causal inference using two-sample GWAS summary data. In brief, MR-SPI consists of the following four steps, as illustrated in Figure 1:
select relevant SNPs that are strongly associated with the exposure;
each relevant SNP provides a ratio estimate of the causal effect, and then all the other relevant SNPs votes for it to be a valid IV if their degrees of violation of assumptions (A2) and (A3) are smaller than a data-dependent threshold as in equation (4);
select valid SNP IVs by majority/plurality voting or by finding the maximum clique of the voting matrix that encodes whether two relevant SNP IVs mutually vote for each other to be valid (the voting matrix is defined in equation (6) in Online Methods);
estimate the causal effect of interest using the selected valid SNP IVs and construct an honest confidence interval for the causal effect that is robust to any potential IV selection error in finite samples.
Most current two-sample MR methods only use step (i) to select (relevant) genetic instruments for downstream MR analysis, while the selected genetic instruments might violate assumptions (A2) and (A3), leading to possibly unreliable scientific findings. To address this issue, MR-SPI automatically select valid genetic instruments for a specific exposure-outcome pair by further incorporating the outcome data. Our key idea of selecting valid genetic instruments is that, under the plurality rule condition, valid IVs will form the largest group and should give “similar” ratio estimates according to the Anna Karenina Principle (see Online Methods). More specifically, we propose the following two criteria to measure the similarity between the ratio estimates of two SNPs j and k in step (ii):
C1: We say the kth SNP “votes for” the jth SNP to be a valid IV if, by assuming the jth SNP is valid, the kth SNP’s degree of violation of assumptions (A2) and (A3) is smaller than a data-dependent threshold as in equation (4);
C2: We say the ratio estimates of two SNPs j and k are “similar” if they mutually vote for each other to be valid.
In step (iii), we construct a symmetric binary voting matrix to encode the votes that each relevant SNP receives from other relevant SNPs: the (k, j) entry of the voting matrix is 1 if SNPs j and k mutually vote for each other to be valid, and 0 otherwise. We propose two ways to select valid genetic instruments based on the voting matrix (see Online Methods): (1) select relevant SNPs who receive majority voting or plurality voting as valid IVs; and (2) use SNPs in the maximum clique of the voting matrix as valid IVs34. Our simulation studies show that the maximum clique method can empirically offer lower false discovery rate (FDR) 35 and higher true positive proportion (TPP) as shown in Table S4 and Supplementary Section S6.
In step (iv), we estimate the causal effect by fitting a zero-intercept ordinary least squares (OLS) regression of SNP-outcome associations on SNP-exposure associations using the set of selected valid genetic instruments, and then construct a standard confidence interval for the causal effect using standard linear regression theory. In finite samples, some invalid IVs with small (but still nonzero) degrees of violation of assumptions (A2) and (A3) might be incorrectly selected as valid IVs, commonly referred to as “locally invalid IVs” 36. To address this possible issue, we propose to construct a robust confidence interval with a guaranteed nominal coverage even in the presence of IV selection error in finite-sample settings using a searching and sampling method 36, as described in Figure 5 and Online Methods.
2.2 Comparing MR-SPI to other competing MR methods in simulation studies
We conduct extensive simulations to evaluate the performance of MR-SPI in the presence of invalid IVs. We simulate data in a two-sample setting under four setups: (S1) majority rule condition holds, and no locally invalid IVs exist; (S2) plurality rule condition holds, and no locally invalid IVs exist; (S3) majority rule condition holds, and locally invalid IVs exist; (S4) plurality rule condition holds, and locally invalid IVs exist. More detailed simulation settings are described in Online Methods. We compare MR-SPI to the following competing MR methods: (i) the random-effects IVW method19, (ii) MR-RAPS11, (iii) MR-PRESSO23, (iv) the weighted median method22, (v) the mode-based estimation 26, (vi) MRMix27, and (vii) the contamination mixture method25. We exclude MR-Egger in this simulation since it is heavily biased under our simulation settings.
For simplicity, we shall use IVW to represent the random-effects IVW method hereafter.
In Figure 2, we present the percent bias, empirical coverage, and average lengths of 95% confidence intervals of the aforementioned MR methods in simulated data with a sample size of 5,000 for both the exposure and the outcome. Additional simulation results under a range of sample sizes (n = 5,000, 10,000, 20,000, 40,000, 80,000) can be found in Supplementary Figure S1 and Tables S1-S3. When the plurality rule condition holds and no locally invalid IVs exist, MR-SPI has small bias and short confidence interval, and the empirical coverage can attain the nominal level, suggesting the superior performance of MR-SPI. When locally invalid IVs exist, the standard confidence interval might suffer from finite-sample IV selection error, and thus the empirical coverage is lower than 95% if the sample sizes are not large (e.g., 5,000). In practice, we can perform sensitivity analysis of the causal effect estimate by changing the threshold in the voting step (see Online Methods and Supplementary Figure S13). If the causal effect estimate is sensitive to the choice of the threshold, then there might exist finite-sample IV selection error. In such cases, the proposed robust confidence interval of MR-SPI can still attain the 95% coverage level and thus is recommended for use.
2.3 Learning causal relationships of 146 exposure-outcome pairs
In this section, we examine the causal relationships between complex traits and diseases from four categories including ischemic stroke, cholesterol levels, heart diseases, and coronavirus disease 2019 (COVID-19) related traits. We exclude the trait pairs whose exposure and outcome are in the same consortium or are two similar phenotypes (for example, heart failure and coronary artery disease), and we finally obtain 146 pairwise exposure-outcome combinations. Among the 146 exposure-outcome pairs, MR-SPI detects invalid IVs for 16 exposure-outcome pairs. For example, MR-SPI detects one invalid SNP (rs616154, marked by red triangle) in the causal relationship from cardioembolic stroke (CES) to SARS-CoV-2 infection, as illustrated in Figure 3(a). Using the PhenoScanner tool37,38, we find that SNP rs616154 is also associated with the Interleukin-6 (IL-6) levels which is a potential biomarker of COVID-19 progression39, indicating that this SNP might exhibit horizontal pleiotropy in the relationship of cardioembolic stroke on SARS-CoV-2 infection and might be an invalid IV.
After excluding those potentially invalid IVs, MR-SPI identifies 27 significant associations after Bonferroni correction for multiple comparison 40, with results summarized in Figure 3(c). MR-SPI detects some significant associations that cannot be discovered by other competing MR methods considered in this paper. For example, MR-SPI suggests that SARS-CoV-2 infection might be a risk factor for HF, which is consistent with a former study that reported a significant increase in the risk of developing acute heart failure in patients with confirmed COVID-19 infection 41. We also present the Venn diagram of the significant pairs using MR-SPI, the mode-based estimation, MRMix and the contamination mixture method in Figure 3(b), as these four methods are all based on the plurality rule condition. Using the robust confidence intervals constructed by Algorithm 2 in Online Methods, MR-SPI also discovers four significant associations that are immune to finite-sample IV selection error (CES on heart failure (HF), low-density lipoprotein (LDL) on coronary artery disease (CAD), total cholesterol (TC) on CAD, and atrial fibrillation (AF) on CES), as shown in Figure 3(d). More detailed results can be found in Supplementary Section S10.
2.4 Identifying plasma proteins associated with the risk of Alzheimer’s disease
Omics MR (xMR) aims to identify omics biomarkers (e.g., proteins) causally associated with complex traits and diseases. In particular, xMR with proteomics data enables the identification of disease-associated proteins, facilitating crucial advancements in disease diagnosis, monitoring, and novel drug target discovery. In this section, we apply MR-SPI to identify plasma protein biomarkers putatively causally associated with the risk of Alzheimer’s disease (AD). The proteomics data used in our analysis comprises 54,306 participants from the UK Biobank Pharma Proteomics Project (UKB-PPP)30. Following the guidelines30, significant (p-value < 3.40 × 10−11, accounting for Bonferroni correction) and independent (r2 < 0.01) SNPs are extracted from the proteomics data as candidate genetic instruments, and thus all of these candidates SNPs are strongly associated with the exposures (proteins). Summary statistics for AD are obtained from a meta-analysis of GWAS studies for clinically diagnosed AD and AD-by-proxy, comprising 455,258 samples in total 42. For MR method comparison, we analyze 912 plasma proteins that share four or more candidate SNPs within the summary statistics for AD, because the implementation of MR-PRESSO requires a minimum of four SNPs as candidate IVs23.
As presented in Figure 4(a), MR-SPI identifies 7 proteins that are significantly associated with AD after Bonferroni correction, including CD33, CD55, EPHA1, PILRA, PILRB, RET, and TREM2. The detailed information of the selected SNP IVs for these 7 proteins can be found in Supplementary Table S6. Among them, four proteins (CD33, PILRA, PILRB, and RET) are positively associated with the risk of AD while the other three proteins (CD55, EPHA1, and TREM2) are negatively associated with the risk of AD. Previous studies have revealed that some of those 7 proteins and the corresponding protein-coding genes might contribute to the pathogenesis of AD43,44,45,46,47,48. For example, it has been found that CD33 plays a key role in modulating microglial pathology in AD, with TREM2 acting downstream in this regulatory pathway45. Besides, a recent study has shown that a higher level of soluble TREM2 is associated with protection against the progression of AD pathology49. Additionally, RET at mitochondrial complex I is activated during ageing, which might contribute to an increased risk of ageing-related diseases including AD47. Using the UniProt database50, we also find that genes encoding these 7 proteins are overexpressed in tissues including hemopoietic tissues and brain, as well as cell types including microglial, macrophages and dendritic cells. These findings highlight the potential therapeutic opportunities that target these proteins for the treatment of AD. Furthermore, in the Therapeutic Target Database (TTD)51 and DrugBank database52, we find existing US Food and Drug Administration (FDA)-approved drugs that target these proteins identified by MR-SPI. For example, gemtuzumab ozogamicin is a drug that targets CD33 and has been approved by FDA for acute myeloid leukemia therapy53,54. Besides, pralsetinib and selpercatinib are two RET inhibitors that have been FDA-approved for the treatment of non-small-cell lung cancers 55,56. Therefore, these drugs might be potential drug repurposing candidates for the treatment of AD.
In Figure 4(b), we present the 3D structural alterations of CD33 due to missense genetic variation of SNP rs2455069, as predicted by AlphaFold231,32. The 3D structures are shown in blue when the allele is A, and in red when the allele is G at SNP rs2455069 A/G, which is a cis-SNP located on chromosome 19 (19q13.41) and is selected as a valid IV by MR-SPI. The presence of the G allele at SNP rs2455069 results in the substitution of the 69th amino acid of CD33, changing it from Arginine (colored in green if the allele is A) to Glycine (colored in yellow if the allele is G), consequently causing a local change in the structure of CD33. Previous studies have found that CD33 is overexpressed in microglial cells in the brain57, and the substitution of Arginine to Glycine in the 69th amino acid of CD33 might lead to the accumulation of amyloid plaques in the brain58, thus the presence of the G allele at SNP rs2455069 might contribute to an increased risk of AD. We also apply AlphaFold2 to predict the 3D structures of the other 6 proteins that are detected to be significantly associated with AD by MR-SPI, which are presented in Supplementary Figure S15.
In Figure 4(c), we present the point estimates and 95% confidence intervals of the causal effects (on the log odds ratio scale) of these 7 proteins on AD using the other competing MR methods. In Figure 4(b), these proteins are identified by most of the competing MR methods, confirming the robustness of our findings. Notably, in the relationship of TREM2 on AD, MR-SPI detects one possibly invalid IV SNP rs10919543, which is associated with red blood cell count according to PhenoScanner. Red blood cell count is a known risk factor for AD 59,60, and thus SNP rs10919543 might exhibit pleiotropy in the relationship of TREM2 on AD. After excluding this potentially invalid IV, MR-SPI suggests that TREM2 is negatively associated with the risk of AD (, p-value = 1.20 × 10−18). Additionally, we perform the gene ontology (GO) enrichment analysis using the g:Profiler web server61 (https://biit.cs.ut.ee/gprofiler/gost) to gain more biological insights for the 7 proteins identified by MR-SPI, and the results are presented in Figure 4(d) and Supplementary Table S7. After Bonferroni correction, the GO analysis indicates that these 7 proteins are significantly enriched in 20 GO terms, notably, the positive regulation of phosphorus metabolic process and major histocompatibility complex (MHC) class I protein binding. It has been found that increased phosphorus metabolites (e.g., phosphocreatine) are associated with aging, and that defects in metabolic processes for phospholipid membrane function is involved in the pathological progression of Alzheimer’s disease62,63. In addition, MHC class I proteins may play a crucial role in preserving brain integrity during post-developmental stages, and modulation of the stability of MHC class I proteins emerges as a potential therapeutic target for restoring synaptic function in AD64,65,66.
3 Discussion
In this paper, we develop a novel two-sample MR method called MR-SPI, to automatically select valid genetic instruments for a specific exposure-outcome pair from GWAS studies and perform valid post-selection inference. MR-SPI first selects relevant IVs with strong SNP-exposure associations, and then applies the proposed voting procedure to select valid IVs whose ratio estimates are similar to each other as valid IVs. In the possible presence of locally invalid IVs in finite-sample settings, MR-SPI provides a robust confidence interval constructed by the searching and sampling method36, which is immune to finite-sample IV selection error. We employ MR-SPI to conduct xMR analysis with 912 plasma proteins using the proteomics data in 54,306 UK Biobank participants and identify 7 proteins significantly associated with the risk of Alzheimer’s disease. The 3D structural changes in these proteins, as predicted by AlphaFold2 in response to missense genetic variations of selected SNP IVs, shed new insights to their biological functions in the etiology of Alzheimer’s disease. We also find existing FDA-approved drugs that target some of our identified proteins, which provide opportunities for potential existing drug repurposing for the treatment of Alzheimer’s disease. These findings highlight the great potential of MR-SPI as a powerful tool for identifying protein biomarkers as new therapeutic targets and drug repurposing for disease prevention and treatment.
We emphasize two main advantages of MR-SPI. First, MR-SPI incorporates both exposure and outcome data to automatically select a set of valid genetic instruments in genome-wide studies, and the selection procedure does not rely on any additional distributional assumptions on the genetic effects. Therefore, MR-SPI is the first to offer such a practically robust approach to selecting valid genetic instruments for a specific exposure-outcome pair from GWAS studies for more reliable MR analyses, which is especially advantageous in the presence of wide-spread horizontal pleiotropy. Second, we propose a robust confidence interval for the causal effect using the searching and sampling method, which is immune to finite-sample IV selection error. Therefore, when locally invalid IVs are incorrectly selected and the causal effect estimate is biased in finite samples, MR-SPI can still provide reliable inference for the causal effect using the proposed robust confidence interval.
MR-SPI also has some limitations. First, MR-SPI uses independent SNPs from two non-overlapping samples. For future work, we plan to extend MR-SPI to include SNPs with arbitrary linkage disequilibrium (LD) structure from GWAS summary statistics of two possibly overlapping samples. Second, the proposed robust confidence interval is slightly more conservative than the confidence interval calculated from the limiting distribution of the causal effect estimate, which is the price to pay for the gained robustness to finite-sample IV selection error. Future work is needed to construct less conservative confidence intervals that are robust to finite-sample IV selection error.
In conclusion, MR-SPI provides an automatic approach to selecting valid genetic instruments among candidate SNPs and performs reliable causal inference using two-sample GWAS summary statistics. Our software is user-friendly and computationally efficient. Therefore, MR-SPI can help detect more trustworthy causal relationships with increasingly rich and publicly available GWAS and multi-omics datasets.
Data Availability
All data produced in the present study are available upon reasonable request to the authors.
Software availability
The R package MR.SPI is publicly available at https://github.com/MinhaoYaooo/MR-SPI.
Data availability
All the GWAS data analyzed are publicly available with the following URLs:
CARDIoGRAMplusC4D consortium: http://www.cardiogramplusc4d.org/data-downloads/;
GIANT consortium: https://portals.broadinstitute.org/collaboration/giant/index.php/GIANT_consortium_data_files;
MEGASTROKE consortium: http://megastroke.org/download.html;
Global Lipids Genetics Consortium (GLGC): http://csg.sph.umich.edu/willer/public/lipids2013/;
GWAS for heart failure: https://www.ebi.ac.uk/gwas/publications/31919418;
GWAS for atrial fibrillation: https://www.ebi.ac.uk/gwas/publications/30061737;
The COVID-19 Host Genetics Initiative: https://www.covid19hg.org/;
GWAS for Alzheimer’s disease: https://ctg.cncr.nl/software/summary_statistics;
UK Biobank proteomics data: https://www.biorxiv.org/content/10.1101/2022.06.17.496443v1.supplementary-material.
Online Methods
Two-sample GWAS summary statistics
Suppose that we obtain p independent SNPs Z = (Z1,…, Zp)⊺ by using LD clumping that retains one representative SNP per LD region67. We also assume that the SNPs are standardized68 such that 𝔼Zj = 0 and Var(Zj) = 1 for 1 ≤ j ≤ p. Let D denote the exposure and Y denote the outcome. We assume that D and Y follow the exposure model D = Z⊺γ +δ and the outcome model Y = Dβ + Z⊺π + e, respectively, where β represents the causal effect of interest, γ = (γ1, …, γp)⊺ represents the IV strength, and π = (π1, …, πp)⊺ encodes the violation of assumptions (A2) and (A3)24,69. If assumptions (A2) and (A3) hold for SNP j, then πj = 0 and otherwise πj ≠ 0 (see Supplementary Section S1 for details). The error terms δ and e with respective variances and are possibly correlated due to unmeasured confounding factors. By plugging the exposure model into the outcome model, we obtain the reduced-form outcome model Y = Z⊺(βγ + π) + ϵ, where ϵ = βδ + e. Let Γ = (Γ1, …, Γp)⊺ denote the SNP-outcome associations, then we have Γ = βγ + π. If γj ≠ 0, then SNP j is called a relevant IV. If both γj ≠ 0 and πj = 0, then SNP j is called a valid IV. Let 𝒮 = {j : γj ≠ 0, 1 ≤ j ≤ p} denote the set of all relevant IVs, and 𝒱= {j : γj ≠ 0 and πj = 0, 1 ≤ j ≤ p} denote the set of all valid IVs. The majority rule condition can be expressed as 69, and the plurality rule condition can be expressed as |𝒱| > maxc≠0 |{j ∈ 𝒮: πj/γj = c}|24. If the plurality rule condition holds, then valid IVs with the same ratio of SNP-outcome effect to SNP-exposure effect will form a plurality. Based on this key observation, our proposed MR-SPI selects the largest group of SNPs as valid IVs with similar ratio estimates of the causal effect using a voting procedure described in detail in the next subsection.
Let and be the estimated marginal effects of SNP j on the exposure and the outcome, and and be the corresponding estimated standard errors respectively. Let and denote the vector of estimated SNP-exposure and SNP-outcome associations, respectively. In the two-sample setting, the summary statistics and are calculated from two non-overlapping samples with sample sizes n1 and n2 respectively. When all the SNPs are independent of each other, the joint asymptotic distribution of and is where the diagonal entries of Vγ and VΓ are and , respectively, and the off-diagonal entries of Vγ and VΓ are and , respectively. The derivation of the limit distribution can be found in Supplementary Section S2. Therefore, with the summary statistics of the exposure and the outcome, we estimate the covariance matrices and as: After obtaining , we then perform the proposed IV selection procedure as illustrated in Figure 1 in the main text.
Selecting valid instruments by voting
The first step of MR-SPI is to select relevant SNPs with large IV strength using GWAS summary statistics for the exposure. Specifically, we estimate the set of relevant IVs 𝒮 by: where is the standard error of in the summary statistics, Φ−1(·) is the quantile function of the standard normal distribution, and α* is the user-specified threshold with the default value of 1 × 10−6. This step is equivalent to filtering the SNPs in the exposure data with p-value < α*, and is adopted by most of the current two-sample MR methods to select (relevant) genetic instruments for downstream MR analysis. Note that the selected genetic instruments may not satisfy the IV independence and exclusion restriction assumptions and thus maybe invalid. In contrast, our proposed MR-SPI further incorporates the outcome data to automatically select a set of valid genetic instruments from for a specific exposure-outcome pair.
Under the plurality rule condition, valid genetic instruments with the same ratio of SNP-outcome effect to SNP-exposure effect (i.e., Γj/γj) will form a plurality and yield “similar” ratio estimates of the causal effect. Based on this key observation, MR-SPI selects a plurality of relevant IVs whose ratio estimates are “similar” to each other as valid IVs. Specifically, we propose the following two criteria to measure the similarity between the ratio estimates of two SNPs j and k:
C1: We say the kth SNP “votes for” the jth SNP to be a valid IV if, by assuming the jth SNP is valid, the kth SNP’s degree of violation of assumptions (A2) and (A3) is smaller than a threshold as in equation (4);
C2: We say the ratio estimates of two SNPs j and k are “similar” if they mutually vote for each other to be valid IVs.
The ratio estimate of the jth SNP is defined as . By assuming the jth SNP is valid, the plug-in estimate of the kth SNP’s degree of violation of (A2) and (A3) can be obtained by as we have Γk = βγk + πk for the true causal effect β, and for the ratio estimate of the kth SNP. From equation (3), has two noteworthy implications. First, measures the difference between the ratio estimates of SNPs j and k (multiplied by the kth SNP-exposure effect estimate ), and a small implies that the difference scaled by is small. Second, represents the kth IV’s degree of violation of assumptions (A2) and (A3) by regarding the jth SNP’s ratio estimate as the true causal effect, thus a small implies a strong evidence that the kth IV supports the jth IV to be valid. Therefore, we say the kth IV votes for the jth IV to be valid if: where is the standard error of , which is given by: and the term in equation (4) ensures that the violation of (A2) and (A3) can be correctly detected with probability one as the sample sizes go to infinity, as shown in Supplementary Section S3.
For each relevant IV in , we collect all relevant IVs’ votes on whether it is a valid IV according to equation (4). Then we construct a voting matrix to summarize the voting results and evaluate the similarity of two SNPs’ ratio estimates according to criterion C2. Specifically, we define the (k, j) entry of as: where I(·) is the indicator function such that I(A) = 1 if event A happens and I(A) = 0 otherwise. From equation (6), we can see that the voting matrix is symmetric, and the entries of are binary: represents SNPs j and k vote for each other to be a valid IV, i.e., the ratio estimates of these two SNPs are close to each other; represents that they do not. For example, in Figure 1, since the ratio estimates of SNPs 1 and 2 are similar, while because the ratio estimates of SNPs 1 and 4 differ substantially, as SNPs 1 and 4 mutually “vote against” each other to be valid according to equation (4).
After constructing the voting matrix , we select the valid IVs by applying majority/plurality voting or finding the maximum clique of the voting matrix34. Let be the total number of SNPs whose ratio estimates are similar to SNP k. For example, VM1 = 3 in Figure 1, since three SNPs (including SNP 1 itself) yield similar ratio estimates to SNP 1 according to criterion C2. A large VMk implies a strong evidence that SNP k is a valid IV, since we assume that valid IVs form a plurality of the relevant IVs. Let denote the set of IVs with majority voting, and denote the set of IVs with plurality voting, then the union can be a robust estimate of 𝒱 in practice. Alternatively, we can also find the maximum clique in the voting matrix as an estimate of 𝒱. A clique in the voting matrix is a group of IVs who mutually vote for each other to be valid, and the maximum clique is the clique with the largest possible number of IVs34.
Estimation and inference of the causal effect
After selecting the set of valid genetic instruments , the causal effect β is estimated by where and are the estimates of SNP-exposure associations and SNP-outcome associations of the selected valid IVs in , respectively. The MR-SPI estimator in equation (7) is the regression coefficient obtained by fitting a zero-intercept ordinary least squares regression of on . Since the SNPs are standardized, the genetic associations and are scaled by (compared to the genetic associations calculated using the unstandardized SNPs, denoted by and ), where fj is the minor allele frequency of SNP j. As fj(1− fj) is approximately proportional to the inverse variance of when each SNP IV explains only a small proportion of variance in the outcome 70, the MR-SPI estimator of the causal effect in equation (7) is approximately equal to the inverse-variance weighted estimator19 calculated with .
Let α ∈ (0, 1) be the significance level and z1−α/2 be the (1 − α/2)-quantile of the standard normal distribution, then the (1 − α) confidence interval for β is given by: where is the estimated var iance of , which can be found in Supplementary Section S4. As min{n1, n2} → ∞, we have under the plurality rule condition, as shown in Supplementary Section S5. Hence, MR-SPI provides a theoretical guarantee for the asymptotic coverage probability of the confidence interval under the plurality rule condition.
We summarize the proposed procedure of selecting valid IVs and constructing the corresponding confidence interval by MR-SPI in Algorithm 1.
Selecting Valid Instruments and Performing Inference of the Causal Effect by MR-SPI
A robust confidence interval via searching and sampling
In finite-sample settings, the selected set of relevant IVs might include some invalid IVs whose degrees of violation of (A2) and (A3) are small but nonzero, and we refer to them as “locally invalid IVs”36. When locally invalid IVs exist and are incorrectly selected into , the confidence interval in equation (8) becomes unreliable, since its validity (i.e., the coverage probability attains the nominal level) requires that the invalid IVs are correctly filtered out. In practice, we can multiply the threshold in the right-hand side of equation (4) by a scaling factor η to examine whether the confidence interval calculated by equation (8) is sensitive to the choice of the threshold. If the confidence interval varies substantially to the choice of the scaling factor η, then there might exist finite-sample IV selection error especially with locally invalid IVs. We demonstrate this issue with two numerical examples presented in Supplementary Figure S13. Supplementary Figure S13(a) shows an example in which MR-SPI provides robust inference across different values of the scaling factor, while Supplementary Figure S13(b) shows an example that MR-SPI might suffer from finite-sample IV selection error, as the causal effect estimate and the corresponding confidence interval are sensitive to the choice of the scaling factor η. This issue motivates us to develop a more robust confidence interval.
To construct a confidence interval that is robust to finite-sample IV selection error, we borrow the idea of searching and sampling36, with main steps described in Figure 5. The key idea is to sample the estimators of γ and Γ repeatedly from the following distribution: where M is the number of sampling times (by default, we set M = 1, 000). Since and follow distributions centered at γ and Γ, there exists m* such that and are close enough to the true values γ and Γ when the number of sampling times M is sufficiently large, and thus the confidence interval obtained by using and instead of and might have a larger probability of covering β.
For each sampling, we construct the confidence interval by searching over a grid of β values such that more than half of the selected IVs in are detected as valid. As for the choice of grid, we start with the smallest interval [L, U] that contains all the following intervals: where is the ratio estimate of the jth SNP, is the variance of , and serves the same purpose as in equation (4). Then we discretize [L, U ] into ℬ = {b1, b2, · · ·, bK} as the grid set such that b1 = L, bK = U and for 1 ≤ k ≤ K − 2, where nmin = min(n1, n2). We set the grid size so that the error caused by discretization is smaller than the parametric rate .
For each grid value b ∈ ℬ and sampling index 1 ≤ m ≤ M, we propose an estimate of πj by for , where is a data-dependent threshold, Φ−1(·) is the inverse of the cumulative distribution function of the standard normal distribution, α ∈ (0, 1) is the significance level, and (λ < 1 when M is sufficiently large) is a scaling factor to make the thresholding more stringent so that the confidence interval in each sampling is shorter, as we will show shortly. Here, indicates that the jth SNP is detected as a valid IV in the mth sampling if we take as the estimates of genetic associations and b as the true causal effect. Let , then we construct the mth sampling’s pseudo confidence interval pCI(m) by searching for the smallest and largest b ∈ ℬ such that more than half of SNPs in are detected to be valid. Define and , then the mth sampling’s pseudo confidence interval is constructed as .
From the definitions of and pCI(m), we can see that, when λ is smaller, there will be fewer SNPs in being detected as valid for a given b ∈ ℬ, which leads to fewer b ∈ ℬ satisfying , thus the pseudo confidence interval in each sampling will be shorter. If there does not exist b ∈ℬ such that the majority of IVs in are detected as valid, we set pCI(m) = ∅. Let ℳ = {1 ≤ m ≤ M : pCI(m) ≠ ∅} denote the set of all sampling indexes corresponding to non-empty searching confidence intervals, then the proposed robust confidence interval is given by: We summarize the procedure of constructing the proposed robust confidence interval in Algorithm 2.
Constructing A Robust Confidence Interval via Searching and Sampling
Simulation settings
We set the number of candidate IVs p = 10, as the average number of candidate SNP IVs for the plasma proteins in the UK Biobank proteomics data is around 7.4. We set the sample sizes n1 = n2 ∈ {5,000, 10,000, 20,000, 40,000, 80,000}. We generate the jth genetic instruments Zj and Xj independently from a binomial distribution Bin(2, fj), where fj ∼ U (0.05, 0.50) is the minor allele frequency of SNP j. Then we generate the exposure and the outcome according to the exposure model and the outcome model, respectively. Finally, we calculate the genetic associations and their corresponding standard errors for the exposure and the outcome, respectively. As for the parameters, we fix the causal effect β = 1, and we consider 4 settings for γ ∈ ℝp and π ∈ ℝp:
(S1): set γ = 0.2 · (15, −15)⊺ and π = 0.2 · (06, 14)⊺.
(S2): set γ = 0.2 · (15, −15)⊺ and π = 0.2 · (04, 13, −13)⊺.
(S3): set γ = 0.2 · (15, −15)⊺ and π = 0.2 · (06, 12, 0.25, 0.25)⊺.
(S4): set γ = 0.2 · (15, −15)⊺ and π = 0.2 · (04, 12, 0.25, 12, −0.25)⊺.
Settings (S1) and (S3) satisfy the majority rule condition, while (S2) and (S4) only satisfy the plurality rule condition. In addition, (S3) and (S4) simulate the cases where locally invalid IVs exist, as we shrink some of the SNPs’ violation degrees of assumptions (A2) and (A3) down to 0.25 times in these two settings. In total, we run 1,000 replications in each setting.
Implementation of existing MR methods
We compare the performance of MR-SPI with eight other MR methods in simulation studies and real data analyses. These methods are implemented as follows:
Random-effects IVW, MR-Egger, the weighted median method, the mode-based estimation and the contamination mixture method are implemented in the R package “MendelianRandomization” (https://github.com/cran/MendelianRandomization). The mode-based estimation is run with “iteration=1000”. All other methods are run with the default parameters.
MR-PRESSO is implemented in the R package “MR-PRESSO” (https://github.com/rondolab/MR-PRESSO) with outlier test and distortion test.
MR-RAPS is performed using the R package “mr.raps” (https://github.com/qingyuanzhao/mr.raps) with the default options.
MRMix is run with the R package “MRMix” (https://github.com/gqi/MRMix) using the default options.
Footnotes
Figures revised.
References
- [1].↵
- [2].↵
- [3].↵
- [4].↵
- [5].↵
- [6].↵
- [7].↵
- [8].↵
- [9].↵
- [10].↵
- [11].↵
- [12].↵
- [13].↵
- [14].↵
- [15].↵
- [16].↵
- [17].↵
- [18].↵
- [19].↵
- [20].↵
- [21].↵
- [22].↵
- [23].↵
- [24].↵
- [25].↵
- [26].↵
- [27].↵
- [28].↵
- [29].↵
- [30].↵
- [31].↵
- [32].↵
- [33].↵
- [34].↵
- [35].↵
- [36].↵
- [37].↵
- [38].↵
- [39].↵
- [40].↵
- [41].↵
- [42].↵
- [43].↵
- [44].↵
- [45].↵
- [46].↵
- [47].↵
- [48].↵
- [49].↵
- [50].↵
- [51].↵
- [52].↵
- [53].↵
- [54].↵
- [55].↵
- [56].↵
- [57].↵
- [58].↵
- [59].↵
- [60].↵
- [61].↵
- [62].↵
- [63].↵
- [64].↵
- [65].↵
- [66].↵
- [67].↵
- [68].↵
- [69].↵
- [70].↵