Characterizing Treatment Non-responders vs. Responders in Completed Alzheimer’s Disease Clinical Trials
=========================================================================================================

* Dulin Wang
* Yaobin Ling
* Kristofer Harris
* Paul E. Schulz
* Xiaoqian Jiang
* Yejin Kim

## Abstract

Alzheimer’s disease (AD) patients have varying responses to AD drugs and there may be no single treatment for all AD patients. Trial after trial shows that identifying non-responsive and responsive subgroups and their corresponding moderators will provide better insights into subject selection and interpretation in future clinical trials. We aim to extensively investigate pre-treatment features that moderate treatment effect of Galantamine, Bapineuzumab, and Semagacestat from completed trial data. We obtained individual-level patient data from ten randomized clinical trials. Six Galantamine trials and two Bapineuzumab trials were from Yale University Open Data Access Project and two Semagacestat trials were from the Center for Global Clinical Research Data. We included a total of 10,948 subjects. The trials were conducted worldwide from 2001 to 2012. We estimated treatment effect using causal forest modeling on each trial. Finally, we identified important pre-treatment features that determine treatment efficacy and identified responsive or nonresponsive subgroups. As a result, patient’s pre-treatment conditions that determined the treatment efficacy of Galantamine differed by dementia stages, but we consistently observed that non-responders in Galantamine trials had lower BMI (25 vs 28, *P* < .001) and increased ages (74 vs 68, *P* < .001). Responders in Bapineuzumab and Semagacestat trials had lower Aβ42levels (6.41 vs 6.53 pg/ml, *P* < .001) and smaller whole brain volumes (983.13 vs 1052.78 ml, *P* < .001). 6 ‘positive’ treatment trials had subsets of patients who had, in fact, not responded. 4 “negative” treatment trials had subsets of patients who had, in fact, responded. This study suggests that analyzing heterogeneity in treatment effects in “positive” or “negative” trials may be a very powerful tool for identifying distinct subgroups that are responsive to treatments, which may significantly benefit future clinical trial design and interpretation.

## Introduction

The current understanding and treatment approach towards Alzheimer’s disease (AD) presents substantial challenges, especially in the context of differential responses to medication between patients. Responsiveness (high efficacy) or non-responsiveness (low efficacy) to AD treatment might be related to certain moderators. A previous study indicated that one-third of AD patients do not respond to pharmacological treatment.1 Different moderators, such as sex or gender,2 the presence of comorbid illness,3 and long-term administration of other medications (e.g., antihypertensives),3 might contribute to different responses of AD patients to treatments. Because a one-size-fits-all treatment is not likely to be available for AD in the near future, identifying non-responsive or responsive subgroups and their corresponding moderators will provide better insights into subject selection in future clinical trials.

Identifying patient subgroups with differential responses to treatment requires counterfactual analysis, which compares the outcomes of patients who actually received the treatment (factual outcome) with the outcomes when the same patients would not have received the treatment (counterfactual outcome), and vice versa.4,5 Counterfactual outcomes are never observed. To estimate the average treatment effect (ATE), the traditional approach takes the difference of potential outcomes between the randomized (or computationally debiased) treatment and placebo arms.6 To estimate heterogeneous treatment effect (HTE), earlier studies stratify the samples by prespecified variables and test the statistical significance of differences in arms.7

It is also common practice to try to identify subsets of responsive patients in Phase II clinical trials to determine enrollment criteria for the associated Phase III trial. Many Phase III trials following positive Phase II subgroups, however, have shown negative outcomes, including tarenflurbil, bapineuzumab, solanezumab, and ELND005.8–11 Therefore, identifying subgroups with differential responses may be beyond the scope of the ad-hoc analyses of a few manually selected variables in individual trials, considering the complexity of AD.12–16 Several recent HTE estimation models based on machine learning have flexibly incorporated high-dimensional features space in randomized data. Among them, tree-based HTE estimation models recursively partition subjects in randomized trials to maximize the separation in the subject’s HTE.17,18 The model’s ability to account for nonlinearity in pre-treatment features and interpretability motivated us to leverage this approach to estimate HTE and obtain important features that moderate the treatment effect size.

The goal of this study was to identify important pre-treatment features that define subgroups within randomized clinical trials with positive or negative treatment efficacy. For trials with positive efficacy (e.g., Galantamine), we focused on identifying nonresponsive subgroups who are less likely to benefit from the drug in order to not expose those patients to drugs to which they are unlikely to respond. For trials with neutral efficacy (e.g., Bapineuzumab, Semagacestat), we focused on identifying responsive subgroups that might be amenable to targeted trials.

## Methods

### Study population

We obtained individual-level patient data from ten randomized clinical trials (RCTs) on AD drugs from the Yale University Open Data Access Project (YODA, [http://yoda.yale.edu/](http://yoda.yale.edu/)) and Center for Global Clinical Research Data (Vivli, [https://vivli.org/](https://vivli.org/)). We summarized the ten RCTs in Table 1. The datasets consist of six Galantamine trials for patients with mild to severe AD, two Bapineuzumab trials for mild to moderate AD, with or without ApoE4, and two Semagacestat trials for mild to moderate AD without depression. The Galantamine and Bapineuzumab trials were from YODA and the Semagacestat trials were from Vivli. The primary results of these studies have been previously published.9,19–22 Galantamine improved cognitive function but did not significantly enhance overall daily activities. In contrast, both Bapineuzumab and Semagacestat showed neutral efficacy in improving cognitive function, and patients receiving high doses of Semagacestat showed worse outcomes.

View this table:
[Table 1.](http://medrxiv.org/content/early/2023/10/30/2023.10.27.23297685/T1)

Table 1. Summary of ten randomized clinical trials

### Outcome measurement

The ten RCTs use different sets of outcome measurements to evaluate cognitive function or activities of daily living. The outcomes were assessed before treatment (baseline) and after treatment (endpoint). The ten RCTs also have different study durations. The Alzheimer’s Disease Assessment Scale –Cognitive subscale (ADAS-cog) was the primary outcome measure in most RCTs (eight out of ten studies) (Table 1). Our study focused on the most common outcome measurements, which included ADAS-cog, Severe Impairment Battery (SIB), and Mini-Mental State Examination (MMSE), to ensure comparability between trials. Although they measure cognitive function with different tasks, they are developed to evaluate the cognitive function of AD (or prodromal AD) patients, making it possible for us to compare the efficacy across different trials.

### Features

We included a comprehensive set of pre-treatment features to identify features that moderate the treatment effect (moderator). The features include demographic variables, dependencies, neuropsychological tests, Cerebrospinal Fluid Phospho (CSF) biomarkers, and brain imaging. The availability of such features varied by trial (Table 1). These features may moderate the treatment effects. Previous studies have shown that patient demographics, such as age and ethnicity, can impact cognitive function in AD patients.23,24 Dependency tests included Activities of Daily Living (ADL) and Disability Assessment For Dementia (DAD). Cognitive tests such as the Clinical Dementia Rating-Sum of Boxes (CDR) and MMSE have commonly been used to evaluate AD patients’ cognitive function.25 CSF Biomarkers such as amyloid-beta (Aβ) level and phosphorylated tau (p-tau) have been shown to be useful in detecting AD pathology and predicting cognitive decline.26 Imaging studies have shown that regional brain volume changes are associated with cognitive decline and amyloid-beta burden.27,28 We scaled the regional brain volume (i.e., hippocampal volume and ventricular volume) by whole brain volume as a representation of the proportion of the brain. We also included Pittsburgh Compound B (PiB) - Positron Emission Tomography Standard Uptake Value Ratio (PET SUVR) and 18F-fluorodeoxyglucose (FDG) - PET SUVR as imaging features.

### Missing value imputation

In our study, missing values exist in the imaging features (e.g., whole brain volume, hippocampus volume, ventricular volume, PiB-PET SUVR, and FDG-PET SUVR) and lab test features (e.g., Aβ42, Aβ40, and p-tau), with missing rates ranging from 48% to 93%. We dropped missing variables with a missing rate larger than 90%. Other features had missing rates under 10%. To overcome such severe missing rates, we imputed missing values with multiple imputations by chained equations (MICE)29. MICE is a valid method to iteratively impute missing values in each variable using regression models that take into account the relationships between those variables and other observed variables. This process is repeated multiple times, with each iteration improving the imputations by incorporating information from the imputed values of other variables. The final imputed dataset is created by combining the results from multiple imputations, which produce a set of plausible values that account for the uncertainty in the imputed values.

### Causal forest

We leveraged causal forest30 to estimate conditional average treatment effect (CATE), identified potential moderators that affect the efficacy, and used the moderators to define responders (for neutral trial) and non-responders (for positive trial). Compared to other causal inference methods31, causal forests recursively partition the subjects, thus accounting for the non-linear relationships between features and treatment effect size. The causal forest model is an ensemble of causal trees, where causal trees recursively partition subjects into small subgroups, like classical decision trees, but to maximize the distribution divergence of treatment effects across leaf nodes. The technical details on potential outcome framework, causal forest modeling, and training process were depicted in the Supplement Text.

### Important features

We assessed feature importance across all trees in the forest based on their relative position in a tree and influence on CATE. We calculated the feature importance by jointly considering the location of the feature used in a tree and the times that the features selected as the splitting criteria when growing a tree, which is ![Formula][1]</img> 

here *k* is the depth of the tree, *Ajk* is the total number of splits of the variable *Xj* at depth *k, j* is an index of features included in the algorithm, and *Bk* is the total number of splits at depth k over every tree in the forest. In addition, to visually investigate the impact and direction of important features as potential moderators on the CATE, we plot the relationships between the top important features and the estimated CATE. We estimated the CATE here from the trained causal forest for each feature value while keeping all the other covariates at the median value.

### Responder and non-responder identification

Traditionally, the responders or non-responders refer to the individuals who have estimated individual treatment effect below zero or above zero. In this study, we presented subgroups of responders or non-responders by selecting leaf nodes in causal trees in the causal forest, where the patients in the subgroups share similar estimated treatment effects and similar pre-treatment features. We focused on leaf nodes that involved important features that we identified. The leaf node is defined as a series of splitting rules and its CATE. In the galantamine trials, which had positive efficacy, we identified nonresponder subgroups. For bapineuzumab and Semagacestat trials, which had negative outcomes, we identified responder subgroups who may have benefitted from the drugs. The higher value of outcome measurement (e.g., ADAS-cog11) means severe cognitive dysfunction, and SIB and MMSE were negated to make the favorable outcome in the same direction as ADAS-cog11. Thus, negative treatment effects indicate beneficial treatment effects. In addition, we tested the important features’ mean difference between subgroups with ITE above or below zero to validate the observed patterns using a two-sample t-test.

### Evaluation

To evaluate whether the causal forest accurately estimated the CATE, we applied the treatment heterogeneity test by analyzing the “best linear predictor” 32,33. In the test, we fitted the estimated CATE as a linear function of out-of-bag causal forest estimates. The function has two synthetic regressors: mean forest prediction accounts for the average of out-of-bag CATE estimates with a coefficient a, and differential forest prediction measures the quality of the estimates of treatment heterogeneity on out-of-bag data, with a coefficient β33. The coefficients α and β allow us to evaluate the performance of our estimates. If α = 1, then the average prediction produced by the forest is correct. Meanwhile, if β = 1, then the forest predictions adequately capture the underlying heterogeneity. For tests with β close to 0 or negative, the test between above and below the median of the overall range of the CATE provides us with qualitative insights about the strength of heterogeneity.

## RESULTS

Our study included six Galantamine trials, two Bapineuzumab trials, and two Semagacestat trials. Trial details can be found in Table 1.

### Non-responders vs. Responders

We built causal forests on ten trials and characterized responders and non-responders. The estimated CATE for patients (Figure 1) in Trial 1 to 4 were all below 0, indicating that patients were all responders when looking into individualized CATE. It is worth mentioning that we can still find non-responsive subgroups with positive estimated CATE by extracting splitting rules from causal trees. To simplify, the estimated CATE refers to the subgroup CATE. Table 2 summarizes the important features from causal forests and characteristics of non-responders (in Galantamine trials) or responders (in Bapineuzumab and Semagacestat trials) obtained from causal trees, to identify common patterns in non-responders or responders across trials. In the following, we will discuss the findings by drug.

![Figure 1.](http://medrxiv.org/https://www.medrxiv.org/content/medrxiv/early/2023/10/30/2023.10.27.23297685/F1.medium.gif)

[Figure 1.](http://medrxiv.org/content/early/2023/10/30/2023.10.27.23297685/F1)

Figure 1. Estimated CATE across ten trials

View this table:
[Table 2.](http://medrxiv.org/content/early/2023/10/30/2023.10.27.23297685/T2)

Table 2. Characteristics of non-responsive and responsive subgroups using the causal forest.

BMI was a recurring important feature across the different stages of dementia and different trials. Among severe AD patients, non-responders typically had a BMI between 24 and 27 and NPI total scores below 24. In contrast, non-responders in the mild to moderate AD patients in trials 2-4 presented with various characteristics. Commonly observed were individuals who were overweight (BMI>=25), had higher ADL total scores (>=46; range from 0 to 78, with a lower score indicating greater severity), and relatively lower NPI total scores range (e.g., [2,7), (0,4), and [5,19); range from 0 to 144, with a higher score indicating greater severity). We also observed that the underweight (BMI<20) group did not respond to the Galantamine in trials 3 and 4.

Brain volume metrics were also pivotal factors influencing treatment response. In trial 5, MCI non-responders tended to have increased right hippocampal volume (>=0.0022) and reduced whole-brain volume (<900 ml). For MCI patients in trial 6, non-responders were overweight (BMI>=25) and younger (age<81). Both non-responder subgroups in trials 5 and 6 had higher ADL total scores (<=42). We further investigated the distinction in selected features between patients with responsive and non-responsive subgroups (eTable 1 in the Supplement). Since only trials 5 and 6 show heterogenous ITE, we only focused on the feature distinction in these trials. In trial 5, we can observe the significant feature distinction in whole brain volume (1092.54 vs. 1060.67 ml, *P* < .001) and right hippocampal volume (2.43e-3 vs. 2.79e-3, *P* < .001). In trial 6, we can observe the significant feature distinction in age (74 vs. 68, *P* < .001), ADL total scores (48 vs. 53, *P* < .001), and BMI (25 vs. 28, *P* < .001).

Across Bapineuzumab trials, mild to moderate AD patients who responded favorably to the treatment exhibited lower Aβ42 (<6.9) levels in trial 7 with high-dose treatment and lower Aβ40 (<9) levels in trial 8. Both Aβ42 (6.41 vs. 6.53 pg/ml, *P* < .001) and Aβ40 (8.64 vs. 8.95 pg/ml, *P* < .001) are significantly different between subgroups with negative ITE and positive ITE. In addition, the responsiveness was influenced by brain volume metrics in each trial. These features were also significantly different in negative and positive ITE subgroups. In trial 7, responders had smaller whole brain volume (<1051 ml; 983.13 vs. 1052.78 ml, *P* < .001) with low-dose treatment and smaller ventricular volume (<0.046; 0.045 vs. 0.056, *P* < .001) with high-dose treatment. In trial 8, responders had larger right hippocampus volume (>=0.0024, 2.28e-3 vs. 2.13e-3, *P* < .001).

In the Semagacestat trials, the whole brain volume and right hippocampal volume were consistently observed in the characteristics of responders. In trial 9, responders in two treatment groups typically exhibited smaller whole brain volume (<1114ml or <1044 ml) and larger right hippocampal volume (>=0.0022). There was a significant difference in whole brain volume between negative and positive responsive subgroups (low-dose group: 1062.25 vs. 992.07 ml, *P* < .001; high-dose group: 1014.41 vs. 1037.06, *P* = .003). The right hippocampal volume only showed differences in the low-dose group (1.87e-3 vs. 1.64e-3, *P* < .001). In contrast, in trial 10, responders had smaller whole brain volume (<1044 ml, 967.53 vs 1057.65, *P* < .001) and smaller right hippocampal volume (<0.0022, 1.73e-3 vs. 1.70e-3, *P* = 0.02). Demographic characteristics also played a significant role. Responders in trial 9 treated with low-dose tended to be younger (age<78; 69 vs. 78, *P* < .001), and responders in trial 10 maintained a BMI within the normal range (BMI<25; 24 vs. 25, *P* < .001).

### Relationship between CATE and moderators

We further investigated the potential moderators affecting the CATE estimation by analyzing the impact of single feature alterations on the CATE. Graphical depictions of the relationships between prominent features and the estimated CATE were provided in Figure 2.

![](http://medrxiv.org/https://www.medrxiv.org/content/medrxiv/early/2023/10/30/2023.10.27.23297685/F2/graphic-7.medium.gif)

[](http://medrxiv.org/content/early/2023/10/30/2023.10.27.23297685/F2/graphic-7)

![](http://medrxiv.org/https://www.medrxiv.org/content/medrxiv/early/2023/10/30/2023.10.27.23297685/F2/graphic-8.medium.gif)

[](http://medrxiv.org/content/early/2023/10/30/2023.10.27.23297685/F2/graphic-8)

Figure 2. Relationship between CATE and moderators (one moderator vs. CATE)

We focused on features presenting in characteristics of responders within Galantamine trials 5 and 6. Of particular interest in trial 5, there are negative correlations between the CATE and variables such as BMI (<30), ADL total scores (<40), and whole brain volume (<1100 ml). Conversely, a positive correlation was observed between the CATE and variables such as age (>70) and the right hippocampal volume. In trial 6, the associations of CATE with age and ADL total scores (>40) were reversed.

We then shifted to areas manifesting negative estimated CATE in Bapineuzumab and Semagacestat trials. A consistent trend was observed in Bapineuzumab trials: ventricular volume (<0.05) positively associated with the CATE. Additionally, the whole brain volume (<1100ml, in trials 7-1 and 7-2), Aβ42 (>6, in trials 7-1, 7-2, and 8), and Aβ40 (in trials 7-2 and 8) had positive associations with the CATE, a negative association with the CATE was observed for right hippocampal volume (trial 8), Aβ42 (<6, in trials 7-1 and 7-2). In Semagacestat trials 9-1 and 9-2, we observed that age and BMI were positively associated with the CATE. The whole brain volume (<1100 ml) and right hippocampal volume (>0.0015) were negatively associated with the CATE. In trial 10, the relationship between CATE and moderators was fluctuant. The BMI (<25) and right hippocampal volume (<0.0015) were negatively associated with CATE, whereas BMI (>25), right hippocampal volume (>0.002), and whole brain volume were positively associated with CATE.

### Evaluation

We evaluated whether the causal forest accurately estimated CATE and captured the heterogeneity by first comparing subgroups with lower and higher estimated CATE and then using the treatment heterogeneity test. In our setting, patients below the median of the overall range of CATE are likely to benefit from treatment, while those above the median had no response or negative responses to treatments. In addition, we demonstrated that the estimated CATE in the lower and higher regions are separated, indicating that the causal forests captured the heterogeneity of treatment effects (see eTable 1 in the Supplement). We also observed that the trials had varying values of α and β, with some trials showing high significance levels or having values close to 1. For the trials where β had negative values, we also checked the estimated CATE at lower quantile (Q1) and higher quantile (Q3) (See Table 2 and Table 3). The tables suggested that the causal forest estimates performed reasonably well in estimating the CATE in the trials analyzed.

View this table:
[Table 3.](http://medrxiv.org/content/early/2023/10/30/2023.10.27.23297685/T3)

Table 3. Coefficients of heterogeneity test

## DISCUSSION

This study aimed to identify important pre-treatment features that moderate treatment effects and thus define subgroups with different treatment effects in Alzheimer’s disease clinical trials. We used causal forest modeling on individual-level patient data from ten randomized clinical trials to estimate CATE, characterize responders and non-responders, and identify potential moderators. The characteristics of non-responders and responders varied considerably across the trials and disease severity stages. This variability suggests that a complex interplay of multiple factors, including BMI, age, amyloid burden, and brain atrophy, might influence responsiveness to Galantamine, Bapineuzumab, and Semagacestat. These findings are valuable as they can help tailor treatment strategies for specific subpopulations within existing developed drugs, thereby reducing costs and reducing exposure to those unlikely to respond. Our method may be a promising tool to inform future clinical trial designs.

Specifically, overweight patients across all dementia stages showed no response to the Galantamine treatment. These heavier persons may have a different metabolism that is related to different responses to treatment. This finding aligns with prior research suggesting a potential link between a higher BMI and reduced reaction to certain AD treatments due to inflammation and vascular issues.34 In contrast, we noted that underweight patients with mild to moderate AD at baseline also showed no response to the treatment. The exact mechanism connecting BMI and treatment efficacy remains unclear; it could involve synergistic effects with the patient’s dementia status, cognitive scales, and neuropsychological features at baseline. Intriguingly, our results revealed that older, mild to moderate AD patients and younger MCI patients did not respond to Galantamine. This may be attributed to how Galantamine works. Galantamine enhances the levels of a specific natural substance in the brain required for memory and thought, potentially improving cognitive abilities or decelerating their decline in individuals with AD.35 Furthermore, it assists in maintaining ADL performance in AD patients.36 Therefore, patients with superior cognitive abilities, greater independence, and possibly younger age may not reap significant benefits from Galantamine treatment.

Clinical trials for Bapineuzumab and Semagacestat were halted due to low efficacy.9,19 However, our analysis reveals specific subpopulations of mild to moderate AD patients, identified by distinct Aβ levels and hippocampal volume, who might have responded positively to the treatment. In the Bapineuzumab trials, responders consistently exhibited lower Aβ levels. As a humanized anti-Aβ monoclonal antibody, Bapineuzumab has shown its ability to modify Aβ accumulation.9 This may account for lower baseline Aβ levels being more likely to achieve complete amyloid clearance, which helps maintain or improve primary outcomes. Our findings suggest that a subpopulation bearing a lesser amyloid plaque burden is potentially more receptive to Bapineuzumab. In the Semagacestat trials, responders had larger right hippocampal volume and more brain atrophy (smaller whole brain volume) at baseline. This asymmetry in hippocampal volume influencing treatment response is intriguing and suggests that further research into this is important. The underlying mechanism might be tied to the lateralization of brain function and the disease’s differential impact on brain hemispheres.37

ApoE genotype didn’t show up in the top important features in our analysis due to the tree-based model favoring continuous variables in node splitting. However, so far, we have been learning that ApoE is an important biological factor affecting AD progression as well as AD treatment efficacy.38 Lecanemab, a recently approved therapy for adult AD patients, demonstrates efficacy predominantly among ApoE4 carriers benefit from Lecanemab. 39 Similarly, only ApoE4 carries responded to Solanezumab treatment.40 Thus, there is a precedent for subsets of AD patients responding differently to treatments. Given this, it is worth employing our methodology to identify responsive subgroups within these promising clinical trials.

### Limitation

Several limitations to our study should be considered when interpreting the results. In contrast to traditional hypothesis testing approaches that pre-specify potential moderators based on biological knowledge, our data-driven strategy may produce moderator combinations without a biological basis, leading to spurious results. Due to the variance term in the splitting criterion, tree-based approaches like the causal forest tend to favor continuous variables for node splitting. Thus, important discrete variables may need to be addressed. Finally, we did not consider differences in follow-up period length when investigating treatment effects; we assume the treatment effect is independent of the follow-up period.

## Data Availability

All data produced in the present study are available upon reasonable request to the authors

## Conflict of Interests

XJ is CPRIT Scholar in Cancer Research (RR180012), and he was supported in part by Christopher Sarofim Family Professorship, UT Stars award, UTHealth startup, the National Institute of Health (NIH) under award number R01AG066749, R01AG066749-03S1, R01LM013712, R01LM014520, R01AG082721, R01AG066749, U01AG079847, U01TR002062, U01CA274576 and the National Science Foundation (NSF) #2124789. YK is supported in part by UTHealth startup and the National Institute of Health (NIH) under award number R01AG082721 and R01AG066749. PS is funded by the McCord Family Professorship in Neurology, the Umphrey Family Professorship in Neurodegenerative Disorders, multiple NIH grants, several foundation grants, and contracts with multiple pharmaceutical companies related to the performance of clinical trials. He serves as a consultant and speaker for Eli Lilly, Biogen, and Acadia Pharmaceuticals. No other authors have declarations to disclose.

## Acknowledgements

The authors would like to thank Christine M. Farrell, Ph.D. for her contribution in securing database access for this study. This publication is based on data contributed by Eli Lilly that has been made available through Vivli, Inc. Vivli has not contributed to or approved, and Vivli and Eli Lilly are not in any way responsible for, the contents of this publication. In addition, this study also used data obtained from the Yale University Open Data Access Project under YODA Project 2020-4323, which has an agreement with JANSSEN RESEARCH & DEVELOPMENT, L.L.C. The interpretation and reporting of research using this data are solely the responsibility of the authors and do not necessarily represent the official views of the Yale University Open Data Access Project or JANSSEN RESEARCH & DEVELOPMENT, L.L.C.

*   Received October 27, 2023.
*   Revision received October 27, 2023.
*   Accepted October 30, 2023.


*   © 2023, Posted by Cold Spring Harbor Laboratory

This pre-print is available under a Creative Commons License (Attribution-NonCommercial-NoDerivs 4.0 International), CC BY-NC-ND 4.0, as described at [http://creativecommons.org/licenses/by-nc-nd/4.0/](http://creativecommons.org/licenses/by-nc-nd/4.0/)

## Reference

1.  1.Briggs, R., Kennelly, S. P. & O’Neill, D. Drug treatments in Alzheimer’s disease. Clin. Med. 16, 247–253 (2016).
    
    [Abstract/FREE Full Text](http://medrxiv.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6MTI6ImNsaW5tZWRpY2luZSI7czo1OiJyZXNpZCI7czo4OiIxNi8zLzI0NyI7czo0OiJhdG9tIjtzOjUwOiIvbWVkcnhpdi9lYXJseS8yMDIzLzEwLzMwLzIwMjMuMTAuMjcuMjMyOTc2ODUuYXRvbSI7fXM6ODoiZnJhZ21lbnQiO3M6MDoiIjt9) 

2.  2.Claxton, A. et al. Sex and ApoE Genotype Differences in Treatment Response to Two Doses of Intranasal Insulin in Adults with Mild Cognitive Impairment or Alzheimer’s Disease. J. Alzheimers Dis. 35, 789–797 (2013).
    
    

3.  3.Burke, A. D., Goldfarb, D., Bollam, P. & Khokher, S. Diagnosing and Treating Depression in Patients with Alzheimer’s Disease. Neurol. Ther. 8, 325–350 (2019).
    
    

4.  4.Rubin, D. B. Causal Inference Using Potential Outcomes. Journal of the American Statistical Association vol. 100 322–331 (2005).
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1198/016214504000001880&link_type=DOI) 
    
    [Web of Science](http://medrxiv.org/lookup/external-ref?access_num=000233311100035&link_type=ISI) 

5.  5.He, H., Wu, P. & Chen, D.-G. (din). Statistical Causal Inferences and Their Applications in Public Health Research. (Springer, 2016).
    
    

6.  6.Kovesdy, C. P. & Kalantar-Zadeh, K. Observational Studies Versus Randomized Controlled Trials: Avenues to Causal Inference in Nephrology. Adv. Chronic Kidney Dis. 19, 11–18 (2012).
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1053/j.ackd.2011.09.004&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=22364796&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2023%2F10%2F30%2F2023.10.27.23297685.atom) 
    
    [Web of Science](http://medrxiv.org/lookup/external-ref?access_num=000301610500004&link_type=ISI) 

7.  7.Varadhan, R., Segal, J. B., Boyd, C. M., Wu, A. W. & Weiss, C. O. A framework for the analysis of heterogeneity of treatment effect in patient-centered outcomes research. J. Clin. Epidemiol. 66, 818–825 (2013).
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1016/j.jclinepi.2013.02.009&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=23651763&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2023%2F10%2F30%2F2023.10.27.23297685.atom) 

8.  8.Green, R. C. et al. Effect of tarenflurbil on cognitive decline and activities of daily living in patients with mild Alzheimer disease: a randomized controlled trial. JAMA 302, 2557–2564 (2009).
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1001/jama.2009.1866&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=20009055&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2023%2F10%2F30%2F2023.10.27.23297685.atom) 
    
    [Web of Science](http://medrxiv.org/lookup/external-ref?access_num=000272737200023&link_type=ISI) 

9.  9.Salloway, S. et al. Two phase 3 trials of bapineuzumab in mild-to-moderate Alzheimer’s disease. N. Engl. J. Med. 370, 322–333 (2014).
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1056/NEJMoa1304839&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=24450891&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2023%2F10%2F30%2F2023.10.27.23297685.atom) 
    
    [Web of Science](http://medrxiv.org/lookup/external-ref?access_num=000330036200007&link_type=ISI) 

10. 10.Salloway, S. et al. A phase 2 randomized trial of ELND005, scyllo-inositol, in mild to moderate Alzheimer disease. Neurology 77, 1253–1262 (2011).
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1212/WNL.0b013e3182309fa5&link_type=DOI) 

11. 11.Doody, R. S. et al. Phase 3 trials of solanezumab for mild-to-moderate Alzheimer’s disease. N. Engl. J. Med. 370, 311–321 (2014).
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1056/NEJMoa1312889&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=24450890&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2023%2F10%2F30%2F2023.10.27.23297685.atom) 
    
    [Web of Science](http://medrxiv.org/lookup/external-ref?access_num=000330036200006&link_type=ISI) 

12. 12.Wang, R., Lagakos, S. W., Ware, J. H., Hunter, D. J. & Drazen, J. M. Statistics in Medicine — Reporting of Subgroup Analyses in Clinical Trials. New England Journal of Medicine vol. 357 2189–2194 (2007).
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1056/NEJMsr077003&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=18032770&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2023%2F10%2F30%2F2023.10.27.23297685.atom) 
    
    [Web of Science](http://medrxiv.org/lookup/external-ref?access_num=000251076500014&link_type=ISI) 

13. 13.Burke, J. F., Sussman, J. B., Kent, D. M. & Hayward, R. A. Three simple rules to ensure reasonably credible subgroup analyses. BMJ 351, (2015).
    
    

14. 14.Qiu, C., Kivipelto, M. & von Strauss, E. Epidemiology of Alzheimer’s disease: occurrence, determinants, and strategies toward intervention. Dialogues Clin Neurosci 11, 111 (2009).
    
    

15. 15.Richard Mayeux, Y. S. Epidemiology of Alzheimer Disease. Cold Spring Harb Perspect Med 2, (2012).
    
    

16. 16.Mielke, M. M., Vemuri, P. & Rocca, W. A. Clinical epidemiology of Alzheimer’s disease: assessing sex and gender differences. Clin Epidemiol 6, 37 (2014).
    
    

17. 17.Richard Hahn, P., Murray, J. S. & Carvalho, C. M. Bayesian Regression Tree Models for Causal Inference: Regularization, Confounding, and Heterogeneous Effects (with Discussion). ba 15, 965–1056 (2020).
    
    

18. 18.Wager, S. & Athey, S. Estimation and Inference of Heterogeneous Treatment Effects using Random Forests. (2015).
    
    

19. 19.Doody, R. S. et al. A Phase 3 Trial of Semagacestat for Treatment of Alzheimer’s Disease. N. Engl. J. Med. 369, 341–350 (2013).
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1056/NEJMoa1210951&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=23883379&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2023%2F10%2F30%2F2023.10.27.23297685.atom) 
    
    [Web of Science](http://medrxiv.org/lookup/external-ref?access_num=000322223900009&link_type=ISI) 

20. 20.Burns, A. et al. Safety and efficacy of galantamine (Reminyl) in severe Alzheimer’s disease (the SERAD study): a randomised, placebo-controlled, double-blind trial. Lancet Neurol. 8, 39–47 (2009).
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1016/S1474-4422(08)70261-8&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=19042161&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2023%2F10%2F30%2F2023.10.27.23297685.atom) 
    
    [Web of Science](http://medrxiv.org/lookup/external-ref?access_num=000261860700020&link_type=ISI) 

21. 21.Hager, K. et al. Effects of galantamine in a 2-year, randomized, placebo-controlled study in Alzheimer’s disease. Neuropsychiatr. Dis. Treat. 10, 391–401 (2014).
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=24591834&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2023%2F10%2F30%2F2023.10.27.23297685.atom) 

22. 22.Brodaty, H. et al. Galantamine Prolonged-Release Formulation in the Treatment of Mild to Moderate Alzheimer’s Disease. Dement. Geriatr. Cogn. Disord. 20, 120–32 (2005).
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1159/000086613&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=15990426&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2023%2F10%2F30%2F2023.10.27.23297685.atom) 
    
    [Web of Science](http://medrxiv.org/lookup/external-ref?access_num=000232488900011&link_type=ISI) 

23. 23.Wilson, R. S. et al. Educational attainment and cognitive decline in old age. Neurology 72, 460–465 (2009).
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1212/01.wnl.0000341782.71418.6c&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=19188578&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2023%2F10%2F30%2F2023.10.27.23297685.atom) 

24. 24.Matthews, K. A. et al. Racial and ethnic estimates of Alzheimer’s disease and related dementias in the United States (2015–2060) in adults aged ≥65 years. Alzheimers Dement. 15, 17–24 (2019).
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1016/j.jalz.2018.06.3063&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=http://www.n&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2023%2F10%2F30%2F2023.10.27.23297685.atom) 

25. 25.Andrews, J. S. et al. Disease severity and minimal clinically important differences in clinical outcome assessments for Alzheimer’s disease clinical trials. Alzheimers Dement. Transl. Res. Clin. Interv. 5, 354–363 (2019).
    
    

26. 26.Jack, C. R. et al. NIA-AA Research Framework: Toward a biological definition of Alzheimer’s disease. Alzheimers Dement. J. Alzheimers Assoc. 14, 535–562 (2018).
    
    

27. 27.Fletcher, E. et al. Brain volume change and cognitive trajectories in aging. Neuropsychology 32, 436–449 (2018).
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1037/neu0000447&link_type=DOI) 

28. 28.Libowitz, M. R. et al. Regional brain volumes relate to Alzheimer’s disease cerebrospinal fluid biomarkers and neuropsychometry: A cross-sectional, observational study. PLoS ONE 16, e0254332 (2021).
    
    

29. 29.Buuren, S. van & Groothuis-Oudshoorn, K. mice: Multivariate Imputation by Chained Equations in R. J. Stat. Softw. 45, 1–67 (2011).
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=doi:10.18637/jss.v045.i05&link_type=DOI) 

30. 30.Athey, S. & Imbens, G. Recursive partitioning for heterogeneous causal effects. Proc. Natl. Acad. Sci. 113, 7353–7360 (2016).
    
    [Abstract/FREE Full Text](http://medrxiv.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6NDoicG5hcyI7czo1OiJyZXNpZCI7czoxMToiMTEzLzI3LzczNTMiO3M6NDoiYXRvbSI7czo1MDoiL21lZHJ4aXYvZWFybHkvMjAyMy8xMC8zMC8yMDIzLjEwLjI3LjIzMjk3Njg1LmF0b20iO31zOjg6ImZyYWdtZW50IjtzOjA6IiI7fQ==) 

31. 31.Ling, Y., Upadhyaya, P., Chen, L., Jiang, X. & Kim, Y. Heterogeneous Treatment Effect Estimation using machine learning for Healthcare application: tutorial and benchmark. Preprint at doi:10.48550/arXiv.2109.12769 (2023).
    
    

32. 32.Athey, S. & Wager, S. Estimating treatment effects with causal forests: An application. Obs. Stud. 5, 37–51 (2019).
    
    

33. 33.Chernozhukov, V., Demirer, M., Duflo, E. & Fernández-Val, I. Generic Machine Learning Inference on Heterogenous Treatment Effects in Randomized Experiments. Preprint at [http://arxiv.org/abs/1712.04802](http://arxiv.org/abs/1712.04802) (2022).
    
    

34. 34.Kloiber, S. et al. Overweight and Obesity Affect Treatment Response in Major Depression. Biol. Psychiatry 62, 321–326 (2007).
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1016/j.biopsych.2006.10.001&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=17241618&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2023%2F10%2F30%2F2023.10.27.23297685.atom) 
    
    [Web of Science](http://medrxiv.org/lookup/external-ref?access_num=000248658100007&link_type=ISI) 

35. 35.Galantamine improves global and cognitive symptoms at doses of 16 mg/day or greater, in people with mild to moderate Alzheimer’s disease, for at least 6 months. [https://www.cochrane.org/CD001747/DEMENTIA\_galantamine-improves-global-and-cognitive-symptoms-at-doses-of-16-mgday-or-greater-in-people-with-mild-to-moderate-alzheimers-disease-for-at-least-6-months](https://www.cochrane.org/CD001747/DEMENTIA_galantamine-improves-global-and-cognitive-symptoms-at-doses-of-16-mgday-or-greater-in-people-with-mild-to-moderate-alzheimers-disease-for-at-least-6-months) doi:10.1002/14651858.CD001747.pub3.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1002/14651858.CD001747.pub3&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=16437436&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2023%2F10%2F30%2F2023.10.27.23297685.atom) 

36. 36.Galasko, D., Kershaw, P. R., Schneider, L., Zhu, Y. & Tariot, P. N. Galantamine maintains ability to perform activities of daily living in patients with Alzheimer’s disease. J. Am. Geriatr. Soc. 52, 1070–1076 (2004).
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1111/j.1532-5415.2004.52303.x&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=15209643&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2023%2F10%2F30%2F2023.10.27.23297685.atom) 
    
    [Web of Science](http://medrxiv.org/lookup/external-ref?access_num=000222070900004&link_type=ISI) 

37. 37.Ross, E. D. Differential Hemispheric Lateralization of Emotions and Related Display Behaviors: Emotion-Type Hypothesis. Brain Sci. 11, 1034 (2021).
    
    

38. 38.Yamazaki, Y., Zhao, N., Caulfield, T. R., Liu, C.-C. & Bu, G. Apolipoprotein E and Alzheimer disease: pathobiology and targeting strategies. Nat. Rev. Neurol. 15, 501–518 (2019).
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1038/s41582-019-0228-7&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=31367008&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2023%2F10%2F30%2F2023.10.27.23297685.atom) 

39. 39.Second Look at BAN2401 Data Still Positive, Despite Snafu | ALZFORUM. [https://www.alzforum.org/news/conference-coverage/second-look-ban2401-data-still-positive-despite-snafu](https://www.alzforum.org/news/conference-coverage/second-look-ban2401-data-still-positive-despite-snafu).
    
    

40. 40.Evans, C. D. et al. APOE ε4’s impact on response to amyloid therapies in early symptomatic Alzheimer’s disease: Analyses from multiple clinical trials. Alzheimers Dement. **n/a**,.
    
    

41. 41.Janssen Pharmaceutica N.V., Belgium. Treatment of Severe Alzheimer’s Disease in a Residential Home, Nursing Home, or Geriatric Residential Setting: Evaluation of Efficacy and Safety of Galantamine Hydrobromide in a Randomised, Doubleblind, Placebo-Controlled Study. [https://clinicaltrials.gov/ct2/show/NCT00216593](https://clinicaltrials.gov/ct2/show/NCT00216593) (2011).
    
    

42. 42.Janssen Research & Development, LLC. A Randomized, Double-Blind, Placebo-controlled Trial of Long-term (2-year) Treatment of Galantamine in Mild to Moderately-Severe Alzheimer’s Disease. [https://clinicaltrials.gov/ct2/show/NCT00679627](https://clinicaltrials.gov/ct2/show/NCT00679627) (2013).
    
    

43. 43.Johnson & Johnson Pharmaceutical Research & Development, L.L.C. Placebo-Controlled Evaluation of Galantamine in the Treatment of Alzheimer’s Disease: Safety and Efficacy of a Controlled-Release Formulation. [https://clinicaltrials.gov/ct2/show/NCT00253214](https://clinicaltrials.gov/ct2/show/NCT00253214) (2011).
    
    

44. 44.Cummings, J. L., Schneider, L., Tariot, P. N., Kershaw, P. R. & Yuan, W. Reduction of Behavioral Disturbances and Caregiver Distress by Galantamine in Patients With Alzheimer’s Disease. Am. J. Psychiatry 161, 532–538 (2004).
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1176/appi.ajp.161.3.532&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=14992980&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2023%2F10%2F30%2F2023.10.27.23297685.atom) 
    
    [Web of Science](http://medrxiv.org/lookup/external-ref?access_num=000221276000020&link_type=ISI) 

45. 45.Johnson & Johnson Pharmaceutical Research & Development, L.L.C. A Randomized Double Blind Placebo-Controlled Trial to Evaluate the Efficacy and Safety of Galantamine in Patients With Mild Cognitive Impairment (MCI) Clinically at Risk for Development of Clinically Probable Alzheimer’s Disease. [https://clinicaltrials.gov/ct2/show/NCT00236574](https://clinicaltrials.gov/ct2/show/NCT00236574) (2011).
    
    

46. 46.JANSSEN Alzheimer Immunotherapy Research & Development, LLC. A Phase 3, Multicenter, Randomized, Double-Blind, Placebo-Controlled, Parallel-Group, Efficacy and Safety Trial of Bapineuzumab (AAB-001, ELN115727) In Patients With Mild to Moderate Alzheimer’s Disease Who Are Apolipoprotein E4 Non-Carriers. [https://clinicaltrials.gov/study/NCT00574132](https://clinicaltrials.gov/study/NCT00574132) (2013).
    
    

47. 47.JANSSEN Alzheimer Immunotherapy Research & Development, LLC. A Phase 3, Multicenter, Randomized, Double-Blind, Placebo-Controlled, Parallel-Group, Efficacy and Safety Trial of Bapineuzumab (AAB-001, ELN115727) In Patients With Mild to Moderate Alzheimer’s Disease Who Are Apolipoprotein E4 Carriers. [https://clinicaltrials.gov/ct2/show/NCT00575055](https://clinicaltrials.gov/ct2/show/NCT00575055) (2013).
    
    

48. 48.Eli Lilly and Company. Effect of γ-Secretase Inhibition on the Progression of Alzheimer’s Disease: LY450139 Versus Placebo. [https://clinicaltrials.gov/ct2/show/NCT00594568](https://clinicaltrials.gov/ct2/show/NCT00594568) (2015).
    
    

49. 49.Eli Lilly and Company. Effect of LY450139 a y-Secretase Inhibitor, on the Progression of Alzheimer’s Disease as Compared With Placebo. [https://clinicaltrials.gov/ct2/show/NCT00762411](https://clinicaltrials.gov/ct2/show/NCT00762411) (2015).

 [1]: /embed/graphic-3.gif