Abstract
Background Of persons randomized to the placebo arm of Alzheimer’s Disease (AD) treatment trials, 40% do not show cognitive decline over 80 weeks of follow-up. Identifying and excluding these individuals from both arms of randomized clinical trials (RCTs) of AD has the potential to increase power to detect treatment effects.
Objectives We aimed to develop machine learning-based predictive models to identify persons unlikely to show decline on placebo treatment over 80 weeks.
Method We used the data from 1072 patients with mild dementia and biomarker evidence of amyloid burden from the placebo arm of EXPEDITION3 trial. Participants were identified as those who demonstrated Clinically Meaningful Cognitive Decline (CMCD, change in ADAS-Cog≥3) or Cognitive Stable (CS, change in ADAS-Cog<3) at final visit of the trial (week 80). Machine learning-based classifiers were trained to classify participants into CMCD vs. CS groups using combinations of demographics, neuropsychological tests (NP) and biomarkers, including APOE4 genotype and volumetric MRI. The results were developed in 70% of the EXPEDITION3 placebo sample (EXPtrain) using 5-fold cross-validation. Trained models were then used to classify the participants in an internal validation sample (EXPvalid) and an external matched sample from the Alzheimer’s Disease Neuroimaging Initiative (ADNI) study.
Result Participants selected from the EXPEDITION3 trial were on average 72.7(±7.7) years old, 59% were female. CMCD was observed in 55.8% of participants of EXPEDITION3 at final visit. In the independent validation sample within the EXPEDITION3 data, all the models showed high sensitivity and modest specificity. Positive predictive values (PPVs) of models were at least 11% higher than base prevalence of CMCD observed at the end of the trial. The subset of matched ADNI participants (ADNIAD) were on average 74.5(±6.4) years old and 46% female. The models that were validated in ADNIAD also showed high sensitivity, modest specificity and PPVs of at least 15% higher than the base prevalence in ADNIAD.
Conclusion Our results indicate that predictive models have the potential to improve the design of AD trials through selective inclusion criteria for participants expected to decline and exclusion of those expected to remain stable.
Competing Interest Statement
The authors have declared no competing interest.
Funding Statement
There was no direct funding for this work. The author(s) would like to disclose the following. Dr. Bhargav T. Nallapu has nothing to disclose; Dr. Kellen K. Petersen has nothing to disclose; Dr. Tianchen Qian has nothing to disclose; Dr. Idris Demirsoy has nothing to disclose; Dr. Elham Ghanbarian has nothing to disclose; Dr. Christos Davatzikos receives research support in part by grants from the National Institute of Health (NIA RF1AG054409); Dr. Richard B. Lipton is the Edwin S. Lowe Professor of Neurology at the Albert Einstein College of Medicine in New York. He receives research support from the NIH: 2PO1 AG003949 (mPI), 1RF1 AG057531 (Site PI), 1UG3FD006795 (mPI), 1U24NS113847 (Investigator), U01 AT011005 (Investigator), 1R01 AG075758 (Investigator), 1R01 AG077639 (Investigator), 1RO1A1011875 (Investigator), 1RM1DA0055437 (Investigator), RO1AG080635 (Investigator), SG24988292 (Investigator), U19AGO76581 (Investigator), 1RO1NS123374 (Investigator), R61NS125153 (Investigator), and K23 NS107643 (Mentor). He also receives support from the Migraine Research Foundation and the National Headache Foundation and research grants from TEVA, Satsuma and Amgen. He serves on the editorial board of Neurology, senior advisor to Headache, and associate editor to Cephalalgia. He has reviewed for the NIA and NINDS, holds stock and stock options in Axon, Biohaven Holdings, CoolTech and Manistee; serves as consultant, advisory board member, or has received honoraria from: Abbvie (Allergan), American Academy of Neurology, American Headache Society, Amgen, Avanir, Axon, Axsome, Biohaven, Biovision, Boston Scientific, Dr. Reddy's (Promius), Electrocore, Eli Lilly, eNeura Therapeutics, Equinox, GlaxoSmithKline, Grifols, Lundbeck (Alder), Manistee, Merck, Pernix, Pfizer, Satsuma, Supernus, Teva, Trigemina, Vector, Vedanta. He receives royalties from Wolff's Headache 7th and 8th Edition, Oxford Press University, 2009, Wiley and Informa.; Dr. Ali Ezzati serves as consultant, advisory board member, or has received honoraria from: PCORI Health Care Horizon Scanning System, GlaxoSmithKline, Mist Research, and Corium. A.E is an Editorial Board Member of Journal of Alzheimer's Disease, A.E receives research support in part by grants from the National Institute of Health (NIA K23 AG063993, 2PO1 AG003949, AG080635), the Alzheimer's Association (SG-24-988292 ISAVRAD); Cure Alzheimer Fund, None of the sponsors had any role in the design, methods, data acquisition, analysis and preparation of the manuscript.;
Author Declarations
I confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.
Yes
The details of the IRB/oversight body that provided approval or exemption for the research described are given below:
Ethics committee/IRB of Eli Lilly Company and Alzheimer's Disease Neuroimaging Initiative gave ethical approval for this work
I confirm that all necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived, and that any patient/participant/sample identifiers included were not known to anyone (e.g., hospital staff, patients or participants themselves) outside the research group so cannot be used to identify individuals.
Yes
I understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).
Yes
I have followed all appropriate research reporting guidelines, such as any relevant EQUATOR Network research reporting checklist(s) and other pertinent material, if applicable.
Yes
Data Availability
All data produced in the present study are available upon reasonable request to the authors
