Abstract
Background Structural MRI plays a pivotal role in the radiological workup for assessing neurodegeneration. Scanner-related differences hinder quantitative neuroradiological assessment of Alzheimer’s disease (QNAD). This study aims to train a machine-learning model to harmonize brain volumetric data of patients not encountered during model training.
Method Neuroharmony is a recently developed method that uses image quality metrics (IQM) as predictors to remove scanner-related effects in brain-volumetric data using random forest regression. To account for the interactions between AD-pathology and IQM during harmonization, we developed a multi-class extension of Neuroharmony. We performed cross-validation experiments to benchmark performance against existing approaches using data from 20,864 participants comprising cognitively unimpaired (CU) and impaired (CI) individuals, spanning 11 cohorts and 43 scanners. Evaluation metrics assessed ability to remove scanner-related variations in brain volumes (biomarker concordance), while retaining the ability to delineate different diagnostic groups (preserving disease-related signal).
Results For each strategy, biomarker concordances between scanners were significantly better (p < 10−6) compared to pre-harmonized data. The proposed multi-class model achieved significantly higher concordance than the Neuroharmony model trained on CU individuals (CI: p < 10−6, CU: p = 0.02) and preserved disease-related signal better than the Neuroharmony model trained on all individuals without our proposed extension (ΔAUC= −0.09). The biomarker concordance was better in scanners seen during training (concordance > 97%) than unseen (concordance < 79%), independent of cognitive status.
Conclusion In a large-scale multi-center dataset, our proposed multi-class Neuroharmony model outperformed other strategies available for harmonizing brain-volumetric data in a clinical setting. This paves the way for enabling QNAD in the future.
Competing Interest Statement
F.B. is on the steering committee or Data Safety Monitoring Board member for Biogen, Merck, ATRI/ACTC and Prothena. F.B. has been a consultant for Roche, Celltrion, Rewind Therapeutics, Merck, IXICO, Jansen, Combinostics and has research agreements with Merck, Biogen, GE Healthcare, Roche. F.B. and D.C.A. are co-founders and shareholders of Queen Square Analytics Ltd. N.P.O. is a consultant for Queen Square Analytics Ltd.
Funding Statement
This study was supported by the Early Detection of Alzheimer's Disease Subtypes (E-DADS) project, an EU Joint Programme - Neurodegenerative Disease Research (JPND) project (see www.jpnd.eu). The project is supported under the aegis of JPND through the following funding organizations: United Kingdom, Medical Research Council (MR/T046422/1); Netherlands, ZonMW (733051106); France, Agence Nationale de la Recherche (ANR-19-JPW2-000); Italy, Italian Ministry of Health (MoH); Australia, National Health & Medical Research Council (1191535); Hungary, National Research, Development and Innovation Office (2019-2.1.7-ERA-NET-2020-00008). This work used the Dutch national e-infrastructure with the support of the SURF Cooperative using grant no. EINF-5353. F.B. is supported by the NIHR Biomedical Research Centre at UCLH. B.W. and Z.V. were supported by Project no. RRF-2.3.1-21-2022-00015, which has been implemented with the support provided by the European Union. B.W. was supported by the Consolidator Researcher program of the Óbuda University. N.P.O. is supported by a UKRI Future Leaders Fellowship (UK Medical Research Council MR/S03546X/1). Acknowledgments The authors would like to thank the developers of the original Neuroharmony algorithm for making the code available, and all the research participants and their families for donating their data for scientific research. Data collection and sharing for ADNI was funded by the Alzheimer’s Disease Neuroimaging Initiative (ADNI) (National Institutes of Health Grant U01 AG024904) and DOD ADNI (Department of Defense award number W81XWH-12-2-0012). ADNI is funded by the National Institute on Aging, the National Institute of Biomedical Imaging and Bioengineering, and through generous contributions from the following: AbbVie, Alzheimer’s Association; Alzheimer’s Drug Discovery Foundation; Araclon Biotech; BioClinica, Inc.; Biogen; Bristol-Myers Squibb Company; CereSpir, Inc.; Cogstate; Eisai Inc.; Elan Pharmaceuticals, Inc.; Eli Lilly and Company; EuroImmun; F. Hoffmann-La Roche Ltd and its affiliated company Genentech, Inc.; Fujirebio; GE Healthcare; IXICO Ltd.; Janssen Alzheimer Immunotherapy Research & Development, LLC.; Johnson & Johnson Pharmaceutical Research & Development LLC.; Lumosity; Lundbeck; Merck & Co., Inc.; Meso Scale Diagnostics, LLC.; NeuroRx Research; Neurotrack Technologies; Novartis Pharmaceuticals Corporation; Pfizer Inc.; Piramal Imaging; Servier; Takeda Pharmaceutical Company; and Transition Therapeutics. The Canadian Institutes of Health Research is providing funds to support ADNI clinical sites in Canada. Private sector contributions are facilitated by the Foundation for the National Institutes of Health (www.fnih.org). The grantee organization is the Northern California Institute for Research and Education, and the study is coordinated by the Alzheimer’s Therapeutic Research Institute at the University of Southern California. ADNI data are disseminated by the Laboratory for Neuro Imaging at the University of Southern California. The AIBL study (https://aibl.org.au) is a consortium between Austin Health, CSIRO, Edith Cowan University, the Florey Institute (The University of Melbourne), and the National Ageing Research Institute. The study has received partial financial support from the Alzheimer’s Association (US), the Alzheimer’s Drug Discovery Foundation, an Anonymous foundation, the Science and Industry Endowment Fund, the Dementia Collaborative Research Centres, the Victorian Government’s Operational Infrastructure Support program, the Australian Alzheimer’s Research Foundation, the National Health and Medical Research Council (NHMRC), and The Yulgilbar Foundation. Numerous commercial interactions have supported data collection and analyses. In-kind support has also been provided by Sir Charles Gairdner Hospital, Cogstate Ltd, Hollywood Private Hospital, The University of Melbourne, and St Vincent’s Hospital. The AIBL team wishes to thank all clinicians who referred patients with AD and/or MCI to the study. We also thank all those who took part as subjects in the study for their commitment and dedication to helping advance research into the early detection and causation of AD. We thank all the investigators within the AIBL who contributed to the design and implementation of the resource and/or provided data but did not actively participate in the development, analysis, interpretation or writing of this current study. The NACC database is funded by NIA/NIH Grant U24 AG072122. NACC data are contributed by the NIA-funded ADRCs: P30 AG062429 (PI James Brewer, MD, PhD), P30 AG066468 (PI Oscar Lopez, MD), P30 AG062421 (PI Bradley Hyman, MD, PhD), P30 AG066509 (PI Thomas Grabowski, MD), P30 AG066514 (PI Mary Sano, PhD), P30 AG066530 (PI Helena Chui, MD), P30 AG066507 (PI Marilyn Albert, PhD), P30 AG066444 (PI John Morris, MD), P30 AG066518 (PI Jeffrey Kaye, MD), P30 AG066512 (PI Thomas Wisniewski, MD), P30 AG066462 (PI Scott Small, MD), P30 AG072979 (PI David Wolk, MD), P30 AG072972 (PI Charles DeCarli, MD), P30 AG072976 (PI Andrew Saykin, PsyD), P30 AG072975 (PI David Bennett, MD), P30 AG072978 (PI Neil Kowall, MD), P30 AG072977 (PI Robert Vassar, PhD), P30 AG066519 (PI Frank LaFerla, PhD), P30 AG062677 (PI Ronald Petersen, MD, PhD), P30 AG079280 (PI Eric Reiman, MD), P30 AG062422 (PI Gil Rabinovici, MD), P30 AG066511 (PI Allan Levey, MD, PhD), P30 AG072946 (PI Linda Van Eldik, PhD), P30 AG062715 (PI Sanjay Asthana, MD, FRCP), P30 AG072973 (PI Russell Swerdlow, MD), P30 AG066506 (PI Todd Golde, MD, PhD), P30 AG066508 (PI Stephen Strittmatter, MD, PhD), P30 AG066515 (PI Victor Henderson, MD, MS), P30 AG072947 (PI Suzanne Craft, PhD), P30 AG072931 (PI Henry Paulson, MD, PhD), P30 AG066546 (PI Sudha Seshadri, MD), P20 AG068024 (PI Erik Roberson, MD, PhD), P20 AG068053 (PI Justin Miller, PhD), P20 AG068077 (PI Gary Rosenberg, MD), P20 AG068082 (PI Angela Jefferson, PhD), P30 AG072958 (PI Heather Whitson, MD), P30 AG072959 (PI James Leverenz, MD).
Author Declarations
I confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.
Yes
The details of the IRB/oversight body that provided approval or exemption for the research described are given below:
Ethics committee/IRB of IRCCS Istituto Centro San Giovanni di Dio Fatebenefratelli gave ethical approval for this work; Ethics committee/IRB of Amsterdam UMC gave ethical approval for this work; Ethics committee/IRB of Research Centre for Natural Sciences, Budapest gave ethical approval for this work;
I confirm that all necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived, and that any patient/participant/sample identifiers included were not known to anyone (e.g., hospital staff, patients or participants themselves) outside the research group so cannot be used to identify individuals.
Yes
I understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).
Yes
I have followed all appropriate research reporting guidelines, such as any relevant EQUATOR Network research reporting checklist(s) and other pertinent material, if applicable.
Yes
The Chan Zuckerberg Initiative, Cold Spring Harbor Laboratory, the Sergey Brin Family Foundation, California Institute of Technology, Centre National de la Recherche Scientifique, Fred Hutchinson Cancer Center, Imperial College London, Massachusetts Institute of Technology, Stanford University, University of Washington, and Vrije Universiteit Amsterdam.