Reduced expression of fMRI subsequent memory effects with increasing severity across the Alzheimer’s disease risk spectrum

2.1. Study cohort

In the present study, we applied a previously described methodology, validated in a cohort of healthy young and older adults (Soch et al., 2021a), to a sample of individuals with SCD, MCI, and early-stage AD as well as healthy controls and first-degree relatives of AD patients from the DZNE Longitudinal Cognitive Impairment and Dementia Study¹ (DELCODE; Jessen et al., 2018), a multi-center study based in memory clinics collaborating with the German Center for Neurodegenerative Diseases (DZNE). All participants groups except HC and AD-rel were memory-clinic referrals and underwent clinical assessments, including a medical history interview, psychiatric and neurological examinations, neuropsychological testing, and routine MRI scans. Cognitive functioning was assessed using the Consortium to Establish a Registry for Alzheimer’s Disease (CERAD; Fillenbaum et al., 2008) neuropsychological test battery and the Mini Mental Status Examination (MMSE; Beyermann et al., 2013). Participants in the HC and AD-rel groups were recruited via newspaper advertisements.

The diagnostic assignment of participants to groups was as follows: Participants were assigned to HC, if they self-identified as cognitively healthy, passed a telephone screening for SCD, and their memory test performance was within 1.5 standard deviations (SD) of age-, gender-, and education-adjusted normal performance on all CERAD subtests. If participants expressed concerns regarding cognitive decline, a semi-structured interview with a physician at a memory clinic was conducted, and following the SCD-plus criteria (Jessen et al., 2014) and their CERAD performance, they were assigned to either SCD or MCI. Whereas MCI was assigned, if participants performed more than 1.5 SD below normal on the “recall word list” subtest, SCD was assigned, when they performed above this threshold. Participants with non-amnestic MCI were excluded from participation (Jessen et al., 2018), resulting in the MCI group including only individuals with amnestic MCI. MCI patients also needed to not meet the criteria for AD. In the AD group, only patients with >18 and <26 points in the MMSE were included (Beyermann et al., 2013).

Complete baseline data (i.e., data from the first study visit) was available for 844 subjects at the time of data analysis. From these subjects, we had to exclude (i) subjects without available diagnosis, (ii) subjects who did not perform the fMRI task, (iii) subjects whose logfiles from the fMRI experiment were missing, and (iv) subjects lacking one or more MRI data files necessary for our pre-processing pipeline (see below). This resulted in a final sample size of N = 468 subjects (HC: 128; SCD: 199; MCI: 74; AD: 21; AD-rel: 46) used for the analyses reported here. Demographic information for the different groups is given in Table 1.

2.2. Comparison with original study

Apart from using a different study cohort, comprising five (HC, SCD, MCI, AD and AD relatives) rather than two (healthy young and older adults) groups of participants, the present study uses the exact same workflow and protocols for data acquisition and data analysis as the original study (see Supplementary Table S2). While data acquisition mostly took place before completion of this original study used as the reference here (Soch et al., 2021a), the complete data analysis was performed after its publication, following the approval of a detailed analysis protocol by the DELCODE steering committee, such that the present work can be considered effectively preregistered².

2.3. Experimental paradigm

Participants performed an incidental memory task introduced by Düzel and colleagues (Düzel et al., 2011), which was slightly adapted as part of the DELCODE protocol (Düzel et al., 2018; Bainbridge et al., 2019), with the adapted version also used in the “Autonomy in Old Age” study (Soch et al., 2021a; Soch et al., 2021b; Richter et al., 2023). Subjects were presented with photographs of indoor and outdoor scenes, which were either novel to the participant at the time of presentation (44 indoor and 44 outdoor scenes) or were repetitions of two pre-familiarized “master” images (22 indoor and 22 outdoor trials). In a later retrieval session, participants were presented with all novel images from the encoding session, now considered “old” stimuli (88 images), as well images not previously seen by the participant, i.e., “new” stimuli (44 images). Participants were asked to provide a recognition-confidence rating for each image, using a five-point Likert scale ranging from “sure new” (1) over “don’t know” (3) up to “sure old” (5). For further details, see previous descriptions of the paradigm (Assmann et al., 2020; Soch et al., 2021a; Soch et al., 2021b; Richter et al., 2023). To help participants focus their attention on the stimuli, responses were given overtly and recorded by a trained experimenter. There was also no response deadline in the retrieval task, and the next stimulus was only shown after a response had been given.

2.4. MRI data acquisition

MRI data were acquired at eight different sites of the DZNE across Germany (see Table 1), using Siemens 3T MR tomographs. All sites followed the exact same MRI protocol implemented in the DELCODE study (Jessen et al., 2018; Düzel et al., 2018). Structural MRI included a T1-weighted MPRAGE image (voxel size = 1 x 1 x 1 mm) as well as phase and magnitude fieldmaps for later spatial artifact correction. Functional MRI consisted of 206 T2*-weighted echo-planar images (TR = 2.58 s, voxel size = 3.5 x 3.5 x 3.5 mm) measured during the encoding session of the memory task (09:01 min) as well as a resting-state session comprising 180 scans (same parameters) not used for the present study. For detailed scanning parameters, see previous descriptions of data acquisition (Soch et al., 2021a, 2021b).

2.5. MRI data processing

MRI data were analyzed with Statistical Parametric Mapping³, version 12, revision 7771 (SPM12 R7771; Wellcome Trust Center for Neuroimaging, University College London, London, UK). Preprocessing of the fMRI data included acquisition time correction (slice timing), head motion correction (realignment), correction of magnetic field inhomogeneities using the fieldmaps (unwarping), coregistration of the T1-weighted MPRAGE image to the mean functional image, segmentation of the coregistered MPRAGE image and subsequent normalization of unwarped EPIs into the MNI standard space (voxel size = 3 x 3 x 3 mm) using the transformation parameters obtained from segmentation, and finally, spatial smoothing of the functional images (FWHM = 6 mm).

Statistical analysis of the fMRI data was based on voxel-wise general linear models (GLMs) that included two onset regressors, one for novel images (novelty regressor) and one for the master images (master regressor), six head movement regressors obtained from realignment and a constant regressor representing the implicit baseline. This setup is referred to as the “baseline model” and was later varied (see Sections 2.6 and 2.7) in order to test specific hypothesis using Bayesian model inference.

2.6. Bayesian model selection

Bayesian model inference was performed via cross-validated Bayesian model selection (cvBMS; Soch et al., 2016), as implemented in the SPM toolbox for model assessment, comparison and selection (MACS; Soch & Allefeld, 2018). This technique proceeds by calculating the voxel-wise cross-validated log model evidence (cvLME) for each GLM, applied to each participant’s data. Then, the cvLME maps from all subjects and models are submitted to voxel-wise random-effects Bayesian model selection (RFX BMS; Stephan et al., 2008; Penny et al., 2009; Rosa et al., 2010). Whenever a particular analysis addresses a comparison of model families rather than individual models (see below), a cross-validated log family evidence (cvLFE) is calculated from the cvLMEs of all models belonging to a family, before entering cvLFEs into RFX BMS. Group-level analysis results in selected-model maps (SMMs) which indicate, for each voxel, the most frequently selected optimal model for describing the measured group fMRI data. For each model or family comparison, we report continuous SMMs which indicate, for the winning model, the likeliest frequency (LF) of this model, based on the posterior distribution over candidate models from RFX BMS. The LF can be interpreted as the proportion of subjects in the population for which this model best explains the measured fMRI data or, alternatively, as the probability that the measured fMRI data of an individual subject were generated by this model (Stephan et al., 2008; Soch et al., 2021a).

2.7. Overview of the model space

There are two groups of variations that were applied to the baseline model (see Table 3 and Figure 8 in the Appendix): First, there were variations of no interest, testing different ways of describing the encoding event as such, without regard for actual encoding success. Second, the baseline model was modified to include different variants of the subsequent memory effect.

Variations of no interest included (i) replacing event duration of 2.5 s (the actual trial duration; model family “GLMs_TD”) with an event duration of 0 s (assuming point events; model family “GLMs_PE”); (ii) collapsing novel and master images (model family “GLMs_00”) rather than modeling them as separate regressors (model family “GLMs_0”); and (iii) separating indoor and outdoor images (model family “GLMs_x2”) rather than collapsing them into a single regressor (model family “GLMs_x1”). For details regarding variations of no interest, see Soch et al. (2021a), Section 3.1.

Model modifications introducing a subsequent memory effect included (i) splitting novel images into 2, 3, or 5 categories based on the corresponding later memory responses (model family “GLMs_2” and models “GLM_3” and “GLM_5”); (ii) parametrically modulating the novelty regressor with theoretical (i.e. a priori defined) functions of the subsequent memory response (model family “GLMs_1t”); and (iii) parametrically modulating the novelty regressor with empirical (i.e. single-subject-data-derived) functions of the subsequent memory response (model family “GLMs_1e”).

Model “GLM_5” included five categorical regressors, one for each of the five response categories of the recognition-confidence scale (“sure new”, “probably new”, “don’t know”, “probably old”, “sure old”). Model “GLM_3” collapsed the “probably" and “sure” responses, resulting in three categorical regressors (“old”, “don’t know”, “new”). Model family “GLM_2” collapsed the five response options to two categorical regressors, where neutral responses were either considered forgotten (“GLM_2nf”) or remembered (“GLM_2nr”), or split between these two categories, according to responses frequencies (“GLM_2ns”).

The parametric model family “GLMs_1t” employed parametric modulations of the single novelty regressor with continuous functions of the participant’s responses on the recognition-confidence scale, namely either a linear transformation (“GLM_1t-l”), or an arcsine transformation (“GLM_1t-a”) or a sine transformation (“GLM_1t-s”), in order to either put a more weight on the “sure” responses than on the “probably” responses (arcsine) or weighting the “probably” responses more strongly than the linear model (sine).

The parametric model family “GLMs_1e” also employed parametric modulations of the single novelty regressor with a function the participant’s memory response, which was, in this case, not defined a priori, but instead based on individual response frequencies, using either conditional probability, inverse probability or a logistic regression model for modulator values (see Table 3). For further details about modelling the subsequent memory effect, see Soch et al. (2021a), Sections 3.2-3.3.

In total, these variations resulted in 19 first-level GLMs describing the fMRI data scanned during memory encoding (see Appendix, Table 3 and Figure 8). This model space is successively explored using model family and individual model comparisons (see Supplementary Table S1). For some of these analyses, models were grouped into families according to their abbreviations. For example, “GLMs_1” is the family of all parametric-modulator models, “GLMs_2” is the family of all categorical models with two regressors, “GLMs_12” is the family of all memory models with one or two regressors, etc.

2.8. Statistical analyses

In addition to group-level Bayesian model comparisons, classical analyses were performed on the single-subject extent of novelty and memory effects according to voxel-wise log Bayes factors (LBF). For this purpose, the number of voxels exceeding LBF > 3 (corresponding to a Bayes factor threshold of exp(3) ≈ 20) on either the comparison for novelty processing (comparing models separating novel and familiar items vs. models not doing so) or subsequent memory (comparing models with one or two memory regressors vs. the baseline model) was extracted from each subject’s LBF maps and used as the dependent variable.

These numbers were then subjected to an analysis of covariance (ANCOVA) with diagnostic group as categorical independent variable and additional factors and covariates of no interest (acquisition site, gender, age, years of education, and years of employment; see Figure 2 and Supplementary Table S3), followed by two-sample t-tests of each diagnostic group against healthy controls as well as Bayesian t-tests against healthy controls to quantify evidence for the hypothesis of no difference (see Table 2). Moreover, binary support vector classifications (SVC) were performed using both contrasts (novelty and memory) as features to assess separability of each diagnostic group from healthy controls (see Table 2).

ANCOVAs and two-sample t-tests were run in MATLAB R2018b using the functions “fitlm”, “anova” and “ttest2”. Bayesian t-tests were implemented in JASP 0.18.3 with a two-sided alternative hypothesis and the default Cauchy prior, reporting the Bayes factor in favor of the null hypothesis BF₁₀ and the posterior median effect size δ_med. For classification analyses, SVMs were calibrated with regularization hyperparameter C = 1 and using k = 10-fold cross-validation. To account for unequal sample sizes among participant groups, we repeatedly drew subsamples with a constant number of observations per class (N = sample size of smallest group). Classification accuracy and 90% confidence interval as measures of predictive performance were obtained as averages across all S = 1000 subsamples. These analyses were implemented using Machine Learning for MATLAB (https://github.com/JoramSoch/ML4ML).

3.1. Participant groups differ by their behavioral response pattern

Behavioral response frequencies that were used as parametric modulators in the empirical parametric GLMs are shown in Figure 1. They included the conditional probability (i.e. the likelihood of a stimulus being old, given the subsequent memory response) and the inverse probability (i.e. the likelihood of a subsequent memory response, given the stimulus being old). Two patterns of variability across participant groups could be observed: First, “old” responses to old items (i.e. hits) became less frequent and “new” response to old items (i.e. misses) became more frequent when moving from HC towards AD (see Figure 1A). Second, the degree to which the subsequent memory response informs about an item being old diminished when moving from healthy controls towards AD patients (see Figure 1B). In both instances, healthy relatives of AD patients were qualitatively indistinguishable from healthy controls.⁴

• Download figure
• Open in new tab

Figure 1. Behavioral response data across diagnostic groups.

Empirically observed probabilities of (A) subsequent memory responses, given stimulus being old (“inverse probability”), and (B) stimulus being old, given a subsequent memory response (“conditional probability”). These probabilities were used as parametric modulators in the empirical parametric GLMs (see Table 3, model family “GLM_1e”). Error bars depict standard deviations (SD) across subjects. This figure corresponds to Figure 2B from the original publication.

• Download figure
• Open in new tab

Figure 2. Bayesian model comparison for novelty processing and subsequent memory.

Number of voxels exceeding a log Bayes factor of 3 (approximately, a Bayes factor of 20) in Bayesian model comparisons testing for (A) novelty processing (comparing models separating novel and familiar items vs. models not doing so) and (B) subsequent memory (comparing models with one or two memory regressors vs. the baseline model), for each subject from all five participant groups. Sample sizes are given in the left panel. Horizontal bars correspond to group-wise means. Statistics inside the panels correspond to the main effect of diagnostic group, controlled for gender, site, age, education and employment (F/p-value), as well as two-sample t-tests of each group against DELCODE healthy controls (significance markers). Abbreviations: HC = healthy controls, SCD = subjective cognitive decline, MCI = mild cognitive impairment, AD = Alzheimer’s disease, AD-rel = AD relatives. Significance: * p < 0.05, Bonferroni-corrected for ** number of tests per contrast (4) or *** number of tests and number of contrasts (4 x 2).

3.2. Variations of no interest are replicated in independent cohorts

Regarding modelling variations of no interest, i.e., modifications of the GLM unrelated to the subsequent memory effect, we could replicate all observations from the original study, albeit to a somewhat lesser degree in AD patients:

• First, the model family “GLMs_TD” was preferred throughout the gray matter in all subject groups (see Supplementary Figure S1), indicating that the actual trial duration of 2.5 s represents a better description of the measured neural signals than point events.

• Second, the model family “GLMs_0” was preferred in large clusters spanning temporal, occipital, and parietal cortical structures (see Figure 3A), indicating differential neural responses to novel vs. non-novel stimuli in these regions. Notably, this novelty effect was already diminished in AD patients (see Figure 3A, 4^th column).

• Finally, we observed that the model family “GLMs_x2” was preferred in selected portions of occipital cortex only (see Supplementary Figure S3), suggesting that the indoor-outdoor distinction was only important in a small subset of visual association cortices likely involved in scene processing. Since those regions were not the focus of our study, we omitted the indoor/outdoor distinction from the model, as in the original study with young and healthy HC (Soch et al., 2021a, p. 6).

• Download figure
• Open in new tab

Figure 3. Modelling preferences for novelty processing and subsequent memory.

Selected-model maps, showing (A) voxels with group-level preference in favor of the family of models separating novel and pre-familiarized images, against the family of models not considering novelty, and (B) voxels with group-level preference in favor of memory models, against the baseline GLM. Three sagittal slices (x-coordinates given at the left), roughly equal to those used in results display in the original study, are shown for each subject group (sample size given on top). Colored voxels display estimated group-level frequency (A) of the model family “GLMs_0” (novelty and master regressor), rather than the model family “GLMs_00” (both regressors collapsed), and (B) of the model family “GLMs_12” (one or two memory regressors), rather than the model “GLM_TD_0x1” (no memory effect). This figure corresponds to Figure S3B and Figure 3A from the original publication.

3.3. Subsequent memory effects decrease across the AD risk spectrum

Based on the outcomes described in Section 3.2., all following analyses were based on modifying a baseline model (i) using the actual trial length as event duration, (ii) modelling novel and master images separately, and (iii) collapsing indoor and outdoor images. First, we compared the family of models with either one parametric memory modulator or two categorical memory regressors (model family “GLMs_12”; i.e. models assuming a subsequent memory effect described using either one or two regressors) against the baseline GLM (model “GLM_TD_0x1”; i.e. a memory-invariant model).

While including an SME in the model improved the model fit in bilateral middle occipital gyrus (MOG), right temporo-parietal junction (TPJ) and the precuneus (PreCun) in the HC, SCD, and AD-rel groups (see Figure 3B; HC & AD-rel: no PreCun effect), memory-invariant models outperformed models considering subsequent memory performance in the MCI and AD groups (see Figure 3B, 3rd & 4th column).

To further substantiate the decline of memory – and, to some extent, novelty – effects across the AD risk spectrum, we performed a one-way ANOVA on the number of voxels with the respective model preferences, using diagnostic group as the between-subject factor. To this end, single subjects’ log Bayes factor (LBF) maps from model comparisons testing for effects of novelty processing (“GLMs_0” vs. “GLMs_00”; see Figure 2A) and subsequent memory (“GLMs_12” vs. “GLM_TD_0x1”; see Figure 2B), respectively, were generated, and the number of voxels exceeding LBF > 3 (corresponding to a Bayes factor threshold of exp(3) ≈ 20) was extracted as the dependent variable.

For both contrasts, there was a main effect of diagnostic group (novelty: F_4,446 = 4.00, p = 0.003; memory: F_4,442 = 3.64, p = 0.006) when additionally controlling for gender, site, age, educational years and employment years (see Supplementary Table S3 for detailed results), supported by significant differences of the MCI and AD, but not the SCD and AD-rel groups, from healthy controls. When using either a more liberal threshold (LBF > 1, corresponding to BF ≈ 3) or a more conservative threshold (LBF > 5, corresponding to BF ≈ 150), numbers of voxels were expectedly different, but the results were qualitatively identical in terms of observed effects and ranking of the groups.

Bayesian t-tests supported evidence for the null hypothesis (i.e., no group difference) when comparing HC against the SCD and AD-rel groups (all BF₀₁ > 3.47), but not when comparing HC against the MCI and AD groups (all BF₀₁ < 0.36; see Table 2). Furthermore, the number of supra-threshold voxels differentiated the AD and MCI groups from healthy controls when using SVM classification (see Table 2, last row).

3.4. Number of regressors effect increases across diagnostic groups

Among the GLMs modeling subsequent memory, we additionally tested for the influence of the number of regressors used to model the SME, which increases from the parametric memory models (1 parametric modulator per model) to the categorical memory models (2, 3 or 5 regressors; see Table 3). To this end, we calculated the LFE for each of these model families and subtracted the LME of the baseline GLM (0 memory regressors) to compute LBF maps in favor of memory models against a no-memory model. The rationale behind this was that some models assuming a memory effect might be too complex, thus performing even worse than memory-invariant models (see Soch et al., 2021a, Fig. 3B).

Note that the categorical model with five memory regressors (“GLM_5”) could only be estimated when each of the five behavioral response options occurred at least once. Therefore, these analyses were based on a subset of the participants (total N = 248; for N by group, see Figure 4). This procedure led to a very small N for the AD group, making the results for this group potentially less generalizable.

• Download figure
• Open in new tab

Figure 4. Influence of number of regressors on Bayesian model quality.

(A) Design matrix of a second-level GLM in which log Bayes factor (LBF) maps comparing models with 1, 2, 3 or 5 memory regressors against the baseline GLM were submitted to a one-way ANOVA with dependencies between levels (here: number of regressors). A conjunction contrast of a significant memory effect (lower contrast) and a significant linear decrease of LBF with number of regressors (upper contrast) was used to identify coordinates of a global maximum in the original study. (B) Average LBFs from these coordinates in each group, along with t-statistics from the contrast testing for linear decrease of LBF with number of regressors. Bar plots depict contrasts of parameter estimates of the group-level model; error bars denote 90% confidence intervals (computed using SPM12). Note that this analysis could only be run for a subset of the participants, namely all those subjects that used the full range of behavioral responses, such that “GLM_5” could be fitted, hence the lower sample sizes in comparison to the other analyses (cf. Table 1). Bar plots are shaded and statistics are not reported for sample sizes smaller than 10. This figure corresponds to Figure 3B from the original publication.

The LBF maps were subjected to a one-way ANOVA model with the four-level within-subject factor number of regressors (see Figure 4A). There was a main effect of number of regressors throughout the whole brain (p < 0.05, FWE-corrected; results not shown). By performing a conjunction analysis between (i) a contrast of “GLMs_1” and “GLMs_2” against baseline and (ii) a t-contrast linearly decreasing with number of regressors (see Figure 4B), a global maximum was identified in the original study (see Soch et al., 2021a, Figure 3B). From the coordinates of that global maximum ([x, y, z] = [-30, -85, 26]; MNI coordinates in mm), LBFs were extracted to calculate parameter estimates, standard deviations and statistics for the linear contrast (see Figure 4B). These showed that GLMs with one or two memory regressors outperformed the memory-invariant model in the HC, SCD, and AD-rel groups, while they performed equally or even worse than the memory-invariant baseline GLM in the MCI and AD groups (see Figure 4B).

3.5. Parametric outperform categorical models in memory-related brain structures

When treating GLMs with one parametric modulator describing subsequent memory (“GLMs_1”) and categorical GLMs using two regressors for remembered vs. forgotten items (“GLMs_2”) as model families (i.e., calculating voxel-wise cvLFEs and comparing the two families via group-level cvBMS), we observed a preference for parametric GLMs throughout the memory network (see Figure 5A), especially in regions that also showed a novelty effect (cf. Figure 3A). The overall preference for parametric models was present in all diagnostic groups and extended to almost all voxels in the MCI and AD groups (see Figure 5A).

• Download figure
• Open in new tab

Figure 5. Bayesian comparison of memory model families.

Selected-model maps, showing (A) voxels with group-level preference in favor of parametric models of the subsequent memory effect, using parametric modulators, against categorical models, separating response options, and (B) voxels with group-level preference in favor of empirical parametric models, using data-driven transformations, against theoretical models, using a priori defined transformations. The layout of the figure follows that of Figure 3. Colored voxels display estimated group-level frequency (A) of the model family “GLMs_1” (one memory regressor), rather than the model family “GLMs_2” (two memory regressors), and (B) of the model family “GLMs_1e” (empirical modulators), rather than the model family “GLMs_1t” (theoretical modulators). This figure corresponds to Figure 4 from the original publication.

Within the family of parametric memory models, we additionally compared theoretical GLMs (“GLMs_1t”) to empirical GLMs (“GLMs_1e”). Comparing these two sub-families via group-level cvBMS, we found an almost whole-brain preference for the empirical GLMs (see Figure 5B). This observation is in accordance with the original study with HC only (Soch et al., 2021a, Section 4.3) and was independent of disease status (see Figure 5B).

3.6. Model preferences within model families are replicated

Following the observation that models with one or two memory regressors outperform the memory-invariant model in large portions of the temporo-parieto-occipital memory network (see Figure 3B), we aimed to identify the optimal models within these different families. Within all sub-families of the memory models, we observed clear model preferences, consistent with observations in the original study (Soch et al., 2021a, Section 4.4):

• Among the two-regressor categorical GLMs, there was a clear preference for the model categorizing images with later neutral responses (response “3”) as forgotten items (“GLM_2-nf”), rather than either categorizing them as remembered items or randomly sampling neutral images as remembered or forgotten (see Figure 6A).

• Among the GLMs with theoretically based parametric modulators calculated, there was a clear preference for the model using an arcsine transformation of subsequent memory reports (“GLM_1t-a”) – which puts a higher weight on definitely remembered and forgotten items (responses “5” and “1”) –, rather than either a linear or a sine-transformed subsequent memory report (see Figure 6B). However, this preference was weaker in the AD group, possibly due a general deterioration of memory effects, in addition to a probably larger variance due to the relatively small size included individuals (N = 21).

• Within the GLMs with parametric modulators estimated from memory responses separately for each single subject, there was a clear preference for the model using the probability of “old” item given memory response as PM (“GLM_1e-ip”) over either employing the probability of memory response given “old” item as PM or estimating the conditional probability via a logistic regression model (see Figure 6C).

• Download figure
• Open in new tab

Figure 6. Winning models within memory model families.

Selected-model maps in favor of (A) the GLM treating neutral images as forgotten items (“GLM_2-nf”), compared to the other two-regressor models (“GLM_2-nr”, “GLM_2-ns”), (B) the GLM using an arcsine-transformed parametric modulator (“GLM_1t-a”), compared to the other theoretical-parametric models (“GLM_1t-l”, “GLM_1t-s”), and (C) the GLM using an inverse probability parametric modulator (“GLM_1e-ip”), compared to the other empirical-parametric models (“GLM_1e-cp”, “GLM_1e-lr”). The layout of the figure follows that of Figure 3. Colored voxels display estimated group-level model frequencies. Due to clear model preferences, only one (the most medial) slice is shown for each comparison. This figure corresponds to Figure 5 from the original publication.

3.7. Novelty and memory parameter estimates reflect model preferences

Finally, in addition to the group-level Bayesian model selection – which informs us about the relative quality of different GLMs (e.g., parametric vs. categorical models) in explaining the measured BOLD signals –, we also performed group-level Frequentist statistical tests to probe statistically significant effects of task manipulations (novelty processing and subsequent memory) within each diagnostic group.

Specifically, we statistically tested for significantly positive or negative effects on (i) the novelty contrast from the GLM with arcsine-transformed PM (“GLM_1t-a”)⁵, (ii) the memory regressor from the parametric GLM with arcsine-transformed PM and (iii) from the parametric GLM with inverse probability PM as well as (iv) the memory contrast from the categorical GLM categorizing neutral responses as forgotten. All analyses were performed using F-contrasts in SPM, and a stringent family-wise error (FWE) correction at voxel level was applied (FWE, p < 0.05, k = 10). We observed two general patterns:

• First, the voxels showing statistically significant effects in a particular fMRI contrast showed a large overlap with those exhibiting model preferences in the respective model comparison. This pattern was found for both, novelty processing (cf. Figure 7A vs. Figure 3A) and subsequent memory (cf. Figure 7B vs. Figure 3B), and statistical significances are generally a bit stronger than model preferences (cf. Figure 7 vs. Figure 3).

• Second, there was a decline of novelty and memory effects across the AD risk spectrum, with (i) prototypical memory network activations in the HC, SCD, and AD-rel groups, (ii) reduced novelty effects and largely absent memory effects in individuals with MCI, and (iii) almost non-identifiable effects of both novelty and subsequent memory in AD patients (see Figure 7 and Supplementary Figures S10-S13).

• Download figure
• Open in new tab

Figure 7. Novelty and memory effects from winning GLM.

On the second level, a one-sample t-test was run across parameter estimates obtained from (A) the novelty contrast (novel vs. master images) and (B) memory contrast (parametric modulator) of the GLM using the arcsine-transformed PM. In SPM, statistical inference was corrected for multiple comparisons (FWE, p < 0.05, k = 10). Colored voxels display F-statistics indicating (A) significant (positive or negative) differences between novel and master images and (B) significant (non-zero) effects of the transformed memory response, on average across subjects from the respective participant group. This figure corresponds to Figure 7A and 7B from the original publication.

When reporting cluster-level-corrected instead of whole-brain FWE-corrected results for these analyses, one additionally observes mild effects of novelty processing in AD patients and mild effects of subsequent memory in MCI patients, but no memory effects for individuals with AD (see Supplementary Figure S14).

4.1. Utility of parametric subsequent memory models in healthy older adults

We have previously demonstrated that subsequent memory models with one or two memory regressors are superior to memory-invariant models in healthy young and older adults and that, among the subsequent memory models, parametric models outperform categorical models (Soch et al., 2021a). In the present study, we were able to largely replicate this pattern of model preferences in the group of older healthy controls and also in individuals with SCD and in healthy relatives of AD patients. Assuming a novelty effect (i.e., a difference between novel and pre-familiarized master images) improves model quality in an extensive network including parietal, occipital and temporal cortices (hippocampus, parahippocampal and middle occipital gyri, MOG) as well as parts of the default mode network (precuneus, temporo-parietal junction, TPJ; see Figure 3A). Parts of this network further exhibited improved model quality when assuming a subsequent memory effect (see Figure 3B), particularly when employing a parametric subsequent memory model (see Figure 5A). As in our original study, BMS favored the model using an arcsine-transformed memory regressor among the theoretical parametric models (see Figure 6B), and the model using the inverse probability among the empirical models, (see Figure 6C).

As model family selection favored empirical over theoretical models, one might conclude that the model using the inverse probability would be the best-fitting model. However, it should be noted that a direct comparison of the two models in the original study yielded inconclusive results (Soch et al., 2021a). Furthermore, in all diagnostic groups, there were participants with a high number of (high-confidence) misses (see Figure 1). In such a situation, high-confidence hits and misses would both contribute to the “hits”, whereas items with low-confidence judgments would contribute to the “misses” of a regressor based on the inverse probability. This would rather reflect a participant’s response confidence than actual memory performance and thus constitute, at best, a questionable index of subsequent memory, despite providing a good model fit. Furthermore, different participants’ parametric modulators also operate at different scales which limits across-subject interpretability of their parameter estimates. High variability of response patterns among study participants would result in potentially large differences of the inverse probability regressor across subjects and possibly diagnostic groups, making group-level analyses difficult to interpret. We therefore recommend using the arcsine-transformed regressor that, like the inverse probability regressor, puts higher weight on high-confidence versus low-confidence hits which typically show more robust subsequent memory effects (Rugg et al., 2015; Hayes et al., 2017).

4.2. Decline of subsequent memory and novelty responses across the AD risk spectrum

Across the AD risk spectrum, we generally observed a progressive deterioration of memory model quality, with the effects of subsequent memory seen in HCs being largely preserved in the SCD and AD-rel groups, but practically absent in the MCI and AD groups (see Figures 2B/6B and Supplementary Figures S11-S13). Considering the rarity of studies reporting an actual subsequent memory effect rather than an encoding vs. baseline comparison (often a novelty effect) in patients with AD or MCI (Browndyke et al., 2013; Billette et al., 2022), our results point to the inherent difficulty of measuring a robust successful encoding response in these populations. In the group of AD patients, the absence of a robust fMRI effect (see Figure 7) was mirrored by a disrupted relationship between subsequent memory report (1-5) and item type (old vs. new) at the behavioral level (see Figure 1). This suggests that, with reduced behavioral accuracy, the predictive value of neural signals with respect to later remembering and forgetting also drops, such that fMRI responses do not covary with subsequent memory reports when the latter most likely reflect mere guessing, at least to a considerable proportion. On the other hand, the declining subsequent memory effect across the AD spectrum could also be interpreted as indicative of the memory decline, with a potential diagnostic or prognostic utility (Soch et al., 2024).

Despite showing a preserved, albeit diminished, relationship between subsequent memory report and item type (see Figure 1), individuals with MCI still exhibited, similarly to AD patients, a preference for memory-invariant models over subsequent memory models (see e.g. Figures 2B and 3B). This may be best explained by the notion that individuals with MCI, by definition, show clinically measurable deficits in memory performance (Petersen et al., 1999), and are thus likely to also exhibit higher guessing rates and thereby a decreased signal-to-noise ratio in fMRI subsequent memory models. On the other hand, not all individuals diagnosed with MCI eventually convert to AD (Grundman, 2004) which might be of importance when deriving putative biomarkers from fMRI data (Soch et al., 2023b).

Effects of novelty processing, on the other hand, were preserved, albeit at a reduced level, in individuals with MCI, but largely absent in patients with manifest AD (see Figures 2A and 6A). As the expression of a novelty effect requires prior successful familiarization of the baseline images (here called “master” images), we suggest that, at the MCI stage, encoding can still take place to some degree, for example with repeated presentation as was done with the master images. In the AD patients, on the other hand, familiarization might have been less effective, resulting in a poorer ability to distinguish novel from pre-familiarized images.

Despite the largely absent subsequent memory effect in the MCI and AD groups, the preference for parametric over categorical models of the subsequent memory effect was also evident in the MCI and AD groups and possibly even more pronounced than in the HC and SCD groups (see Figure 5A). In our view, the most parsimonious explanation for this observation is that, due to a pronounced reduction or even absence of the memory effect in the MCI and AD groups, BMS will inherently favor the parametric models due to their lower complexity.

The same pattern as in healthy older controls was, at least qualitatively, also observed in individuals with SCD and in healthy older relatives of patients with AD (see Figures 2, 3, 4, 6). Compatibly, individuals with SCD and healthy relatives also showed behavioral memory performance and fMRI signals comparable to that of healthy controls (see Figure 1 and 6). This points out the need to stratify SCD into those with subjective complaints and normal performance vs. those with subjective complaints and sub-normal performance (Koppara et al., 2015), possibly based on amyloid pathology (Jessen et al., 2022; Soch et al., 2024). Like the SCD group, healthy relatives often showed model preferences and activity patterns qualitatively identical to those of HCs (see e.g., Figures 2, 3 and 6), consistent with AD relatives in the DELCODE study not significantly differing from HCs in terms of MMSE total (see Table 1), NPT global score, the PACC5 neuropsychological composite score, or ApoE genotype (see Soch et al., 2023b). Thus, the overall preserved patterns of model preference in the SCD and AD-rel groups suggest that moderately increased clinical (SCD) or genetic (AD-rel) risk for AD is not per se associated with a disruption of functional memory network integrity.

4.3. Comparison with previous studies of memory encoding in AD and MCI

At first sight, our results seem to be at odds with previous studies reporting encoding-related fMRI activation differences between healthy controls and individuals with AD or MCI (for meta-analyses, see Browndyke et al., 2013; Nellessen et al., 2015; Terry et al., 2015). However, it must be noted that most studies contributing to those meta-analyses did not report subsequent memory contrasts in a strict sense, but contrasts comparing encoding against a low-level baseline or novelty contrasts (for exceptions, see Gould et al., 2005; Heun et al., 2007; Kircher et al., 2007; Trivedi et al., 2008). The broad inclusion of different encoding contrasts may explain the conflicting results of those meta-analyses with respect to encoding-related hippocampal activations (Terry et al., 2015: HC > AD; Nellessen et al., 2015: MCI > HC). A common finding in all three meta-analyses was, on the other hand, the relatively increased encoding-related activation of DMN structures, particularly precuneus.

The precuneus typically shows deactivations during successful encoding (Kim et al., 2011), which are attenuated in older adults (Maillet and Rajah, 2014; Kizilirmak et al., 2023; Schott et al., 2023). Deactivations of the precuneus are not specific to successful encoding, but have also been observed during novelty processing (Schott et al., 2023) and are more pronounced in individuals with SCD and MCI compared to HC (Billette et al., 2022). With respect to the present results, it must be noted that, at a more liberal threshold (p < 0.05, FWE-corrected at cluster level), we did observe reduced DMN deactivations in the MCI group during both, novelty processing and successful encoding (see Supplementary Figure S14).

It must be noted that our results with respect to the reduced expression of fMRI subsequent memory effects in AD and, to a lesser extent, also in MCI may not necessarily apply to other, for example, electrophysiological modalities like event-related potential (ERPs) to the same extent. ERP studies of successful encoding typically show frontal and centro-parietal positive deflections for subsequently remembered compared to subsequently forgotten stimuli (Paller et al., 1987; Fernández et al., 1998; Schott et al., 2002; Otten et al., 2007). While the importance of a sustained, positive potential (also referred to as “P600”) for successful encoding has been noted in the context of AD and MCI (Jackson and Snyder, 2008), a reduced P600 amplitude has thus far only been reported in the context of word repetition (Olichney et al., 2006). As such, it may correspond to the reduced or absent late positive component (LPC) in AD (Tendolkar et al., 1999), which likely reflects context-rich, recollection-based retrieval and depends on the integrity of the hippocampus (Düzel et al., 2001). Notably, the most recent available comprehensive review of cognitive ERP studies in AD and MCI (Paitel et al., 2021) did not include any studies of the subsequent memory effect. Therefore, while studies of repetition and retrieval point to abnormal memory-related ERPs in AD and MCI, specific alterations related to successful encoding are yet subject to future research.

4.4. Limitations and directions for future research

The primary benefit of this investigation lies in the use of cvBMS as an objective and unbiased procedure for voxel-wise fMRI model selection which accounts for both, model accuracy and model complexity, and allows for non-nested model comparison (unlike statistical significance tests on additional regressors; see Soch et al., 2016). A key limitation in this approach, however, is that cvBMS only provides information about the model quality without allowing for direct inferences on the sign or magnitude of a given regressor or contrast. For example, the preference for novelty or subsequent memory models within the default mode network (DMN) in a memory-impaired older person might originate from the prototypical encoding-related deactivations observed in healthy young and also cognitively unimpaired older individuals (Kim, 2011; Maillet & Rajah, 2014; Kizilirmak et al., 2023), which are associated with memory performance (Schott et al., 2023) and attenuated in individuals with memory impairment (Düzel et al., 2011; Maillet & Rajah, 2014; Billette et al., 2022) . Moreover, it cannot be excluded that cvBMS shows model preferences in voxels outside the networks of interest, even in white matter. This is simply a consequence of the fact that, in case of poor model fit, the most parsimonious model will be preferred. Therefore, one must cautiously examine the preferred models with respect to the plausibility of the voxels or clusters in which a model comes out as preferred model from cvBMS and, furthermore, complement cvBMS results by GLM-based analyses.

A limitation common to most fMRI studies of memory function in in AD is the low number of participants in the most severely affected AD group. While the number of 21 participants in this study was at the upper end compared to previous studies (see meta-analysis by Terry et al., 2015), it was nevertheless below the numbers desirable to obtain reproducible results (Button et al., 2013; Turner et al., 2018). Sample size was even smaller in the comparison of all models, which included only 9 individuals from the AD group, and we therefore refrained from interpreting the results of that group (see Figure 4). In addition to sample size, within-group heterogeneity in the clinical groups may potentially contribute to a lower signal-to-noise ratio and thus reduced expression of novelty-related and memory-related fMRI activation patterns. While we aimed to reduce such heterogeneity, for example by including only individuals with amnestic, but not non-amnestic MCI (Jessen et al., 2018), we cannot exclude a potential influence of, for example, different atrophy patterns within the clinical groups (Baumeister et al., 2024). Ultimately, replication studies are needed to corroborate our findings, along with meta-analytic approaches with more stringent selection of contributing studies and contrasts (see Section 4.3).

Another more general limitation inherent to all fMRI studies in populations with cerebrovascular risk (e.g., aged populations, populations with AD/AD risk) is that changes of the cerebrovascular system can potentially affect the BOLD response (Sweeney et al., 2018; Zimmermann et al., 2021). Cerebral blood flow shortfalls are early findings in neurodegenerative disorders. Baseline differences in cerebral blood flow rates between experimental groups have the potential to produce a confound in the BOLD signal. However, in our study, we addressed specific contrasts rather than BOLD signal relative to baseline. Furthermore, differences between diagnostic groups do not only include reduced deactivations, but also atypial activations on the memory contrast (i.e., effects of subsequent memory) in DMN regions for Alzheimer’s disease patients (see Figure 1E in Soch et al., 2024). Therefore, we conclude that, although the potential impact of cerebrovascular differences cannot be excluded, it is, in our view, unlikely that vascular effects are the main drivers of our results. Furthermore, potential vascular contributions to the reduced expression of fMRI subsequent memory effects in individuals with MCI and AD do not call into question that the effects are reduced. Potential differences in cerebrovascular health therefore warrant caution with respect to mechanistic interpretations of our findings, but are unlikely to affect their potential diagnostic utility (see also Soch et al., 2024).

A limitation more specific to the present study is that participant groups significantly differed regarding age range, gender distribution, acquisition site (see Table 1), ApoE genotype and cognitive measures (MMSE total, NPT global and PACC5 scores; see Soch et al., 2024). While some of these differences are a direct consequence of the study design (e.g., AD patients show lower cognitive performance than the HC or SCD groups), other variables constitute confounds which cannot be as easily integrated into cvBMS as, for example, in a statistical design like a linear regression analysis.

We suggest that, to overcome at least some of the aforementioned limitations, future studies should assess the potential of reductionist or whole-brain multivariate data analysis approaches to both test for pathology-related deviations from more prototypical fMRI activations and assess the influence of potential risk factors (e.g., amyloid pathology) or confounding variables (e.g., study site). To this end, we have employed contrast maps obtained with the winning theoretical parametric GLM (i.e., the model using the arcsine-transformed memory regressor) to calculate single-value scores (Soch et al., 2021b; Richter et al., 2023). In a direct follow-up to the present study, we describe the extent to which these scores can further differentiate between the diagnostic groups in the clinical sample described here (Soch et al., 2024). Furthermore, we are currently working on improved computational modeling of the subsequent memory reports, which could be used in the future to differentiate participant groups based on purely behavioral response patterns (Soch et al., 2022).

4.5. Conclusions

Taken together, we could replicate the preference for parametric over categorical models of the fMRI subsequent memory effect in healthy older adults (Soch et al., 2021a) and demonstrate that this pattern also applies to cognitively unimpaired individuals at increased risk for Alzheimer’s disease (SCD, AD-rel). In individuals with MCI or manifest AD, on the other hand, memory-invariant models outperform any model considering the subsequent memory effect. Our results suggest that voxel-wise memory-related fMRI activity patterns in MCI or AD should be interpreted with caution and point to the need for additional or alternative analyses strategies, such as whole-brain approaches, in these populations.