ABSTRACT
INTRODUCTION There is a lack of cognitive tools to predict disease progression in mild cognitive impairment (MCI) and Alzheimer’s disease (AD).
METHODS We assessed patients with MCI, AD, and cognitively healthy controls (cHC) using NIH toolbox assessments for attention/concentration and executive functioning and overall cognitive decline by the Alzheimer’s Disease Assessment Scale-Cognitive (ADAS-Cog).
RESULTS Among 183 participants over a median follow-up of 540 days, both between- and within-subjects variance in NIH toolbox and ADAS-Cog assessments increased from cHC to MCI to AD patients. Among patients with AD, pattern comparison processing speed (PCPS) and dimensional change card sort tests (DCCS) declined at 3 and 6 months prior to global cognitive decline (p=0.008 & 0.0012). A 5-point decrease in either PCPS or DCCS increased risk of global cognitive decline (HR 1.32 (1.08-1.60) and 1.62 (1.16-2.26)).
DISCUSSION Testing for cognitive domains of attention/concentration and executive functioning may predict subsequent global cognitive, and functional decline.
INTRODUCTION
Today there are nearly 6.9 million older Americans living with Alzheimer’s disease (AD) (1). AD is a progressive neurodegenerative disorder, however, there is much variability in the observed rates of cognitive decline across the spectrum of AD (2–4). The average duration of the disease varies between 4 and 8 years, with some upwards of 20 years (5). There are known demographic and clinical characteristics as well as radiological and genetic features that associate with the rate of cognitive decline (6, 7). More recently both central and peripheral biomarkers have been identified as predicting long-term cognitive decline (8–10). However, these risk factors do not provide short-term predictions of AD disease trajectory. The ability to predict the timing of when a patient will become completely dependent on others would be a powerful tool, enabling patients and families to optimize care and, with newer disease-modifying therapeutics, possibly optimize timing of therapeutic interventions.
The sequence of deficits affecting different cognitive domains in AD commonly starts with an individual’s executive functioning and processing speed (11). Executive functioning defines the higher-level cognitive skills used to control other cognitive abilities (12, 13) while processing speed is the time it takes to execute multi-step information processing in a mental task (14). Both executive functioning and processing speed support other cognitive processes (15, 16) and may serve as a useful cognitive markers for the early trajectory of AD symptoms, being potentially predictive of a more rapid decline (17, 18). Thus, both of these domains may serve as predictors of an inflection point in AD symptoms, when the individual might begin a period of more rapid global cognitive decline, losing function and freedom.
In current clinical practice, there are no established guidelines or tools for monitoring cognitive function after diagnosis for the sole purpose of predicting decline. We reasoned that given that deficits in executive function and processing speed often precede more severe cognitive deficits, standardized testing of these two domains may hold value in clinical practice. While not specifically developed for older populations, the U.S. National Institutes of Health Toolbox for the Assessment of Neurological and Behavioral Function (NIH toolbox) includes a Cognition Battery (CB) that includes brief, comprehensive tests for these functions (19). This CB contains a Dimensional Change Card Sort (DCCS) test that is a sensitive and reliable measure of executive functioning and cognitive flexibility (20), and a Pattern Comparison Processing Speed Test (PCPS), which can also evaluate attention and concentration (21). These NIH toolbox assessments are easy to administer and offer standardized, non-invasive measures which can be compared across studies (19).
The aim of this interim analysis of the Gut-brain Alzheimer’s disease Inflammation and Neurocognitive Study (GAINS) cohort was to evaluate early cognitive data as potential predictors of AD-associated global cognitive decline as measured by the modified Alzheimer’s Disease Assessment Scale-Cognitive Subscale 13 (ADAS-Cog13). ADAS-Cog is a well-established standard for the assessment of cognitive function in patients with AD with moderate to severe disease and is routinely used to help diagnose patients as having MCI, AD, or normal cognition (22) as well as to measure clinically relevant changes (23, 24). The addition of executive functioning and functional ability items to create ADAS-Cog13 (25) from the original 11 question set (ADAS-Cog11) has improved the test’s sensitivity in milder disease (26), but the test still lacks an assessment of processing speed and skews towards language and verbal memory tasks. While greater changes in ADAS-Cog and ADAS-Cog13 scores over time have been associated with AD versus MCI (27), both tests remain in essence, a measure of cognitive ability at a given point in time.
We followed participants in the GAINS cohort at 3-month intervals and assessed their NIH toolbox DCCS and PCPS and ADAS-Cog13 scores. In this longitudinal cohort, a 5-point decrease in the cognitive domains of DCCS or PCPS was predictive of global cognitive and functional decline as measured by the ADAS-Cog13.
METHODS
Study Setting and Population
Older adults, ≥60 years of age, living independently, were recruited into the Gut-brain Alzheimer’s disease Inflammation and Neurocognitive Study (GAINS) and included those diagnosed with Alzheimer’s disease (AD), amnestic mild cognitive impairment (MCI), or had no cognitive issues, serving as healthy controls (cHC). Subjects were included in this sub-group analysis if they had completed 4 study visits (270 days). This prospective cohort study was approved by the institutional review board at the University of Massachusetts Chan Medical School.
Data Collection
We collected demographic measures at enrollment, which included age, sex, race, ethnicity, level of education, and past medical history. At enrollment and at each subsequent visit, we collected information on nutritional status, frailty, and any hospitalizations or changes in medication. We assessed nutritional status using the Mini Nutritional Assessment (MNA) tool (28–30). Subjects were categorized as normal, at risk, or malnourished based on the MNA. Frailty was categorized according to the validated and widely-utilized Canadian Study of Health and Aging’s (CSHA) 7-point Clinical Frailty Scale (31).
During each visit, cognitive testing was performed. We used the modified Alzheimer’s Disease Assessment Scale-Cognitive Subscale 13 (ADAS-Cog13). ADAS-Cog was developed to measure cognitive dysfunction in AD, but is now used for assessment of cognition in other dementia or pre-dementia populations, and is one of the most widely-used cognitive scales in clinical trials (27, 32). We also utilized the NIH toolbox to assess changes in cognition under the subdomains of attention/concentration, using the Pattern Comparison Processing Speed Test (PCPS), and executive functioning using the Dimensional Change Card Sort (DCCS) (33). The Toolbox PCPS provides a reliable measurement of complex processing speed over the lifespan that is sensitive to neurological insults (34).
For our measure of global cognition, we chose to use the ADAS-Cog13 due to its improved responsiveness as compared with the original ADAS-Cog among people with MCI and early disease course AD, as well as its ability to distinguish different stages of AD (22, 26).
Longitudinally, we used a 4-point change in the ADAS-Cog13 score from the day 0 visit as clinically meaningful, either as an improvement (≤ -4 points) or as a decline ≥ +4 points) (35–37). Those that remained within 4 points of their initial visit ADAS-Cog13 scores were categorized as stable, while those with improvement were categorized as improved, and declining as decline. We chose the first timepoint where a subject had a change in ADAS-Cog13 score of ≤ -4 points as the point of decline and the previous visit as the 3 months prior, and the visit before that as 6 months prior to decline. All other previous timepoints were labeled as baseline for analysis.
Determination of AD diagnosis was made by previous cognitive testing coupled with various neuroimaging techniques performed by the subjects’ own physician. Polypharmacy was defined using the most commonly reported definition of five or more daily medications (38). We subdivided our cohort into 4 age categories for analysis: 1) 65 to 74; 2) 75 to 84; 3) 85 to 94; and 4) ≥95 years of age. This has been previously validated in demonstrating signatures of frailty in the gut microbiota (39–41). All survey data was collected by trained research staff or study physicians. Study data were collected and managed using REDCap electronic data capture tools hosted at the University of Massachusetts Chan Medical School.(42)
Data Analysis
We used chi-square tests to compare categorical variables, and the student’s independent-samples t-test for continuous variables between patient groups with different outcomes from their baseline data. To test the equality of standard deviations (variance) we used the sdtest package in Stata. Cox proportional hazards models were used to evaluate the NIH neuropsychological measures that predicted time to significant global cognitive decline, as defined by a greater than 4-point increase in ADAS-Cog13 testing, as described above. The hazard ratio indicates the change in risk per 5-unit change in the predictor. For instance, if the hazard ratio for PCPS is 1.57, each 5-point change in PCPS equates to an increases risk by 57%. Two sets of adjusted Cox models were completed each for PCPS and DCCS, where these neuropsychological measures were adjusted for age (in years), sex, education level, frailty, malnutrition, and polypharmacy. The software used for the analyses was Stata, Release 13.1 (StataCorp LLC, College Station, TX) and Prism Release 10 (GraphPad by Dotmatics, Ltd., United Kingdom).
RESULTS
Clinical and cognitive scores differed among GAINS cohort patient groups
We enrolled 243 older adults, and at the time of this analysis, 183 (75.3%) completed 4 study visits for a longitudinal length of 270 days and were eligible for the analysis. Of these 183 adults in the GAINS cohort, 131 (71.2%) were cHC while 24 (13.0%) had AD and 29 (15.8%) had MCI. This cohort was predominately white (95.1%) and non-Hispanic (91.8%). Unsurprisingly, adults with AD and MCI were older, with higher frailty and malnutrition scores as well as taking more daily medications as defined by polypharmacy (Table 1). This is consistent with what is known about frailty and malnutrition in relation to AD and mild cognitive impairment (43–46). Both frail and pre-frail elders usually have poorer cognitive status (47), and frailty has been linked to the extent of AD pathophysiology (44). Malnutrition is also closely linked to decreased cognitive functioning (43). Not surprisingly, mean score on the ADAS-Cog13 increased from cHC, to MCI and AD subjects, and NIH Toolbox module mean scores decreased from cHC, to MCI and AD subjects (Table 1). These results further validate the ADAS-Cog13 in responsiveness between cognitively healthy individuals and those with MCI versus AD. They also demonstrate the utility of the NIH toolbox cognitive modules in distinguishing these populations.
Cognitive Outcomes in AD was not correlated with initial cognitive scores
Among the GAINS cohort we noted 3 cognitive trajectory patterns on longitudinal ADAS-Cog13 testing. Using a change in score of +/-4 in ADAS-Cog testing for 2 or more timepoints to categorize outcomes, 48 patients improved their scores over time (26.1%), 119 patients remained stable (64.7), and 17 patients experienced cognitive decline (9.2%). Of those with AD, 14 had cognitive decline (58.3%) while 8 remained stable (33.3%) and 2 improved (8.3%). Among AD patients, there were no significant differences among the 3 cognitive outcomes observed (Table 2). Importantly, there were no differences in the day 0 cognitive scores using the ADAS-Cog or NIH toolbox among the AD subjects by cognitive trajectory outcome. In the cHC and MCI patient groups, there were a combined n=5 patients with decline (3.1%), who were older and had worse initial ADAS-Cog testing scores (Supplemental Table 1).
Significant variance in cognitive testing exists between cognitively healthy older adults and those with MCI and AD
To further characterize the baseline characteristics of our study groups (cHC, MCI, AD), we examined the variance between individuals (between) as well as within-person variance (within) (Table 3) as standard deviations are not easy to interpret without a frame of reference (48). Both the between- and within-variance increased from cHC to MCI to AD patients for ADAS-Cog13 testing (Table 3). For both the NIH toolbox assessment of PCPS and DCCS, we did not observe differences in within-group variance across groups. This is reflected in the increasing intraclass correlation coefficient as one goes from cHC to MCI to AD among all cognitive tests (Supplemental Table 2, all p<0.01). The values in Table 3 indicate that there is considerable within-person variability in each of the measures of cognitive functioning. Moreover, the within-person to between-person variability ratios were somewhat larger for the cHC patients compared to those with MCI or AD mostly due to the near doubling of between variance as we move from HC to MCI to AD across all cognitive testing types. The variance for the cHC and MCI groups indicate that the variation for a given individual from one test occasion to the next is more than half as much as the variation from one person to the next. This was the opposite tendency for AD patients where variation for the individual was one quarter to one third of the variation from one person to the next across cognitive tests.
NIH Toolbox assessments of executive functioning decline as early as 6 months prior to cognitive decline measured by ADAS-Cog13
In light of the differences in variances between tests among patients, we next sought to determine whether longitudinal patterns between cognitive outcomes (declined, stable, improved) were correlated with cognitive testing trends. Among the AD patients within the GAINS cohort, we first explored differences between those who experienced a decline in cognition versus those who did not (both stable and improved patients). We did not observe any differences in demographic or clinical characteristics, including in the medications taken by the subjects during the study period (Supplemental Table 3). We did, however, notice a significant decline in executive functioning testing, in both NIH toolbox PCPS and DCCS, at the 3- and 6-month visits before a decline in cognition measured by the ADAS-Cog13 compared to all other timepoints where the ADAS-Cog13 testing was stable (Figure 1a). There were no significant differences in ADAS-Cog13 testing scores at these same time points. The differences from baseline score tests are visualized in Figure 1b.
We next performed univariate cox models predicting cognitive decline by ADAS-Cog for both NIH toolbox domains for PCPS and DCCS among AD patients. We used a 5-point decline in both NIH CB tests as predictor of general cognitive decline given the mean change at both 3 and 6 months prior in each test was about 5 points. Both in the crude and adjusted models, a 5-point change in PCPS or DCCS was associated with a 24% to 32% or 44% to 62% increased risk of cognitive decline respectively (Table 4). In the modeling, adjustments were made for age, sex, education, frailty, malnutrition and polypharmacy.
DISCUSSION
In this study we found that as early as 6 months prior to a global cognitive decline, there were significant decreases in processing speed and executive functioning among AD patients using the NIH toolbox CB assessments for PCPS and DCCS. There was also a noted increase in the between-person variability from cHC to MIC to AD subjects using either the ADAS-Cog or NIH toolbox modules, however the within-group variability only increased between these groups in the ADAS-Cog assessments, with the greatest variability in among AD patients. A 5-point decrease in either PCPS and DCCS resulted in a greater than 30% increased risk of subsequent global cognitive decline. We propose here that these NIH toolbox assessments for executive functioning and processing speed may serve as a monitoring tool to predict which AD patients will go on to experience clinically significant cognitive decline.
Executive function comprises the higher-level cognitive skills used to control and coordinate other cognitive abilities and behaviors (12, 13). Deficits in executive functioning have been shown as one of the most useful cognitive markers for the early detection of AD (17), and declining performance can be detected 2-3 years before the diagnosis of AD (49). Executive dysfunction occurs in all stages of AD and has been linked to functional decline in activities of daily living (50, 51). Executive functioning is also one of the cognitive domains in AD that shows the greatest decline and can indicate a faster disease progression (52–54). The ADAS-Cog test does a poor job of testing for executive functioning. It was built based on the original ADAS-Cog (55), and the ADAS-Cog13 or ADAS-Cog-Modified had delayed word recall or number cancellation added in order to improve the tests responsiveness, to cover the range of mild to moderate AD (25). Others tried adding additional testing domains to the ADAS-Cog test to better cover executive functioning testing such as the ADAS-Cog-Exec (56) and ADAS-Cog-Plus (26). These additional testing modules are not universally used, with the ADAS-Cog still considered the gold standard (27) especially for assessing efficacy of AD treatments.
As we age, both executive functioning and processing speed decline, and this decline is linked to performance in learning and memory (57). The processing speed theory states that the age-related decline in processing speed is the fundamental mechanism with which memory declines with normal aging (58). However, executive functions and processing speed can differentially influence memory decline (57). Processing speed is thought to serve as the foundation for other cognitive processes (15) and it is associated with subsequent deficits in other cognitive domains such as working memory (59), attention (60) and memory (61). Disproportionate slowing of processing speed has been shown to be related to a faster decline in AD (18). Our finding is consistent with a predictive role of processing speed change: the NIH toolbox CB Comparison Processing Speed Test to assess processing speed in GAINS participants was sensitive to early cognitive change, with decreases in processing speed preceding global cognitive decline, with a 5 point drop in score increasing the risk of cognitive decline by greater than 30%, after adjustment.
Instead of expanding the ADAS-Cog to improve its sensitivity, it might be of greater benefit to predict cognitive decline by periodically test executive functioning with other standard measures. The NIH toolbox CB is a set of brief measures assessing cognitive domains including executive functioning studies (19). Subjects that are part of a clinical trial could self-administer these tests as an alternative to the ADAS-Cog, which takes upwards of 45 minutes to administer and needs to be done in-person by trained staff (27). Remote digital cognitive testing is now being shown to be an accurate method to detect cognitive impairment (62–64). A robust tool with a 3 to 6-month predictive window would offer patients and families a reasonable timeframe to make practical care arrangements such as changing living situation, finding caretakers, or applying for elder care benefits and services.
This study does have limitations. First, the majority of the GAINS cohort was without AD, which influences the within-group variance in the AD group. Testing NIH toolbox assessments for their ability to predict cognitive decline in a larger longitudinal cohort would strengthen the findings. Additionally, the GAINS cohort was mostly white and non-Hispanic, limiting the generalizability of our data. These limitations are balanced by the frequent in-person model to assess both ADAS-Cog and the NIH toolbox CB domains.
Conclusion
Based on our findings, we would suggest that brief assessments of both executive functioning and processing speed may serve as a marker of subsequent global cognitive decline. This can be helpful clinically for planning the timing of treatments, interventions, or life management, especially if executive function and processing speed testing is potentially more rapid than a comprehensive cognitive testing session, and more feasibly performed frequently. Tools such as PCPS and DCCS could also help researchers as well as clinicians with monitoring efficacy of AD treatments as part of clinical trials of disease-modifying therapy.
AUTHOR CONTRIBUTIONS
JPH (Data curation; Conceptualization; Formal analysis; Investigation; Project administration; Funding acquisition; Writing – original draft); AMB (Methodology; Writing – review & editing); SNO (Supervision; Data curation; Writing – review & editing); PD (Supervision; Data curation; Writing – review & editing); PMM (Data acquisition; Data curation; Writing – review & editing); IS (Data acquisition; Writing – review & editing); LR (Data acquisition; Writing – review & editing); YSL (Resources; Writing – review & editing); VB (Conceptualization; Formal analysis; Methodology; Writing – review & editing); BAM (Conceptualization; Writing – review & editing).
FUNDING
This study was designed and carried out at the University of Massachusetts Chan Medical School. JPH was supported by an Alzheimer’s Association Grant (2019-AARG-NTF-641955) and NIH grants from the National Institute on Aging (grant numbers: 2019-AARG-NTF-641955, R01AG067483-01). This prospective cohort study was approved by the institutional review board at the University of Massachusetts Chan Medical School (IRB docket H00021745).
CONFLICT OF INTEREST
The authors have no conflict of interest to report.
DATA AVAILABILITY
The data supporting the findings of this study are available on request from the corresponding author. The data are not publicly available due to privacy or ethical restrictions.
ACKNOWLEDEMENTS
We would like to thank the administration and staff from the Clinical Research Center here at UMass Medical Center and the Center for Clinical and Translational Sciences at UMass Chan Medical School for clinical facilities that supported the GAINS cohort.