Correlates of patient-reported cognitive performance with regard to disability

Introduction

Multiple sclerosis (MS), the most common inflammatory and neurodegenerative disease in young adults, affecting more than two million people worldwide¹, is characterized by substantial clinical heterogeneity. Capturing the full spectrum of disease activity including the less visible burden remains a challenge². Between 34 and 65 % of persons with multiple sclerosis (PwMS) suffer from cognitive impairment. Cognitive processing speed and visual learning and memory are impaired in more than 50% of PwMS, while verbal and working memory impairment is seen in about 30%. Impairment of visuospatial abilities and executive functions are found less commonly, in about 20% of patients^3-6.

Because neuropsychological test batteries^7,8 are time-consuming, single screening and monitoring tools are proposed. The Symbol Digit Modalities Test (SDMT), a sensitive measure of information processing speed⁹, is considered the best rapid assessment tool of cognition in clinical practice¹⁰ and has potential as a sentinel test for cognitive impairment in MS¹¹. The Multiple Sclerosis Neuropsychological Questionnaire (MSNQ) was developed as a screening test for patients and informants to assess perceived cognitive impairment and to a lesser extent personality and behavioural changes without requiring professional expertise. The test consists of 15 questions that are scored by frequency of symptoms, with a patient-report and an informant-report version¹².

However, the correlation patterns for the patient-report and informant-report version differ. While only the patient-report version correlated with screening measures for depression^12-16, the correlations of the informant-report version with objective cognitive test results were consistently more pronounced than the correlations of the patient-report version with these tests^12,15-17. Even though the patient-report version frequently but weakly correlated with objective cognitive test results, these findings resulted in the proposal to consider only the informant-report version as a sensitive and validated screening tool for cognitive impairment whereas increased MSNQ scores obtained by the patient were attributed to depression¹³. Benedict et al. proposed to use the patient-report MSNQ as a screening measure for cognitive impairment or depression, which nevertheless resulted in only a slight change in sensitivity, from 83% to 80%, and specificity, from 60% to 68%, when compared to just screening for cognitive impairment¹⁷. Recent findings of associations with reduced employment and work performance^18,19, health-related quality of life¹⁸, health-promoting behaviours^18,20 and reduced thalamic, cortical grey matter²¹ and hippocampal volumes²², nevertheless suggest a substantial impact of subjective cognitive complaints in PwMS, regardless of the link with depression.

An alternative explanation for the variable associations found between patient-reported and objective cognitive performance is the variation in EDSS scores. While Kurtzke Expanded Disability Status Scale (EDSS²³) scores were not considered when selecting questions for the MSNQ¹², later studies included patients with a wide variety of neurological disability^12-14,16,17. We hypothesise that the patient-report MSNQ performs best as a cognitive screening measure in patients with lower EDSS scores, based on the assumption that several questions of the MSNQ may not apply to patients with higher EDSS scores. Increased physical disability is commonly associated with reduced activity and participation. Furthermore, these patients are at increased risk of failing objective cognitive tests^24,25 even though they may not report cognitive symptoms^26,27. Reduced awareness and lacking insight could explain why self-report MSNQ scores are not necessarily increased in a substantial proportion of patients with moderate to severe disability, despite objective cognitive impairment.

To evaluate our hypothesis, we investigate correlations between MSNQ and SDMT scores in low, medium and high EDSS groups with and without correcting for other variables. Furthermore, we assess the value of the patient-report MSNQ as a screening tool for both depression and cognitive impairment through the development of a composite measure of impairment in low, medium and high EDSS groups of a large patient sample.

Materials & Methods

The study protocol, survey, patient information and informed consent were approved by the ethics committees at the University Hospital Brussels (B.U.N. 143201630261, 2016/357, 25 January 2017) and the National Multiple Sclerosis Center, Melsbroek (17/02, 24 January 2017). PwMS, aged 18 years or older, who were diagnosed with definite MS according to the McDonald criteria²⁸ and registered in the EDMUS database from the University Hospital Brussels and the National Multiple Sclerosis Center, were included. 1908 patients received a postal survey, including the patient-report MSNQ and two-question screening tool for depression in MS, which is a reliable tool for identifying depression in PwMS, with a sensitivity of 98.5% and a specificity of 87%^29,30. Patients were invited to contact a trained nurse by telephone in case of problems during completion of the questionnaire, to answer questions and administer the questionnaires together by telephone. Sex, age, onset date (date of first symptoms), phenotype at onset, years of education, SDMT score within the last six months before or after the survey (administered by trained nursing personnel) and EDSS score (assessed by trained neurologists) were retrieved from the database. For a more detailed description of the methods used, we refer to previous publications on this data set^16,18. Since the scope of the study was to assess the value of the patient-reported MSNQ and the patients’ own assessment of cognition, the informant-report MSNQ was not included in the survey.

Patients were included if there was a full data set for the screening for depression, EDSS, MSNQ and SDMT scores. In case of an unanswered MSNQ question, this missing value was imputed by the mean item score. When more than one question of the MSNQ was not answered, this patient was excluded. The cohort was divided into three subcohorts according to EDSS scores: Low 0.0 – 3.0, Medium 3.5 – 6.0 and High 6.5 – 9.0. These cut-offs were based on the EDSS tertiles of our sample, as well as the severity of clinical and functional disease burden as estimated by experienced MS neurologists.

Results were reported as means with 95% confidence intervals (CI 95%), medians with ranges or as percentages. The relations between MSNQ, SDMT, EDSS and depression were investigated through Pearson correlations in the total population and EDSS subgroups. Multiple linear regression analyses were performed to estimate the contribution of age, depression and MSNQ to the SDMT score in the total population and EDSS subgroups. Furthermore, a composite measure of impairment was constructed, with patients being considered impaired if they were cognitively impaired, depressed or both. Cognitive impairment was defined as a normative SDMT-score (i.e. the raw SDMT is corrected based on the expected SDMT provided by a linear regression model trained on a group of healthy controls matched for age, years of education and sex³¹) of < -1.5 and depression was defined as answering ‘yes’ on at least one question of the two-question screening tool for depression in MS. A logistic regression analysis was performed to estimate the contribution of age, sex, years of education, EDSS and MSNQ to this composite measure. The performance of these models was assessed based on R² and adjusted R² and respectively t-tests and Wald tests were used to identify the significantly contributing explanatory variables. Finally, group differences in MSNQ scores between cognitively impaired versus cognitively preserved, depressed versus non-depressed and impaired versus non-impaired (according to the composite measure) patients were assessed visually through boxplots. A two-sided test with a type I error probability of 0.05 was used for all analyses.

Results

Population characteristics

277 patients met the inclusion criteria of our study. After visual inspection two patients with SDMT values of above 80 were removed from the data set, resulting in a total of 275 included patients. These SDMT outliers were patients who underwent monthly SDMT evaluations in the context of their treatment with natalizumab, which has led to an important learning effect due to repeated test exposure. In Table 1 the characteristics of the three EDSS subgroups and the total population are listed. The mean SDMT score was significantly different between the EDSS subgroups, with the low EDSS group scoring the highest and the high EDSS group the lowest. There was no significant difference in the mean MSNQ score between the three groups.

View this table:

• View inline
• View popup
• Download powerpoint

Table 1:

Population characteristics.

CI 95% = 95% confidence interval, EDSS = Expanded Disability Status Scale, MSNQ = Multiple Sclerosis Neuropsychological Questionnaire, SDMT = Symbol Digit Modalities Test.

With regards to the composite measure of impairment, mean MSNQ scores were significantly different in depressed versus non-depressed and impaired versus non-impaired patients, but not in cognitively-impaired versus cognitively-preserved patients in the total population (see Figure 1) and all EDSS subgroups (not shown). The proportion of patients in the total population that is cognitively impaired versus preserved and depressed versus non-depressed is depicted in Figure 2.

• Download figure
• Open in new tab

Figure 1:

Group differences in MSNQ scores between cognitively impaired versus cognitively preserved, depressed versus non-depressed and impaired versus non-impaired patients.

MSNQ = Multiple Sclerosis Neuropsychological Questionnaire, CI = cognitively impaired, CP = cognitively preserved, impaired = depression and/or cognitive impairment, preserved = no depression or cognitive impairment.

• Download figure
• Open in new tab

Figure 2:

Composite measure of impairment in the total population.

Discussion

We did not find significant correlations between MSNQ and SDMT scores in the total population or any of the EDSS subgroups. So, our hypothesis that the patient-report MSNQ performs better as a cognitive screening measure in patients with low compared to medium and high EDSS scores could not be confirmed. However, MSNQ scores contributed significantly and negatively to the prediction of SDMT scores after correcting for age and depression in the total population only, not in the EDSS subgroup analysis. These findings suggest that patient-reported MSNQ scores reflect cognitive functioning, as measured by the SDMT, at least to some degree. Furthermore, MSNQ scores contributed significantly to the prediction of a composite measure of cognitive impairment and depression after correcting for age, sex, years of education and EDSS, both in the total population and all EDSS subgroups.

Our findings confirm the association of patient-report MSNQ scores with depression across all EDSS subgroups. Furthermore, while MSNQ scores contributed significantly to the prediction of a composite measure of impairment (i.e. cognitive impairment and/or depression), this contribution was mainly driven by the association with depression. More specifically, mean MSNQ scores were significantly different in depressed versus non-depressed and impaired versus non-impaired patients (as assessed by our composite measure), but not in cognitively-impaired versus cognitively-preserved patients. The association of the patient-report MSNQ scores with depression is usually considered to be an important limitation when using it as a measure of cognition^12-16. However, accurately measuring the cognitive issues caused by MS is challenging³² and the interplay between cognitive performance and depressive symptoms is complex. Cognitive impairment and depression are highly prevalent and underdiagnosed in PwMS^10,33 and both have been associated with increased disability progression^34,35. Depression also influences information processing speed, memory and executive function in PwMS and affects health behaviours and leisure activities, thereby reducing potential protective effects on cognition^36,37. Previous studies with the Perceived Deficits Questionnaire have found evidence that subjective cognitive impairment reflects subtle declines in cognitive processing speed and memory independent of mood²⁷ and that correlations between patient-reported memory and hippocampal volumes were maintained after controlling for depression²². While the patient-report MSNQ in our study was clearly influenced by depression, it also reflects a marker of cognitive function, as indicated by our multiple linear regression model of SDMT. These findings are in line with previously described results¹⁴. Therefore, reduced subjective cognitive performance and depressive symptoms should both be taken seriously and urge further investigation, especially when considering the important impact of these symptoms on daily life^{18-20,33,35-37}. The patient-report MSNQ, which has been specifically developed for multiple sclerosis and is easy to administer without the need for professional expertise¹², can therefore be a useful screening tool in daily practice for the identification of patients who are at risk of being depressed and/or cognitively impaired, and who thus require for further (neuro)psychological assessment. Furthermore, when used in combination with the informant-report version, the patient’s ability to estimate his own level over impairment can be assessed²⁶.

Important strengths of our study are that, as far as we know, we are the first to assess the relationship between measures of objective and subjective cognitive performance in different EDSS groups. Furthermore, participants were recruited from two centres, representing a broad range of EDSS scores. A limitation is the cross-sectional study design. Moreover, as already discussed^16,18, there was a moderate response rate to the survey, with a possibility of selection bias. Another weakness is that the MSNQ was sent by post and performed by the patient at home, which makes completion of the survey in a controlled environment impossible. Furthermore, the SDMT was assessed within six months before or after the survey, which could introduce bias since SDMT and MSNQ scores were not obtained at the same time. Another limitation is that only one objective cognitive test was carried out. Finally, it should be noted that when using a threshold of a normative SDMT of < -1.5 only 24% the included patients was cognitively impaired, which is lower than the expected 34 to 65%^3-6. This could be due to the fact that patients were recruited either in an academic hospital (University Hospital Brussels) or a reference institute (National MS Center Melsbroek), where they regularly undergo cognitive testing, possibly resulting in a learning effect. The proportion of depressed patients in our study on the other hand corresponded to the expected prevalence of around 40%³³.

In summary, we found that correlations between MSNQ and SDMT scores are not influenced by the patient’s level of physical disability. We were able to confirm patient-reported MSNQ scores are substantially influenced by depression, but nonetheless reflect cognitive impairment to some degree. Since both depression and cognitive impairment are underdiagnosed in PwMS and given the important impact of subjective cognitive symptoms on daily life, the patient-report MSNQ can be a useful screening tool for the identification of patients requiring further (neuro)psychological assessment and interventions.