RT Journal Article
SR Electronic
T1 Usability of the Mayo Test Drive remote self-administered web-based cognitive screening battery in adults ages 35 to 100 with and without cognitive impairment
JF medRxiv
FD Cold Spring Harbor Laboratory Press
SP 2024.05.24.24307909
DO 10.1101/2024.05.24.24307909
A1 Patel, Jay S.
A1 Christianson, Teresa J.
A1 Monahan, Logan T.
A1 Frank, Ryan D.
A1 Fan, Winnie Z.
A1 Stricker, John L.
A1 Kremers, Walter K.
A1 Karstens, Aimee J.
A1 Machulda, Mary M.
A1 Fields, Julie A.
A1 Hassenstab, Jason
A1 Jack, Clifford R.
A1 Botha, Hugo
A1 Graff-Radford, Jonathan
A1 Petersen, Ronald C.
A1 Stricker, Nikki H.
YR 2024
UL http://medrxiv.org/content/early/2024/05/28/2024.05.24.24307909.abstract
AB Background Self-administered cognitive screening measures that can be completed unsupervised and remotely have significant promise for high scalability. Mayo Test Drive (MTD): Test Development through Rapid Iteration, Validation and Expansion, is a web-based remote cognitive assessment platform for self-administered neuropsychological measures with previously demonstrated validity and reliability. Our primary study aim was to examine the usability of MTD. We additionally described participation and adherence rates; characterized factors that inform feasibility to implement MTD in research and clinical settings such as session and subtest durations, frequency of interruptions and noise during test sessions, device type use across demographic and clinical characteristics for completed sessions; and reported qualitative themes of free-text participant comments.Methods 1,950 Mayo Clinic Study of Aging and Mayo Alzheimer’s Disease Research Center participants (97% White, 99% Non-Hispanic) were invited to participate in this ancillary, uncompensated remote study. Most invitees were cognitively unimpaired (CU; n=1,769; 90.7%) and 9.3% were cognitively impaired (CI; n=181). Participation and adherence rates were defined as the number of participants initiating a test session when invited or due to complete a session, respectively. Usability was objectively defined as the percentage of participants who completed a session after initiating a session for a given timepoint (i.e., completion rates). MTD sessions included the Stricker Learning Span (SLS) learning and delay trials, four trials of the Symbols test, and completion of self-report questions that informed session context. All participants were invited to provide free-text comments that were coded by investigators and descriptively characterized by qualitative analysis.Results Baseline session completion rates were 98.5% across participants who initiated a test session (n=1199/1217, mean age 71, SD=12, range 35-100) and were comparable between CU (98.7%) and CI (95.0%) groups (p=.23). Completion rates did not significantly differ by age groups among CU participants (p>.10) and completion rates remained high in individuals 80+ (n=251, 97.3%). Participation rates were higher in the CU (n=1142, 65.4%) versus CI (n=57, 33.1%) group (p<.001). Participation rates were lower in those 80+ (53.8%) relative to younger age groups (68.9% ages 34-64; 70.2% ages 65-69). Adherence (i.e., retention) rate for a 7.5-month follow-up session was 89%. Average session duration was 16 minutes. Most participants used a personal computer (n=751, 62.7%), followed by a smartphone (n=266, 22.2%) or tablet (n=177, 14.8%). Comments were entered by 36.4% of participants and reflected several themes relevant to acceptability, face validity, usability, as well as comments informative for session context.Conclusions MTD demonstrated high usability as defined by completion rates in this research sample that includes a broad age range, though participation rates are lower in individuals with cognitive impairment. Results support good adherence at follow-up, feasibility through mean session durations, and acceptability based on qualitative analysis of participant comments.Competing Interest StatementDr. Patel has nothing to disclose.Ms. Christianson reports grants from NIH during the conduct of the study.Mr. Monahan has nothing to disclose.Mr. Frank reports grants from National Institutes of Health (NIH) during the conduct of the study.Ms. Fan reports grants from NIH during the conduct of the study.Dr. John Stricker reports grants from NIH during the conduct of the study; and a Mayo Clinic invention disclosure has been submitted for the Stricker Learning Span and the Mayo Test Drive platform.Dr. Kremers reports grants from NIH during the conduct of the study.Dr. Karstens reports grants from NIH during the conduct of the study.Dr. Machulda reports grants from National Institutes of Health during the conduct of the study.Dr. Fields reports grants from NIH and grants from the Mangurian Foundation outside the submitted work.Dr. Hassenstab reports grants from NIH during the conduct of the study; personal fees from Parabon Nanolabs, personal fees from Roche, personal fees from AlzPath, personal fees from Prothena, personal fees and other (serves on Data Safety Monitoring Board/Advisory Board) from Caring Bridge (National Institute on Aging sponsored), personal fees and other (serves on Data Safety Monitoring Board/Advisory Board) from Wall-E (National Institute on Aging sponsored) outside the submitted work.Dr. Jack reports grants from NIH and grants from GHR Foundation during the conduct of the study; and Dr. Jack receives research support from the Alexander Family Alzheimer Disease Research Professorship of the Mayo Clinic.Dr. Botha reports grants from NIH outside the submitted work.Dr. Graff-Radford reports grants from NIH outside the submitted work; and serves as the site-PI for a clinical trial co-sponsored by Eisai, cognition therapeutics and NIH, and serves on the Data Safety and Monitoring Board for StrokeNET.Dr. Petersen reports grants from NIH during the conduct of the study; personal fees from Oxford University Press, personal fees from UpToDate, personal fees from Roche, Inc., personal fees from Genentech, Inc., personal fees from Eli Lilly and Co., and personal fees from Nestle, Inc., outside the submitted work.Dr. Nikki Stricker reports grants from NIH during the conduct of the study; and a Mayo Clinic invention disclosure has been submitted for the Stricker Learning Span and the Mayo Test Drive platform.Funding StatementThis research was supported by the National Institute on Aging of the National Institutes of Health (R01 AG081955, R21 AG073967, P30 AG062677, U01 AG006786, RF1 AG069052), the Kevin Merszei Career Development Award in Neurodegenerative Diseases Research IHO Janet Vittone, MD, the Rochester Epidemiology Project (NIH R01 AG034676), the GHR Foundation, and the Mayo Foundation for Education and Research. The content is solely the responsibility of the authors and does not necessarily represent the official views of the National Institutes of Health or other funding sources.Author DeclarationsI confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.YesThe details of the IRB/oversight body that provided approval or exemption for the research described are given below:The Institutional Review Board of Mayo Clinic gave ethical approval for this work.I confirm that all necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived, and that any patient/participant/sample identifiers included were not known to anyone (e.g., hospital staff, patients or participants themselves) outside the research group so cannot be used to identify individuals.YesI understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).YesI have followed all appropriate research reporting guidelines, such as any relevant EQUATOR Network research reporting checklist(s) and other pertinent material, if applicable.YesThe data supporting the findings of this study are available upon reasonable request to the corresponding author and with approval from Mayo Clinic Study of Aging investigators.