RT Journal Article
SR Electronic
T1 An accurate and rapidly calibrating speech neuroprosthesis
JF medRxiv
FD Cold Spring Harbor Laboratory Press
SP 2023.12.26.23300110
DO 10.1101/2023.12.26.23300110
A1 Card, Nicholas S.
A1 Wairagkar, Maitreyee
A1 Iacobacci, Carrina
A1 Hou, Xianda
A1 Singer-Clark, Tyler
A1 Willett, Francis R.
A1 Kunz, Erin M.
A1 Fan, Chaofei
A1 Vahdati Nia, Maryam
A1 Deo, Darrel R.
A1 Srinivasan, Aparna
A1 Choi, Eun Young
A1 Glasser, Matthew F.
A1 Hochberg, Leigh R.
A1 Henderson, Jaimie M.
A1 Shahlaie, Kiarash
A1 Brandman, David M.
A1 Stavisky, Sergey D.
YR 2024
UL http://medrxiv.org/content/early/2024/04/10/2023.12.26.23300110.abstract
AB Brain-computer interfaces can enable rapid, intuitive communication for people with paralysis by transforming the cortical activity associated with attempted speech into text on a computer screen. Despite recent advances, communication with brain-computer interfaces has been restricted by extensive training data requirements and inaccurate word output. A man in his 40’s with ALS with tetraparesis and severe dysarthria (ALSFRS-R = 23) was enrolled into the BrainGate2 clinical trial. He underwent surgical implantation of four microelectrode arrays into his left precentral gyrus, which recorded neural activity from 256 intracortical electrodes. We report a speech neuroprosthesis that decoded his neural activity as he attempted to speak in both prompted and unstructured conversational settings. Decoded words were displayed on a screen, then vocalized using text-to-speech software designed to sound like his pre-ALS voice. On the first day of system use, following 30 minutes of attempted speech training data, the neuroprosthesis achieved 99.6% accuracy with a 50-word vocabulary. On the second day, the size of the possible output vocabulary increased to 125,000 words, and, after 1.4 additional hours of training data, the neuroprosthesis achieved 90.2% accuracy. With further training data, the neuroprosthesis sustained 97.5% accuracy beyond eight months after surgical implantation. The participant has used the neuroprosthesis to communicate in self-paced conversations for over 248 hours. In an individual with ALS and severe dysarthria, an intracortical speech neuroprosthesis reached a level of performance suitable to restore naturalistic communication after a brief training period.Competing Interest StatementStavisky, Henderson, and Willett, are inventors on intellectual property owned by Stanford University that has been licensed to Blackrock Neurotech and Neuralink Corp. Wairagkar, Stavisky, and Brandman have patent applications related to speech BCI owned by the Regents of the University of California. Stavisky was an advisor to wispr.ai and received equity. Brandman is a surgical consultant to Paradromics Inc. Henderson is a consultant for Neuralink Corp, serves on the Medical Advisory Board of Enspire DBS and is a shareholder in Maplight Therapeutics. The MGH Translational Research Center has a clinical research support agreement with Neuralink, Synchron, Axoft, Precision Neuro, and Reach Neuro, for which LRH provides consultative input. Mass General Brigham (MGB) is convening the Implantable Brain-Computer Interface Collaborative Community (iBCI-CC); charitable gift agreements to MGB, including those received to date from Paradromics, Synchron, Precision Neuro, Neuralink, and Blackrock Neurotech, support the iBCI-CC, for which LRH provides effort. Glasser is a consultant to Sora Neuroscience, Manifest Technologies, and Turing Medical. Clinical TrialNCT00912041Funding StatementThis study was funded by the following funding sources: NS Card: A.P. Giannini Postdoctoral Fellowship JM Henderson: Stanford Wu Tsai Neurosciences Institute, HHMI, NIH-NIDCD (1U01DC019430) SD Stavisky: DP2 from the NIH Office of the Director and managed by NIDCD (1DP2DC021055), DOD CDMRP ALS Pilot Clinical Trial Award (AL220043), Pilot Award from the Simons Collaboration for the Global Brain (872146SPI), Searle Scholars Program, Career Award at the Scientific Interface from the Burroughs Wellcome Fund, UC Davis Early Career Faculty Award for Creativity and Innovation LR Hochberg: NIH-NIDCD (U01DC017844), VA RR&D (A2295-R)Author DeclarationsI confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.YesThe details of the IRB/oversight body that provided approval or exemption for the research described are given below:The IRB of University of California, Davis gave ethical approval for this work (protocol #1843264).I confirm that all necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived, and that any patient/participant/sample identifiers included were not known to anyone (e.g., hospital staff, patients or participants themselves) outside the research group so cannot be used to identify individuals.YesI understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).YesI have followed all appropriate research reporting guidelines, such as any relevant EQUATOR Network research reporting checklist(s) and other pertinent material, if applicable.YesDerivatives of the neural data, including RNN probabilities and language model outputs, which can reproduce the reported performance quantification measurements and figures will be made publicly available on Dryad at publication. Code that implements an offline reproduction of the central findings in this study (high-performance neural decoding of real-time attempted speech) will be made publicly available at publication.