RT Journal Article
SR Electronic
T1 An accurate and rapidly calibrating speech neuroprosthesis
JF medRxiv
FD Cold Spring Harbor Laboratory Press
SP 2023.12.26.23300110
DO 10.1101/2023.12.26.23300110
A1 Card, Nicholas S.
A1 Wairagkar, Maitreyee
A1 Iacobacci, Carrina
A1 Hou, Xianda
A1 Singer-Clark, Tyler
A1 Willett, Francis R.
A1 Kunz, Erin M.
A1 Fan, Chaofei
A1 Vahdati Nia, Maryam
A1 Deo, Darrel R.
A1 Choi, Eun Young
A1 Glasser, Matthew F.
A1 Hochberg, Leigh R.
A1 Henderson, Jaimie M.
A1 Shahlaie, Kiarash
A1 Brandman, David M.
A1 Stavisky, Sergey D.
YR 2023
UL http://medrxiv.org/content/early/2023/12/26/2023.12.26.23300110.abstract
AB Brain-computer interfaces (BCIs) can provide a rapid, intuitive way for people with paralysis to communicate by transforming the cortical activity associated with attempted speech into text. Despite recent advances, communication with BCIs has been restricted by requiring many weeks of training data, and by inadequate decoding accuracy. Here we report a speech BCI that decodes neural activity from 256 microelectrodes in the left precentral gyrus of a person with ALS and severe dysarthria. This system achieves daily word error rates as low as 1% (2.66% average; 9 times fewer errors than previous state-of-the-art speech BCIs) using a comprehensive 125,000-word vocabulary. On the first day of system use, following only 30 minutes of attempted speech training data, the BCI achieved 99.6% word accuracy with a 50 word vocabulary. On the second day of use, we increased the vocabulary size to 125,000 words and after an additional 1.4 hours of training data, the BCI achieved 90.2% word accuracy. At the beginning of subsequent days of use, the BCI reliably achieved 95% word accuracy, and adaptive online fine-tuning continuously improved this accuracy throughout the day. Our participant used the speech BCI in self-paced conversation for over 32 hours to communicate with friends, family, and colleagues (both in-person and over video chat). These results indicate that speech BCIs have reached a level of performance suitable to restore naturalistic communication to people living with severe dysarthria.Competing Interest StatementStavisky, Henderson, and Willett, are inventors on intellectual property owned by Stanford University that has been licensed to Blackrock Neurotech and Neuralink Corp. Wairagkar, Stavisky, and Brandman have provisional patent applications related to speech BCI owned by the Regents of the University of California. Stavisky was an advisor to wispr.ai and received equity. Brandman is a surgical consultant to Paradromics Inc. Henderson is a consultant for Neuralink Corp, serves on the Medical Advisory Board of Enspire DBS and is a shareholder in Maplight Therapeutics. The MGH Translational Research Center has a clinical research support agreement with Neuralink, Synchron, Axoft, Precision Neuro, and Reach Neuro, for which LRH provides consultative input. Glasser is a consultant to Sora Neuroscience. Clinical TrialNCT00912041Funding StatementThis study was funded by the following funding sources: NS Card: A.P. Giannini Postdoctoral Fellowship JM Henderson: Stanford Wu Tsai Neurosciences Institute, HHMI, NIH-NIDCD (1U01DC019430) SD Stavisky: DP2 from the NIH Office of the Director and managed by NIDCD (1DP2DC021055), DOD CDMRP ALS Pilot Clinical Trial Award (AL220043), Pilot Award from the Simons Collaboration for the Global Brain (872146SPI), Searle Scholars Program, Career Award at the Scientific Interface from the Burroughs Wellcome Fund, UC Davis Early Career Faculty Award for Creativity and Innovation LR Hochberg: NIH-NIDCD (U01DC017844), VA RR&D (A2295-R)Author DeclarationsI confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.YesThe details of the IRB/oversight body that provided approval or exemption for the research described are given below:The IRB of University of California, Davis gave ethical approval for this work (protocol #1843264).I confirm that all necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived, and that any patient/participant/sample identifiers included were not known to anyone (e.g., hospital staff, patients or participants themselves) outside the research group so cannot be used to identify individuals.YesI understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).YesI have followed all appropriate research reporting guidelines, such as any relevant EQUATOR Network research reporting checklist(s) and other pertinent material, if applicable.YesDerivatives of the neural data, including RNN probabilities and language model outputs, which can reproduce the reported performance quantification measurements and figures will be made publicly available on Dryad at publication. Code that implements an offline reproduction of the central findings in this study (high-performance neural decoding of real-time attempted speech) will be made publicly available at publication. Neural data will be publicly available after completion of the trial.