Abstract
Vision and proprioception regulate motor output during reaching. To study the effects of sensory input on motor control, brain computer interfaces (BCIs) offer particular advantages. As part of a long-term clinical BCI trial, we implanted two 96-channel microelectrode arrays into M1 of a person who was completely paralyzed below the neck but retained intact somatosensation. Neural recordings from M1 were transformed into a 2-dimensional velocity control signal for a robotic arm using an optimal linear estimator decoder that was calibrated while the participant imagined performing movements demonstrated by a virtual arm. Once the decoder was calibrated, we asked the participant to move the robotic arm left and right past a pair of lines as many times as possible in one minute. We examined how visual and proprioceptive feedback were incorporated into BCI control during this task by providing the participant with either visual or proprioceptive feedback, both, or neither. Proprioceptive feedback was provided by moving the participant’s own arm to match the movement of the robotic arm. Task performance with vision or proprioception alone was better than when neither were provided. However, providing proprioceptive feedback impaired performance relative to visual feedback alone, unless the decoder was calibrated with neural data collected while both visual and proprioceptive feedback were provided. Providing proprioceptive feedback during decoder calibration rescued performance because it better captured M1’s neural activity during BCI control with proprioceptive feedback. In general, BCI performance was positively correlated with how well the decoder captured variance in neural activity during the task. In summary, we found that while the BCI participant was able to use proprioceptive feedback regardless of whether the decoder was trained with vision only or vision and proprioception, training the decoder with both visual and proprioceptive feedback made performance more robust to the addition or removal of visual or proprioceptive feedback. This was because training a decoder with proprioceptive feedback allows the decoder to take advantage of proprioception-driven activity in M1. Overall, we demonstrated that natural sensation can be effectively combined with BCI to improve performance in humans.
Competing Interest Statement
The authors have declared no competing interest.
Clinical Trial
This trial is registered on clinicaltrials.gov (http://clinicaltrials.gov/ct2/show/NCT01364480).
Funding Statement
This study was funded by the Defense Advanced Research Projects Agency's (Arlington, VA, USA) Revolutionizing Prosthetics program (contract number N66001-10-C-4056).
Author Declarations
I confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.
Yes
The details of the IRB/oversight body that provided approval or exemption for the research described are given below:
This study was conducted under an Investigational Device Exemption (IDE) granted by the US Food and Drug Administration and with approval from the Institutional Review Boards at the University of Pittsburgh and the Space and Naval Warfare Systems Center Pacific. This trial is registered on clinicaltrials.gov (http://clinicaltrials.gov/ct2/show/NCT01364480).
I confirm that all necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived, and that any patient/participant/sample identifiers included were not known to anyone (e.g., hospital staff, patients or participants themselves) outside the research group so cannot be used to identify individuals.
Yes
I understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).
Yes
I have followed all appropriate research reporting guidelines, such as any relevant EQUATOR Network research reporting checklist(s) and other pertinent material, if applicable.
Yes
Data Availability
All data produced in the present study are available upon reasonable request to the authors