Neuroprosthetic system and method for substituting a sensory modality of a mammal by high-density electrical stimulation of a region of the cerebral cortex
A neuroprosthetic system for substituting a sensory modality of a mammal by electrical stimulation of a region of the cerebral cortex corresponding to the neural modality to be substituted. The system includes at least one sensor for generating a sensed data feed by sensing a neural modality to be substituted, an electrode unit including a plurality of three-dimensional arrays of flexible electrode shafts for implantation of a region of the cerebral cortex, a rigid electrode support structure for guiding the flexible electrode shafts into the region of the cerebral cortex and for retraction after implantation, a driving unit for electrically driving the electrode, a recording unit, and a processing unit for analysing sensed data feed for providing stimulation patterns for electrically driving groups of electrical contacts of the electrode unit corresponding to subsets of locations in the region of the cerebral cortex, for substituting the sensory modality.
1. A neuroprosthetic system for substituting a sensory modality of a mammal by electrical stimulation of a region of the cerebral cortex of the mammal corresponding to the sensory modality to be substituted, comprising:
at least one sensor, for use by the mammal, for generating a sensed data feed by sensing a sensory modality to be substituted;
an electrode unit, comprising a plurality of three-dimensional arrays of flexible electrode shafts, for intracortical implantation for an occupation of the region of the cerebral cortex of the mammal for providing functional coverage of the sensory modality, each flexible electrode shaft comprising multiple electrical contacts for electrical stimulation of subsets of locations in the region of the cerebral cortex;
a rigid electrode support structure for simultaneously guiding the flexible electrode shafts of an array into the region of the cerebral cortex of the mammal during intracortical implantation, and for detaching from the array of flexible electrode shafts and retracting the rigid electrode support structure after implantation of the array of the flexible electrode shafts, the rigid electrode support structure including a plurality of rigid insert shafts, wherein each rigid insert shaft extends alongside and is removably attached to one of the flexible electrode shafts by a temporary interface configured to detach post-intracortical implantation;
a driving unit for electrically driving the electrode unit for stimulating the subsets of locations in the region of the cerebral cortex;
a recording unit for obtaining neural recording through the electrode unit in the region of the cerebral cortex; and
a processing unit for analysing the sensed data feed for providing stimulation patterns for electrically driving groups of electrical contacts of the electrode unit corresponding to the subsets of locations in the region of the cerebral cortex, for substituting the sensory modality.
2. The neuroprosthetic system according to claim 1 , wherein:
the neuroprosthetic system is operable for substituting visual perception in a visual region of the cerebral cortex of the mammal;
the at least one sensor comprises at least one portable imaging unit for capturing images and generating a captured image data feed;
the driving unit is operable for evoking phosphenes at locations in the visual region of the cerebral cortex; and
the processing unit is operable for providing the stimulation patterns for stimulating groups of electrical contacts of the electrode unit corresponding to subsets of phosphene locations in the visual region of the cerebral cortex for evoking phosphenes for substituting the visual perception comprised of phosphene patterns obtained through semantic segmentation of images of the captured image data feed.
3. The neuroprosthetic system according to claim 1 , further comprising a switching device for channelling one or more stimulation signals of the driving unit to subsets of electrical contacts located within the region of the cerebral cortex providing the functional coverage of the sensory modality.
4. The neuroprosthetic system according to claim 1 , wherein the processing unit is configured to determine correlations between neural signals from the electrodes, and locations in the region of the cerebral cortex, for deducing functional maps of the sensory cortex.
5. The neuroprosthetic system according to claim 1 , wherein:
the processing unit comprises a transceiver configured for wireless data communication;
the neuroprosthetic system comprises a signal transducer arrangement configured for wireless data communication with the processing unit, the signal transducer arrangement configured for controlling the recording unit and the driving unit for driving and recording of the electrical contacts in a calibration mode and an operational mode, wherein the electrical contacts in the operational mode are controlled for signal stimulation and in the calibration mode for signal stimulation and signal reception, and wherein the signal transducer arrangement is configured for controlling the driving unit in the calibration mode for driving the electrical contacts for signal stimulation in the region of the cerebral cortex, and signal reception in one or more other cortex areas for determining potential locations in the region of the cerebral cortex for substituting the sensory modality.
6. The neuroprosthetic system according to claim 5 , wherein the signal transducer arrangement is configured for controlling the driving unit in the calibration mode for driving the electrical contacts in one of signal stimulation and signal reception at predetermined regular time intervals, for recalibrating at least one of stimulation signals and potential locations in the region of the cerebral cortex for substituting the sensory modality.
7. The neuroprosthetic system according to claim 6 , wherein the signal transducer arrangement comprises electrical simulation circuitry operable for simultaneously energizing, during the operational mode, a plurality of electrical contacts corresponding to the subsets of locations for substituting the sensory modality in accordance with sensory primitives.
8. The neuroprosthetic system according to claim 1 , wherein the processing unit is configured for analysing the sensed data feed for providing the stimulation patterns based on convolutional neural networks.
9. The neuroprosthetic system according to claim 1 , further comprising at least one eye-tracking sensor for sensing perceptual information for augmenting the substitution of the sensory modality.