Balance prosthesis device, method, system and computer program
A balance prosthesis device for an individual including a sensor module configured to obtain a sensor signal indicative of a balance or equilibrium state of the individual, a processing module configured to determine at least one neurostimulation signal based at least in part on the obtained sensor signal, and a transmitter module configured to transmit the determined neurostimulation signal to a neurostimulation device of the individual. The neurostimulation signal is configured to elicit an artificial sensation in a specific sensory cortex area of the individual via directly stimulating afferent sensory axons of the central or peripheral nervous system of the individual targeting sensory neurons of the sensory cortex area not directly associated with vestibulocortical pathways of the individual. The elicited artificial sensation provides a balance indication to the individual in order to support, mimic, substitute or enhance the natural sense of balance of the individual.
1 . A balance prosthesis device for an individual, comprising:
a neurostimulation device of the individual, wherein the neurostimulation device is operably linked to one or more spinal cord electrodes implanted in the individual;
a sensor configured to obtain at least one sensor signal indicative of a balance or equilibrium state of the individual;
a processor operably connected to the sensor and configured to determine at least one neurostimulation signal based at least in part on the obtained sensor signal; and
a transmitter operably connected to the processor and configured to transmit the at least one determined neurostimulation signal to the neurostimulation device;
wherein the neurostimulation device is configured to signal the one or more spinal cord electrodes to apply the at least one determined neurostimulation signal to directly stimulate afferent sensory axons of the central or peripheral nervous system of the individual targeting sensory neurons of the sensory cortex not directly associated with vestibulocortical pathways of the individual, wherein directly stimulating the afferent sensory axons elicits an artificial sensation in an area of the sensory cortex of the individual, and wherein signal parameters of the at least one determined neurostimulation signal are adjusted, based at least in part on one or more of the obtained sensor signal or at least one additionally obtained sensor signal, to elicit respective action potentials in respective sub-populations of the afferent sensory axons projecting to one or more of somatosensory neurons, auditory neurons, and visual neurons in respective areas of the sensory cortex to elicit the artificial sensation,
wherein at least one of a perceived laterality or a location of the artificial sensation, elicited from directly stimulating the afferent axons, indicates a direction of a body tilt of the individual or a direction of a compensatory movement to decrease the body tilt, and
wherein a perceived intensity of the artificial sensation, elicited from directly stimulating the afferent sensory axons, encodes an angle or a degree of the body tilt of the individual relative to at least one of a reference position, a range, an angle, or a degree of a compensatory movement to decrease the body tilt, and
wherein the artificial sensation, elicited from directly stimulating the afferent sensory axons, provides a balance indication to the individual that is derived at least in part from the obtained sensor signal in order to support, mimic, substitute or enhance a natural sense of balance of the individual.
2 . The balance prosthesis device of claim 1 ,
wherein the at least one sensor signal comprises at least one motion sensor signal received from an accelerometer or gyroscope and obtained via a wired or wireless interface, and
wherein the sensor obtains, via the wired or wireless interface, an auxiliary sensor signal originating from an auxiliary sensor device, wherein the auxiliary sensor device comprises as a camera, a light detection and ranging (LIDAR) sensor, a global positioning satellite (GPS) system, a pressure sensor or an elevation sensor.
3 . The balance prosthesis device of claim 2 ,
wherein the processor is further configured to:
detect, based at least in part on one or both of the at least one motion sensor signal and the auxiliary sensor signal using a trained machine learning system, whether a body of the individual is oriented at a degree of body tilt indicative of a risk to fall; and
in response to said detection, generate a neurostimulation warning signal that is configured to elicit an artificial sensation in an area of the sensory cortex providing a falling warning to the individual.
4 . The balance prosthesis device of claim 1 ,
wherein the processor determines, based at least in part on the at least one motion sensor signal, one or more of:
an estimate of a current body position of the individual with respect to a reference body position; and
an estimate of a future body position with respect to the reference body position.
5 . The balance prosthesis device of claim 4 ,
wherein the current and future body positions of the individual are characterized by one or more of the following parameters:
a body tilt of the individual in a coronal and/or a sagittal plane;
a rate of change of the body tilt of the individual in the coronal and/or the sagittal plane;
a deviation of a center of gravity of a body of the individual from a reference position or range for the center of gravity; and
a rate of change of the deviation of the center of gravity from the reference position or range.
6 . The balance prosthesis device of claim 1 ,
wherein a perceived repetition rate of the elicited artificial sensation encodes a terrain characteristic comprising an inclination angle of a walking surface or a remaining distance to an obstacle.
7 . The balance prosthesis device of claim 1 ,
wherein a secondary sensory quality of the elicited artificial sensation comprises one or more of:
a texture of a somatosensation;
a color of a visual sensation; and
a tone and timbre of an auditory sensation, and
wherein the secondary sensory quality encodes body balance support information comprising an inclination of a walking surface or a remaining distance to an obstacle.
8 . The balance prosthesis device of claim 1 ,
wherein the at least one determined neurostimulation signal is synchronized with a walking pace of the individual to provide a continuous body tilt correction indication configured to improve a gait stability of the individual while walking.
9 . The balance prosthesis device of claim 1 , further comprising:
one or more implanted or wearable motion sensors configured to provide input signals to the sensor of the balance prosthesis device.
10 . The balance prosthesis system of claim 9 , further comprising:
one or more sensor devices providing further input signals to the sensor of the balance prosthesis device, wherein the one or more sensor devices comprise one or more of:
a camera device;
a LIDAR sensor device;
a GPS system;
a pressure sensor measuring the contact pressure between a foot of the individual and a walking surface; and
at least two pressure sensors measuring a difference in contact pressure between two points on a walking surface to determine an inclination of the walking surface.
11 . The balance prosthesis system of claim 9 , further comprising:
a spinal cord stimulation device comprising a set of implanted spinal cord leads targeting somatosensory ganglions or afferent sensory nerve fibers within or adjacent to a spinal cord of the individual.
12 . A method for providing a balance indication to an individual, the method comprising:
obtaining at least one sensor signal indicative of a balance or equilibrium state of the individual;
determining at least one neurostimulation signal based at least in part on the obtained sensor signal; and
transmitting the at least one determined neurostimulation signal to a neurostimulation device of the individual, wherein the neurostimulation device is operably linked to one or more spinal cord electrodes implanted in the individual; and
applying, via the one or more spinal cord electrodes and in response to being signaled by the neurostimulation device, the at least one determined neurostimulation signal to directly stimulate afferent sensory axons of the central or peripheral nervous system of the individual targeting sensory neurons of the sensory cortex not associated with vestibulocortical pathways of the individual, wherein directly stimulating the afferent sensory axons elicits an artificial sensation in an area of the sensory cortex of the individual, and wherein signal parameters of the at least one determined neurostimulation signal are adjusted, based at least in part on one or more of the obtained sensor signal or at least one additionally obtained sensor signal, to elicit respective action potentials in respective sub-populations of the afferent sensory axons projecting to one or more of somatosensory neurons, auditory neurons, and visual neurons in respective areas of the sensory cortex to elicit the artificial sensation;
wherein a perceived repetition rate of the artificial sensation, elicited from directly stimulating the afferent sensory axons, encodes a terrain characteristic comprising at least one of an inclination angle of a walking surface or a remaining distance to an obstacle, and
wherein the artificial sensation, elicited from directly stimulating the afferent sensory axons, provides a balance indication to the individual that is derived at least in part from the obtained sensor signal in order to support, mimic, substitute or enhance a natural sense of balance of the individual.
13 . The method of claim 12 ,
wherein the at least one sensor signal is obtained via a wired or wireless interface from an accelerometer or a gyroscope, wherein the method further comprises:
obtaining, via the wired or wireless interface, an auxiliary sensor signal originating from an auxiliary sensor device, wherein the auxiliary sensor device comprises as a camera, a light detection and ranging (LIDAR) sensor, a global positioning satellite (GPS) system, a pressure sensor or an elevation sensor.
14 . The method of claim 12 , the method further comprising:
determining, based at least in part on the obtained sensor signal, one or more of:
an estimate of a current body position of the individual with respect to a reference body position; and
an estimate of a future body position with respect to the reference body position,
wherein the current and future body positions of the individual are characterized by one or more of the following parameters:
a body tilt of the individual in a coronal and/or a sagittal plane;
a rate of change of the body tilt of the individual in the coronal and/or the sagittal plane;
a deviation of a center of gravity of a body of the individual from a reference position or range for the center of gravity; and
a rate of change of the deviation of the center of gravity from the reference position or range.
15 . The method of claim 12 ,
wherein a perceived laterality or location of the elicited artificial sensation indicates a direction of a body tilt of the individual or a direction of a compensatory movement to decrease the body tilt, and
wherein a perceived intensity of the elicited artificial sensation encodes an angle or a degree of the body tilt of the individual relative to a reference position or range or an angle or degree of a compensatory movement to decrease the body tilt.
16 . A non-transitory computer-readable storage device storing comprising program instructions which, when executed by a processor, cause a balance prosthesis device to:
obtain at least one sensor signal indicative of a balance or equilibrium state of an individual;
determine at least one neurostimulation signal based at least in part on the obtained sensor signal; and
transmit the at least one determined neurostimulation signal to a neurostimulation device of the individual, wherein the neurostimulation device is operably linked to one or more spinal cord electrodes implanted in the individual; and
apply, via the one or more spinal cord electrodes and in response to being signaled by the neurostimulation device the at least one determined neurostimulation signal to directly stimulate afferent sensory axons of the central or peripheral nervous system of the individual targeting sensory neurons of the sensory cortex area not associated with vestibulocortical pathways of the individual, wherein directly stimulating the afferent sensory axons elicits an artificial sensation in an area of the sensory cortex area of the individual, and wherein signal parameters of the at least one determined neurostimulation signal are adjusted, based at least in part on one or more of the obtained sensor signal or at least one additionally obtained sensor signal, to elicit respective action potentials in respective sub-populations of the afferent sensory axons projecting to one or more of somatosensory neurons, auditory neurons, and visual neurons in respective areas of the sensory cortex to elicit the artificial sensation;
wherein a perceived repetition rate of the artificial sensation, elicited from directly stimulating the afferent sensory axons, encodes a terrain characteristic comprising at least one of an inclination angle of a walking surface or a remaining distance to an obstacle, and
wherein the artificial sensation, elicited from directly stimulating the afferent sensory axons, provides a balance indication to the individual that is derived at least in part from the obtained sensor signal in order to support, mimic, substitute or enhance a natural sense of balance of the individual.
17 . The storage device of claim 16 ,
wherein the at least one sensor signal is obtained via a wired or wireless interface from an accelerometer or a gyroscope, wherein the method further comprises:
obtaining, via the wired or wireless interface, an auxiliary sensor signal originating from an auxiliary sensor device, wherein the auxiliary sensor device comprises as a camera, a light detection and ranging (LIDAR) sensor, a global positioning satellite (GPS) system, a pressure sensor or an elevation sensor.
18 . The storage device of claim 16 , wherein the program instructions are further executable by the processor to cause the balance prosthesis device to:
determine, based at least in part on the obtained sensor signal, one or more of:
an estimate of a current body position of the individual with respect to a reference body position; and
an estimate of a future body position with respect to the reference body position,
wherein the current and future body positions of the individual are characterized by one or more of the following parameters:
a body tilt of the individual in a coronal and/or a sagittal plane;
a rate of change of the body tilt of the individual in the coronal and/or the sagittal plane;
a deviation of a center of gravity of a body of the individual from a reference position or range for the center of gravity; and
a rate of change of the deviation of the center of gravity from the reference position or range.
19 . The storage device of claim 16 ,
wherein a perceived laterality or location of the elicited artificial sensation indicates a direction of a body tilt of the individual or a direction of a compensatory movement to decrease the body tilt, and
wherein a perceived intensity of the elicited artificial sensation encodes an angle or a degree of the body tilt of the individual relative to a reference position or range or an angle or degree of a compensatory movement to decrease the body tilt.
20 . The storage device of claim 16 , wherein a secondary sensory quality of the elicited artificial sensation comprises one or more of:
a texture of a somatosensation;
a color of a visual sensation; and
a tone and timbre of an auditory sensation, and
wherein the secondary sensory quality encodes body balance support information comprising an inclination of a walking surface or a remaining distance to an obstacle.