Brain-computer interface
An adaptive calibration method in a brain-computer interface is disclosed. The method is used to reliably associate a neural signal to an object whose attendance by a user elicited that neural signal. A visual stimulus overlaying one or more objects is provided, at least a portion of the visual stimulus having a characteristic modulation. The brain computer interface measures neural response to objects viewed by a user. The neural response to the visual stimulus is correlated to the modulation, the correlation being stronger when attention is concentrated upon the visual stimulus. Weights are applied to the resulting model of neural responses for the user based on the determined correlations. Both neural signal model weighting and displayed object display modulation are adapted so as to improve the certainty of the association of neural signals with the objects that evoked those signals.
1. A computer-implemented method comprising:
receiving neural signals from a user while the user is exposed to sensory stimuli during use by the user of a Brain Computer Interface (BCI), the sensory stimuli including a display of a target object as a first graphical object with a varying first temporal characteristic distinct from a second temporal characteristic of a second graphical object of the sensory stimuli;
decoding the neural signals to identify a focus of attention of the user on the target object using a neural response model;
modifying the sensory stimuli in real-time based on the focus of attention to provide real-time feedback to the user;
refining the neural response model using a response by the user to the real-time feedback; and
continuously repeating the receiving, decoding, modifying, and refining operations during use by the user of the BCI to continuously calibrate the neural response model.
2. The method of claim 1 , wherein the sensory stimuli include visual stimuli, and the real-time feedback comprises modifying the display characteristics of the visual stimuli.
3. The method of claim 1 , wherein the sensory stimuli are part of a confirmation sequence including at least one of the sensory stimuli from a training sequence.
4. The method of claim 3 , wherein the sensory stimuli are modified by altering an appearance of the sensory stimuli in the confirmation sequence.
5. The method of claim 1 , wherein the neural response model includes weights applied to features of the neural signals, and refining the neural response model involves modifying the weights.
6. The method of claim 1 , wherein the sensory stimuli are part of a training sequence including one or more sensory stimuli, each having at least one predetermined corresponding characteristic.
7. The method of claim 1 , wherein the method further comprises using the model of user neural response to sensory stimuli to estimate which of the sensory stimuli is an object of focus of the user.
8. A machine, comprising:
one or more processors; and
a memory storing instructions that, when executed by the one or more processors, cause the machine to perform operations comprising:
receiving neural signals from a user while the user is exposed to sensory stimuli during use by the user of a Brain Computer Interface (BCI), the sensory stimuli including a display of a target object as a first graphical object with a varying first temporal characteristic distinct from a second temporal characteristic of a second graphical object of the sensory stimuli;
decoding the neural signals to identify a focus of attention of the user on the sensory stimuli using a neural response model;
modifying the sensory stimuli in real-time based on the focus of attention to provide real-time feedback to the user;
refining the neural response model using a response by the user to the real-time feedback; and
continuously repeating the receiving, decoding, modifying, and refining operations during use by the user of the BCI to continuously calibrate the neural response model.
9. The machine of claim 8 , wherein the sensory stimuli include visual stimuli, and the real-time feedback comprises modifying the display characteristics of the visual stimuli.
10. The machine of claim 8 , wherein the sensory stimuli are part of a confirmation sequence including at least one of the sensory stimuli from a training sequence.
11. The machine of claim 10 , wherein the sensory stimuli are modified by altering an appearance of the sensory stimuli in the confirmation sequence.
12. The machine of claim 8 , wherein the neural response model includes weights applied to features of the neural signals, and refining the neural response model involves modifying the weights.
13. The machine of claim 8 , wherein the sensory stimuli are part of a training sequence including one or more sensory stimuli, each having at least one predetermined corresponding characteristic.
14. The machine of claim 8 , wherein the operations further comprise using the model of user neural response to sensory stimuli to estimate which of the sensory stimuli is an object of focus of the user.
15. A machine-storage medium storing machine-executable instructions that, when executed by a machine, cause the machine to perform operations comprising:
receiving neural signals from a user while the user is exposed to sensory stimuli during use by the user of a Brain Computer Interface (BCI), the sensory stimuli including a display of a target object as a first graphical object with a varying first temporal characteristic distinct from a second temporal characteristic of a second graphical object of the sensory stimuli;
decoding the neural signals to identify a focus of attention of the user on the sensory stimuli using a neural response model;
modifying the sensory stimuli in real-time based on the focus of attention to provide real-time feedback to the user;
refining the neural response model using a response by the user to the real-time feedback; and
continuously repeating the receiving, decoding, modifying, and refining operations during use by the user of the BCI to continuously calibrate the neural response model.
16. The machine-storage medium of claim 15 , wherein the sensory stimuli include visual stimuli, and the real-time feedback comprises modifying the display characteristics of the visual stimuli.
17. The machine-storage medium of claim 15 , wherein the sensory stimuli are part of a confirmation sequence including at least one of the sensory stimuli from a training sequence.
18. The machine-storage medium of claim 17 , wherein the sensory stimuli are modified by altering an appearance of the sensory stimuli in the confirmation sequence.
19. The machine-storage medium of claim 15 , wherein the sensory stimuli are part of a training sequence including one or more sensory stimuli, each having at least one predetermined corresponding characteristic.
20. The machine-storage medium of claim 15 , wherein the operations further comprise using the model of user neural response to sensory stimuli to estimate which of the sensory stimuli is an object of focus of the user.