Brain-computer interface
A system and method relating to a brain-computer interface in which a visual stimulus overlaying one or more objects is provided, the visual stimulus having a characteristic modulation. The brain computer interface measures neural response to objects viewed by a user. The neural response to the visual stimulus is correlated to the modulation. The method allows the interface to discriminate between merely viewing of a display object and deliberate selection of that display object (for example, as a trigger to a further action).
1. A method comprising:
generating a compound visual stimulus with multiple distinguishable portions;
displaying the compound visual stimulus to a user;
utilizing a first decoding model to determine first decoded neural signals captured from the user in response to a first portion of the compound visual stimulus;
utilizing a second decoding model to decode second decoded neural signals captured from the user in response to a second portion of the compound visual stimulus;
comparing the first decoded neural signals and the second decoded neural signals to assess the attentional engagement of the user; and
determining an attention of the user as defocused based on a balanced response to the first portion and the second portion of the compound visual stimulus.
2. The method of claim 1 , further comprising:
receiving images captured by at least one eye tracking camera and determining eye-tracking information according to the captured image,
wherein determining the attention of the user as defocused further includes using the eye-tracking information.
3. The method of claim 2 , wherein the eye-tracking information includes at least one of a direction of gaze and a depth of focus.
4. The method of claim 1 , wherein a modulation is selectively applied to the multiple distinguishable portions of the compound visual stimulus.
5. The method of claim 4 , wherein the modulation is applied to a high spatial frequency (HSF) component of the compound visual stimulus.
6. The method of claim 1 , wherein a color is selectively applied to the multiple distinguishable portions of the compound visual stimulus.
7. The method of claim 1 , wherein a motion is selectively applied to the multiple distinguishable portions of the compound visual stimulus.
8. A machine comprising:
at least one processor; and
at least one memory storing instructions that, when executed by the at least one processor, cause the machine to perform operations comprising:
generating a compound visual stimulus with multiple distinguishable portions;
displaying the compound visual stimulus to a user;
utilizing a first decoding model to determine first decoded neural signals captured from the user in response to a first portion of the compound visual stimulus;
utilizing a second decoding model to decode second decoded neural signals captured from the user in response to a second portion of the compound visual stimulus;
comparing the first decoded neural signals and the second decoded neural signals to assess the attentional engagement of the user; and
determining an attention of the user as defocused based on a balanced response to the first portion and the second portion of the compound visual stimulus.
9. The machine of claim 8 , wherein the operations further comprise:
receiving images captured by at least one eye tracking camera and determining eye-tracking information according to the captured image,
wherein determining the attention of the user as defocused further includes using the eye-tracking information.
10. The machine of claim 9 , wherein the eye-tracking information includes at least one of a direction of gaze and a depth of focus.
11. The machine of claim 8 , wherein a modulation is selectively applied to the multiple distinguishable portions of the compound visual stimulus.
12. The machine of claim 11 , wherein the modulation is applied to a high spatial frequency (HSF) component of the compound visual stimulus.
13. The machine of claim 8 , wherein a color is selectively applied to the multiple distinguishable portions of the compound visual stimulus.
14. The machine of claim 8 , wherein a motion is selectively applied to the multiple distinguishable portions of the compound visual stimulus.
15. A machine-readable medium, the machine-storage medium including instructions that, when executed by a machine, cause the machine to perform operations comprising:
generating a compound visual stimulus with multiple distinguishable portions;
displaying the compound visual stimulus to a user;
utilizing a first decoding model to determine first decoded neural signals captured from the user in response to a first portion of the compound visual stimulus;
utilizing a second decoding model to decode second decoded neural signals captured from the user in response to a second portion of the compound visual stimulus;
comparing the first decoded neural signals and the second decoded neural signals to assess the attentional engagement of the user; and
determining an attention of the user as defocused based on a balanced response to the first portion and the second portion of the compound visual stimulus.
16. The machine-readable medium of claim 15 , wherein the operations further comprise:
receiving images captured by at least one eye tracking camera and determining eye-tracking information according to the captured image,
wherein determining the attention of the user as defocused further includes using the eye-tracking information.
17. The machine-readable medium of claim 16 , wherein the eye-tracking information includes at least one of a direction of gaze and a depth of focus.
18. The machine-readable medium of claim 15 , wherein a modulation is selectively applied to the multiple distinguishable portions of the compound visual stimulus.
19. The machine-readable medium of claim 18 , wherein the modulation is applied to a high spatial frequency (HSF) component of the compound visual stimulus.
20. The machine-readable medium of claim 15 , wherein a color is selectively applied to the multiple distinguishable portions of the compound visual stimulus.