Human interface system
A human interface system comprising a physical controller configured to receive input from a user and a brain-computer interface in which visual stimuli are presented such that the intention of the user can be validated. The input data from the physical controller is combined with input data from the brain-computer interface to provide hybrid input which may be used to control one or more external real or computer-generated objects. Method of operating said human interface device.
1. A method comprising:
receiving a first set of input instructions from a user via a gesture tracking device, the gesture tracking device tracking gestures made by the user;
presenting at least one object in a display of a display device;
for one or more of said at least one objects, generating and applying a respective visual stimulus having a corresponding characteristic modulation;
receiving electrical signals corresponding to neural responses to the or each stimulus from a neural signal capture device;
determining, as a second set of input instructions, which of the objects is an intentional object of focus in accordance with a correlation between the electrical signals and characteristic modulation of the visual stimulus; and
combining the first set of input instructions with the second set of input instructions to generate a hybrid set of input instructions.
2. The method of claim 1 , wherein an operation of combining the first set of input instructions with the second set of input instructions includes:
applying the first set of input instructions to a first element in a graphical output of a computer-generated application; and
simultaneously applying the second set of input instructions to a second element in the graphical output.
3. The method of claim 1 , wherein an operation of combining the first set of input instructions with the second set of input instructions includes:
applying the first set of input instructions to an element in a graphical output of a computer-generated application as a selection operation; and
applying the second set of input instructions to the element as a validation operation.
4. The method of claim 1 , wherein the object of focus is associated with a controllable object, the method further comprising:
transmitting a command to the controllable object corresponding to the hybrid input, thereby controlling said controllable object to implement an action based on the command.
5. The method of claim 1 , wherein the second set of input instructions is associated with navigation at a different scale from the first set of input instructions from the gesture tracking device.
6. The method of claim 1 , wherein the gesture tracking device is a motion sensitive physical hand controller.
7. The method of claim 1 , wherein the gesture tracking device is an image capture device.
8. A machine comprising:
at least one processor; and
at least one memory storing instructions that, when executed by the at least one processor, cause the machine to perform operations comprising:
receiving a first set of input instructions from a user via a gesture tracking device, the gesture tracking device tracking gestures made by the user;
presenting at least one object in a display of a display device;
for one or more of said at least one objects, generating and applying a respective visual stimulus having a corresponding characteristic modulation;
receiving electrical signals corresponding to neural responses to the or each stimulus from a neural signal capture device;
determining, as a second set of input instructions, which of the objects is an intentional object of focus in accordance with a correlation between the electrical signals and characteristic modulation of the visual stimulus; and
combining the first set of input instructions with the second set of input instructions to generate a hybrid set of input instructions.
9. The machine of claim 8 , wherein the operation of combining the first set of input instructions with the second set of input instructions includes:
applying the first set of input instructions to a first element in a graphical output of a computer-generated application; and
simultaneously applying the second set of input instructions to a second element in the graphical output.
10. The machine of claim 8 , wherein the operation of combining the first set of input instructions with the second set of input instructions includes:
applying the first set of input instructions to an element in a graphical output of a computer-generated application as a selection operation; and
applying the second set of input instructions to the element as a validation operation.
11. The machine of claim 8 , wherein an object of focus is associated with a controllable object, and wherein the operations further comprise:
transmitting a command to the controllable object corresponding to the hybrid input, thereby controlling said controllable object to implement an action based on the command.
12. The machine of claim 8 , wherein the second set of input instructions is associated with navigation at a different scale from the first set of input instructions from the gesture tracking device.
13. The machine of claim 8 , wherein the gesture tracking device is a motion sensitive physical hand controller.
14. The machine of claim 8 , wherein the gesture tracking device is an image capture device.
15. A machine-readable storage medium, the machine-readable storage medium including instructions that, when executed by a machine, cause the machine to perform operations comprising:
receiving a first set of input instructions from a user via a gesture tracking device, the gesture tracking device tracking gestures made by the user;
presenting at least one object in a display of a display device;
for one or more of said at least one objects, generating and applying a respective visual stimulus having a corresponding characteristic modulation;
receiving electrical signals corresponding to neural responses to the or each stimulus from a neural signal capture device;
determining, as a second set of input instructions, which of the objects is an intentional object of focus in accordance with a correlation between the electrical signals and characteristic modulation of the visual stimulus; and
combining the first set of input instructions with the second set of input instructions to generate a hybrid set of input instructions.
16. The machine-readable storage medium of claim 15 , wherein the operation of combining the first set of input instructions with the second set of input instructions includes:
applying the first set of input instructions to a first element in a graphical output of a computer-generated application; and
simultaneously applying the second set of input instructions to a second element in the graphical output.
17. The machine-readable storage medium of claim 15 , wherein the operation of combining the first set of input instructions with the second set of input instructions includes:
applying the first set of input instructions to an element in a graphical output of a computer-generated application as a selection operation; and
applying the second set of input instructions to the element as a validation operation.
18. The machine-readable storage medium of claim 15 , wherein the object of focus is associated with a controllable object, wherein the operations further comprise:
transmitting a command to the controllable object corresponding to the hybrid input, thereby controlling said controllable object to implement an action based on the command.
19. The machine-readable storage medium of claim 15 , wherein the gesture tracking device is a motion sensitive physical hand controller.
20. The machine-readable storage medium of claim 15 , wherein the gesture tracking device is an image capture device.