HUMAN INTERFACE SYSTEM
A human interface system comprising a physical controller configured to receive input from a user and a brain-computer interface in which visual stimuli are presented such that the intention of the user can be validated. The input data from the physical controller is combined with input data from the brain-computer interface to provide hybrid input which may be used to control one or more external real or computer-generated objects. Method of operating said human interface device.
1 . A method comprising:
receiving a first set of input instructions from a first user via a physical controller;
presenting at least one object in a display of a display device;
for one or more of said at least one objects, generating and applying a respective visual stimulus having a corresponding characteristic modulation;
receiving electrical signals corresponding to neural responses of a second user to the or each stimulus from a neural signal capture device;
determining, as a second set of input instructions, which of the objects is an intentional object of focus of the second user in accordance with a correlation between the electrical signals and characteristic modulation of the visual stimulus; and
combining the first set of input instructions with the second set of input instructions to generate a hybrid set of input instructions.
2 . The method of claim 1 , wherein combining the first set of input instructions with the second set of input instructions comprises:
applying the first set of input instructions to a first element in a graphical output of a computer-generated application; and
simultaneously applying the second set of input instructions to a second element in the graphical output.
3 . The method of claim 1 , wherein combining the first set of input instructions with the second set of input instructions comprises:
applying the first set of input instructions to an element in a graphical output of a computer-generated application as a selection operation; and
applying the second set of input instructions to the element as a validation operation.
4 . The method of claim 3 , wherein the first set of input instructions is blocked in an absence of the second set of input instructions.
5 . The method of claim 1 , wherein the object of focus is associated with a controllable object, the method further comprising transmitting a command to the controllable object corresponding to the hybrid input.
6 . The method of claim 1 , wherein the hybrid set of input instructions is applied to control mixed reality graphical objects, and wherein the first set of input instructions provides input of a hand pointer and the second set of input instructions snaps the hand pointer to center on an interactive mixed reality graphical objects based on an inferred object of focus of the second user.
7 . The method of claim 1 , wherein the physical controller comprises a pointer manipulated by the first user.
8 . A machine comprising:
at least one processor; and
at least one memory storing instructions that, when executed by the at least one processor, cause the machine to perform operations comprising:
receiving a first set of input instructions from a first user via a physical controller;
presenting at least one object in a display of a display device;
for one or more of said at least one objects, generating and applying a respective visual stimulus having a corresponding characteristic modulation;
receiving electrical signals corresponding to neural responses of a second user to the or each stimulus from a neural signal capture device;
determining, as a second set of input instructions, which of the objects is an intentional object of focus of the second user in accordance with a correlation between the electrical signals and characteristic modulation of the visual stimulus; and
combining the first set of input instructions with the second set of input instructions to generate a hybrid set of input instructions.
9 . The machine of claim 8 , wherein combining the first set of input instructions with the second set of input instructions comprises:
applying the first set of input instructions to a first element in a graphical output of a computer-generated application; and
simultaneously applying the second set of input instructions to a second element in the graphical output.
10 . The machine of claim 8 , wherein combining the first set of input instructions with the second set of input instructions comprises:
applying the first set of input instructions to an element in a graphical output of a computer-generated application as a selection operation; and
applying the second set of input instructions to the element as a validation operation.
11 . The machine of claim 10 , wherein the first set of input instructions is blocked in an absence of the second set of input instructions.
12 . The machine of claim 8 , wherein the object of focus is associated with a controllable object, the method wherein the operations further comprise transmitting a command to the controllable object corresponding to the hybrid input.
13 . The machine of claim 8 , wherein the hybrid set of input instructions is applied to control mixed reality graphical objects, and wherein the first set of input instructions provides input of a hand pointer and the second set of input instructions snaps the hand pointer to center on an interactive mixed reality graphical objects based on an inferred object of focus of the second user.
14 . The machine of claim 8 , wherein the physical controller comprises a pointer manipulated by the first user.
15 . A machine-readable medium including instructions that, when executed by a machine, cause the machine to perform operations comprising:
receiving a first set of input instructions from a first user via a physical controller;
presenting at least one object in a display of a display device;
for one or more of said at least one objects, generating and applying a respective visual stimulus having a corresponding characteristic modulation;
receiving electrical signals corresponding to neural responses of a second user to the or each stimulus from a neural signal capture device;
determining, as a second set of input instructions, which of the objects is an intentional object of focus of the second user in accordance with a correlation between the electrical signals and characteristic modulation of the visual stimulus; and
combining the first set of input instructions with the second set of input instructions to generate a hybrid set of input instructions.
16 . The machine-readable medium of claim 15 , wherein combining the first set of input instructions with the second set of input instructions comprises:
applying the first set of input instructions to a first element in a graphical output of a computer-generated application; and
simultaneously applying the second set of input instructions to a second element in the graphical output.
17 . The machine-readable medium of claim 15 , wherein combining the first set of input instructions with the second set of input instructions comprises:
applying the first set of input instructions to an element in a graphical output of a computer-generated application as a selection operation; and
applying the second set of input instructions to the element as a validation operation.
18 . The machine-readable medium of claim 17 , wherein the first set of input instructions is blocked in an absence of the second set of input instructions.
19 . The machine-readable medium of claim 15 , wherein the object of focus is associated with a controllable object, the method wherein the operations further comprise transmitting a command to the controllable object corresponding to the hybrid input.
20 . The machine-readable medium of claim 15 , wherein the hybrid set of input instructions is applied to control mixed reality graphical objects, and wherein the first set of input instructions provides input of a hand pointer and the second set of input instructions snaps the hand pointer to center on an interactive mixed reality graphical objects based on an inferred object of focus of the second user.
21 . The machine-readable medium of claim 15 , wherein the physical controller comprises a pointer manipulated by the first user.