Gaze-based active device identification and management
View Patent ↗Aspects of the present disclosure relate to gaze-based active device identification and management. At a first time, at least one reference gaze image of a user while the user is gazing at a first user device of a plurality of user devices in an environment of the user can be collected. At a second time, a current gaze image of the user can be collected. The at least one reference gaze image can be compared with the current gaze image to determine that the user is gazing at the first user device of the plurality of user devices.
1. A method comprising:
collecting a plurality of reference gaze images of a user while the user is gazing, at a first time, at a first user device of a plurality of user devices in an environment of the user, wherein respective collected reference gaze images are captured from a different user device of the plurality of user devices while the user is gazing at the first user device;
collecting a plurality of current gaze images of the user at a second time, wherein respective collected current gaze images are captured from respective different user devices that captured a reference gaze image of the user at the first time; and
comparing respective reference gaze images with the respective current gaze images to determine that the user is gazing at the first user device of the plurality of user devices.
2. The method of claim 1 , further comprising:
pairing, in response to determining that the user is gazing at the first user device of the plurality of user devices, at least one peripheral device to the first user device.
3. The method of claim 1 , wherein the plurality of reference gaze images collected from different user devices of the plurality of user devices are used to generate a virtual layout of the environment of the user, wherein the virtual layout indicates a position and an orientation of each user device of the plurality of user devices that captured a reference gaze image of the user at the first time.
4. The method of claim 3 , wherein the virtual layout includes a graphical user interface (GUI) with a plurality of configurable options for gaze-based active device identification and management.
5. The method of claim 4 wherein the plurality of configurable options include a first option to enable or disable specific user devices of the plurality of devices for gaze-based active device identification management and a second option to set peripheral pairing preferences for each user device of the plurality of user devices.
6. The method of claim 4 , wherein the plurality of configurable options include a first option to set reference gaze image collection conditions and a second option to set current gaze image collection conditions.
7. The method of claim 1 , wherein prior to collecting of the plurality of reference gaze images, a determination is made whether a condition is met for reference gaze image collection.
8. The method of claim 7 , wherein the condition includes a determination that at least one user device of the plurality of user devices has been repositioned.
9. The method of claim 1 , further comprising:
automatically issuing a command to the first user device in response to determining that the user is gazing at the first user device of the plurality of user devices.
10. The method of claim 9 , wherein the command is a power-on command.
11. The method of claim 1 , wherein the comparing includes comparing pixels of respective reference gaze images to pixels of respective current gaze images to determine a percentage of matching pixels for each respective comparison.
12. The method of claim 11 , wherein a percentage of matching pixels of a respective comparison is compared to a threshold to determine that the user is gazing at the first user device of the plurality of user devices.
13. A system comprising:
one or more processors; and
one or more computer-readable storage media collectively storing program instructions which, when executed by the one or more processors, are configured to cause the one or more processors to perform a method comprising:
collecting a plurality of reference gaze images of a user while the user is gazing, at a first time, at a first user device of a plurality of user devices in an environment of the user, wherein respective collected reference gaze images are captured from a different user device of the plurality of user devices while the user is gazing at the first user device;
collecting a plurality of current gaze images of the user at a second time, wherein respective collected current gaze images are captured from respective different user devices that captured a reference gaze image of the user at the first time; and
comparing respective reference gaze images with the respective current gaze images to determine that the user is gazing at the first user device of the plurality of user devices.
14. The system of claim 13 , wherein the program instructions include additional instructions configured to cause the one or more processors perform the method further comprising:
pairing, in response to determining that the user is gazing at the first user device of the plurality of user devices, at least one peripheral device to the first user device.
15. The system of claim 13 , wherein the program instructions include additional instructions configured to cause the one or more processors perform the method further comprising:
automatically issuing a command to the first user device to open a first application or file in response to determining that the user is gazing at the first user device of the plurality of user devices.
16. The system of claim 13 , wherein the comparing includes comparing detected features within respective reference gaze images to detected features within respective current gaze images to determine a number of matching features for each respective comparison, wherein a number of matching features of a first respective comparison is compared to a threshold to determine that the user is gazing at the first user device of the plurality of user devices.
17. A computer program product comprising one or more computer readable storage media, and program instructions collectively stored on the one or more computer readable storage media, the program instructions comprising instructions configured to cause one or more processors to perform a method comprising:
collecting a plurality of reference gaze images of a user while the user is gazing, at a first time, at a first user device of a plurality of user devices in an environment of the user, wherein respective collected reference gaze images are captured from a different user device of the plurality of user devices while the user is gazing at the first user device;
collecting a plurality of current gaze images of the user at a second time, wherein respective collected current gaze images are captured from respective different user devices that captured a reference gaze image of the user at the first time; and
comparing respective reference gaze images with the respective current gaze images to determine that the user is gazing at the first user device of the plurality of user devices.
18. The computer program product of claim 17 , wherein the program instructions include additional instructions configured to cause the one or more processors perform the method further comprising:
pairing, in response to determining that the user is gazing at the first user device of the plurality of user devices, at least one peripheral device to the first user device.
19. The computer program product of claim 17 , wherein the program instructions include additional instructions configured to cause the one or more processors perform the method further comprising:
automatically issuing a command to the first user device to execute a memory action in response to determining that the user is gazing at the first user device of the plurality of user devices.
20. The computer program product of claim 17 , wherein the plurality of reference gaze images collected from different user devices of the plurality of user devices are used to generate a virtual layout of the environment of the user, wherein the virtual layout indicates a position and an orientation of each user device of the plurality of user devices that captured a reference gaze image of the user at the first time.