Systems and methods for eye-gaze tracking (EGT) handoff
Embodiments of systems and methods for Eye-Gaze Tracking (EGT) handoff are described. In an illustrative, non-limiting embodiment, an Information Handling System (IHS) may include a processor and a memory coupled to the processor, the memory having program instructions stored thereon that, upon execution by the processor, cause the IHS to: detect an event during a virtual, augmented, or mixed reality (xR) application, where a user wears a Head-Mounted Device (HMD) comprising a first Eye-Gaze Tracking (EGT) system, and where the user operates an external display comprising a second EGT system; and in response to the event, select the first or second EGT system.
1. An Information Handling System (IHS), comprising:
a processor; and
a memory coupled to the processor, the memory having program instructions stored thereon that, upon execution by the processor, cause the IHS to:
calibrate a first Eye-Gaze Tracking (EGT) system and a second EGT system;
detect an event during a virtual, augmented, or mixed reality (xR) application, wherein a user wears a Head-Mounted Device (HMD) comprising the first EGT system, and wherein the user operates an external display comprising the second EGT system; and
in response to the event, select the first or second EGT system based upon the calibration data.
2. The IHS of claim 1 , wherein the first and second EGT systems each comprise a visual spectrum camera or a near-infrared (NIR) camera.
3. The IHS of claim 1 , wherein the first and second EGT systems each employ a 3D model gaze estimation or a 2D model gaze estimation.
4. The IHS of claim 1 , wherein the program instructions, upon execution, further cause the IHS to provide a gaze vector captured by the first or second EGT systems to a rendering engine of the xR application.
5. The IHS of claim 1 , wherein detecting the event further comprises detecting the user's interaction with content rendered via the HMD, and wherein the program instructions, upon execution, further cause the IHS to select the first EGT system.
6. The IHS of claim 1 , wherein detecting the event further comprises detecting the user's interaction with content rendered on the external display, and wherein the program instructions, upon execution, further cause the IHS to select the second EGT system.
7. The IHS of claim 1 , wherein detecting the event further comprises detecting the user's presence within a first distance from the external display, and wherein the program instructions, upon execution, further cause the IHS to select the second EGT system.
8. The IHS of claim 7 , wherein the detecting event further comprises detecting the user's presence within a second distance from the external display greater than the first distance, and wherein the program instructions, upon execution, further cause the IHS to select the first EGT system.
9. The IHS of claim 1 , wherein detecting the event further comprises detecting an ambient light level below a threshold value, and wherein the program instructions, upon execution, further cause the IHS to select the second EGT system.
10. The IHS of claim 1 , wherein detecting the event further comprises detecting an ambient light level above a threshold value, and wherein the program instructions, upon execution, further cause the IHS to select the second EGT system.
11. The IHS of claim 1 , wherein detecting the event further comprises detecting a battery level of the HMD at or below a threshold value, and wherein the program instructions, upon execution, further cause the IHS to select the second EGT system.
12. The IHS of claim 1 , wherein detecting the event further comprises losing a line-of-sight between the second EGT system and the user's eyes, and wherein the program instructions, upon execution, further cause the IHS to select the first EGT system.
13. A method, comprising:
calibrating a first Eye-Gaze Tracking (EGT) system and a second EGT system;
detecting an event during a virtual, augmented, or mixed reality (xR) application, wherein a user wears a Head-Mounted Device (HMD) comprising the first EGT system, and wherein the user operates an external display comprising the second EGT system; and
in response to the event, selecting the first or second EGT system based on the calibration data.
14. The method of claim 13 , further comprising providing a gaze vector captured by the first or second EGT systems to a rendering engine of the xR application.
15. The method of claim 13 , wherein detecting the event further comprises detecting the user's interaction with content rendered via the HMD, and wherein the method further comprises selecting the first EGT system.
16. The method of claim 13 , wherein detecting the event further comprises detecting the user's interaction with content rendered on the external display, and wherein the method further comprises selecting the second EGT system.
17. The method of claim 13 , wherein detecting the event further comprises detecting the user's presence within a first distance from the external display, and wherein the method further comprises selecting the second EGT system.
18. The method of claim 17 , wherein detecting the event further comprises detecting the user's presence within a second distance from the external display greater than the first distance, and wherein the method further comprises selecting the first EGT system.
19. A hardware memory having program instructions stored thereon that, upon execution by a processor of an Information Handling System (IHS), cause the IHS to:
calibrate a first Eye-Gaze Tracking (EGT) camera and a second EGT camera;
detect an event during a virtual, augmented, or mixed reality (xR) application, wherein a user wears a Head-Mounted Device (HMD) comprising the first EGT camera, and wherein the user operates an external display comprising the second EGT camera; and
in response to the event, select the first or second EGT cameras based on the calibration data.
20. The hardware memory of claim 19 , wherein the program instructions, upon execution, further causes the IHS to select the second EGT camera in response to the user being within range of the second EGT camera, or to select the first EGT camera in response to the user being outside the range.