Display visibility based on eye convergence
Gaze information of a user can be determined by a computing device that analyzes images of the user. Gaze information of a user includes information such as the user's line of sight, point of regard information, the direction of the user's gaze, the depth of convergence of the user's gaze, and the like. The computing device is able to estimate the distance from the user at which the user is focusing (for example, at a screen near the user or at an object farther away). The visibility and display characteristics of objects displayed on the HUD may be based on the gaze information. For example, content on a heads-up display (HUD) on a windshield may be more transparent while the user is looking through the windshield and more opaque (or otherwise enhanced) while the user is focusing on the HUD.
1. A method comprising:
determining cornea center locations and pupil center locations for two eyes of a user using image data of the two eyes;
determining an optical axis for each of the two eyes of the user based on the cornea center locations and the pupil center locations;
determining a first three-dimensional (3D) point of regard of the user based on the optical axes for the two eyes of the user at a first time;
displaying a virtual object on a display of an augmented reality headset;
responsive to a determination that the first 3D point of regard of the user matches a position associated with the virtual object, the position having a different depth than a depth associated with the display of the augmented reality headset, adjusting a transparency of the display in a manner that increases visibility of the virtual object by increasing an opacity of the display at a rate of increase;
determining a second 3D point of regard of the user based on the optical axes for the two eyes of the user at a second time after the first time; and
responsive to a determination that the second 3D point of regard of the user does not match the position associated with the virtual object, adjusting a transparency of the display in a manner that decreases visibility of the virtual object by decreasing the opacity of the display at a rate of decrease, the rate of decrease being faster than the rate of increase.
2. The method of claim 1 , wherein the 3D point of regard is determined based on visual axes for the two eyes of the user, the visual axes corresponding to the optical axes.
3. The method of claim 1 , further comprising adjusting an attribute of the visibility of the virtual object being displayed in a manner that increases the visibility of the virtual object.
4. The method of claim 3 , wherein the attribute of the visibility of the virtual object comprises a transparency of the virtual object.
5. The method of claim 3 , wherein the attribute of the visibility of the virtual object comprises a brightness of the virtual object.
6. The method of claim 3 , wherein the attribute of the visibility of the virtual object comprises a location of the virtual object.
7. The method of claim 3 , wherein the attribute of the visibility of the virtual object comprises a size of the virtual object.
8. A system comprising:
a display of an augmented reality headset; and
a hardware-implemented eye tracking module configured to:
determine cornea center locations and pupil center locations for two eyes of a user using image data of the two eyes;
determine an optical axis for each of the two eyes of the user based on the cornea center locations and the pupil center locations;
determine a first three-dimensional (3D) point of regard of the user based on the optical axes for the two eyes of the user at a first time;
present a virtual object on the display;
responsive to a determination that the first 3D point of regard of the user matches a position associated with the virtual object, the position having a different depth than a depth associated with the display of the augmented reality headset, adjust a transparency of the display in a manner that increases visibility of the virtual object by increasing an opacity of the display at a rate of increase;
determine a second 3D point of regard of the user based on the optical axes for the two eyes of the user at a second time after the first time; and
responsive to a determination that the second 3D point of regard of the user does not match the position associated with the virtual object, adjust a transparency of the display in a manner that decreases visibility of the virtual object by decreasing the opacity of the display at a rate of decrease, the rate of decrease being faster than the rate of increase.
9. The system of claim 8 , wherein the 3D point of regard is determined based on visual axes for the two eyes of the user, the visual axes corresponding to the optical axes.
10. The system of claim 8 , wherein the hardware-implemented eye tracking module is further configured to adjust an attribute of the visibility of the virtual object being displayed in a manner that increases the visibility of the virtual object.
11. The system of claim 10 , wherein the attribute of the visibility of the virtual object comprises at least one of a transparency of the virtual object, a brightness of the virtual object, a location of the virtual object, and a size of the virtual object.
12. A system, comprising:
at least one processor; and
executable instructions accessible on a computer-readable media that, when executed, cause the at least one processor to perform operations comprising:
determining cornea center locations and pupil center locations for the two eyes of a user using image data of the two eyes;
determining an optical axis for each of the two eyes of the user based on the cornea center locations and the pupil center locations;
determining a first three-dimensional (3D) point of regard of the user based on the optical axes for the two eyes of the user at a first time;
presenting a virtual object on a display of an augmented reality headset;
responsive to a determination that the first 3D point of regard of the user matches a position associated with the virtual object, the position having a different depth than a depth associated with the display of the augmented reality headset, adjusting a transparency of the display in a manner that increases visibility of the virtual object by increasing an opacity of the display at a rate of increase;
determining a second 3D point of regard of the user based on the optical axes for the two eyes of the user at a second time after the first time; and
responsive to a determination that the second 3D point of regard of the user does not match the position associated with the virtual object, adjusting a transparency of the display in a manner that decreases visibility of the virtual object by decreasing the opacity of the display at a rate of decrease, the rate of decrease being faster than the rate of increase.
13. The system of claim 12 , wherein the executable instructions, when executed, further cause the at least one processor to perform operations comprising:
displaying calibration targets at known positions on the display; and
determining angular offsets between the calibration targets and the optical axes for the two eyes of the user while the user is looking at the calibration targets, the angular offsets comprising an alpha angle representing a horizontal offset and a beta angle representing a vertical offset.
14. The system of claim 13 , wherein executable instructions, when executed, further cause the at least one processor to perform operations comprising:
applying the angular offsets to the determined optical axis to determine a visual axis.
15. The method of claim 2 , further comprising:
displaying calibration targets at known positions on the display; and
determining angular offsets between the visual axes and the optical axes for the two eyes of the user while the user is looking at the calibration targets, the angular offsets comprising an alpha angle representing a horizontal offset and a beta angle representing a vertical offset.