Eye glint imaging in see-through computer display systems
Disclosure herein concerns a method that includes illuminating a user's eye with an illumination source in a head-worn display, capturing an image of the user's eye with an eye camera in the head-worn display, wherein the image includes an eye glint produced by light from the illumination source that is reflected from a surface of the user's eye, determining a size of an eye glint in the captured image, and identifying a change in focus distance for the user's eye in correspondence with a change in the size of the eye glint.
1. A wearable head device comprising:
a see-through display;
an illumination source configured to illuminate an eye of a user of the wearable head device, the eye having an iris, wherein illuminating the eye produces an eye glint;
one or more sensors; and
one or more processors configured to perform a method comprising:
capturing, via the one or more sensors, an image of the eye glint;
capturing, via the one or more sensors, an image of the iris;
comparing, based on the image of the eye glint and further based on the image of the iris, a position of the iris with a position of the eye glint;
determining, based on the comparing, whether to present virtual content to the user at a first region of the see-through display;
in accordance with a determination to present the virtual content to the user at the first region of the see-through display, presenting the virtual content at the first region of the see-through display; and
in accordance with a determination to not present the virtual content to the user at the first region of the see-through display, forgoing presenting the virtual content at the first region of the see-through display.
2. The wearable device of claim 1 , wherein:
presenting the virtual content at the first region of the see-through display comprises moving a presentation of the virtual content to the first region of the see-through display from a second region of the see-through display; and
forgoing presenting the virtual content at the first region of the see-through display comprises presenting the virtual content at the second region of the see-through display.
3. The wearable device of claim 2 , wherein the first region of the see-through display comprises a central region of the see-through display and the second region of the see-through display comprises a peripheral region of the see-through display.
4. The wearable device of claim 1 , wherein determining whether to present the virtual content to the user at the first region of the see-through display comprises determining, based on the comparing, whether an eye movement of the user is a momentary eye movement.
5. The wearable device of claim 1 , wherein:
the method further comprises determining, based on an output of the one or more sensors, whether the user's head is stationary; and
determining whether to present the virtual content to the user at the first region of the see-through display is further based on the determination whether the user's head is stationary.
6. The wearable device of claim 1 , wherein:
the method further comprises detecting, via the one or more sensors, a head movement of the user; and
determining whether to present the virtual content to the user at the first region of the see-through display comprises:
determining whether an eye movement of the user exceeds a first threshold; and
determining whether the head movement exceeds a second threshold.
7. The wearable device of claim 6 , wherein the method further comprises determining a location of the first region of the see-through display based on the detected head movement.
8. A method comprising:
illuminating, via an illumination source of a wearable head device, the wearable head device comprising a see-through display and one or more sensors, an eye of a user of the wearable head device to produce an eye glint;
capturing, via the one or more sensors, an image of the eye glint;
capturing, via the one or more sensors, an image of an iris of the eye;
comparing, based on the image of the eye glint and further based on the image of the iris, a position of the iris with a position of the eye glint;
determining, based on the comparing, whether to present virtual content to the user at a first region of the see-through display;
in accordance with a determination to present the virtual content to the user at the first region of the see-through display, presenting the virtual content at the first region of the see-through display; and
in accordance with a determination to not present the virtual content to the user at the first region of the see-through display, forgoing presenting the virtual content at the first region of the see-through display.
9. The method of claim 8 , wherein:
presenting the virtual content at the first region of the see-through display comprises moving a presentation of the virtual content to the first region of the see-through display from a second region of the see-through display; and
forgoing presenting the virtual content at the first region of the see-through display comprises presenting the virtual content at the second region of the see-through display.
10. The method of claim 9 , wherein the first region of the see-through display comprises a central region of the see-through display and the second region of the see-through display comprises a peripheral region of the see-through display.
11. The method of claim 8 , wherein determining whether to present the virtual content to the user at the first region of the see-through display comprises determining, based on the comparing, whether an eye movement of the user is a momentary eye movement.
12. The method of claim 8 , wherein:
the method further comprises determining, based on an output of the one or more sensors, whether the user's head is stationary; and
determining whether to present the virtual content to the user at the first region of the see-through display is further based on the determination whether the user's head is stationary.
13. The method of claim 8 , wherein:
the method further comprises detecting, via the one or more sensors, a head movement of the user; and
determining whether to present the virtual content to the user at the first region of the see-through display comprises:
determining whether an eye movement of the user exceeds a first threshold; and
determining whether the head movement exceeds a second threshold.
14. The method of claim 13 , further comprising determining a location of the first region of the see-through display based on the detected head movement.
15. A non-transitory computer-readable medium storing instructions which, when executed by one or more processors, cause the one or more processors to perform a method comprising:
illuminating, via an illumination source of a wearable head device, the wearable head device comprising a see-through display and one or more sensors, an eye of a user of the wearable head device to produce an eye glint;
capturing, via the one or more sensors, an image of the eye glint;
capturing, via the one or more sensors, an image of an iris of the eye;
comparing, based on the image of the eye glint and further based on the image of the iris, a position of the iris with a position of the eye glint;
determining, based on the comparing, whether to present virtual content to the user at a first region of the see-through display;
in accordance with a determination to present the virtual content to the user at the first region of the see-through display, presenting the virtual content at the first region of the see-through display; and
in accordance with a determination to not present the virtual content to the user at the first region of the see-through display, forgoing presenting the virtual content at the first region of the see-through display.
16. The non-transitory computer-readable medium of claim 15 , wherein:
presenting the virtual content at the first region of the see-through display comprises moving a presentation of the virtual content to the first region of the see-through display from a second region of the see-through display; and
forgoing presenting the virtual content at the first region of the see-through display comprises presenting the virtual content at the second region of the see-through display.
17. The non-transitory computer-readable medium of claim 16 , wherein the first region of the see-through display comprises a central region of the see-through display and the second region of the see-through display comprises a peripheral region of the see-through display.
18. The non-transitory computer-readable medium of claim 15 , wherein determining whether to present the virtual content to the user at the first region of the see-through display comprises determining, based on the comparing, whether an eye movement of the user is a momentary eye movement.
19. The non-transitory computer-readable medium of claim 15 , wherein:
the method further comprises determining, based on an output of the one or more sensors, whether the user's head is stationary; and
determining whether to present the virtual content to the user at the first region of the see-through display is further based on the determination whether the user's head is stationary.
20. The non-transitory computer-readable medium of claim 15 , wherein:
the method further comprises detecting, via the one or more sensors, a head movement of the user; and
determining whether to present the virtual content to the user at the first region of the see-through display comprises:
determining whether an eye movement of the user exceeds a first threshold; and
determining whether the head movement exceeds a second threshold.