Eye gaze tracking
Aspects of the embodiments are directed to systems, methods, and devices for eye gaze tracking. In embodiments, a projective surface, such as a virtual reality display screen or augmented reality projective surface, can project light towards a wearer's eyes. The light can be light representing the shape of the projective surface or can be a displayed shape. The light can be reflected from a cornea. The reflected light from the cornea can be received. A distortion of the shape of the projective surface or displayed shape can be used to determine an eye gaze position.
1. A wearable apparatus which projects a native image onto a wearer's eye and determines eye gaze tracking by analyzing a reflection from the wearer's cornea, the wearable apparatus comprising:
a display which projects the native image;
an image sensor which receives the reflection of the native image; and,
a processor in electrical communication with the image sensor and the display, the processor configured to:
receive data representative the native image;
receive data representative of the reflection of the native image;
compare the data representative of the native image with the reflection of the native image;
detect distortions of the data representative of the native image with the reflection of the native image;
resolve the distortions of the data representative of the native image with the reflection of the native image into a reflected shape; and,
determine eye gaze based upon the distortions and reflected shape;
wherein, the distortion detection does not rely upon any light other than the reflection of the native image.
2. The wearable apparatus of claim 1 , wherein the wearable apparatus is comprised by one of a virtual reality display screen and an augmented reality headset projector.
3. The wearable apparatus of claim 1 , wherein the image sensor comprises high dynamic range image sensor.
4. The wearable apparatus of claim 1 , wherein the processor is further configured to:
determine a first edge of the reflected shape;
determine a second edge of the reflected shape;
compare the first edge to the second edge of the reflected shape; and wherein,
identify eye gaze direction based, at least in part, upon the first and second edge of the reflected shape.
5. The wearable apparatus of claim 4 , further comprising a circuit providing edge detection.
6. The wearable apparatus of claim 1 , wherein the identification of eye gaze direction is based solely on the distorted reflection of the projected native image and not on gridlines, beacons, image markers, not light outside the bandwidth of the native image.
7. The wearable apparatus of claim 1 , the processor further configured to:
intermittently display a calibration image on the display;
receive a reflection of the calibration image at the image sensor;
determine a shape of the calibration image; and
correlate the shape of the calibration image to an eye gaze direction.
8. A method for determining eye gaze in a wearable apparatus by projecting a native image onto a wearer's eye and analyzing a reflection from the wearer's cornea, the method comprising:
displaying a scene comprised by the native image;
sensing a reflected image on an image sensor;
electrically communicating data representative of the reflected image to a processor;
receiving data representative, the native image at the processor;
receiving data representative of the reflection of the native image at the processor;
comparing the data representative of the native image with the reflection of the native image;
detecting distortions of the data representative of the native image with the reflection of the native image;
resolving the distortions of the data representative of the native image with the reflection of the native image into a reflected shape; and,
determining eye gaze based upon the distortions and reflected shape;
wherein, the scene contains no beacons, gridlines, nor specific image locators.
9. The method of claim 8 , wherein the wearable apparatus is comprised by one of a virtual reality display screen and an augmented reality headset projector.
10. The method of claim 8 , wherein the image sensor comprises high dynamic range image sensor.
11. The method of claim 8 , further comprising:
determining a first edge of the reflected shape;
determining a second edge of the reflected shape;
comparing the first edge to the second edge of the reflected shape; and wherein,
identify eye gaze direction based, at least in part, upon the first and second edge of the reflected shape.
12. The method of claim 8 , wherein the identification of eye gaze direction is based solely on the distorted reflection of the projected native image and not on gridlines, beacons nor image markers.
13. The method of claim 8 , further comprising:
intermittently displaying a calibration image on the display;
receiving a reflection of the calibration image at the image sensor;
determining a shape of the calibration image; and
correlating the shape of the calibration image to an eye gaze direction.
14. A wearable apparatus which projects a native image onto a wearer's eye and determines eye gaze tracking by analyzing a reflection from the wearer's cornea, the wearable apparatus comprising:
means for displaying a scene comprised by the native image;
means for sensing a reflected image on an image sensor;
means for electrically communicating data representative of the reflected image to a processor;
means for receiving data representative the native image at the processor;
means for receiving data representative of the reflection of the native image at the processor;
means for comparing the data representative of the native image with the reflection of the native image;
means for detecting distortions of the data representative of the native image with the reflection of the native image;
means for resolving the distortions of the data representative of the native image with the reflection of the native image into a reflected shape; and,
means for determining eye gaze based upon the distortions and reflected shape;
wherein, the scene contains no beacons, gridlines nor specific image locators.
15. The wearable apparatus of claim 14 , wherein the wearable apparatus is comprised by one of a virtual reality display screen and an augmented reality headset projector.
16. The wearable apparatus of claim 14 , wherein the image sensor comprises high dynamic range image sensor.
17. The wearable apparatus of claim 14 , further comprising:
means for determining a first edge of the reflected shape;
means for determining a second edge of the reflected shape;
means for comparing the first edge to the second edge of the reflected shape;
and wherein,
means for identifying eye gaze direction based, at least in part, upon the first and second edge of the reflected shape.
18. The wearable apparatus of claim 14 , wherein the identification of eye gaze direction is based solely on the distorted reflection of the projected native image and not on gridlines, beacons, nor image markers.
19. The wearable apparatus of claim 14 , further comprising:
means for receiving a reflection of the calibration image at the image sensor;
means for determining a shape of the calibration image; and
means for correlating the shape of the calibration image to an eye gaze direction.