Eye gesture tracking
Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for eye gesture recognition. In one aspect, a method includes obtaining an electrical signal that represents a measurement, by a photodetector, of an optical signal reflected from an eye and determining a depth map of the eye based on phase differences between the electrical signal generated by the photodetector and a reference signal. Further, the method includes determining gaze information that represents a gaze of the eye based on the depth map and providing output data representing the gaze information.
1. A machine, comprising:
a display device comprising an array of light sources to generate visible light;
an eye gesture tracking module integrated into the display device and configured to track an eye gesture of an eye of a user to determine gaze information representing a gaze direction and a focus of the eye, wherein the eye gesture tracking module is configured to:
illuminate the eye; and
detect reflected signals from the eye to track the gaze direction and the focus of the eye,
wherein the display device is configured to render an image according to the gaze information,
wherein the eye gesture tracking module comprises a modulated optical source to illuminate eyes of the user at one or more selected wavelengths, and
wherein the modulated optical source comprises an optical emitter modulated by a radio-wave frequency or a microwave frequency voltage source.
2. The machine of claim 1 , wherein the display device comprises a gaze reference point corresponding to the focus of the eye.
3. The machine of claim 2 , wherein the image is displayed at a particular portion of the display device corresponding to the gaze reference point.
4. The machine of claim 1 , wherein the machine is configured to receive hand gesture information to aid to render the image.
5. The machine of claim 1 , further comprising an accelerometer or a gyroscope to aid in the tracking of the eye gesture of the eye.
6. The machine of claim 1 , wherein the eye gesture tracking module is configured to create a depth map according to the reflected signals to determine the gaze information.
7. The machine of claim 1 , wherein the eye gesture tracking module comprises one or more photodetectors configured to detect the reflected signals that come from a modulated optical signal provided by the eye gesture tracking module for determining the gaze information.
8. The machine of claim 7 , wherein each photodetector of the one or more photodetectors comprises a time-of-flight pixel.
9. The machine of claim 7 , wherein the eye gesture tracking module is configured to generate a depth map based on time-of-flight information from the one or more photodetectors.
10. The machine of claim 1 , wherein the display device comprises an organic light emitting diode.
11. The machine of claim 1 , wherein the eye gesture tracking module is configured to compare the reflected signals and a reference signal to determine a depth map.
12. The machine of claim 1 , wherein the display device comprises a display that is at least partly transparent.
13. The machine of claim 1 , further comprising a tunable optical element that is tunable to adjust focusing and defocusing of the light from the display device in real time to aid in the eye's viewing the display device based on the gaze information.
14. The machine of claim 1 , further comprising a tunable lens situated between the user and the display device, wherein the tunable lens is tunable to refocus the light from the display device based on the gaze information.
15. The machine of claim 1 , further comprising a second eye gesture tracking module configured to illuminate a second eye of the user to track an eye gesture of the second eye.
16. The machine of claim 1 , further comprising two screens configured to enable two distinct gaze points respectively for two eyes of the user corresponding to the gaze information.
17. The machine of claim 1 , further comprising two screens configured to shows multiple images for two eyes of the user corresponding to the gaze information.
18. The machine of claim 1 , wherein the machine is configured to measure a duration of the focus of the user on a particular location to record an interest level of the user.
19. A method for rendering an image according to gaze information of a user, the method comprising:
illuminating, by a modulated optical source, one or more eyes of the user;
detecting, by an eye gesture tracking module, reflected signals from the one or more eyes;
tracking, by the eye gesture tracking module and based on the reflected signals, an eye gesture of the user;
determining, by the eye gesture tracking module and based on the eye gesture, the gaze information representing a gaze direction and a focus of the one or more eyes; and
rendering, by a display device comprising an array of light sources to generate visible light, an image according to the gaze information,
wherein the eye gesture tracking module is integrated into the display device,
wherein the eye gesture tracking module comprises the modulated optical source to illuminate eyes of the user at one or more selected wavelengths, and
wherein the modulated optical source comprises an optical emitter modulated by a radio-wave frequency or a microwave frequency voltage source.