EYE TRACKING VIA TRANSPARENT NEAR EYE LENS
A head mounted device includes a transparent display, an infrared light source, and an infrared light receiver. The transparent display has a transparent waveguide and a first and second optical component connected to the transparent waveguide. The infrared light source generates an infrared light directed at the second optical component. The transparent waveguide receives the infrared light from the second optical component and transmits the infrared light to the first optical component. The first optical component directs the infrared light to an eye of a user of the head mounted device and receives a reflection of the infrared light off the eye of the user. The infrared light receiver receives the reflection of the infrared light via the second optical component and generates reflection data based on the received reflection of the infrared light. A position of the eye of the user is identified based on the reflection data.
1 . A head mounted device comprising:
a transparent display having a transparent waveguide and a first and second optical component, the first and second optical component being connected to the transparent waveguide;
an infrared light source coupled to the transparent display, the infrared light source configured to generate an infrared light directed at the second optical component, the transparent waveguide configured to receive the infrared light from the second optical component and to transmit the infrared light to the first optical component, the first optical component configured to direct the infrared light to an eye of a user of the head mounted device and receive a reflection of the infrared light off the eye of the user;
an infrared light receiver configured to receive the reflection of the infrared light via the second optical component and to generate reflection data based on the received reflection of the infrared light; and
one or more hardware processor comprising an eye tracking application, the eye tracking application configured to perform operations comprising: receiving the reflection data from the infrared light receiver, and identifying a position of the eye of the user based on the reflection data.
2 . The head mounted device of claim 1 , wherein the transparent waveguide includes an elongated member having a first planar side and a second planar side opposite and parallel to the first planar side, the elongated member having a first end and a second end opposite to the first end, the first optical component connected to the first end of the elongated member on the first planar side, the second optical component connected to the second end of the elongated member on the first planar side.
3 . The head mounted device of claim 2 , wherein the infrared light source and the infrared light receiver are coupled to the second optical component on the first planar side of the transparent guide.
4 . The head mounted device of claim 1 , further comprising:
an augmented reality display system coupled to the transparent display, the augmented reality display system comprising a second light source directed at the second optical component, the second light source configured to generate a light having a wavelength different from the infrared light, the second light source configured to generate the light based on an augmented reality object to be displayed in the transparent display.
5 . The head mounted device of claim 4 , wherein the one or more hardware processor further comprises:
an augmented reality application configured to perform operations comprising: generating the augmented reality object and communicating the augmented reality object to the display system.
6 . The head mounted device of claim 4 , wherein the one or more hardware processor further comprises:
an augmented reality application configured to perform operations comprising: generating the augmented reality object based on the position of the eye of the user, and communicating the augmented reality object to the display system.
7 . The head mounted device of claim 4 , wherein the eye tracking application is configured to identify a movement of the eye of the user based on changes in the reflection data.
8 . The head mounted device of claim 7 , wherein the one or more hardware processor further comprises:
an augmented reality application configured to perform operations comprising: generating the augmented reality object based on the movement of the eye of the user, and communicating the augmented reality object to the display system.
9 . The head mounted device of claim 2 , further comprising:
a third optical component connected to the second end of the elongated member on the first planar side, the third optical component being adjacent to the second optical component; and
an augmented reality display system coupled to the third optical component, the display system configured to generate a second light source directed at the third optical component, the second light source configured to generate a light having a wavelength different from the infrared light, the second light source configured to generate the light based on an augmented reality object to be displayed.
10 . The head mounted device of claim 1 , wherein the first and second optical components include at least of one a prism, a lens, and a hologram.
11 . A method comprising:
generating an infrared light with an infrared light source directed at a second optical component of a transparent display, the transparent display having a transparent waveguide, and a first optical component and the second optical component connected to the transparent waveguide, the transparent waveguide configured to receive the infrared light from the second optical component and to transmit the infrared light to the first optical component, the first optical component configured to direct the infrared light to an eye of a user of a head mounted device and to receive a reflection of the infrared light off the eye of the user;
receiving, at an infrared light receiver, the reflection of the infrared light via the second optical component;
generating, using one or more hardware processor, reflection data based on the received reflection of the infrared light; and
identifying a position of the eye of the user based on the reflection data.
12 . The method of claim 11 , wherein the transparent waveguide includes an elongated member having a first planar side and a second planar side opposite and parallel to the first planar side, the elongated member having a first end and a second end opposite to the first end, the first optical component connected to the first end of the elongated member on the first planar side, the second optical component connected to the second end of the elongated member on the first planar side.
13 . The method of claim 12 , wherein the infrared light source and the infrared light receiver are coupled to the second optical component on the first planar side of the transparent guide.
14 . The method of claim 11 , further comprising:
generating an augmented reality object with an augmented reality application implemented in the one or more hardware processor;
communicating the augmented reality object to a display system coupled to the transparent display; and
generating, with a second light source directed at the second optical component, a light having a wavelength different from the infrared light, the light generated based on the augmented reality object to be displayed in the transparent display, the second light source controlled by the display system.
15 . The method of claim 14 , wherein the augmented reality object includes virtual content generated based on a direction of a gaze determined based on the position of the eye of the user.
16 . The method of claim 14 , further comprising:
identifying a movement of the eye of the user based on changes in the reflection data.
17 . The method of claim 14 , wherein the augmented reality object includes virtual content generated based on the movement of the eye of the user.
18 . The method of claim 12 , wherein the transparent display includes a third optical component connected to the second end of the elongated member on the first planar side, the third optical component being adjacent to the second optical component, an augmented reality display system coupled to the third optical component,
wherein the method further comprises:
generating, with a second light source directed at the third optical component, a light having a wavelength different from the infrared light, the second light source controlled by the augmented reality system and configured to generate the light based on an augmented reality object to be displayed.
19 . The method of claim 11 , wherein the first and second optical components include at least of one a prism, a lens, and a hologram.
20 . A non-transitory computer-readable storage medium, the computer-readable storage medium including instructions that when executed by a computer, cause the computer to:
generating an infrared light with an infrared light source directed at a second optical component of a transparent display, the transparent display having a transparent waveguide, and a first optical component and the second optical component connected to the transparent waveguide, the transparent waveguide configured to receive the infrared light from the second optical component and to transmit the infrared light to the first optical component, the first optical component configured to direct the infrared light to an eye of a user of a head mounted device and to receive a reflection of the infrared light off the eye of the user;
receiving, at an infrared light receiver, the reflection of the infrared light via the second optical component;
generating, using one or more hardware processor, reflection data based on the received reflection of the infrared light; and
identifying a position of the eye of the user based on the reflection data.