Eye tracking system with in-plane illumination
An eye tracking system with in-optical-assembly plane illumination is described. Side-emitting light emitting diodes (LEDs) aligned with a plane of an optical assembly of a near-eye display device are used to illuminate the eye of a user and generate glints that can be detected by an eye tracking camera. A waveguide display of the near-eye display device projects computer-generated content to the eye. A mirror is positioned between the LEDs and the waveguide display to reflect light beams generated from the LEDs toward the waveguide display to mitigate any double glints that may cause ghost signals. A processor of the near-eye display device determines a position and gaze of the eye based on the captured image of the eye with the glints, and generates the computer-generated content for the waveguide display based on the position and gaze of the eye.
1 . An eye tracking system to be used in a near-eye display device, comprising:
at least one illuminator to generate light beams including glints on a surface of an eye;
an eye tracking camera to capture an image of the eye with the glints;
a waveguide display to project computer-generated content to the eye;
a mirror placed between the at least one illuminator and the waveguide display to reflect light of the light beams generated from the at least one illuminator toward the waveguide display, wherein the mirror is positioned to control a direction of the reflected light of the light beams to bypass the eye; and
a processor to receive the captured image of the eye with the glints from the eye tracking camera, determine a gaze direction of the eye based on the captured image of the eye with the glints, and generate the computer-generated content for the waveguide display to project to the eye based on the gaze direction of the eye.
2 . The eye tracking system of claim 1 , wherein the at least one illuminator comprises a light emitting diode (LED) that emits visible, infrared, or near-infrared light.
3 . The eye tracking system of claim 2 , wherein the LED is an angled-emission LED that comprises one of a refractive layer, a diffractive layer, an in-package reflector, or an external reflector to achieve angled light emission.
4 . The eye tracking system of claim 1 , wherein the at least one illuminator comprises one of a side-emitting laser diode, a vertical-cavity surface-emitting laser diode, or a superluminescent light-emitting diode.
5 . The eye tracking system of claim 1 , wherein the at least one illuminator is positioned to generate the glints within a field of view (FOV) of the eye tracking camera.
6 . The eye tracking system of claim 1 , further comprising:
a corrective optical lens positioned between the at least one illuminator and the eye, wherein an edge portion of the corrective optical lens is shaped to direct the light beams generated by the at least one illuminator toward the eye.
7 . The eye tracking system of claim 1 , wherein the at least one illuminator comprises up to 20 illuminators.
8 . A method for tracking a gaze direction of an eye, the method comprising:
generating, by at least one illuminator, light beams including glints on a surface of the eye;
capturing, by an eye tracking camera, an image of the eye with the glints;
projecting, by a waveguide display, computer-generated content to the eye;
positioning a mirror to control a direction of reflected light of the light beams to bypass the eye;
reflecting, by the mirror positioned between the at least one illuminator and the waveguide display, light of the light beams generated from the at least one illuminator toward the waveguide display;
determining, by a processor communicatively coupled to the eye tracking camera and the waveguide display, the gaze direction of the eye based on the captured image of the eye with the glints; and
generating, by the processor, the computer-generated content for the waveguide display to project to the eye based on the gaze direction of the eye.
9 . The method of claim 8 , wherein the at least one illuminator comprises an angled-emission light emitting diode (LED) that comprises one of a refractive layer, a diffractive layer, an in-package reflector, or an external reflector to achieve angled light emission.
10 . The method of claim 8 , wherein the at least one illuminator comprises a light emitting diode (LED) that emits visible, infrared, or near-infrared light.
11 . The method of claim 8 , further comprising:
positioning the at least one illuminator to generate the glints within a field of view (FOV) of the eye tracking camera.
12 . The method of claim 8 , further comprising:
positioning a corrective optical lens between the at least one illuminator and the eye, wherein an edge portion of the corrective optical lens is shaped to direct the light beams generated by the at least one illuminator toward the eye.
13 . The method of claim 9 , further comprising:
directing the light beams to the surface of the eye through one of the refractive layer or the diffractive layer.
14 . The method of claim 9 , further comprising:
directing the light beams to the surface of the eye through the in-package reflector.
15 . The method of claim 9 , further comprising:
directing the light beams to the surface of the eye through the external reflector of the angled-emission LED.
16 . A near-eye display device, comprising:
an optical assembly comprising:
a waveguide display to project computer-generated content to an eye,
an optical lens,
at least one illuminator to generate light beams including glints on a surface of the eye through the optical lens, and
a mirror, positioned between the at least one illuminator and the waveguide display, to reflect light of the light beams generated from the at least one illuminator toward the waveguide display, wherein the mirror is positioned to control a direction of the reflected light of the light beams to bypass the eye;
an eye tracking camera to capture the glints on the surface of the eye; and
a processor to receive the captured image of the eye with the glints from the eye tracking camera, determine a gaze direction of the eye based on the captured image of the eye, and generate the computer-generated content for the waveguide display to project to the eye based on the gaze direction of the eye.
17 . The near-eye display device of claim 16 , wherein the at least one illuminator comprises a light emitting diode (LED) that emits visible, infrared, or near-infrared light.
18 . The near-eye display device of claim 17 , wherein the LED comprises an angled-emission LED that comprises one of a refractive layer, a diffractive layer, an in-package reflector, or an external reflector to achieve angled light emission.
19 . The near-eye display device of claim 16 , wherein the at least one illuminator is positioned to direct the glints within a field of view (FOV) of the eye tracking camera.
20 . The near-eye display device of claim 16 , wherein the optical lens in the optical assembly is a corrective optical lens, wherein an edge portion of the corrective optical lens is shaped to direct the light beams generated by the at least one illuminator toward the eye.