Eye tracking system
An eye tracking system for detecting position and movements of a user's eyes in a head-mounted display (HMD). The eye tracking system includes at least one eye tracking camera, an illumination source that emits infrared light towards the user's eyes, and diffraction gratings located at the eyepieces. The diffraction gratings redirect or reflect at least a portion of infrared light reflected off the user's eyes, while allowing visible light to pass. The cameras capture images of the user's eyes from the infrared light that is redirected or reflected by the diffraction gratings.
1. A system, comprising:
a head-mounted device comprising:
left and right eyepieces located in front of a user's left and right eyes;
one or more infrared light sources configured to emit infrared light towards the user's eyes;
left and right infrared cameras;
left and right diffraction gratings located at the left and right eyepieces, wherein the left and right diffraction gratings are configured to redirect infrared light returned from the user's eyes towards the left and right infrared cameras, respectively; and
wherein the left and right infrared cameras are located farther from the left and right eyepieces than the one or more infrared light sources and are configured to capture a portion of the infrared light redirected by the left and right diffraction gratings to generate images of the user's eyes.
2. The system as recited in claim 1 , wherein the left and right infrared cameras include at least one camera that images the user's left eye and at least one camera that images the user's right eye.
3. The system as recited in claim 1 , wherein the diffraction gratings are implemented as a holographic film.
4. The system as recited in claim 1 , wherein the diffraction gratings are implemented as photothermal reflective glass or as a surface relief grating with mismatched index of refraction at an eye tracking wavelength.
5. The system as recited in claim 1 , further comprising optical prisms or wedges located at edges of outer surfaces of the left and right eyepieces to prevent total internal reflection (TIR) of infrared light rays redirected by the left and right diffraction gratings in a region near the edges of the eyepieces.
6. The system as recited in claim 1 , further comprising a controller comprising one or more processors, wherein the controller is configured to:
obtain the images of the user's eyes from the left and right infrared cameras; and
analyze the images of the user's eyes to determine eye tracking information.
7. The system as recited in claim 6 , wherein the eye tracking information includes one or more of eye position, eye movement, or pupil dilation.
8. The system as recited in claim 1 , wherein the head-mounted device is configured to display visual content for viewing by the user.
9. The system as recited in claim 8 , further comprising one or more visible light cameras configured to capture views of the user's environment, wherein the visual content includes virtual content composited into the views of the user's environment to provide an augmented or mixed reality view to the user.
10. The system as recited in claim 8 , wherein the visual content includes virtual content to provide a virtual reality view to the user.
11. A method, comprising:
emitting, by one or more light sources of a head-mounted device, infrared (IR) light to illuminate a user's eyes;
receiving, at diffraction gratings located at eyepieces of the head-mounted device, a portion of the IR light reflected off the user's eyes;
redirecting, by the diffraction gratings, at least a portion of the received IR light towards IR cameras positioned at or near sides of the user's face when wearing the head-mounted device, and wherein the IR cameras are located farther from the eyepieces than the one or more light sources; and
capturing, by the IR cameras of the head-mounted device, images of the user's eyes from the IR light redirected by the diffraction gratings.
12. The method as recited in claim 11 , wherein the diffraction gratings are implemented as one of a holographic film, a photothermal reflective glass, or a surface relief grating with mismatched index of refraction at an eye tracking wavelength.
13. The method as recited in claim 11 , wherein the IR cameras include at least one camera that images the user's left eye and at least one camera that images the user's right eye.
14. The method as recited in claim 11 , wherein the eyepieces include optical prisms or wedges located at edges of outer surfaces of the eyepieces to prevent total internal reflection (TIR) of infrared light rays in a region near the edges of the eyepieces.
15. The method as recited in claim 11 , further comprising:
obtaining, by a controller of the head-mounted device, the images of the user's eyes from the IR cameras; and
analyzing, by the controller, the images of the user's eyes to determine eye tracking information, wherein the eye tracking information includes one or more of eye position, eye movement, or pupil dilation.
16. The method as recited in claim 11 , further comprising displaying, by the head mounted device, visual content for viewing by the user.
17. The method as recited in claim 16 , further comprising capturing, by one or more visible light cameras, views of the user's environment, wherein the visual content includes virtual content composited into the views of the user's environment to provide an augmented or mixed reality view to the user.
18. The method as recited in claim 16 , wherein the visual content includes virtual content to provide a virtual reality view to the user.
19. A device, comprising:
a display configured to display visual content for viewing by a user;
an infrared light source configured to emit infrared light towards the user's eye;
a camera; and
a diffraction grating located on an optical path between the user's eye and the display, wherein the diffraction grating is located at an optical element of the device, and wherein the diffraction grating is configured to redirect the infrared light returned from the user's eye in a direction of the camera;
wherein the camera is located farther from the optical element than the infrared light source and is configured to capture a portion of the infrared light redirected by the diffraction grating to generate images of the user's eye.
20. The device as recited in claim 19 , wherein the diffraction grating is one of a holographic film applied to a surface of the optical element, a photothermal reflective glass attached to a surface of an optical element, or a surface relief grating on an optical element.