Method and system for tracking eye movement in conjunction with a light scanning projector
An eye tracking system includes a pair of glasses including two frames; a light scanning projector coupled to the pair of glasses and operable to scan a beam of light to project an image frame including a plurality of pixels; an eyepiece mounted in one of the two frames and optically coupled to the light scanning projector; one or more photodetectors coupled to one of the two frames and operable to detect time-varying reflected signals; and a processor coupled to the light scanning projector and the photodetectors. The eyepiece includes an exit pupil expander operable to direct a portion of the beam of light towards an eye of a user. Each of the time-varying reflected signals is associated with the plurality of pixels. The processor is operable to correlate the time-varying reflected signals with the plurality of pixels and determine a first eye orientation.
1. An eye tracking system operable to track movement of an eye of a user, the eye tracking system comprising:
a light scanning projector;
an eyepiece optically coupled to the light scanning projector, wherein the eyepiece includes an inner surface facing the eye and an outer surface opposing the inner surface;
an optical sensor; and
an image processor coupled to the light scanning projector and the optical sensor, wherein the eyepiece comprises a diffractive reflector overlaying the eyepiece, wherein the diffractive reflector is formed as a planar layer laminated to the inner surface of the eyepiece and is operable to reflect, through diffraction, one or more time-varying reflected signals to the optical sensor.
2. The eye tracking system of claim 1 wherein the light scanning projector comprises a fiber scanning projector configured to scan in a spiral pattern with an increasing angular deflection as a function of time during a scanning time of an image frame.
3. The eye tracking system of claim 1 further comprising glasses having a frame, wherein the light scanning projector, the eyepiece, and the optical sensor are mounted in the frame.
4. The eye tracking system of claim 1 wherein the eyepiece comprises a plurality of planar waveguides.
5. The eye tracking system of claim 4 wherein the plurality of planar waveguides comprise four planar waveguides.
6. The eye tracking system of claim 1 wherein the optical sensor comprises a photodetector.
7. The eye tracking system of claim 1 wherein the light scanning projector is operable to output a display signal and a characterization signal.
8. The eye tracking system of claim 7 wherein the display signal comprises one or more visible wavelengths and the characterization signal comprises one or more non-visible wavelengths.
9. The eye tracking system of claim 8 wherein the one or more visible wavelengths comprise red, green, and blue wavelengths and the one or more non-visible wavelengths comprise infrared wavelengths.
10. The eye tracking system of claim 9 wherein the eyepiece comprises a plurality of planar waveguides including:
a first planar waveguide corresponding to red wavelengths;
a second planar waveguide corresponding to green wavelengths;
a third planar waveguide corresponding to blue wavelengths; and
a fourth planar waveguide corresponding to infrared wavelengths.
11. A method of operating an eye tracking system including a light scanning projector, an eyepiece, and an optical sensor, the method comprising:
generating, using the light scanning projector, a time-varying optical signal;
coupling at least a portion of the time-varying optical signal into the eyepiece, wherein the eyepiece includes an inner surface facing an eye of a user and an outer surface opposing the inner surface;
projecting, from the eyepiece, an image viewable by the eye of the user;
reflecting, through diffraction and using a diffractive reflector overlaying the eyepiece, one or more time-varying signals reflected by the eye of the user to the optical sensor, wherein the diffractive reflector is formed as a planar layer laminated to the inner surface of the eyepiece;
detecting, using the optical sensor, the one or more time-varying signals; and
tracking a position of the eye of the user.
12. The method of claim 11 wherein the light scanning projector comprises a fiber scanning projector configured to scan in a spiral pattern with an increasing angular deflection as a function of time during a scanning time of the image.
13. The method of claim 11 wherein the time-varying optical signal comprises a display signal and a characterization signal.
14. The method of claim 13 wherein the display signal comprises one or more visible wavelengths and the characterization signal comprises one or more non-visible wavelengths.
15. The method of claim 14 wherein the one or more visible wavelengths comprise red, green, and blue wavelengths and the one or more non-visible wavelengths comprise infrared wavelengths.
16. The method of claim 11 wherein the eyepiece comprises a plurality of planar waveguides.
17. The method of claim 16 wherein the plurality of planar waveguides comprise four planar waveguides.
18. The method of claim 11 wherein the optical sensor comprises a photodetector.
19. The method of claim 11 wherein tracking the position of the eye of the user comprises correlating a position of a series of pixels of the image with a series of intensities of the one or more time-varying signals reflected from the eye of the user.
20. The eye tracking system of claim 1 wherein the diffractive reflector is positioned adjacent to the optical sensor.