Systems and methods for eye tracking using modulated radiation
Eye-tracking systems of the present disclosure may include at least one light source configured to emit modulated radiation toward an intended location for a user's eye. The modulated radiation may be modulated in a manner that enables the light source to be identified by detection and analysis of the modulated radiation. At least one optical sensor including at least one sensing element may be configured to detect at least a portion of the modulated radiation. A processor may be configured to identify, based on the modulated radiation detected by the optical sensor, the light source that emitted the modulated radiation. Various other methods, systems, and devices are also disclosed.
1. An eye-tracking system, comprising:
at least one light source configured to emit, toward a location intended for a user's eye, modulated radiation that is modulated in a manner that enables the light source to be identified by detection and analysis of the modulated radiation, wherein the radiation is modulated according to at least one of amplitude modulation, frequency modulation, pulse-width modulation, waveform modulation, or phase modulation;
at least one optical sensor comprising:
at least one sensing element configured to detect a first waveform of at least a portion of the modulated radiation; and
at least one other sensing element configured to detect a second, different waveform of at least the portion of the modulated radiation wherein the at least one sensing element and the at least one other sensing element comprise an event driven sensing element that is configured to detect a change in intensity of the modulated radiation; and
a processor configured to:
identify, based on the modulated radiation detected by the optical sensor, the light source that emitted the modulated radiation when the event driven sensing element detects a change in intensity of the modulated radiation.
2. The eye-tracking system of claim 1 , wherein the processor is configured to:
determine that the at least one sensing element of the optical sensor has stopped receiving at least a portion of the modulated radiation emitted by the identified light source; and
turn off or disregard signals generated by the at least one sensing element of the optical sensor in response to the determination.
3. The eye-tracking system of claim 1 , wherein the modulated radiation comprises radiation having a predetermined characteristic, wherein the predetermined characteristic comprises at least one of the following:
a predetermined amplitude;
a predetermined frequency; or
a predetermined phase.
4. The eye-tracking system of claim 1 , further comprising backend electronics operatively coupled to the optical sensor, wherein the backend electronics are configured to perform at least one operation on a signal from the optical sensor.
5. The eye-tracking system of claim 4 , wherein the backend electronics comprise at least one filter for filtering a signal corresponding to the modulated radiation.
6. The eye-tracking system of claim 5 , wherein the filter comprises at least one of a passive filter or an active filter.
7. The eye-tracking system of claim 1 , wherein the at least one light source comprises a plurality of light sources and the modulated radiation emitted by each light source of the plurality of light sources is modulated in a manner that enables each light source to be uniquely identified.
8. The eye-tracking system of claim 1 , wherein the at least one optical sensor comprises a plurality of optical sensors, wherein each optical sensor of the plurality of optical sensors is configured to detect a unique waveform of the modulated radiation emitted from the at least one light source.
9. The eye-tracking system of claim 1 , wherein the optical sensor comprises at least one of:
a low-resolution optical sensor array including one hundred or fewer sensing elements; or
a high-resolution optical sensor array including more than one hundred sensing elements.
10. The eye-tracking system of claim 1 , wherein the processor is configured to perform a fast Fourier transform on a signal from the optical sensor associated with the modulated radiation.
11. The eye-tracking system of claim 1 , further comprising at least one amplifier electrically coupled to the optical sensor, wherein the amplifier is configured to amplify a signal generated by the optical sensor corresponding to the modulated radiation.
12. The eye-tracking system of claim 11 , wherein the amplifier comprises a lock-in amplifier.
13. The eye-tracking system of claim 1 , wherein the light source comprises an infrared light-emitting diode.
14. The eye-tracking system of claim 1 , wherein the at least one sensing element of the optical sensor comprises at least one of:
a charge-coupled device sensor;
a complementary metal-oxide-semiconductor sensor;
a position-sensing detector; or
a photodiode sensor.
15. A head-mounted display, comprising:
an optical element through which a user views an image, the optical element configured to be worn by the user;
at least one light source configured to emit, toward a location intended for the user's eye, modulated radiation that is modulated in a manner that enables the light source to be identified by detection and analysis of the modulated radiation, wherein the radiation is modulated according to at least one of amplitude modulation, frequency modulation, pulse-width modulation, waveform modulation, or phase modulation;
at least one optical sensor comprising:
at least one sensing element configured to detect a first waveform of at least a portion of the modulated radiation; and
at least one other sensing element configured to detect a second, different waveform of at least the portion of the modulated radiation, wherein the at least one sensing element and the at least one other sensing element comprise an event driven sensing element that is configured to detect a change in intensity of the modulated radiation; and
a processor configured to:
identify, based on the modulated radiation detected by the optical sensor, the light source that emitted the modulated radiation when the event driven sensing element detects a change in intensity of the modulated radiation.
16. The head-mounted display of claim 15 , further comprising an electronic display associated with the optical element, wherein the electronic display is configured for displaying an image to the user.
17. The head-mounted display of claim 15 , wherein the light source is positioned within an optical aperture of the optical element.
18. The head-mounted display of claim 15 , wherein the optical sensor is positioned within an optical aperture of the optical element.
19. A method for eye tracking, comprising:
emitting, by at least one light source, modulated radiation toward a user's eye, the radiation being modulated in a manner that enables the light source to be identified by detection and analysis of the modulated radiation, wherein the radiation is modulated according to at least one of amplitude modulation, frequency modulation, pulse-width modulation, waveform modulation, or phase modulation;
detecting, by at least one optical sensor comprising at least one sensing element, a first waveform of at least a portion of the modulated radiation reflected off the user's eye;
detecting, by at least one other optical sensor comprising at least one sensing element, a second, different waveform of at least a portion of the modulated radiation reflected off the user's eye, wherein the at least one optical sensor and the at least one other optical sensor comprise an event driven sensing element that is configured to react to a change in intensity of the modulated radiation;
identifying, by a processor and based on the modulated radiation reflected off the user's eye and detected by the optical sensor, the light source that emitted the modulated radiation to track the user's eye when the event driven sensing element detects a change in intensity of the modulated radiation.