Illumination system synchronized with image sensor
Eye tracking technology may be used in a wide range of lighting conditions and with many different and varying light levels. In some embodiments, an eye tracking device may employ active illumination (e.g., in the form of infrared light-emitting diodes (LEDs)). However, employing active illumination may reduce the battery life of the device. Under some circumstances (e.g., in a dark environment), the light intensity may be excessive and could be reduced, thereby reducing energy consumption and extending the battery life of the device. An algorithm may be used to adjust the duration of light in eye tracking systems that employ active illumination.
1. A method comprising:
identifying a region of interest of an image to be captured by a camera comprising a rolling shutter image sensor, the image captured by sequentially exposing lines of the image sensor starting with a first line of the image sensor, the region of interest beginning at a beginning line of the image sensor and ending at an ending line of the image sensor and corresponding to a region of the image depicting an eye;
determining a delay period between a time at which the first line of the image sensor begins exposure and a time at which the ending line begins exposure;
capturing a filtered infrared image by the camera, wherein capturing the filtered infrared image comprises:
detecting a signal by a processor of a machine, the signal indicating a time at which the first line of the image sensor begins exposure, and
responsive to the delay period elapsing from the detection of the signal, activating an infrared light source, and wherein the camera further comprises an infrared pass filter that passes light having wavelengths in a range between 800 nm and 900 nm and attenuates light having wavelengths outside the range;
detecting one or more eye features in the region of interest of the filtered infrared image; and
determining a point of regard based on the one or more eye features, the point of regard identifying a position on a display at which the eye is looking.
2. The method of claim 1 , wherein the signal is a trigger signal from a camera control module.
3. The method of claim 1 , further comprising:
determining an activation period based on a number of lines between the beginning line and the ending line; and
responsive to the activation period elapsing from the activation of the light source, deactivating the light source.
4. The method of claim 3 , wherein determining the activation period comprises determining a period between a time at which the ending line begins exposure and a time at which the beginning line ends exposure.
5. The method of claim 1 , wherein the region of interest of the image includes a region of the image depicting an eye and excludes a region of the image depicting at least a portion of a face.
6. The method of claim 1 , wherein the region of interest of the image is a region of the image depicting a face.
7. The method of claim 1 , further comprising:
detecting the region of interest in the filtered infrared image; and
prior to detecting one or more eye features in the region of interest, cropping the filtered infrared image to generate a cropped image, the cropped image including the region of interest and excluding portions of the image outside the region of interest.
8. A system comprising:
a memory that stores instructions;
an infrared light source; and
one or more processors, configured by the instructions to perform operations comprising:
identifying a region of interest of an image to be captured by a camera comprising a rolling shutter image sensor, the image captured by sequentially exposing lines of the image sensor starting with a first line of the image sensor, the region of interest beginning at a beginning line of the image sensor and ending at an ending line of the image sensor and corresponding to a region of the image depicting an eye,
determining a delay period between a time at which the first line begins exposure and a time at which the ending line of the image sensor begins exposure,
capturing a filtered infrared image by the camera, wherein capturing the filtered infrared image comprises:
detecting a signal indicating a time at which the first line of the image sensor begins exposure, and
responsive to the delay period elapsing from the detection of the signal, activating the infrared light source, and wherein the camera further comprises an infrared pass filter that passes light having wavelengths in a range between 800 nm and 900 nm and attenuates light having wavelengths outside the range;
detecting one or more eye features in the region of interest of the filtered infrared image; and
determining a point of regard based on the one or more eye features, the point of regard identifying a position on a display at which the eye is looking.
9. The system of claim 8 , wherein the signal is a trigger signal from a camera control module.
10. The system of claim 8 , wherein the operations further comprise:
determining an activation period based on a number of lines between the beginning line and the ending line; and
responsive to the activation period elapsing from the activation of the light source, deactivating the light source.
11. The system of claim 10 , wherein determining the activation period comprises determining a period between a time at which the ending line begins exposure and a time at which the beginning line ends exposure.
12. The system of claim 8 , wherein the region of interest of the image includes a region of the image depicting an eye and excludes a region of the image depicting at least a portion of a face.
13. The system of claim 8 , wherein the region of interest of the image is a region of the image depicting a face.
14. A non-transitory machine-readable storage medium storing instructions which, when executed by one or more processors, cause the one or more processors to perform operations comprising:
identifying a region of interest of an image to be captured by a camera comprising a rolling shutter image sensor, the image captured by sequentially exposing lines of the image sensor starting with a first line of the image sensor, the region of interest beginning at a beginning line of the image sensor and ending at an ending line of the image sensor and corresponding to a region of the image depicting an eye;
determining a delay period between a time at which the first line of the image sensor begins exposure and a time at which the ending line begins exposure;
capturing a filtered infrared image by the camera, wherein capturing the filtered infrared image comprises:
detecting a signal by a processor of a machine, the signal indicating a time at which the first line of the image sensor begins exposure, and
responsive to the delay period elapsing from the detection of the signal, activating an infrared light source, and wherein the camera further comprises an infrared pass filter that passes light having wavelengths in a range between 800 nm and 900 nm and attenuates light having wavelengths outside the range;
detecting one or more eye features in the region of interest of the filtered infrared image; and
determining a point of regard based on the one or more eye features, the point of regard identifying a position on a display at which the eye is looking.
15. The non-transitory machine-readable storage medium of claim 14 , wherein the signal is a trigger signal from a camera control module.
16. The non-transitory machine-readable storage medium of claim 14 , wherein the operations further comprise:
determining an activation period based on a number of lines between the beginning line and the ending line; and
responsive to the activation period elapsing from the activation of the light source, deactivating the light source.