Systems and methods of eye tracking control on mobile device
Methods and systems to facilitate eye tracking control on mobile devices are provided. An image of a portion of a user is received at an eye tracking device, where the image includes reflections caused by light emitted on the user from one or more light sources located within the eye tracking device. One or more eye features associated with an eye of the user is detected using the reflections. Point of regard information is determined using the one or more eye features, where the point of regard information indicates a location on a display of a computing device coupled to the eye tracking device at which the user was looking when the image of the portion of the user was taken. The point of regard information is sent to an application capable of performing a subsequent operation using the point of regard information.
1. A method comprising:
controlling, at an eye tracking device, one or more light sources located within the eye tracking device to synchronize emission of light from the one or more light sources with a timing of image capture by a camera, wherein the controlling further includes filtering the light from the light sources using an infrared (IR) pass filter that allows light within an IR passband between 800nm and 900 nm to enter the camera and prevents light outside of the IR passband from entering the camera, and wherein the camera has a field of view that overlaps with a field of emission of the one or more light sources;
receiving, at the eye tracking device, an image of a portion of a user captured by the camera, the image including reflections caused by light emitted on the user from the one or more light sources located within the eye tracking device;
detecting one or more eye features associated with an eye of the user using the reflections;
determining point of regard information using the one or more eye features, the point of regard information indicating a location on a display of a computing device coupled to the eye tracking device at which the user was looking when the image of the portion of the user was taken; and
sending the point of regard information to an application capable of performing a subsequent operation using the point of regard information,
wherein at least one of the camera and the one or more light sources are turned off when the user is not detected for a predetermined amount of time and are turned on when the user is detected again.
2. The method of claim 1 , wherein the camera is located within the eye tracking device.
3. The method of claim 1 , wherein the camera has a depth of field ranging from 40 cm to 80 cm.
4. The method of claim 1 , wherein the subsequent operation includes moving an object displayed on the display based on the point of regard information.
5. The method of claim 1 , wherein the field of emission is approximately 30-40 degrees.
6. A non-transitory machine-readable storage medium storing instructions which, when executed by one or more processors, cause the one or more processors to perform operations comprising:
controlling, at an eye tracking device, one or more light sources located within the eye tracking device to synchronize emission of light from the one or more light sources with a timing of image capture by a camera, wherein the controlling further includes filtering the light from the light sources using an infrared (IR) pass filter that allows light within an IR passband between 800nm and 900 nm to enter the camera and prevents light outside of the IR passband from entering the camera, and wherein the camera has a field of view that overlaps with a field of emission of the one or more light sources;
receiving, at the eye tracking device, an image of a portion of a user captured by the camera, the image including reflections caused by light emitted on the user from the one or more light sources located within the eye tracking device;
detecting one or more eye features associated with an eye of the user using the reflections;
determining point of regard information using the one or more eye features, the point of regard information indicating a location on a display of a computing device coupled to the eye tracking device at which the user was looking when the image of the portion of the user was taken; and
sending the point of regard information to an application capable of performing a subsequent operation using the point of regard information,
wherein at least one of the camera and the one or more light sources are turned off when the user is not detected for a predetermined amount of time and are turned on when the user is detected again.
7. The non-transitory machine-readable storage medium of claim 6 , wherein the camera is located within the eye tracking device.
8. The non-transitory machine-readable storage medium of claim 6 , wherein the camera has a depth of field ranging from 40 cm to 80 cm.
9. The non-transitory machine-readable storage medium of claim 6 , wherein the subsequent operation includes moving an object displayed on the display based on the point of regard information.
10. The non-transitory machine-readable storage medium of claim 6 , wherein the field of emission is approximately 30-40 degrees.
11. An eye tracking device comprising:
one or more light sources configured to emit light wherein the one or more light sources further comprise an infrared (IR) pass filter that allows light within an IR passband between 800 nm and 900 nm to enter the camera and prevents light outside of the IR passband from entering the camera; and
one or more hardware processors in communication with the one or more light sources, the one or more hardware processors configured to:
control the one or more light sources to synchronize emission of light from the one or more light sources with a timing of image capture by a camera, wherein the camera has a field of view that overlaps with a field of emission of the one or more light sources,
receive an image of a portion of a user captured by the camera, the image including reflections caused by light emitted on the user from the one or more light sources,
detect one or more eye features associated with an eye of the user including detecting the one or more eye features using the reflections,
determine point of regard information using the one or more eye features, the point of regard information indicating a location on a display of a computing device coupled to the eye tracking device at which the user was looking when the image of the portion of the user was taken, and
send the point of regard information to an application capable of performing a subsequent operation using the point of regard information,
wherein at least one of the camera and the one or more light sources are turned off when the user is not detected for a predetermined amount of time and are turned on when the user is detected again.
12. The eye tracking device of claim 11 , wherein the camera is located within the eye tracking device.
13. The eye tracking device of claim 11 , wherein the predetermined amount of time is five seconds or greater.
14. The eye tracking device of claim 11 , wherein the subsequent operation includes moving an object displayed on the display based on the point of regard information.
15. The eye tracking device of claim 11 , wherein the predetermined amount of time is five seconds or greater.
16. The eye tracking device of claim 11 , wherein the field of emission is approximately 30-40 degrees.