Eye tracking device and method for operating an eye tracking device
The invention relates to an eye tracking device ( 10 a; 10 b; 10 c ) comprising a processing unit ( 18 ) and an optical system ( 14 ), which comprises a capturing unit. The optical system ( 14 ) provides a first optical path (P; P 1 ) with a first imaging property and a second optical path (P; P 2 ) with a second imaging property and the capturing unit (C; C 1 , C 2 ) captures a first image ( 24 a ) by capturing light that has passed along the first optical path (P; P 1 ) and a second image ( 24 b ) by capturing light that has passed along the second optical path (P; P 2 ), so that due to the difference of the first and second imaging property the first ( 24 a ) and the second image ( 24 b ) comprise a difference related to a characteristic of at least part of the first and the second image ( 24 b ), wherein the eye tracking device ( 10 a; 10 b; 10 c ) is configured to determine a property of the eye ( 12 ) on the basis of at least one of the first image ( 24 a ) and the second image ( 24 b ).
1. A method comprising:
capturing a first image of an eye of a user with a first focal length providing a first sharpness of the first image;
capturing a second image of the eye of the user with a second focal length different from the first focal length providing a second sharpness of the second image less than the first sharpness of the first image;
determining a position of a pupil of the eye of the user based on the first image having the first sharpness;
determining a position of a corneal reflection on a cornea of the eye of the user based on the second image having the second sharpness less than the first sharpness; and
determining a gaze direction of the user based on the position of the pupil and the position of the corneal reflection.
2. The method of claim 1 , wherein the first image and the second image are captured simultaneously.
3. The method of claim 1 , wherein the first image and the second image are captured in temporal succession.
4. The method of claim 1 , wherein capturing the first image comprises setting a focal length of a varifocal lens to obtain the first image having the first sharpness and wherein capturing the second image comprises setting the focal length of the varifocal lens to obtain the second image having the second sharpness less than the first sharpness.
5. The method of claim 1 , wherein capturing the first image comprises capturing the first image of eye of the user along a first path and wherein capturing the second image comprises capturing the second image of the eye of the user along a second path that is partially overlapping the first path and partially spatially separated from the first path.
6. The method of claim 1 , wherein capturing the second image comprises:
determining one or more eye features of the user based on the first image; and
determining the second focal length based on the one or more eye features.
7. An eye tracking device comprising:
an imaging system to capture a first image of an eye of a user with a first focal length providing a first sharpness of the first image and to capture a second image of the eye of the user with a second focal length different from the first focal length providing a second sharpness of the second image less than the first sharpness of the first image; and
a processor to determine a position of a pupil of the eye of the user based on the first image having the first sharpness, determine a position of a corneal reflection on a cornea of the eye of the user based on the second image having the second sharpness less than the first sharpness, and determine a gaze direction of the user based on the position of the pupil and the position of the corneal reflection.
8. The eye tracking device of claim 7 , wherein the imaging system is to capture the first image and the second image simultaneously.
9. The eye tracking device of claim 7 , wherein the imaging system is to capture the first image and the second image in temporal succession.
10. The eye tracking device of claim 7 , wherein the imaging system comprises a varifocal lens and the processor is to set a focal length of a varifocal lens to obtain the first image having the first sharpness and to set the focal length of the varifocal lens to obtain the second image having the second sharpness less than the first sharpness.
11. The eye tracking device of claim 7 , wherein the imaging system is to capture the first image along a first path and to capture the second image along a second path that is partially overlapping the first path and partially spatially separated from the first path.
12. The eye tracking device of claim 11 , wherein the imaging system includes a beam splitter that spatially separates the first path and the second path.
13. The eye tracking device of claim 7 , wherein the processor is to:
determine one or more eye features of the user based on the first image;
determine the second focal length based on the one or more eye features; and
set a varifocal lens of the imaging system to capture the second image with the second focal length.
14. A non-transitory computer-readable medium encoding instructions which, when executed, cause a processor to perform operations comprising:
capturing a first image of an eye of a user with a first focal length providing a first sharpness of the first image;
capturing a second image of the eye of the user with a second focal length different from the first focal length providing a second sharpness of the second image less than the first sharpness of the first;
determining a position of a pupil of the eye of the user based on the first image having the first sharpness;
determining a position of a corneal reflection on a cornea of the eye of the user based on the second image having the second sharpness less than the first sharpness; and
determining a gaze direction of the user based on the position of the pupil and the position of the corneal reflection.
15. The non-transitory computer-readable medium of claim 14 , wherein capturing the first image comprises setting a focal length of a varifocal lens to obtain the first image having the first sharpness and wherein capturing the second image comprises setting the focal length of the varifocal lens to obtain the second image having the second sharpness less than the first sharpness.
16. The method of claim 1 , wherein the first image is a sharp image and the second image is an unsharp image.
17. The method of claim 1 , wherein the first image is in-focus and the second image is out-of-focus, creating a bokeh in the second image.
18. The method of claim 1 , wherein determining the position of the corneal reflection on a cornea of the eye of the user based on the second image includes:
determining a plurality of contour points of the corneal reflection;
fitting an ellipse to the plurality of contour points; and
determining a center of the ellipse.
19. The method of claim 1 , wherein determining a position of a corneal reflection on a cornea of the eye of the user based on the second image includes subtracting the first image and the second image from each other.