Line-of-sight detection device and method for detecting line of sight

1. A line-of-sight detection device, comprising:

an image data acquisition unit configured to acquire image data of a face of a subject irradiated with detection light emitted from at least one light source;

a line-of-sight detection unit configured to detect a line of sight of the subject based on the image data;

an image processing unit configured to perform image processing on the image data to separately generate a feature image of the face and an eyeglasses reflection image indicating a reflection image of the at least one light source on eyeglasses worn on the face; and

a display controller configured to cause a display device to display the feature image and the eyeglasses reflection image in a different display form in a composite image in which the feature image and the eyeglasses reflection image are combined, wherein

the image processing unit is further configured to generate the feature image and the eyeglasses reflection image based on the image data obtained at a time when the detection light of a first amount of light is emitted from the at least one light source and the image data obtained at a time when the detection light of a second amount of light larger than the first amount of light is emitted from the at least one light source,

the at least one light source includes a first light source and a second light source disposed at a different position,

the detection light of the first amount of light is emitted from the first light source, and the detection light of the second amount of light is emitted from the second light source, and

the first light source and the second light source alternately emit the detection light.

2. The line-of-sight detection device according to claim 1 , wherein

the display form includes at least one of luminance, color, lightness, and saturation, and the feature image includes a contour image of the face.

3. The line-of-sight detection device according to claim 1 , wherein

the display controller is configured to cause the display device to display the eyeglasses reflection image with luminance higher than luminance of the feature image.

4. The line-of-sight detection device according to claim 1 , wherein

a first threshold value and a second threshold value higher than the first threshold value are predetermined, and

the image processing unit is configured to generate

the eyeglasses reflection image with luminance equal to or higher than the second threshold value, and generates the feature image with luminance equal to or lower than the first threshold value.

5. The line-of-sight detection device according to claim 1 , wherein

the image data acquisition unit is configured to acquire the image data from at least one camera that takes an image of the face illuminated with the detection light, and

the image processing unit is configured to generate the feature image and the eyeglasses reflection image based on the image data of a first exposure amount obtained by the at least one camera and image data of a second exposure amount smaller than the first exposure amount obtained by the at least one camera.

6. The line-of-sight detection device according to claim 5 , further comprising:

a light source controller configured to control light emission intensity of the at least one light source and light emission time of the at least one light source; and

a camera controller configured to control an exposure value of the detection light in the at least one camera, wherein

the exposure amount of the image data is adjusted based on at least one of the light emission intensity of the at least one light source, the light emission time of the at least one light source, and the exposure value of the at least one camera.

7. The line-of-sight detection device according to claim 1 , further comprising:

a distance data acquisition unit configured to acquire distance data between a display screen of the display device and the face, wherein

the display controller is configured to cause the display device to display the distance data.

8. The line-of-sight detection device according to claim 1 , wherein

the display controller is configured to cause the display device to display a guide line with a fixed dimension and position on the display screen of the display device.

9. A method for detecting a line of sight, comprising:

acquiring image data of a face of a subject irradiated with detection light emitted from at least one light source;

generating separately, by performing image processing on the image data, a feature image of the face and an eyeglasses reflection image indicating a reflection image of the at least one light source on eyeglasses worn on the face;

causing a display device to display the feature image and the eyeglasses reflection image in a different display form in a composite image in which the feature image and the eyeglasses reflection image are combined; and

detecting a line of sight of the subject based on the image data, wherein

the feature image and the eyeglasses reflection image are generated based on the image data obtained at a time when the detection light of a first amount of light is emitted from the at least one light source and the image data obtained at a time when the detection light of a second amount of light larger than the first amount of light is emitted from the at least one light source,

the at least one light source includes a first light source and a second light source disposed at a different position,

the detection light of the first amount of light is emitted from the first light source, and the detection light of the second amount of light is emitted from the second light source, and

the first light source and the second light source alternately emit the detection light.