Line-of-sight direction determination device and line-of-sight direction determination method
Provided are a line-of-sight direction determination device and a line-of-sight direction determination method capable of highly precisely and accurately determining a line-of-sight direction from immediately after start of measurement without indication of an object to be carefully observed and adjustment work done in advance. The line-of-sight direction determination device ( 100 ) comprises: a line-symmetric position determination unit ( 150 ) for determining that the corneal reflection image of a left eye or a right eye is located at a line-symmetric position with respect to the center line of the pupils of the right and left eyes; and a line-of-sight direction determination unit ( 170 ) for determining, from the line-symmetric position determination result, a line-of-sight direction at a specific position including the installation position of an imaging unit ( 111 ) or an irradiation unit ( 112 ) at the substantially same position as the imaging unit ( 111 ). The line-of-sight direction determination device ( 100 ) determines that the corneal reflection image is line symmetric and, from this line symmetry property, determines a specific line-of-sight direction.
1. A line-of-sight direction determining apparatus comprising:
an imaging section that takes an image of a face including right and left eyes;
an illuminating section that illuminates corneas of the right and left eyes using a light source;
a pupil detecting section that detects a first coordinate and a second coordinate, the first coordinate and the second coordinate being a center coordinate of the pupil of one of the right and left eyes and a center coordinate of the pupil of the other one of the right and left eyes, respectively;
a cornea reflection image detecting section that detects a third coordinate and a fourth coordinate, the third coordinate and the fourth coordinate being a center coordinate of a cornea reflection image of the light source on the cornea of one of the right and left eyes and a center coordinate of a cornea reflection image of the light source on the cornea of the other one of the right and left eyes, respectively;
a line-symmetric position calculating section that calculates a perpendicular bisector of a first line segment connecting between the first coordinate and the second coordinate, and calculates a line-symmetric position coordinate being a position coordinate that is line-symmetric to the third coordinate with respect to the perpendicular bisector; and
a line-of-sight direction determining section that calculates a coordinate distance between the fourth coordinate and the line-symmetric position coordinate, and, based on a comparison of the coordinate distance and a predetermined threshold, determines a direction of line of sight of the right and left eyes.
2. The line-of-sight direction determining apparatus according to claim 1 , wherein a second line segment connecting between a foot of a perpendicular line from the imaging section to a plane including the first line segment and a foot of a perpendicular line from the illuminating section to the plane, and the first line segment cross at right angles.
3. The line-of-sight direction determining apparatus according to claim 1 , further comprising a warning apparatus,
wherein the warning apparatus receives determination results in the line-of-sight determining section, counts the number of times the direction of line of sight is determined not to match a specific direction, and issues a warning when the count of the number of times exceeds a predetermined number of times.
4. The line-of-sight direction determining apparatus according to claim 3 , wherein the warning apparatus makes the count of the number of times zero upon receiving a determination result that the direction of line of sight matches the specific direction.
5. The line-of-sight determining apparatus according to claim 1 , further comprising:
a face direction calculating section that determines a direction of the face based on the image of the face; and
a face/line-of-sight direction determining section that determines a direction of line of sight based on the coordinate distance and the predetermined threshold, when the face direction calculating section determines that the direction of the face matches the specific direction,
wherein the line-of-sight direction determining section determine the direction of line of sight using the direction of the face as a parameter.
6. The line-of-sight direction determining apparatus according to claim 1 , further comprising:
a line-of-sight direction calculating section that calculates line-of-sight direction information from the image of the face acquired in the imaging section; and
an adjusting section that calculates an offset value of the direction of line of sight based on a determination result in the line-of-sight direction determining section and the line-of-sight direction calculation information, and adjusts the direction of line of sight based on the offset value.
7. A line-of-sight direction determining method comprising:
taking an image of a face including right and left eyes,
illuminating corneas of the right and left eyes using a light source,
detecting a first coordinate and a second coordinate, the first coordinate and the second coordinate being a center coordinate of the pupil of one of the right and left eyes and a center coordinate of the pupil of the other one of the right and left eyes, respectively;
detecting a third coordinate and a fourth coordinate, the third coordinate and the fourth coordinate being a center coordinate of a cornea reflection image of the light source on the cornea of one of the right and left eyes and a center coordinate of a cornea reflection image of the light source on the cornea of the other one of the right and left eyes, respectively;
calculating a perpendicular bisector of a first line segment connecting between the first coordinate and the second coordinate, and calculating a line-symmetric position coordinate being a position coordinate that is line-symmetric to the third coordinate with respect to the perpendicular bisector; and
calculating a coordinate distance between the fourth coordinate and the line-symmetric position coordinate, and, based on a comparison of the coordinate distance and a predetermined threshold, determining a direction of line of sight of the right and left eyes.