Point-of-gaze detection device, point-of-gaze detecting method, personal parameter calculating device, personal parameter calculating method, program, and computer-readable storage medium
View Patent ↗A point-of-gaze detection device according to the present invention detects a point-of-gaze of a subject toward a surrounding environment. The device includes: an eyeball image obtaining means configured to obtain an eyeball image of the subject; a reflection point estimating means configured to estimate a first reflection point, at which incoming light in an optical axis direction of an eyeball of the subject is reflected, from the eyeball image; a corrected reflection point calculating means configured to calculate a corrected reflection point as a corrected first reflection point by correcting the first reflection point on the basis of a personal parameter indicative of a difference between a gaze direction of the subject and the optical axis direction of the eyeball; and a point-of-gaze detecting means configured to detect the point-of-gaze on the basis of light at the corrected reflection point and light in the surrounding environment.
1. A point-of-gaze detection device to detect a point-of-gaze of a subject toward a surrounding environment, comprising:
an eyeball image obtaining section configured to obtain an eyeball image of the subject;
a reflection point estimating section configured to estimate a first reflection point, at which incoming light in an optical axis direction of an eyeball of the subject is reflected, from the eyeball image;
a corrected reflection point calculating section configured to calculate a corrected reflection point as a corrected first reflection point by correcting the first reflection point on the basis of a personal parameter indicative of a difference between a gaze direction of the subject and the optical axis direction of the eyeball; and
a point-of-gaze detecting section configured to detect the point-of-gaze on the basis of light at the corrected reflection point and light in the surrounding environment.
2. The device of claim 1 , further comprising:
a pose calculating section configured to calculate a pose of the eyeball from the eyeball image;
wherein the reflection point estimating section estimates the first reflection point on the basis of the pose of the eyeball and a geometric model of the eyeball.
3. The device of claim 1 , wherein
the reflection point estimating section estimates the first reflection point on the basis of a model on the assumption that the gaze direction of the subject is parallel to the optical axis direction of the eyeball of the subject.
4. The device of claim 1 , wherein
the light in the surrounding environment is light of an LED array projector.
5. The device of claim 1 , wherein
the light in the surrounding environment is light of a pattern illumination marker.
6. A point-of-gaze detecting method for detecting a point-of-gaze of a subject toward a surrounding environment, comprising:
obtaining an eyeball image of the subject;
estimating a first reflection point, at which incoming light in an optical axis direction of an eyeball of the subject is reflected, from the eyeball image;
calculating a corrected reflection point as a corrected first reflection point by correcting the first reflection point on the basis of a personal parameter indicative of a difference between a gaze direction of the subject and the optical axis direction of the eyeball; and
detecting the point-of-gaze on the basis of light at the corrected reflection point and light in the surrounding environment.
7. A personal parameter calculating device to calculate a personal parameter indicative of a difference between a gaze direction of a subject and an optical axis direction of an eyeball of the subject, comprising:
an eyeball image obtaining section configured to obtain an eyeball image of the subject;
a reflection point estimating section configured to estimate a first reflection point, at which incoming light in the optical axis direction of the eyeball is reflected, from the eyeball image;
a reflection point detecting section configured to detect a second reflection point, at which light coming from a point-of-gaze of the subject is reflected, from the eyeball image; and
a personal parameter calculating section configured to calculate the personal parameter of the subject based on the first reflection point and the second reflection point.
8. The device of claim 7 , further comprising:
a pose calculating section configured to calculate a pose of the eyeball from the eyeball image;
wherein the reflection point estimating section estimates the first reflection point on the basis of the pose of the eyeball and a geometric model of the eyeball.
9. The device of claim 7 , wherein
the reflection point estimating section estimates the first reflection point on the basis of a model on the assumption that the gaze direction of the subject is parallel to the optical axis direction of the eyeball.
10. A personal parameter calculating method for calculating a personal parameter indicative of a difference between a gaze direction of a subject and an optical axis direction of an eyeball of the subject, comprising:
obtaining an eyeball image of the subject;
estimating a second reflection point, at which incoming light in an optical axis direction of the eyeball is reflected, from the eyeball image;
detecting a first reflection point, at which light coming from a point-of-gaze of the subject is reflected, from the eyeball image; and
calculating the personal parameter of the subject on the basis of the first reflection point and the second reflection point.
11. A non-transitory computer readable storage medium which stores a program to allow a computer to execute point-of-gaze detection for detection of a point-of-gaze of a subject toward a surrounding environment,
wherein the program includes:
obtaining an eyeball image of the subject;
estimating a first reflection point, at which incoming light in an optical axis direction of an eyeball of the subject is reflected, from the eyeball image;
calculating a corrected reflection point as a corrected first reflection point by correcting the first reflection point on the basis of a personal parameter indicative of a difference between a gaze direction of the subject and the optical axis direction of the eyeball; and
detecting the point-of-gaze on the basis of light at the corrected reflection point and light in the surrounding environment.
12. A non-transitory computer readable storage medium which stores a program to allow a computer to execute personal parameter calculation for calculation of a personal parameter indicative of a difference between a gaze direction of a subject and an optical axis direction of an eyeball of the subject,
wherein the program includes:
obtaining an eyeball image of the subject;
estimating a second reflection point, at which incoming light in the optical axis direction of the eyeball is reflected, from the eyeball image;
detecting a first reflection point, at which light coming from a point-of-gaze of the subject is reflected, from the eyeball image; and
calculating the personal parameter of the subject on the basis of the first reflection point and the second reflection point.