IP Library Granted Patent US 9,993,154
Granted Patent B2
US 9,993,154 · App. 15/160,058 · Granted Jun 12, 2018

Eye gaze detection supporting device and eye gaze detection supporting method

Inventors: Masaru Ninomiya (Yokohama, JP); Katsuyuki Shudo (Yokohama, JP); Shuji Hakoshima (Yokohama, JP)
Assignee: JVC KENWOOD Corporation
A61B3/113A61B3/0008A61B3/0025A61B3/0041A61B3/107A61B3/14
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,993,154
App. No.
15/160,058
Granted
Jun 12, 2018
Kind
B2
Abstract

An eye gaze detection supporting device includes an illuminator including a light source that performs irradiation with light, a plurality of imaging units, position detectors that detect a first position indicating a center of a pupil and a second position indicating a center of corneal reflection, from an image of an eye ball of a subject irradiated with light by the illuminator, and captured by the imaging units, and a calculator that calculates a fourth position indicating a curvature center of a cornea, based on a position of the light source, a third position on a display, the first position, and the second position.

Claims (33)

1. An eye gaze detection supporting device comprising:

an illuminator including a single light source that performs irradiation with light;

a plurality of imaging units;

a position detector configured to

detect a first position indicating a center of a pupil from an image of an eye ball of a subject irradiated with the light by the illuminator, and captured by the imaging units, and

detect, from the image, a region having predetermined brightness including the brightest part as corneal reflection and detect a second position indicating a center of the corneal reflection; and

a calculator configured to calculate a fourth position indicating a curvature center of a cornea, based on a position of the light source, the fourth position indicating the distance from the corneal reflection center becoming a predetermined value, on a straight line, a third position indicating the target image on a display, the first position, and the second position; and

an eye gaze detector processor or circuit configured to detect an eye gaze, based on the first position and the fourth position.

2. The eye gaze detection supporting device according to claim 1 , wherein

the calculator

calculates a first straight line connecting a position of the light source and the second position, and

a second straight line connecting the first position and the third position, and

calculates the fourth position existing on the first straight line, and at which a distance from the first position becomes a first distance, where

the first distance is a distance between an intersection point of the first straight line and the second straight line, and the first position.

3. An eye gaze detection supporting device comprising:

an illuminator including a light source that performs irradiation with light:

a plurality of imaging units;

a position detector configured to detect a first position indicating a center of a pupil and a second position indicating a center of corneal reflection, from an image of an eye ball of a subject irradiated with the light by the illuminator, and captured by the imaging units; and

a calculator configured to calculate a fourth position indicating a curvature center of a cornea, based on a position of the light source, a third position on a display, the first position, and the second position, wherein

the calculator

calculates a first straight line connecting a position of the light source and the second position, and a second straight line connecting the first position and the third position,

calculates the fourth position existing on the first straight line, and at which a distance from the first position becomes a first distance, where the first distance is a distance between an intersection point of the first straight line and the second straight line, and the first position,

calculates a first line segment connecting the position of the light source and the third position, and

a second line segment parallel to the first line segment, and going from the first position to the first straight line, and

calculates the first distance where a ratio of a length of the second line segment to a length of the first line segment, and a ratio of the first distance to a distance between the third position and the fourth position become equal to detect an eye gaze, by an eye gaze detector processor or circuit.

4. An eye gaze detection supporting method comprising the steps of:

detecting a first position indicating a center of a pupil and a second position indicating a center of corneal reflection, from an image of an eye ball of a subject irradiated with light by an illuminator including a light source, and captured by a plurality of imaging units; and

calculating, by a calculator, a fourth position indicating a curvature center of a cornea, based on a position of the light source, a third position on a display, the first position, and the second position, wherein

the calculating includes the steps of

calculating, by a calculator, a first straight line connecting a position of the light source and the second position, and a second straight line connecting the first position and the third position,

calculating, by a calculator, the fourth position existing on the first straight line, and at which a distance from the first position becomes a first distance, where the first distance is a distance between an intersection point of the first straight line and the second straight line, and the first position,

calculating, by a calculator, a first line segment connecting the position of the light source and the third position, and a second line segment parallel to the first line segment, and going from the first position to the first straight line, and

detecting an eye gaze, by an eye gaze detector processor or circuit, based on calculating, by a calculator, the first distance where a ratio of a length of the second line segment to a length of the first line segment, and a ratio of the first distance to a distance between the third position and the fourth position become equal.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 20, 2016
From: NINOMIYA, MASARU; SHUDO, KATSUYUKI; HAKOSHIMA, SHUJI
To: JVC KENWOOD CORPORATION
Reel/Frame 038657/0101 →
Priority Claims (2)
JP 2013-246725 · Nov 28, 2013 · national
JP 2014-111699 · May 29, 2014 · national
Continuity (2)
Continuation PCTJP2014081123 · Nov 25, 2014
Related Publication 20160262614A1 · Sep 15, 2016