IP Library Granted Patent US 8,503,737
Granted Patent B2
US 8,503,737 · App. 13/240,200 · Granted Aug 6, 2013

Visual line estimating apparatus

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,503,737
App. No.
13/240,200
Granted
Aug 6, 2013
Kind
B2
Abstract

The visual line estimating apparatus 200 comprises: an image inputting section 201 operable to take an image of a human; a visual line measurement section 202 operable to measure a direction of a visual line on the basis of the taken image; a visual line measuring result storing section 211 operable to store therein visual line measuring results previously measured; a representative value extracting section 212 operable to extract a previous representative value; and a visual line determining section 213 operable to judge whether or not a difference between the representative value and the visual line measuring result is lower than a predetermined threshold to determine a visual line estimating result from the representative value and the visual line measuring result.

Claims (23)

1. A visual line estimating apparatus comprising:

an image inputting section operable to take an image of a region including an eye on a face;

a visual line measurement section operable to measure a direction of a visual line on the basis of the taken image;

a visual line measuring result storing section operable to store therein visual line measuring results previously measured by the visual line measurement section;

a representative value extracting section operable to extract a representative value from the visual line measuring results stored in the visual line measuring result storing section;

a visual line determining section operable to judge whether or not a difference between the representative value extracted by the representative value extracting section and the visual line measuring result measured by the visual line measurement section is lower than a predetermined threshold T to determine a visual line estimating result from the representative value and the visual line measuring result; and

a threshold determining section operable to determine the threshold T, wherein

the threshold determining section is operable to determine the threshold T between a maximum eyeball rotation angle P and a minimum angle Q after setting the maximum eyeball rotation angle P indicating a possible travel angle of the visual line in a time period of a frame and setting the minimum angle Q indicating an angular difference D between the visual line at the time of detecting a true pupil and the visual line at the time of detecting a false pupil outside of a region of the true pupil.

2. The visual line estimating apparatus as set forth in claim 1 , wherein

the threshold determining section is adapted to set the maximum eyeball rotation angle P on the basis of a known value corresponding to an elastic speed of a muscle controlling eye movement.

3. The visual line estimating apparatus as set forth in claim 2 , wherein

the threshold determining section is adapted to adjust the maximum eyeball rotation angle P on the basis of the previous results outputted from at least one of the visual line measurement section and the visual line determining section.

4. The visual line estimating apparatus as set forth in claim 1 , wherein

the threshold determining section is adapted to set the minimum angle Q on the basis of the maximum eyeball rotation angle P and an angle between a line from a center of the pupil to a center of the eyeball and a line from a point on an outline of an iris to the center of the eyeball.

5. The visual line estimating apparatus as set forth in claim 1 , wherein

the representative value extracting section is operable to extract a center value of the visual line measuring results stored in the visual line measuring result storing section as the representative value.

6. The visual line estimating apparatus as set forth in claim 4 , wherein

the threshold determining section is adapted to calculate an iris radius and calculate the angle between the line from the center of the pupil to the center of the eyeball and the line from the point on the outline of the iris on the basis of the calculated iris radius to the center of the eyeball.

7. The visual line estimating apparatus as set forth in claim 6 , further comprising

an irradiating section operable to irradiate the region including the eye on the face, wherein

the threshold determining section is operable to have the irradiating section change the state of irradiating at the time of calculating the iris radius.

8. The visual line estimating apparatus as set forth in claim 1 , further comprising

a time-series filter operable to smooth the value determined by the visual line determining section.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 28, 2024
From: PANASONIC HOLDINGS CORPORATION
To: PANASONIC AUTOMOTIVE SYSTEMS CO., LTD.
Reel/Frame 066595/0839 →
CHANGE OF NAME Recorded Feb 21, 2024
From: PANASONIC CORPORATION
To: PANASONIC HOLDINGS CORPORATION
Reel/Frame 066644/0600 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 31, 2011
From: OKA, KENJI; TSUKIZAWA, SOTARO
To: PANASONIC CORPORATION
Reel/Frame 027144/0458 →