IP Library Granted Patent US 10,176,394
Granted Patent B2
US 10,176,394 · App. 15/461,749 · Granted Jan 8, 2019

Search assisting apparatus, search assisting method, and computer readable medium

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,176,394
App. No.
15/461,749
Granted
Jan 8, 2019
Kind
B2
Abstract

A search assisting apparatus includes a line-of-sight trajectory detector, a gaze region extractor, and a target presence determiner. The line-of-sight trajectory detector that detects a line-of-sight trajectory of the operator on an image displayed on a display. The gaze region extractor that extracts, on a basis of the line-of-sight trajectory detected by the line-of-sight trajectory detector, a gaze region gazed by the operator in the image displayed on the display. The target presence determiner that determines, on a basis of a distance from a predetermined position, presence of a predetermined detection target in the gaze region.

Claims (26)

1. A search assisting apparatus comprising:

a controller; and

a memory storing instructions that, when executed by the controller, cause the controller to:

detect a line-of-sight trajectory of an operator on an image displayed on a display;

extracting, on a basis of the line-of-sight trajectory detected, a gaze region gazed by the operator in the image displayed on the display; and

determine, on a basis of a distance from a predetermined position, a presence of a predetermined detection target in the gaze region,

wherein extracting the gaze region comprises extracting, from the image displayed on the display, a circular region as the gaze region, the circular region being a region in which an average position of the line-of-sight trajectory is defined as a center and in which probability of presence of the line-of-sight trajectory takes a predetermined value.

2. The search assisting apparatus according to claim 1 , further comprising a stereo camera obtaining information on the distance from the predetermined.

3. The search assisting apparatus according to claim 2 , wherein determining the gaze region comprises extracting, from the image displayed on the display, a circular region as the gaze region, the circular region being a region in which an average position of the line-of-sight trajectory is defined as a center and in which probability of presence of the line-of-sight trajectory takes a predetermined value.

4. The search assisting apparatus according to claim 1 , wherein

the presence of the predetermined detection target in the gaze region is determined when a difference between an average value of the distance in the gaze region from a capturing unit and a distance nearest in the gaze region from the capturing unit is equal to or greater than a predetermined value, and

orientation of the detection target is performed, by defining a position of the distance that is the nearest in the gaze region from the capturing unit as a position of the detection target.

5. The search assisting apparatus according to claim 2 , wherein

the presence of the predetermined detection target in the gaze region is determined when a difference between an average value of the distance in the gaze region from the stereo camera and a distance nearest in the gaze region from the stereo camera is equal to or greater than a predetermined value, and

performs orientation of the detection target, by defining a position of the distance that is the nearest in the gaze region from the stereo camera as a position of the detection target.

6. The search assisting apparatus according to claim 2 , wherein the stereo camera is mounted on an aircraft.

7. A search assisting method comprising:

detecting a line-of-sight trajectory of an operator on an image displayed on a display;

extracting, on a basis of the line-of-sight trajectory detected by the detecting of the line-of-sight trajectory, a gaze region gazed by the operator in the image displayed on the display; and

determining, on a basis of a distance from a predetermined position measured by the measuring of the distance, a presence of a predetermined detection target in the gaze region,

wherein extracting the gaze region comprises extracting, from the image displayed on the display, a circular region as the gaze region, the circular region being a region in which an average position of the line-of-sight trajectory is defined as a center and in which probability of presence of the line-of-sight trajectory takes a predetermined value.

8. A non-transitory computer readable medium having a search assisting program, the search assisting program causing, when executed by a controller of a search assisting apparatus, the search assisting apparatus to:

detect a line-of-sight trajectory of an operator on an image displayed on a display that displays an image captured by a capturing unit;

extract, on a basis of the detected line-of-sight trajectory, a gaze region gazed by the operator in the image displayed on the display; and

determine, on a basis of a distance in the gaze region from a predetermined position measured by a ranging unit that measures a distance from the capturing unit, a presence of the detection target in the gaze region,

wherein extracting the gaze region comprises extracting, from the image displayed on the display, a circular region as the gaze region, the circular region being a region in which an average position of the line-of-sight trajectory is defined as a center and in which probability of presence of the line-of-sight trajectory takes a predetermined value.

Assignments (2)
CHANGE OF NAME Recorded May 12, 2017
From: FUJI JUKOGYO KABUSHIKI KAISHA
To: SUBARU CORPORATION
Reel/Frame 042624/0886 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 17, 2017
From: ONOMURA, YOICHI
To: FUJI JUKOGYO KABUSHIKI KAISHA
Reel/Frame 041608/0112 →