IP Library Granted Patent US 9,165,197
Granted Patent B2
US 9,165,197 · App. 13/758,503 · Granted Oct 20, 2015

Vehicle surroundings monitoring apparatus

Inventor: Makoto Aimura (Wako, JP)
Assignee: HONDA MOTOR CO., LTD
G06K9/00805G06K9/00825
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,165,197
App. No.
13/758,503
Granted
Oct 20, 2015
Kind
B2
Abstract

In an image captured by an infrared camera mounted in a vehicle, a featured image portion group including first and second high luminance image portions lined up side by side vertically or horizontally and a third high luminance image portion located below the first and second high luminance image portions is defined. The featured image portion group has a feature indicating that a similarity of one of a luminance distribution and a shape between the first high luminance image portion and the second high luminance image portion is higher than between the third high luminance image portion and at least one of the first and second high luminance image portions. If the featured image portion group is found in the captured image, it is determined that at least the third high luminance image portion is the image of a component of a traffic signal structure.

Claims (30)

1. A vehicle surroundings monitoring apparatus for performing an object recognition on an object located in the vicinity of a vehicle on the basis of an image captured by an infrared camera mounted in the vehicle, comprising:

a structure recognition unit that detects whether a featured image portion group is included in the captured image, the featured image portion group including:

i) first and second high luminance image portions lined up side by side vertically or horizontally and a third high luminance image portion located below the first and second high luminance image portions, and

ii) a feature indicating that a similarity of one of a luminance distribution and a shape between the first high luminance image portion and the second high luminance image portion is higher than between the third high luminance image portion and at least one of the first and second high luminance image portions,

wherein upon detecting the featured image portion group in the captured image, the structure recognition unit determines that at least the third high luminance image portion is an image of a component of a traffic signal structure.

2. The vehicle surroundings monitoring apparatus according to claim 1 , wherein the featured image portion group includes the first and second high luminance image portions lined up side by side vertically and the third high luminance image portion located below the first and second high luminance image portions, and

wherein upon detecting the featured image portion group in the captured image, the structure recognition unit determines that at least the third high luminance image portion is an image of a component of a traffic signal structure installed on a road in the United States.

3. The vehicle surroundings monitoring apparatus according to claim 1 , wherein the featured image portion group includes the first and second high luminance image portions lined up side by side horizontally and the third high luminance image portion located below the first and second high luminance image portions, and

wherein upon detecting the featured image portion group in the captured image, the structure recognition unit determines that at least the third high luminance image portion is an image of a component of a traffic signal structure installed in a railway crossing in Japan.

4. The vehicle surroundings monitoring apparatus according to claim 2 , wherein the structure recognition unit determines whether the vehicle is located in the vicinity of an intersection, and if so, the structure recognition unit detects whether the featured image portion group is included in the captured image.

5. The vehicle surroundings monitoring apparatus according to claim 3 , wherein the structure recognition unit determines whether the vehicle is located in the vicinity of a railway crossing, and if so, the structure recognition unit detects whether the featured image portion group is included in the captured image.

6. The vehicle surroundings monitoring apparatus according to claim 1 , further comprising:

an attention needed object detecting unit that detects, from the captured image, an image of an attention needed object of predetermined types including at least a human being; and

an alerting unit that performs a process for alerting a driver of the vehicle to the attention needed object when the attention needed object is detected,

wherein if the structure recognition unit determines that the third high luminance image portion is the image of one of the components of the traffic signal structure, the attention needed object detecting unit determines that at least the third high luminance image portion is not the image of the attention needed object.

7. The vehicle surroundings monitoring apparatus according to claim 6 , wherein if the structure recognition unit determines that the third high luminance image portion is the image of one of the components of the traffic signal structure, the attention needed object detecting unit continues to determine that at least the third high luminance image portion is not the image of the attention needed object for at least a predetermined period of time.

8. The vehicle surroundings monitoring apparatus according to claim 6 , wherein if the structure recognition unit determines that the third high luminance image portion is the image of one of the components of the traffic signal structure, the attention needed object detecting unit determines that an image of an object located above the third high luminance image portion in the captured image is not the image of the attention needed object.

9. The vehicle surroundings monitoring apparatus according to claim 1 , further comprising the infrared camera capturing an infrared image.

10. The vehicle surroundings monitoring apparatus according to claim 9 , wherein the infrared camera includes a semiconductor image sensor.

11. A vehicle surroundings monitoring apparatus for performing an object recognition on an object located in the vicinity of a vehicle on the basis of an image captured by an infrared camera mounted in the vehicle, comprising:

a structure recognition means for detecting whether a featured image portion group is included in the captured image, the featured image portion group including:

i) first and second high luminance image portions lined up side by side vertically or horizontally and a third high luminance image portion located below the first and second high luminance image portions, and

ii) a feature indicating that a similarity of one of a luminance distribution and a shape between the first high luminance image portion and the second high luminance image portion is higher than between the third high luminance image portion and at least one of the first and second high luminance image portions,

wherein upon detecting the featured image portion group in the captured image, the structure recognition means determines that at least the third high luminance image portion is an image of a component of a traffic signal structure.

12. A vehicle surroundings monitoring method for performing an object recognition on an object located in the vicinity of a vehicle, the method comprising:

capturing an image by an infrared camera mounted in the vehicle;

detecting, using a processor, whether a featured image portion group is included in the captured image, the featured image portion group including:

i) first and second high luminance image portions lined up side by side vertically or horizontally and a third high luminance image portion located below the first and second high luminance image portions, and

ii) a feature indicating that a similarity of one of a luminance distribution and a shape between the first high luminance image portion and the second high luminance image portion is higher than between the third high luminance image portion and at least one of the first and second high luminance image portions; and

upon detecting the featured image portion group in the captured image, determining, using a processor, that at least the third high luminance image portion is an image of a component of a traffic signal structure.

Assignments (4)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 11, 2024
From: ARRIVER SOFTWARE AB
To: QUALCOMM AUTO LTD.
Reel/Frame 069171/0233 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 5, 2022
From: VEONEER SWEDEN AB
To: ARRIVER SOFTWARE AB
Reel/Frame 059596/0826 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 13, 2021
From: HONDA MOTOR CO., LTD
To: VEONEER SWEDEN AB
Reel/Frame 057336/0220 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 4, 2013
From: AIMURA, MAKOTO
To: HONDA MOTOR CO., LTD.
Reel/Frame 029749/0526 →
Priority Claims (1)
JP 2012-048639 · Mar 5, 2012 · national
Continuity (1)
Related Publication 20130229520A1 · Sep 5, 2013