IP Library Granted Patent US 10,366,295
Granted Patent B2
US 10,366,295 · App. 15/504,192 · Granted Jul 30, 2019

Object recognition apparatus

Inventor: Yusuke Matsumoto (Kariya, JP)
Assignee: DENSO CORPORATION
G06K9/00805B60R11/04G01S13/867G01S13/931G06K9/00798G06T7/73G08G1/16G08G1/163G08G1/165G08G1/166B60R2300/107B60R2300/301B60R2300/804B60R2300/8033B60R2300/8093G01S17/936G01S2013/9367G06T2207/10024G06T2207/10028G06T2207/30261
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,366,295
App. No.
15/504,192
Granted
Jul 30, 2019
Kind
B2
Abstract

An object recognition apparatus learns an axis displacement amount of a reference axis of first object detecting means, combines and integrates, as information belonging to a same object, a plurality of pieces of information present within a first combining area and a second combining area, when a positional relationship between the first combining area and the second combining area meets a predetermined combinable condition. The first combining area is set as an area in which pieces of information related to the object acquired by the first object detecting means are combined. The second combining area is set as an area in which pieces of information related to the object acquired by second object detecting means are combined. The object recognition apparatus variably sets sizes of the first combining area and the second combining area based on a learning state of the axis displacement amount of the reference axis.

Claims (51)

1. An object recognition apparatus mounted to a moving body, the moving body being provided with a plurality of object detecting apparatuses for detecting an object present within a predetermined detectable area including a reference axis, the plurality of object detecting apparatus including a first object detecting apparatus and a second object detecting apparatus, the detectable area of the first object detecting apparatus and the detectable area of the second object detecting apparatus overlapping each other, the object recognition apparatus comprising:

a processor, wherein the processor is configured to:

learn an axis displacement amount of the reference axis of the first object detecting apparatus;

combine and integrate, as information belonging to a same object, a plurality of pieces of information present within a first combining area and a second combining area, when a positional relationship between the first combining area and the second combining area meets a predetermined combinable condition, the first combining area being set as an area in which pieces of information related to the object acquired by the first object detecting apparatus are combined, the second combining area being set as an area in which pieces of information related to the object acquired by the second object detecting means apparatus are combined; and

variably set sizes of the first combining area and the second combining area based on a learning state of the axis displacement amount learned by the processor.

2. The object recognition apparatus according to claim 1 , wherein:

the processor reduces the first combining area and the second combining area as accuracy of learning by the processor increases.

3. The object recognition apparatus according to claim 2 , wherein:

the first object detecting apparatus is an imaging apparatus that captures an image of a peripheral environment including a road;

the processor is further configured to recognize a lane marking on the road based on an image captured by the first object detecting apparatus;

the processor learns the axis displacement amount of the reference axis of the first object detecting apparatus based on lane marking information that is information related to the lane marking recognized by the processor; and

the processor reduces the first combining area and the second combining area from those before completion of learning when learning of the axis displacement amount based on the lane marking information by the processor is completed after start of operation of the moving body.

4. The object recognition apparatus according to claim 3 , wherein:

the processor is further configured to calculate an optical flow based on an image captured by the first object detecting apparatus, wherein:

the processor performs a first learning process to learn the axis displacement amount of the reference axis of the first object detecting apparatus based on the optical flow calculated by the processor and performs a second learning process to learn the axis displacement amount of the reference axis of the first object detecting apparatus based on the lane marking information, and the first learning process is completed earlier than the second learning process after the start of operation of the moving body; and

the processor reduces the first combining area and the second combining area from those before completion of each learning when the first learning process is completed and the second learning process is completed after the start of operation of the moving body.

5. The object recognition apparatus according to claim 4 , wherein:

the first object detecting apparatus is an imaging apparatus that captures an image of a peripheral environment including a road; and

the second object detecting apparatus is a detection apparatus that detects an object by transmitting transmission waves and receiving the transmitted transmission waves.

6. The object recognition apparatus according to claim 5 , wherein:

the processor sets a reduction ratio in a distance direction to be greater than a reduction ratio in a width direction that is perpendicular to the distance direction, when the first combining area is reduced based on the learning state of the axis displacement amount by the processor.

7. The object recognition apparatus according to claim 6 , wherein:

the processor sets the reduction ratio in the width direction that is perpendicular to the distance direction to be greater than the reduction ratio in the distance direction when the second combining area is reduced based on the learning state of the axis displacement amount by the processor.

8. The object recognition apparatus according to claim 7 , wherein:

the moving body is a vehicle.

9. The object recognition apparatus according to claim 1 , wherein:

the first object detecting apparatus is an imaging apparatus that captures an image of a peripheral environment including a road;

a the processor is further configured to recognize a lane marking on the road based on an image captured by the first object detecting apparatus is further included;

the processor learns the axis displacement amount of the reference axis of the first object detecting apparatus based on lane marking information that is information related to the lane marking recognized by the processor; and

the processor reduces the first combining area and the second combining area from those before completion of learning when learning of the axis displacement amount based on the lane marking information by the processor is completed after start of operation of the moving body.

10. The object recognition apparatus according to claim 1 , wherein:

the first object detecting apparatus is an imaging apparatus that captures an image of a peripheral environment including a road; and

the second object detecting apparatus is a detection apparatus that detects an object by transmitting transmission waves and receiving the transmitted transmission waves.

11. The object recognition apparatus according to claim 1 , wherein:

the processor sets the reduction ratio in the width direction that is perpendicular to the distance direction to be greater than the reduction ratio in the distance direction when the second combining area is reduced based on the learning state of the axis displacement amount by the processor.

12. The object recognition apparatus according to claim 1 , wherein:

the moving body is a vehicle.

13. An object recognition system comprising:

a plurality of object detecting apparatus for detecting an object present in a predetermined detectable area including a reference axis that are mounted to a moving body; and

an object recognition apparatus that is mounted to the moving body,

the plurality of object detecting apparatuses including a first object detecting apparatus and a second object detecting means apparatus, the detectable area of the first object detecting apparatus and the detectable area of the second object detecting apparatus overlapping each other, and

the object recognition apparatus including:

a processor, wherein the processor is configured to:

learn an axis displacement amount of the reference axis of the first object detecting apparatus;

combine and integrate, as information belonging to a same object, a plurality of pieces of information present within a first combining area and a second combining area, when a positional relationship between the first combining area and the second combining area meets a predetermined combinable condition, the first combining area being set as an area in which pieces of information related to the object acquired by the first object detecting apparatus are combined, the second combining area being set as an area in which pieces of information related to the object acquired by the second object detecting apparatus are combined; and

variably set sizes of the first combining area and the second combining area based on a learning state of the axis displacement amount learned by the processor.

14. A processing method of an object recognition apparatus that is a processing method of an object recognition apparatus mounted to a moving body, the moving body being provided with a plurality of object detecting apparatus for detecting an object present within a predetermined detectable area including a reference axis, the plurality of object detecting apparatuses including a first object detecting apparatus and a second object detecting apparatus, and the detectable area of the first object detecting apparatus and the detectable area of the second object detecting apparatus overlapping each other; and

the processing method of the object recognition apparatus comprising:

learning, by a processor provided in the object recognition apparatus, an axis displacement amount of the reference axis of the first object detecting apparatus,

combining and integrating, by the processor, as information belonging to a same object, a plurality of pieces of information present within a first combining area and a second combining area, when a positional relationship between the first combining area and the second combining area meets a predetermined combinable condition, the first combining area being set as an area in which pieces of information related to the object acquired by the first object detecting apparatus are combined, the second combining area being set as an area in which pieces of information related to the object acquired by the second object detecting apparatus are combined; and

variably setting, by the processor, sizes of the first combining area and the second combining area based on a learning state of the axis displacement amount learned by the processor.

Assignments (2)
CORRECTIVE ASSIGNMENT TO CORRECT THE INVENTOR'S NAME PREVIOUSLY RECORDED AT REEL: 041441 FRAME: 0972. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT . Recorded Jun 10, 2019
From: MATSUMOTO, YUSUKE
To: DENSO CORPORATION
Reel/Frame 049425/0396 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 2, 2017
From: MATSUMOTO, YUUSUKE
To: DENSO CORPORATION
Reel/Frame 041441/0972 →
Priority Claims (1)
JP 2014-165948 · Aug 18, 2014 · national
Continuity (1)
Related Publication 20170262716A1 · Sep 14, 2017