IP Library Granted Patent US 10,140,526
Granted Patent B2
US 10,140,526 · App. 15/500,814 · Granted Nov 27, 2018

Object detecting device

Inventors: Shinji Kakegawa (Tokyo, JP); Takeshi Shima (Tokyo, JP); Yuji Otsuka (Tokyo, JP)
Assignee: HITACHI AUTOMOTIVE SYSTEMS, LTD.
G06K9/00791B60R21/00B60W10/04B60W10/18B60W30/09G06K9/00805G06K9/00825G06K9/4604G06T1/00G06T7/60G08G1/16G08G1/165G08G1/166B60W2420/42B60W2420/52B60W2550/145B60W2710/18B60W2720/106G06T2207/30252
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,140,526
App. No.
15/500,814
Granted
Nov 27, 2018
Kind
B2
Abstract

The purpose of the present invention is to provide an object detecting device which is capable of accurately detecting an object even far away, and of shortening processing time. Provided is an object detecting device ( 100 ), comprising: a disparity acquisition unit ( 116 ) which compares each image of two cameras ( 112, 113 ) and computes a disparity for each pixel; a near-far boundary setting unit ( 118 ) which, in a single image of one of the two cameras, sets a boundary (Rb) between a near region (R 1 ) which is close to a vehicle ( 110 ) and a far region (R 2 ) which is distant from the vehicle ( 110 ); a near object detecting unit ( 119 ) which detects objects ( 102, 104 ) of the near region (R 1 ) on the basis of the disparity; and a far object detecting unit ( 120 ) which detects objects ( 103, 104 ) of the far region (R 2 ) on the basis of the single image.

Claims (41)

1. An object detecting system comprising:

two cameras configured to capture images in front of a vehicle; and

a processor configured to:

compare individual images of the two cameras and calculate a disparity for each pixel;

set a boundary between a near region close to the vehicle and a far region distant from the vehicle, in a single image of one of the two cameras;

detect an object of the near region, on the basis of the disparity; and

detect an object of the far region, on the basis of the single image,

wherein the processor configured to set the boundary further comprises the processor configured to:

output a V-Disparity image obtained by projecting, onto a virtual plane where a first axis shows the disparity and a second axis shows a coordinate position of a longitudinal direction of each pixel of the single image, data of the disparity and the coordinate position corresponding to each pixel of the single image.

2. The object detecting system according to claim 1 , wherein the processor is further configured to:

erase a detection result of a long distance in detection results of the objects displayed on the single image and overlapping each other.

3. The object detecting system according to claim 1 , wherein the processor is further configured to:

extract, using a disparity image in which a disparity calculated for each pixel of the near region of the single image is stored for each pixel, a group of the distance data in which distance data to be the disparity of each pixel of the disparity image is continuous in a depth direction and a transverse direction, from the disparity image, and detects the object of the near region.

4. An object detecting device for detecting objects in front of a vehicle, the object detecting device comprising:

a processor configured to:

compare individual images of two cameras and calculate a disparity for each pixel, wherein the individual images are captured by the two cameras;

set a boundary between a near region close to the vehicle and a far region distant from the vehicle, in a single image of one of the two cameras;

detect an object of the near region, on the basis of the disparity; and

detect an object of the far region, on the basis of the single image,

wherein the processor is further configured to:

calculate a distance to a road surface in front of the vehicle, on the basis of the disparity, and detect a boundary pixel position between a region where reliability of the distance is high and a region where the reliability of the distance is low; and

set the boundary on the basis of the boundary pixel position, and

wherein the processor is further configured to:

output a V-Disparity image obtained by projecting, onto a virtual plane where a transverse axis shows the disparity and a longitudinal axis shows a coordinate position of a longitudinal direction of each pixel of the single image, data of the disparity and the coordinate position corresponding to each pixel of the single image;

detect a most dominant straight line in the V-Disparity image; and

detect the boundary pixel position, on the basis of a deviation of the straight line in the V-Disparity image and a position of the data.

5. The object detecting device according to claim 4 , wherein the processor is further configured to:

set a search range to the far region on the single image, scan a template in the search range, and detect the object of the far region by pattern matching.

6. The object detecting device according to claim 5 , wherein the processor is further configured to:

set using an estimation error between a coordinate position of a longitudinal direction of a pixel at the boundary of the single image and the boundary pixel position of the V-Disparity image, one end of a longitudinal direction of the search range to a position to be a sum of the boundary pixel position and the estimation error.

7. The object detecting device according to claim 6 , wherein the processor is further configured to:

set the other end of the longitudinal direction of the search range to a position obtained by subtracting an image longitudinal width of an object of a maximum height assumed at the boundary of the single image and the estimation error from the boundary pixel position, using the image longitudinal width.

8. The object detecting device according to claim 5 , wherein the processor is further configured to:

set a road shape in front of the vehicle using the single image,

wherein the processor sets positions of left and right ends of the search range to positions of left and right ends of an image region of the road shape.

9. The object detecting device according to claim 5 , wherein the processor is further configured to:

scan the search range repetitively using a plurality of templates having different sizes.

10. The object detecting device according to claim 4 , wherein the processor is further configured to:

erase a detection result of a long distance in detection results of the objects displayed on the single image and overlapping each other.

11. The object detecting device according to claim 4 , wherein the processor is further configured to:

extract, using a disparity image in which a disparity calculated for each pixel of the near region of the single image is stored for each pixel, a group of the distance data in which distance data to be the disparity of each pixel of the disparity image is continuous in a depth direction and a transverse direction, from the disparity image, and detects the object of the near region.

Assignments (2)
CHANGE OF NAME Recorded Mar 25, 2021
From: HITACHI AUTOMOTIVE SYSTEMS, LTD.
To: HITACHI ASTEMO, LTD.
Reel/Frame 056299/0447 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 31, 2017
From: KAKEGAWA, SHINJI; SHIMA, TAKESHI; OTSUKA, YUJI
To: HITACHI AUTOMOTIVE SYSTEMS, LTD.
Reel/Frame 041136/0949 →
Priority Claims (1)
JP 2014-171960 · Aug 26, 2014 · national
Continuity (1)
Related Publication 20170220877A1 · Aug 3, 2017