IP Library Granted Patent US 11,259,001
Granted Patent B2
US 11,259,001 · App. 16/645,865 · Granted Feb 22, 2022

Stereo image processing device

Inventors: Hideaki Kido (Tokyo, JP); Takeshi Nagasaki (Hitachinaka, JP); Toshiyuki Aoki (Tokyo, JP)
Assignee: Hitachi Astemo, Ltd.
H04N13/128H04N13/167H04N13/239H04N2013/0081H04N2013/0085
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,259,001
App. No.
16/645,865
Granted
Feb 22, 2022
Kind
B2
Abstract

In order to improve parallax accuracy and output an accurate distance, this stereo image processing device is provided with: a stereo image capture unit that captures a plurality of images with different viewpoints; a synchronization unit that synchronizes image capture times when the plurality of images are captured; image correction units that parallelize and output the plurality of images captured by the stereo image capture unit; a parallax measurement unit that detects parallax on the basis of the images outputted by the image correction units; and an object detection unit that detects an object on the basis of the parallax measured by the parallax measurement unit, and is further provided with delay amount holding units that each hold, pixel by pixel, delay times from the image capture times synchronized by the synchronization unit, and an object parallax correction unit that corrects the parallax of the object detected by the object detection unit on the basis of the delay times held by the delay amount holding units.

Claims (38)

1. A stereo image processing device comprising:

a stereo image capture unit that captures a plurality of images with different viewpoints;

a synchronization unit that synchronizes image capture times when the plurality of images are captured;

image correction units that parallelize and output the plurality of images captured by the stereo image capture unit;

a parallax measurement unit that detects parallax on the basis of the images output by the image correction units;

an object detection unit that detects an object on the basis of the parallax measured by the parallax measurement unit;

delay amount holding units that each hold, pixel by pixel, delay times from the image capture times synchronized by the synchronization unit; and

an object parallax correction unit that corrects the parallax of the object detected by the object detection unit using as an input the delay times held by the delay amount holding units, which hold on a pixel-by-pixel basis, the delay times from the imaging time synchronized by the synchronization unit, wherein

the delay times are calculated using ΔL(x1,y1)=α*y1+β*x1, in which α is a time required to image one line of the image before correction, β is a time required to image one pixel x1 is a position along an x coordinate and y1 is a position along a v-coordinate.

2. The stereo image processing device according to claim 1 , wherein

the stereo image capture unit is a rolling shutter system, and

the object parallax correction unit corrects a parallax measurement error accompanying a lateral speed of the object detected by the object detection unit.

3. The stereo image processing device according to claim 1 , wherein the object parallax correction unit considers that point groups of the parallax detected by the object detection unit have the same lateral speed.

4. The stereo image processing device according to claim 1 , wherein the delay amount holding unit performs calculation on the basis of an output of the image correction unit.

5. A stereo image processing device comprising:

a stereo image capture unit that captures a plurality of images with different viewpoints;

a synchronization unit that synchronizes image capture times when the plurality of images are captured;

image correction units that parallelize and output the plurality of images captured by the stereo image capture unit;

a parallax measurement unit that detects parallax on the basis of the images output by the image correction units;

delay amount holding units that each hold, pixel by pixel, delay times from the image capture times synchronized by the synchronization unit;

a movement information acquisition unit that acquires movement information of the stereo image capture unit or a vehicle on which the stereo image capture unit is mounted; and

a parallax image correction unit that corrects the parallax of the object measured by the parallax measurement unit using as an input the delay times held by the delay amount holding units, which hold, on a pixel-by-pixel basis, the delay times from the imaging time synchronized by the synchronization unit, and the movement information acquired by the movement information acquisition unit, wherein

the delay times are calculated using ΔL(x1,y1)=α*y1+β*x1, in which α is a time required to image one line of the image before correction, β is a time required to image one pixel x1 is a position along an x coordinate and y1 is a position along a y-coordinate.

6. The stereo image processing device according to claim 5 , wherein

the stereo image capture unit is a rolling shutter system, and

the object parallax correction unit corrects an error of the parallax accompanying a lateral speed of the stereo image capture unit.

7. The stereo image processing device according to claim 6 , wherein the parallax is corrected when the lateral speed of the stereo image capture unit is larger than a predetermined value.

8. A stereo image processing device comprising:

a stereo image capture unit that captures a plurality of images with different viewpoints;

a synchronization unit that synchronizes image capture times when the plurality of images are captured;

image correction units that parallelize and output the plurality of images captured by the stereo image capture unit;

a parallax measurement unit that detects parallax on the basis of the images output by the image correction units;

delay amount holding units that each hold, pixel by pixel, delay times from the image capture times synchronized by the synchronization unit;

a movement information acquisition unit that acquires movement information of the stereo image capture unit or a vehicle on which the stereo image capture unit is mounted;

a parallax image correction unit that corrects the parallax of the object measured by the parallax measurement unit using as an input the delay times held by the delay amount holding units, which hold, on a pixel-by-pixel basis, the delay times from the imaging time synchronized by the synchronization unit, and the movement information acquired by the movement information acquisition unit;

an object detection unit that detects a solid object using the images corrected by the parallax image correction unit; and

an object parallax correction unit that corrects parallax of the solid object output by the object detection unit using the delay amount holding unit, wherein

the delay times are calculated using ΔL(x1,y1)=α*y1+β*x1, in which α is a time required to image one line of the image before correction, β is a time required to image one pixel x1 is a position along an x coordinate and y1 is a position along a v-coordinate.

Assignments (2)
CHANGE OF NAME Recorded Nov 30, 2021
From: HITACHI AUTOMOTIVE SYSTEMS, LTD.
To: HITACHI ASTEMO, LTD.
Reel/Frame 058481/0935 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 10, 2020
From: KIDO, HIDEAKI; NAGASAKI, TAKESHI; AOKI, TOSHIYUKI
To: HITACHI AUTOMOTIVE SYSTEMS, LTD.
Reel/Frame 052071/0669 →