IP Library Granted Patent US 7,221,777
Granted Patent B2
US 7,221,777 · App. 10/607,647 · Granted May 22, 2007

Image analysis device

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 7,221,777
App. No.
10/607,647
Granted
May 22, 2007
Kind
B2
Abstract

An image analysis device installed on a vehicle for detecting objects that are likely to affect the vehicle. An image processing unit included in the image analysis device sets a seeking area in a left-hand image of the field, and calculates a moving increment for seeking “Step” using a variable “n”. A correlation calculation process is sequentially executed in the seeking area set in the left-hand image of the field while moving a reference image stepwise at the moving increment “Step” so as to obtain a correlation area that gives the highest degree of correlation, and then a new seeking area is set, which consists of the correlation area and horizontally arranged two areas that sandwich the correlation area, and the moving increment “Step” is decreased in order to reduce the amount of calculation.

Claims (47)

1. An image analysis device comprising:

first and second cameras which together constitute a set of stereo cameras; and

a distance calculation section which is adapted to calculate distance to an object in such a manner that a first image of the object is extracted from an image of a field taken by the first camera while a second image of the object corresponding to the first image of the object is extracted from a seeking area being set, in another image of the field taken by the second camera, depending on the extracted first image using a correlation calculation process, and then a parallax between the first and second images is calculated, wherein

the distance calculation section is further adapted to set a moving increment based on the width of an object frame that is determined depending on the first image of the object, and to execute the correlation calculation process while moving the first image of the object stepwise at the moving increment in the seeking area so as to extract a new seeking area which consists of a correlation area that exhibits a high degree of correlation with the first image of the object and two areas that sandwich the correlation area.

2. An image analysis device according to claim 1 , wherein the moving increment is set to be equal to the width of the object frame.

3. An image analysis device comprising:

first and second cameras which together constitute a set of stereo cameras; and

a distance calculation section which is adapted to calculate distance to an object in such a manner that a first image of the object is extracted from an image of a field taken by the first camera while a second image of the object corresponding to the first image of the object is extracted from a seeking area being set, in another image of the field taken by the second camera, depending on the extracted first image using a correlation calculation process, and then a parallax between the first and second images is calculated, wherein

the distance calculation section is further adapted to set a moving increment based on the width of an object frame that is determined depending on the first image of the object, and to execute the correlation calculation process while moving the first image of the object stepwise at the moving increment in the seeking area so as to extract a new seeking area which consists of a correlation area that exhibits a high degree of correlation with the first image of the object and two areas that sandwich the correlation area,

wherein the moving increment is set to be equal to the width of the object frame, and

wherein the distance calculation section is further adapted to reset the moving increment to a smaller moving increment based on the width of the object frame every time a new seeking area is extracted, and to execute the correlation calculation process in the new seeking area while moving the first image of the object stepwise at the smaller moving increment.

4. An image analysis device comprising:

first and second cameras which together constitute a set of stereo cameras; and

a distance calculation section which is adapted to calculate distance to an object in such a manner that

a first image of the object is extracted from a first field image of a field taken by the first camera

while a second image of the object corresponding to the first image of the object is extracted from a seeking area that is set, in a second field image of the field taken by the second camera, depending on the extracted first image using a correlation calculation process, and

then a parallax between the first and second images is calculated, wherein the distance calculation section is further adapted to

set a moving increment based on a width of an object frame that defines a periphery of the first image of the object, and

execute the correlation calculation process while moving the first image of the object within the seeking area stepwise a distance equal to the moving increment so as to extract a new seeking area which consists of an area that is the sum of

a correlation area that exhibits a high degree of correlation with the first image of the object, and

two areas that sandwich the correlation area.

5. The image analysis device of claim 4 wherein the moving increment is set to be equal to the width of the object frame.

6. The image analysis device of claim 4 wherein the moving increment is set to be equal to a fraction of the width of the object frame.

7. The image analysis device of claim 4 wherein the extraction of the second image of the object is achieved iteratively, the iteration step identified by the value n, where n is initially set to be zero, and

the moving increment is set according to the following equation:

moving increment=(width of the object frame)/2 n .

8. A method of analyzing an image using an image processing device, the image processing device comprising:

first and second cameras which together constitute a set of stereo cameras; and

a distance calculation section,

wherein the distance calculation section is adapted to calculate distance to an object using the following method steps:

extracting a first object image of the object from a first field image of a field taken by the first camera, the first image comprising an object frame, the object frame comprising a frame width substantially corresponding to the width of the first object image,

setting an initial step width, the initial step width based on the frame width,

setting a seeking area in a second field image of the field taken by the second camera,

setting a search area within the seeking area, the search area comprising an area substantially corresponding to the area of the object frame, the search area set within the seeking area such that a left edge of the search area overlies a left edge of the seeking area, and executing a correlation calculation process within the search area,

moving the search area within the seeking area to the left within the seeking area a distance corresponding to the initial step width and executing a correlation calculation process within the search area,

repeating the step of moving the search area and executing a correlation calculation process across a width of the seeking area,

identifying the position of the search area having the highest degree of correlation with the first object image of the object,

extracting a second object image of the object, corresponding to the first object image of the object, from the seeking area,

calculating a parallax between the first and second object images.

9. The method of analyzing an image using an image processing device of claim 8 , wherein the distance calculation section comprises the following additional method steps inserted following the step of identifying the position of the search area having the highest degree of correlation:

extracting a new seeking area in the second field image which consists of an area that is the sum of

the search area identified as having the highest degree of correlation with the first object image of the object, and

two areas that sandwich the correlation area, setting a new step width, the new step width comprising a fraction of the initial step width,

setting a new search area within the new seeking area, the new search area comprising an area corresponding to a fraction of the area of the object frame, the new search area set within the new seeking area such that a left edge of the new search area overlies a left edge of the new seeking area, and executing a correlation calculation process within the new search area,

moving the new search area within the new seeking area to the left within the new seeking area a distance corresponding to the new step width and executing a correlation calculation process within the new search area,

repeating the step of moving the new search area and executing a correlation calculation process until a right edge of the new search area lies outside the new seeking area,

identifying the position of the new search area having the highest degree of correlation with the first object image of the object.

Assignments (4)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 11, 2024
From: ARRIVER SOFTWARE AB
To: QUALCOMM AUTO LTD.
Reel/Frame 069171/0233 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 5, 2022
From: VEONEER SWEDEN AB
To: ARRIVER SOFTWARE AB
Reel/Frame 059596/0826 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 13, 2021
From: HONDA MOTOR CO., LTD
To: VEONEER SWEDEN AB
Reel/Frame 057336/0220 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 27, 2003
From: NAGAOKA, NOBUHARU; WATANABE, MASAHITO; TSUJI, TAKAYUKI; HATTORI, HIROSHI; TAKATSUDO, IZUMI
To: HONDA GIKEN KOGYO KABUSHIKI KAISHA
Reel/Frame 014254/0783 →