IP Library Granted Patent US 9,030,560
Granted Patent B2
US 9,030,560 · App. 13/700,289 · Granted May 12, 2015

Apparatus for monitoring surroundings of a vehicle

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,030,560
App. No.
13/700,289
Granted
May 12, 2015
Kind
B2
Abstract

The vehicle surroundings monitoring apparatus is provided with an imaging device and a device that transforms captured image to digital image. A first edge extraction mask is applied to detect multiple horizontal edges. The apparatus further includes a detector that detects upper end of the head of the object by detecting a horizontal edge having a highest edge intensity out of the multiple horizontal edges. A second edge extraction mask is used to detect the lower end of the head of the physical object by detecting multiple vertical edges and matching the positional variation of the multiple vertical edges with predetermined patterns.

Claims (13)

1. An apparatus for monitoring surroundings of a vehicle, comprising: an imaging device that is mounted on a vehicle and captures an image around the vehicle; and an image processing unit having a processor and a memory; wherein the image processing unit is configured to: transform a grayscale image acquired by the imaging device to a multi-value image; detect an upper end of a head of a physical object in the multi-value image by determining a horizontal edge having a maximum edge intensity in a region of a first edge extraction mask applied to the multi-value image; detect multiple vertical edges in the multi-value image by applying a second edge extraction mask extending downwards from the detected upper end of the head of the physical object; detect a lower end of the head of the physical object based on a positional variation of the detected multiple vertical edges; and to identify a head region of the physical object based on a space between the upper end of the head and the lower end of the head of the physical object.

2. The apparatus according to claim 1 , wherein the imaging device is a single infrared camera, and the image processing unit is further configured to: calculate a distance between the vehicle and the physical object in a real space based on a size of the head of the physical object in the multi-value image and a focal length of the infrared camera.

3. The apparatus according to claim 2 , wherein the image processing unit is further configured to: determine a possibility that the vehicle contacts the physical object based on at least one of the calculated distance, a vehicle speed, and a yaw rate of the vehicle.

4. The apparatus according to claim 1 , wherein the image processing unit is further configured to: apply an intensity profile to the grayscale image of the detected head region to produce information about the head; and to determine reliability of the detection of the head in the light of the information produced from the intensity profile.

5. The apparatus according to claim 1 , wherein the lower end of the head is detected when the positional variation of a pixels of the detected vertical edges matches a predetermined pattern.

6. An apparatus for monitoring surroundings of a vehicle, comprising: an imaging means mounted on a vehicle for capturing an image around the vehicle; means for transforming a grayscale image acquired by the imaging device to a multi-value image; means for detecting an upper end of a head of a physical object in the multi-value image by determining a horizontal edge having a maximum edge intensity in a region of a first edge extraction mask applied to the multi-value image; means for detecting multiple vertical edges in the multi-value image by applying a second edge extraction mask extending downwards from the detected upper end of the head of the physical object in the multi-value image; means for detecting a lower end of the head of the physical object based on a positional variation of the detected multiple vertical edges in the multi-value image; and means for identifying a head region of the physical object in the multi-value image based on a space between the detected upper end of the head and the detected lower end of the head of the physical object.

7. The apparatus according to claim 6 , wherein the imaging means is a single infrared camera, and the apparatus further comprising: means for calculating a distance between the vehicle and the physical object in a real space based on a size of the head of the physical object in the multi-value image and a focal length of the infrared camera.

8. The apparatus according to claim 7 , further comprising: means for determining a possibility that the vehicle contacts the physical object based on at least one of the calculated distance, a used brake magnitude, a vehicle speed, and a yaw rate of the vehicle.

9. The apparatus according to claim 6 , wherein the lower end of the head is detected when the positional variation of a pixels of the detected vertical edges matches a predetermined pattern.

10. A method of monitoring surroundings of a vehicle, comprising: capturing an image around the vehicle with an imaging device mounted on the vehicle; transforming a grayscale image acquired by the imaging device to a multi-value image; detecting an upper end of a head of a physical object in the multi-value image by determining a horizontal edge having a maximum edge intensity in a region of a first edge extraction mask applied to the multi-value image; detecting multiple vertical edges in the multi-value image by applying a second edge extraction mask extending downwards from the detected upper end of the head of the physical object in the multi-value image; detecting a lower end of the head of the physical object based on a positional variation of the detected multiple vertical edges in the multi-value image; and identifying a head region of the physical object in the multi-value image based on a space between the upper end of the head and the lower end of the head of the physical object.

11. The method according to claim 10 , wherein the imaging device is a single infrared camera, and the method further comprises: calculating a distance between the vehicle and the physical object in a real space based on a size of the head of the physical object in the multi-value image and a focal length of the infrared camera.

12. The method according to claim 11 , further comprising: determining a possibility that the vehicle contacts the physical object based on at least one of the calculated distance, a used brake magnitude, a vehicle speed, and a yaw rate of the vehicle.

13. The method according to claim 10 , wherein the lower end of the head is detected when the positional variation of a pixels of the detected vertical edges matches a predetermined pattern.

Assignments (4)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 11, 2024
From: ARRIVER SOFTWARE AB
To: QUALCOMM AUTO LTD.
Reel/Frame 069171/0233 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 5, 2022
From: VEONEER SWEDEN AB
To: ARRIVER SOFTWARE AB
Reel/Frame 059596/0826 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 13, 2021
From: HONDA MOTOR CO., LTD
To: VEONEER SWEDEN AB
Reel/Frame 057336/0220 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 10, 2012
From: AIMURA, MAKOTO; NAGAOKA, NOBUHARU
To: HONDA MOTOR CO., LTD.
Reel/Frame 029434/0482 →