IP Library Granted Patent US 9,121,717
Granted Patent B1
US 9,121,717 · App. 14/103,280 · Granted Sep 1, 2015

Collision avoidance for vehicle control

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,121,717
App. No.
14/103,280
Granted
Sep 1, 2015
Kind
B1
Abstract

A method is provided for processing an image in which only parts of the image that appear above a point on a horizon line are analyzed to identify an object. In one embodiment, the distance between the object and a vehicle is determined, and at least one of the speed and direction of the vehicle is changed when it is determined that the distance is less than the range of a sensor. The method for processing images is not limited to vehicular applications only and it may be used in all applications where computer vision is used to identify objects in an image.

Claims (34)

1. A system comprising:

memory storing a range value of an object detection sensor of a vehicle; and

one or more processors configured to:

determine, based on a pitch of the vehicle, a point P on a visual horizon;

determine a distance between the vehicle and an object that is located above and beyond the point P;

compare the distance to the range value; and

when the distance is less than the range value, change at least one of a speed of the vehicle and a heading of the vehicle in order to reduce a likelihood of collision with an object not currently detectable by the object detection sensor.

2. The system of claim 1 , wherein the one or more processors are further configured to change at least one of the speed and heading of the vehicle based on at least a grade of a surface on which the vehicle is standing or driving exceeding a threshold grade value.

3. The system of claim 1 , wherein the one or more processors are further configured to change at least one of the speed and heading of the vehicle based on at least the pitch of the vehicle exceeding a threshold pitch value.

4. The system of claim 1 , further comprising a camera configured to capture a plurality of images, and wherein the plurality of images are used to determine the distance.

5. The system of claim 4 , wherein the one or more processors are further configured to determine the point P further based on a signal received from a sensor that senses the pitch of the camera.

6. The system of claim 4 , wherein the camera is a stereo camera.

7. The system of claim 4 , wherein the one or more processors are further configured to identify the object by extracting a template of the object from a first image of the plurality of images and comparing the template against a plurality of object representations.

8. The system of claim 1 , wherein the one or more processors are further configured to identify the object based on a comparison to a representation of a type of the object.

9. The system of claim 1 , wherein the one or more processors are further configured to identify the object based on proximity to the point P.

10. The system of claim 1 , wherein the one or more processors are further configured to:

receive a first image of a scene at least part of the vehicle's surroundings and a second image overlapping at least a part of the scene of the first image; and

process the first image and the second image in order to determine the point P.

11. A method comprising:

determining, by one or more processors, based on a pitch of a vehicle, a point P on a visual horizon;

determining, by the one or more processors, a distance between the vehicle and an object that is located above and beyond the point P;

comparing, by the one or more processors, the distance to a range value of an object detection sensor of the vehicle; and

when the distance is less than the range value, changing, by the one or more processors, at least one of a speed of the vehicle and a heading of the vehicle in order to reduce a likelihood of collision with an object not currently detectable by the object detection sensor.

12. The method of claim 11 , wherein the at least one of the speed and heading of the vehicle are changed further based on at least a grade of a surface on which the vehicle is standing or driving exceeding a threshold grade value.

13. The method of claim 11 , wherein the at least one of the speed and heading of the vehicle are changed further based on at least the pitch of the vehicle exceeding a threshold pitch value.

14. The method of claim 11 , further comprising receiving a plurality of images from a camera, and wherein the distance is determined further based on the plurality of images.

15. The method of claim 14 , wherein the point P is determined further based on a signal received from a sensor that senses the pitch of the camera.

16. The method of claim 14 , wherein the camera is a stereo camera.

17. The method of claim 14 , further comprising identifying the object by extracting a template of the object from a first image of the plurality of images and comparing the template against a plurality of object representations.

18. The method of claim 11 , further comprising identifying the object based on a comparison to a representation of a type of the object.

19. The method of claim 11 , further comprising identifying the object based on proximity to the point P.

20. The method of claim 11 , further comprising:

receiving a first image of a scene at least part of the vehicle's surroundings and a second image overlapping at least a part of the scene of the first image; and

processing the first image and the second image in order to determine the point P.

Assignments (6)
CORRECTIVE ASSIGNMENT TO CORRECT THE THE REMOVAL OF THE INCORRECTLY RECORDED APPLICATION NUMBERS 14/149802 AND 15/419313 PREVIOUSLY RECORDED AT REEL: 44144 FRAME: 1. ASSIGNOR(S) HEREBY CONFIRMS THE CHANGE OF NAME. Recorded Mar 4, 2024
From: GOOGLE INC.
To: GOOGLE LLC
Reel/Frame 068092/0502 →
SUBMISSION TO CORRECT AN ERROR MADE IN A PREVIOUSLY RECORDED DOCUMENT THAT ERRONEOUSLY AFFECTS THE IDENTIFIED APPLICATIONS Recorded Nov 11, 2019
From: WAYMO LLC
To: WAYMO LLC
Reel/Frame 050978/0359 →
CHANGE OF NAME Recorded Oct 6, 2017
From: GOOGLE INC.
To: GOOGLE LLC
Reel/Frame 044144/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 28, 2017
From: WAYMO HOLDING INC.
To: WAYMO LLC
Reel/Frame 042108/0021 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 27, 2017
From: GOOGLE INC.
To: WAYMO HOLDING INC.
Reel/Frame 042099/0935 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 7, 2014
From: ZHU, JIAJUN
To: GOOGLE INC.
Reel/Frame 032379/0056 →