IP Library Granted Patent US 10,445,595
Granted Patent B2
US 10,445,595 · App. 16/110,284 · Granted Oct 15, 2019

Barrier and guardrail detection using a single camera

Inventor: Gideon Stein (Jerusalem, IL)
Assignee: Mobileye Vision Technologies Ltd.
G06K9/00798G06K9/00805G06K9/6202G06T3/0093G06T7/248G06T7/74H04N7/183G06T2207/10004G06T2207/30256G06T2207/30261
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,445,595
App. No.
16/110,284
Granted
Oct 15, 2019
Kind
B2
Abstract

Driver assistance systems for detecting a structural barrier extending along a road. The driver assistance system may be mountable in a host vehicle. The camera may capture multiple image frames in the forward field of view of the camera. A processor may process motion of images of the barrier in the image frames. The camera may be a single camera. The motion of the images may be responsive to forward motion of the host vehicle and/or the motion of the images may be responsive to lateral motion of the host vehicle.

Claims (34)

1. A method for detection of a structural barrier extending along a road, the method performed by a driver assistance system mountable in a host vehicle, wherein the driver assistance system includes a camera operatively connectible to a processor, the method comprising:

capturing a plurality of image frames in the forward field of view of the camera; and

determining a first horizontal image coordinate, in a first frame of the plurality of image frames, of a feature of the structural barrier;

determining a second horizontal image coordinate, in a second frame of the plurality of image frames, of the feature of the structural barrier, wherein determining the second horizontal image coordinate includes identifying a change from the first horizontal image coordinate based on movement of the host vehicle, wherein the movement of the host vehicle is used to determine that the feature of the structural barrier is upright; and

identifying a linear image structure, hypothesized based on the first frame, as a correct projection of the structural barrier onto a road plane based on the linear image structure correctly aligning with the feature in the second frame.

2. The method of claim 1 , wherein the linear image structure includes an image line on an image frame of the plurality of image frames, and wherein the image line intersects a vanishing point of the image frame.

3. The method of claim 1 , wherein the feature includes a vertical post of the structural barrier.

4. The method of claim 1 , wherein the linear image structure is identified from a plurality of hypothesized linear image structures.

5. The method of claim 4 , wherein the linear image structure is the only linear image structure of the plurality of hypothesized linear image structures to correctly align with the feature in the second frame.

6. The method of claim 4 , wherein each of the plurality of hypothesized linear image structures correspond to different image vertical coordinates identified in the first frame.

7. An electronic device mountable in a host vehicle for detection of a structural barrier extending along a road, the electronic device comprises:

one or more processors;

memory;

a camera operatively connectible to the one or more processors;

one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs including instructions for:

capturing a plurality of image frames in the forward field of view of the camera;

determining a first horizontal image coordinate, in a first frame of the plurality of image frames, of a feature of the structural barrier;

determining a second horizontal image coordinate, in a second frame of the plurality of image frames, of the feature of the structural barrier, wherein determining the second horizontal image coordinate includes identifying a change from the first horizontal image coordinate based on movement of the host vehicle, wherein the movement of the host vehicle is used to determine that the feature of the structural barrier is upright; and

identifying a linear image structure, hypothesized based on the first frame, as a correct projection of the structural barrier onto a road plane based on the linear image structure correctly aligning with the feature in the second frame.

8. The electronic device of claim 7 , wherein the linear image structure includes an image line on an image frame of the plurality of image frames, and wherein the image line intersects a vanishing point of the image frame.

9. The electronic device of claim 7 , wherein the feature includes a vertical post of the structural barrier.

10. The electronic device of claim 7 , wherein the linear image structure is identified from a plurality of hypothesized linear image structures.

11. The electronic device of claim 10 , wherein the linear image structure is the only linear image structure of the plurality of hypothesized linear image structures to correctly align with the feature in the second frame.

12. The electronic device of claim 10 , wherein each of the plurality of hypothesized linear image structures correspond to different image vertical coordinates identified in the first frame.

13. A non-transitory computer-readable storage medium storing one or more programs for detection of a structural barrier extending along a road, the one or more programs comprising instructions, which when executed by one or more processors of an electronic device with a camera, cause the device to:

capturing a plurality of image frames in the forward field of view of the camera;

determining a first horizontal image coordinate, in a first frame of the plurality of image frames, of a feature of the structural barrier;

determining a second horizontal image coordinate, in a second frame of the plurality of image frames, of the feature of the structural barrier, wherein determining the second horizontal image coordinate includes identifying a change from the first horizontal image coordinate based on movement of the host vehicle, wherein the movement of the host vehicle is used to determine that the feature of the structural barrier is upright; and

identifying a linear image structure, hypothesized based on the first frame, as a correct projection of the structural barrier onto a road plane based on the linear image structure correctly aligning with the feature in the second frame.

14. The computer-readable storage medium of claim 13 , wherein the linear image structure includes an image line on an image frame of the plurality of image frames, and wherein the image line intersects a vanishing point of the image frame.

15. The computer-readable storage medium of claim 13 , wherein the feature includes a vertical post of the structural barrier.

16. The computer-readable storage medium of claim 13 , wherein the linear image structure is identified from a plurality of hypothesized linear image structures.

17. The computer-readable storage medium of claim 16 , wherein the linear image structure is the only linear image structure of the plurality of hypothesized linear image structures to correctly align with the feature in the second frame.

18. The computer-readable storage medium of claim 16 , wherein each of the plurality of hypothesized linear image structures correspond to different image vertical coordinates identified in the first frame.

Continuity (4)
Continuation 15012455 · Feb 1, 2016
Continuation 13237163 · Sep 20, 2011
Provisional Application 61385122 · Sep 21, 2010
Related Publication 20180365502A1 · Dec 20, 2018