IP Library Granted Patent US 9,446,765
Granted Patent B2
US 9,446,765 · App. 14/610,537 · Granted Sep 20, 2016

Systems and methods for identifying relevant traffic lights

Inventors: Itai Ben Shalom (Mazkeret Batya, IL); Eyal Bagon (Jerusalem, IL); Yoav Taieb (Jerusalem, IL)
Assignee: MOBILEYE VISION TECHNOLOGIES LTD.
B60W30/00B60K31/00B60T7/12B62D6/00G06K9/00798G06K9/00805G06K9/00825G06T7/602B60W10/20B60W30/12B60W2550/10B60W2550/142B60W2710/207G06T2207/30256G06T2207/30261
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,446,765
App. No.
14/610,537
Granted
Sep 20, 2016
Kind
B2
Abstract

Systems and methods use cameras to provide autonomous navigation features. In one implementation, a system includes at least one image capture device configured to acquire at least one image of an area forward of the vehicle. The area includes a plurality of traffic lamp fixtures each including at least one traffic light. The system further includes at least one processing device configured to use at least one indicator of vehicle position, as determined from the at least one acquired image, to determine a relevance to the vehicle of each of the plurality of traffic lamp fixtures. The at least one processing device may determine, based on the at least one acquired image, a status of a traffic light included in at least one traffic lamp fixture determined to be relevant to the vehicle, and cause a system response based on the determined status.

Claims (43)

1. A traffic light detection system or a vehicle; the system comprising:

at least one image capture device configured to acquire at least one image of an area forward of the vehicle, the area including a plurality of traffic lamp fixtures, wherein each of the plurality of traffic lamp fixtures is a structure that houses at least one traffic light;

a data interface; and

at least one processing device configured to:

receive the at least one acquired image via the data interface;

use at least one indicator of vehicle position, as determined from the at least one acquired image, to determine a relevance to the vehicle of each of the plurality of traffic lamp fixtures;

determine, based on the at least one acquired image, a status of a traffic light included in at least one traffic lamp fixture determined to be relevant to the vehicle; and

cause a system response based on the determined status.

2. The traffic light detection system of claim 1 , wherein the at least one indicator of vehicle position includes a lane marker recognized based on analysis of the at least one image.

3. The traffic light detection system of claim 1 , wherein determining the status of the traffic light includes any of determining a location of the traffic light within a relevant traffic lamp fixture, determining whether the traffic light is illuminated, determining a color of the traffic light, and determining whether the traffic light includes an arrow.

4. The traffic light detection system of claim 1 , wherein the system response includes any of providing a warning to the driver of the vehicle, applying vehicle brakes, and discontinuing cruise control.

5. The traffic light detection system of claim 1 , wherein the relevance to the vehicle of each of the plurality of traffic lamp fixtures includes an indication of an orientation of each of the plurality of traffic lamp fixtures with respect to the vehicle.

6. The traffic light detection system of claim 1 , wherein the at least one traffic lamp fixture determined to be relevant to the vehicle is facing a front portion of the vehicle.

7. A vehicle, comprising:

a body;

at least one image capture device configured to acquire at least one image of an area forward of the vehicle, the area including a plurality of traffic lamp fixtures, wherein each of the plurality of traffic lamp fixtures is a structure that houses at least one traffic light;

a data interface; and

at least one processing device configured to:

receive the at least one acquired image via the data interface;

use at least one indicator of vehicle position, as determined from the at least one acquired image, to determine a relevance to the vehicle of each of the plurality of traffic lamp fixtures;

determine, based on the at least one acquired image, a status of a traffic light included in at least one traffic lamp fixture determined to be relevant to the vehicle; and

cause a system response based on the determined status.

8. The vehicle of claim 7 , wherein the at least one indicator of vehicle position includes a lane marker recognized based on analysis of the at least one image.

9. The vehicle of claim 7 , wherein determining the status of the traffic light includes any of determining a location of the traffic light within a relevant traffic lamp fixture, determining whether the traffic light is illuminated, determining a color of the traffic light, and determining whether the traffic light includes an arrow.

10. The vehicle of claim 7 , wherein the system response includes any of providing a warning to the driver of the vehicle, applying vehicle brakes, and discontinuing cruise control.

11. The vehicle of claim 7 , wherein the relevance to the vehicle of each of the plurality of traffic lamp fixtures includes an indication of an orientation of each of the plurality of traffic lamp fixtures with respect to the vehicle.

12. The vehicle of claim 7 , wherein the at least one traffic lamp fixture determined to be relevant to the vehicle is facing a front portion of the vehicle.

13. A method for traffic light detection, the method comprising:

acquiring, via at least one image capture device; at least one image of an area forward of a vehicle, the area including a plurality of traffic lamp fixtures, wherein each of the plurality of traffic lamp fixtures is a structure that houses at least one traffic light;

using at least one indicator of vehicle position, as determined from the at least one acquired image, to determine a relevance to the vehicle of each of the plurality of traffic lamp fixtures;

determining, based on the at least one acquired image, a status of a traffic light included in at least one traffic lamp fixture determined to be relevant to the vehicle; and

causing a system response based on the determined status.

14. The method of claim 13 , wherein the at least one indicator of vehicle position includes a lane marker recognized based on analysis of the at least one image.

15. The method of claim 13 , wherein determining the status of the traffic light includes any of determining a location of the traffic light within a relevant traffic lamp fixture, determining whether the traffic light is illuminated, determining a color of the traffic light, and determining whether the traffic light includes an arrow.

16. The method of claim 13 , wherein the system response includes any of providing a warning to the driver of the vehicle, applying vehicle brakes, and discontinuing cruise control.

17. The method of claim 13 , wherein the relevance to the vehicle of each of the plurality of traffic lamp fixtures includes an indication of an orientation of each of the plurality of traffic lamp fixtures with respect to the vehicle.

18. The method of claim 13 , wherein the at least one traffic lamp fixture determined to be relevant to the vehicle is facing a front portion of the vehicle.

19. The traffic light detection system of claim 1 , wherein the at least one processing device is further configured to rank the relevancy of the traffic lamp fixtures identified in the at least one acquired image, and the traffic lamp fixture having the highest value of relevancy ranking is determined to be the relevant traffic lamp fixture.

20. The traffic light detection system of claim 1 , further comprising an additional image capture device for detecting at least one feature that relates to a road in an environment of the vehicle.

21. The traffic light detection system of claim 20 , wherein the additional image capture device has a field of view within a range of 40 degrees to 56 degrees.

22. The method of claim 13 , further comprising:

acquiring, via an additional image capture device, an image including a road in an environment of the vehicle; and

detecting in the image at least one feature that relates to the road.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 24, 2015
From: BEN SHALOM, ITAI; BAGON, EYAL; TAIEB, YOAV
To: MOBILEYE VISION TECHNOLOGIES LTD.
Reel/Frame 036010/0861 →
Continuity (6)
Provisional Application 61933325 · Jan 30, 2014
Provisional Application 61993111 · May 14, 2014
Provisional Application 62040246 · Aug 21, 2014
Provisional Application 62060603 · Oct 7, 2014
Provisional Application 62102669 · Jan 13, 2015
Related Publication 20150210278A1 · Jul 30, 2015