IP Library › Granted Patent US 9,365,214
Granted Patent B2
US 9,365,214 · App. 14/610,404 · Granted Jun 14, 2016

Systems and methods for determining the status of a turn lane traffic light

Inventors: Itai Ben Shalom (Mazkaret Batya, IL); Shai Shalev-Shwartz (Jerusalem, IL); Eyal Bagon (Jerusalem, IL); Yoav Taieb (Jerusalem, IL); Amnon Shashua (Mevaseret Zion, IL)
Assignee: MOBILEYE VISION TECHNOLOGIES LTD.
B60W30/00B60T7/12B60W10/20B62D6/00G06K9/00798G06K9/00805G06K9/00825G06T7/602B60W2550/10B60W2550/142B60W2710/207G06T2207/30256G06T2207/30261
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,365,214
App. No.
14/610,404
Granted
Jun 14, 2016
Kind
B2
Abstract

Systems and methods use cameras to provide autonomous navigation features. In one implementation, a traffic light detection system is provided for a vehicle. One or more processing devices associated with the system receive at least one image of an area forward of the vehicle via a data interface, with the area including at least one traffic lamp fixture having at least one traffic light. The processing device(s) determine, based on at least one indicator of vehicle position, whether the vehicle is in a turn lane. Also, the processing device(s) process the received image(s) to determine the status of the traffic light, including whether the traffic light includes an arrow. Further, the system may cause a system response based on the determination of the status of the traffic light, whether the traffic light includes an arrow, and whether the vehicle is in a turn lane.

Claims (53)

1. A traffic light detection system for a vehicle, the system comprising:

at least one image capture device configured to acquire at least one image of an area forward of the vehicle, the area including a traffic lamp fixture having at least one traffic light;

a data interface; and

at least one processing device configured to:

receive the at least one acquired image via the data interface;

determine, based on analysis of the at least one image and at least one indicator of vehicle position, whether the vehicle is in a turn lane;

perform image processing on the at least one image to determine whether an arrow exists in the at least one image within pixels of the image representative of the traffic light;

determine, based on analysis of the at least one image, a status of the traffic light; and

cause a system response based on the determination of the status of the traffic light, whether the traffic light includes an arrow, and whether the vehicle is in a turn lane.

2. The traffic light detection system of claim 1 , wherein the at least one indicator of vehicle position includes a lane marker recognized based on analysis of the at least one image.

3. The traffic light detection system of claim 1 , wherein the at least one indicator of vehicle position includes an arrow associated with the traffic lamp fixture recognized based on analysis of the at least one image.

4. The traffic light detection system of claim 1 , wherein the at least one indicator of vehicle position includes a vehicle location acquired by GPS.

5. The traffic light detection system of claim 1 , wherein the system response includes any of providing a notice to the driver of the vehicle, applying vehicle brakes, discontinuing cruise control, and initiating an automated turning maneuver.

6. The traffic light detection system of claim 1 , wherein determining a status of the traffic light includes any of determining whether the traffic light is illuminated, determining a position of the traffic light within the traffic lamp fixture, and determining a color associated with the traffic light.

7. The traffic light detection system of claim 1 , wherein the at east one indicator of vehicle position includes a distance to an intersection.

8. The traffic light detection system of claim 1 , wherein the determined status of the traffic light is that it is a blinking yellow light.

9. The traffic light detection system of claim 8 , wherein the at least one processing device is further configured to:

determine whether one or more vehicles are approaching the intersection from the opposite direction; and

if no vehicles are approaching the intersection from the opposite direction, cause a system response based on the determination,

wherein the system response includes any of providing a notice to the driver of the vehicle, applying vehicle brakes, discontinuing cruise control, and initiating an automated turning maneuver.

10. The traffic light detection system of claim 1 , wherein the at least one processing device is further configured to determine whether the turn lane in which the vehicle is located is authorized to proceed in the direction indicated by the determined status of the traffic light.

11. The traffic light detection system of claim 10 , wherein determining whether the turn lane in which the vehicle is located is authorized to proceed comprises determining whether to turn left, turn right, or continue straight through the intersection based on a predetermined destination for the vehicle.

12. A vehicle, comprising:

a body;

at least one image capture device configured to acquire at least one image of an area forward of the vehicle, the area including a traffic lamp fixture having at least one traffic light;

a data interface; and

at least one processing device configured to:

receive the at least one acquired image via the data interface;

determine, based on analysis of the at least one image and at least one indicator of vehicle position, whether the vehicle is in a turn lane;

perform image processing on the at least one image to determine whether an arrow exists in the at least one image within pixels of the image representative of the traffic light;

determine, based on analysis of the at least one image, a status of the traffic light; and

cause a system response based on the determination of the status of the traffic light, whether the traffic light includes an arrow, and whether the vehicle is in a turn lane.

13. The vehicle of claim 12 , wherein the at least one indicator of vehicle position includes a lane marker recognized based on analysis of the at least one image.

14. The vehicle of claim 12 , wherein the at least one indicator of vehicle position includes a vehicle location acquired by GPS.

15. The vehicle of claim 12 , wherein the system response includes any of providing a notice to the driver of the vehicle, applying vehicle brakes, discontinuing cruise control, and initiating an automated turning maneuver.

16. The vehicle of claim 12 , wherein determining a status of the traffic light includes any of determining whether the traffic light is illuminated, determining a position of the traffic light within the traffic lamp fixture, and determining a color associated with the traffic light.

17. The vehicle of claim 12 , wherein the at least one indicator of vehicle position includes a distance to an intersection.

18. The vehicle of claim 12 , wherein the determined status of the traffic light is that it is a blinking yellow light, and the at least one processing device is further configured to:

determine whether one or more vehicles are approaching the intersection from the opposite direction; and

if no vehicles are approaching the intersection from the opposite direction, cause a system response based on the determination,

wherein the system response includes any of providing a notice to the driver of the vehicle, applying vehicle brakes, discontinuing cruise control, and initiating an automated turning maneuver.

19. The vehicle of claim 12 , wherein the at least one processing device is further configured to determine whether the turn lane in which the vehicle is located is authorized to proceed in the direction indicated by the determined status of the traffic light.

20. A method for traffic light detection, the method comprising:

acquiring, via at least one image capture device, at least one image of an area forward of a vehicle, the area including a traffic lamp fixture having at least one traffic light;

determining, based on analysis of the at least one image and at least one indicator of vehicle position, whether the vehicle is in a turn lane;

performing image processing on the at least one image to determine whether an arrow exists in the at least one image within pixels of the image representative of the traffic light;

determining, based on analysis of the at least one image, a status of the traffic light; and

causing a system response based on the determination of the status of the traffic light, whether the traffic light includes an arrow, and whether the vehicle is in a turn lane.

21. The method of claim 20 , wherein the at least one indicator of vehicle position includes a lane marker recognized based on analysis of the at least one image.

22. The method of claim 20 , wherein the at least one indicator of vehicle position includes an arrow associated with the traffic lamp fixture recognized based on analysis of the at least one image.

23. The method of claim 20 , wherein the at least one indicator of vehicle position includes a vehicle location acquired by GPS.

24. The method of claim 20 , wherein the system response includes any of providing a notice to the driver of the vehicle, applying vehicle brakes, discontinuing cruise control, and initiating an automated turning maneuver.

25. The method of claim 20 , wherein determining a status of the traffic light includes any of determining whether the traffic light is illuminated, determining a position of the traffic light within the traffic lamp fixture, and determining a color associated with the traffic light.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 24, 2015
From: BEN SHALOM, ITAI; SHALEV-SHWARTZ, SHAI; BAGON, EYAL; TAIEB, YOAV; SHASHUA, AMNON
To: MOBILEYE VISION TECHNOLOGIES LTD.
Reel/Frame 036012/0205 →
Continuity (6)
Provisional Application 61933325 · Jan 30, 2014
Provisional Application 61993111 · May 14, 2014
Provisional Application 62040246 · Aug 21, 2014
Provisional Application 62060603 · Oct 7, 2014
Provisional Application 62102669 · Jan 13, 2015
Related Publication 20150210276A1 · Jul 30, 2015