IP Library Granted Patent US 10,906,548
Granted Patent B2
US 10,906,548 · App. 15/667,015 · Granted Feb 2, 2021

Robust method for detecting traffic signals and their associated states

Inventors: David I. Ferguson (San Francisco, CA); Nathaniel Fairfield (Mountain View, CA); Anthony Levandowski (Berkeley, CA)
Assignee: Waymo LLC
B60W30/18154G05D1/0088G05D1/0231G06K9/00791G06K9/00818G06K9/00825B60W2555/60B60W2556/50
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,906,548
App. No.
15/667,015
Granted
Feb 2, 2021
Kind
B2
Abstract

Methods and devices for detecting traffic signals and their associated states are disclosed. In one embodiment, an example method includes a scanning a target area using one or more sensors of a vehicle to obtain target area information. The vehicle may be configured to operate in an autonomous mode, and the target area may be a type of area where traffic signals are typically located. The method may also include detecting a traffic signal in the target area information, determining a location of the traffic signal, and determining a state of the traffic signal. Also, a confidence in the traffic signal may be determined. For example, the location of the traffic signal may be compared to known locations of traffic signals. Based on the state of the traffic signal and the confidence in the traffic signal, the vehicle may be controlled in the autonomous mode.

Claims (39)

1. A method comprising:

determining a location of a detected traffic signal;

determining, using a computing device, whether there is a known location of a traffic signal within a threshold distance of the determined location of the detected traffic signal;

determining a state of the detected traffic signal;

determining, using the computing device, a control command for a vehicle based on the determined state of the detected traffic signal and the determination of whether there is a known location of a traffic signal within the threshold distance of the determined location of the detected traffic signal, wherein determining the control command comprises outputting an instruction to obtain additional information regarding the detected traffic signal using a sensor of the vehicle based on the determination being that there is not a known location of a traffic signal within the threshold distance of the determined location of the detected traffic signal, and wherein determining the control command comprises:

i) outputting an instruction to brake in response to the determined state of the detected traffic signal being red and the determination being that there is not a known location of a traffic signal within the threshold distance of the determined location of the detected traffic signal,

ii) outputting an instruction to proceed with caution in response to the determined state of the detected traffic signal being green and the determination being that there is not a known location of a traffic signal within the threshold distance of the determined location of the detected traffic signal, or

iii) outputting an instruction to decelerate in response to the determined state of the detected traffic signal being unknown and the determination being that there is not a known location of a traffic signal within the threshold distance of the determined location of the detected traffic signal; and

controlling motion of the vehicle in accordance with the determined control command.

2. The method of claim 1 :

wherein the detected traffic signal is detected in a target area, and

wherein the instruction to obtain additional information regarding the detected traffic signal comprises an instruction to rescan the target area.

3. The method of claim 1 , wherein determining whether there is a known location of a traffic signal within a threshold distance of the determined location of the detected traffic signal comprises performing a search to determine known locations of traffic signals using the determined location of the detected traffic signal and a traffic signal database.

4. The method of claim 3 , wherein the search comprises a nearest neighbor search.

5. The method of claim 1 , further comprising:

obtaining an image; and

detecting the detected traffic signal in the image.

6. A controller comprising:

a memory;

a processor; and

instructions stored in the memory and executable by the processor to cause the controller to perform functions comprising:

determining a location of a detected traffic signal,

determining whether there is a known location of a traffic signal within a threshold distance of the determined location of the detected traffic signal,

determining a state of the detected traffic signal,

determining a control command for a vehicle based on the determined state of the detected traffic signal and the determination of whether there is a known location of a traffic signal within the threshold distance of the determined location of the detected traffic signal, wherein determining the control command comprises outputting an instruction to obtain additional information regarding the detected traffic signal using a sensor of the vehicle based on the determination being that there is not a known location of a traffic signal within the threshold distance of the determined location of the detected traffic signal, and wherein determining the control command comprises:

i) outputting an instruction to brake in response to the determined state of the detected traffic signal being red and the determination being that there is not a known location of a traffic signal within the threshold distance of the determined location of the detected traffic signal;

ii) outputting an instruction to proceed with caution in response to the determined state of the detected traffic signal being green and the determination being that there is not a known location of a traffic signal within the threshold distance of the determined location of the detected traffic signal; or

iii) outputting an instruction to decelerate in response to the determined state of the detected traffic signal being unknown and the determination being that there is not a known location of a traffic signal within the threshold distance of the determined location of the detected traffic signal, and

controlling motion of the vehicle in accordance with the determined control command.

7. A method comprising:

detecting a traffic signal using a vehicle;

determining, using a computing device, whether there is a known location of a traffic signal within a threshold distance of a location of the vehicle;

determining a state of the detected traffic signal;

determining, using the computing device, a control command for the vehicle based on the determined state of the detected traffic signal and the determination of whether there is a known location of a traffic signal within the threshold distance of the location of the vehicle, wherein determining the control command comprises outputting an instruction to obtain additional information regarding the detected traffic signal using a sensor of the vehicle based on the determination being that there is not a known location of a traffic signal within the threshold distance of the location of the vehicle, and wherein determining the control command comprises:

i) outputting an instruction to brake in response to the determined state of the detected traffic signal being red and the determination being that there is not a known location of a traffic signal within the threshold distance of the determined location of the detected traffic signal,

ii) outputting an instruction to proceed with caution in response to the determined state of the detected traffic signal being green and the determination being that there is not a known location of a traffic signal within the threshold distance of the determined location of the detected traffic signal, or

iii) outputting an instruction to decelerate in response to the determined state of the detected traffic signal being unknown and the determination being that there is not a known location of a traffic signal within the threshold distance of the determined location of the detected traffic signal; and

controlling motion of the vehicle in accordance with the determined control command.

8. The method of claim 7 , wherein determining whether there is a known location of a traffic signal within a threshold distance of the location of the vehicle comprises performing a search to determine known locations of traffic signals using the location of the vehicle and a traffic signal database.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 3, 2017
From: FERGUSON, DAVID I.; FAIRFIELD, NATHANIEL; LEVANDOWSKI, ANTHONY
To: GOOGLE INC.
Reel/Frame 043179/0018 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 3, 2017
From: GOOGLE INC.
To: WAYMO HOLDING INC.
Reel/Frame 043419/0637 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 3, 2017
From: WAYMO HOLDING INC.
To: WAYMO LLC
Reel/Frame 043420/0070 →
Continuity (3)
Continuation 14831777 · Aug 20, 2015
Continuation 13430150 · Mar 26, 2012
Related Publication 20170355375A1 · Dec 14, 2017