IP Library Granted Patent US 12,134,384
Granted Patent B2
US 12,134,384 · App. 18/218,290 · Granted Nov 5, 2024

Robust method for detecting traffic signals and their associated states

Inventors: David I. Ferguson (San Francisco, CA); Nathaniel Fairfield (Rockingham, VA); Anthony Levandowski (Palo Alto, CA)
Assignee: Waymo LLC
B60W30/18154G05D1/0088G05D1/0231G06V20/56G06V20/582G06V20/584B60W2555/60B60W2556/20B60W2556/50
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,134,384
App. No.
18/218,290
Granted
Nov 5, 2024
Kind
B2
Abstract

Methods and devices for detecting traffic signals and their associated states are disclosed. In one embodiment, an example method includes a scanning a target area using one or more sensors of a vehicle to obtain target area information. The vehicle may be configured to operate in an autonomous mode, and the target area may be a type of area where traffic signals are typically located. The method may also include detecting a traffic signal in the target area information, determining a location of the traffic signal, and determining a state of the traffic signal. Also, a confidence in the traffic signal may be determined. For example, the location of the traffic signal may be compared to known locations of traffic signals. Based on the state of the traffic signal and the confidence in the traffic signal, the vehicle may be controlled in the autonomous mode.

Claims (63)

1. A method of controlling a vehicle, the method comprising:

determining a state of a traffic signal of a traffic intersection, wherein the vehicle is configured to operate in an autonomous mode;

determining additional information to confirm the state of the traffic signal, wherein determining the additional information comprises at least one of:

(i) requesting more information from a passenger or driver of the vehicle, and

(ii) monitoring behavior of one or more vehicles traveling relative to the traffic intersection;

decreasing a speed of the vehicle while determining the additional information to confirm the state of the traffic signal;

confirming, based on the additional information, the state of the traffic signal; and

controlling the vehicle based on the confirmed state of the traffic signal.

2. The method of claim 1 , wherein determining the additional information comprises:

requesting more information from the passenger or driver of the vehicle and monitoring behavior of one or more vehicles traveling relative to the traffic intersection.

3. The method of claim 1 , wherein monitoring behavior of one or more vehicles traveling relative to the intersection comprises:

monitoring behavior of another vehicle traveling in front of the vehicle.

4. The method of claim 1 , further comprising:

providing a visual or audible indication based on the confirmed state of the traffic signal.

5. The method of claim 1 , further comprising:

providing instructions or warnings to the driver based on the confirmed state of the traffic signal.

6. The method of claim 1 , wherein monitoring behavior of one or more vehicles traveling relative to the intersection comprises:

monitoring behavior of one or more vehicles traveling as cross-traffic with respect to the vehicle.

7. The method of claim 1 , where determining additional information to confirm the state of the traffic signal further comprises:

receiving additional information from a sensor of the vehicle, wherein the additional information corresponds to an area of the traffic signal of the traffic intersection and is used to confirm the state of the traffic signal of the traffic intersection.

8. The method of claim 1 , further comprising:

determining an uncertainty associated with the determined state of the traffic signal of the traffic intersection; and

wherein determining additional information to confirm the state of the traffic signal comprises:

determining the additional information based on the uncertainty associated with the determined state of the traffic signal of the traffic intersection.

9. The method of claim 1 , wherein determining the state of the traffic signal of the traffic intersection comprises:

determining the state of the traffic signal of the traffic intersection using information from one or more sensors of the vehicle.

10. The method of claim 1 , wherein determining the state of the traffic signal of the traffic intersection comprises:

determining the state of the traffic signal of the traffic intersection based on one or more images from a camera coupled to the vehicle.

11. A non-transitory computer-readable medium having stored therein instructions executable by a computing device to cause the computing device to perform functions comprising:

determining a state of a traffic signal of a traffic intersection, wherein the vehicle is configured to operate in an autonomous mode;

determining additional information to confirm the state of the traffic signal, wherein determining the additional information comprises at least one of:

(i) requesting more information from a passenger or driver of the vehicle, and

(ii) monitoring behavior of one or more vehicles traveling relative to the traffic intersection;

decreasing a speed of the vehicle while determining the additional information to confirm the state of the traffic signal;

confirming, based on the additional information, the state of the traffic signal; and

controlling the vehicle based on the confirmed state of the traffic signal.

12. The non-transitory computer-readable medium of claim 11 , wherein the functions further comprise:

requesting more information from the passenger or driver of the vehicle and monitoring behavior of one or more vehicles traveling relative to the traffic intersection.

13. The non-transitory computer-readable medium of claim 11 , wherein the functions further comprise:

monitoring behavior of another vehicle traveling in front of the vehicle.

14. The non-transitory computer-readable medium of claim 11 , wherein the functions further comprise:

providing a visual or audible indication based on the confirmed state of the traffic signal.

15. The non-transitory computer-readable medium of claim 11 , wherein the functions further comprise:

providing instructions or warnings to the driver based on the confirmed state of the traffic signal.

16. The non-transitory computer-readable medium of claim 11 , wherein the functions further comprise:

monitoring behavior of one or more vehicles traveling as cross-traffic with respect to the vehicle.

17. The non-transitory computer-readable medium of claim 11 , wherein the functions further comprise:

receiving additional information from a sensor of the vehicle, wherein the additional information corresponds to an area of the traffic signal of the traffic intersection and is used to confirm the state of the traffic signal of the traffic intersection.

18. The non-transitory computer-readable medium of claim 11 , wherein the functions further comprise:

determining the state of the traffic signal of the traffic intersection based on one or more images from a camera coupled to the vehicle.

19. A vehicle configured to be operated in an autonomous mode, the vehicle comprising:

a memory;

a processor coupled to the memory; and

instructions stored in the memory and executable by the processor to:

determine a state of a traffic signal of a traffic intersection, wherein the vehicle is configured to operate in an autonomous mode;

determine additional information to confirm the state of the traffic signal, wherein determining the additional information comprises at least one of:

(i) requesting more information from a passenger or driver of the vehicle, and

(ii) monitoring behavior of one or more vehicles traveling relative to the traffic intersection;

decrease a speed of the vehicle while determining the additional information to confirm the state of the traffic signal;

confirm, based on the additional information, the state of the traffic signal; and

control the vehicle based on the confirmed state of the traffic signal.

20. The method of claim 10 , wherein determine additional information to confirm the state of the traffic signal further comprising:

determining additional information based on one or more additional images from the camera coupled to the vehicle.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 7, 2023
From: FERGUSON, DAVID I.; FAIRFIELD, NATHANIEL; LEVANDOWSKI, ANTHONY
To: GOOGLE INC.
Reel/Frame 064182/0963 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 7, 2023
From: WAYMO HOLDING INC.
To: WAYMO LLC
Reel/Frame 064228/0227 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 7, 2023
From: GOOGLE INC.
To: WAYMO HOLDING INC.
Reel/Frame 064545/0526 →
Continuity (5)
Continuation 17080724 · Oct 26, 2020
Continuation 15667015 · Aug 2, 2017
Continuation 14831777 · Aug 20, 2015
Continuation 13430150 · Mar 26, 2012
Related Publication 20230339469A1 · Oct 26, 2023