IP Library › Granted Patent US 11,568,652
Granted Patent B2
US 11,568,652 · App. 17/154,976 · Granted Jan 31, 2023

Use of relationship between activities of different traffic signals in a network to improve traffic signal state estimation

Inventors: David I. Ferguson (San Francisco, CA); Bradley Templeton (Sunnyvale, CA)
Assignee: Waymo LLC
G06V20/584B60W40/00G08G1/00G08G1/09623G08G1/09626G08G1/096716G08G1/096725G08G1/096758G08G1/096775G08G1/096791
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,568,652
App. No.
17/154,976
Granted
Jan 31, 2023
Kind
B2
Abstract

Methods and devices for using a relationship between activities of different traffic signals in a network to improve traffic signal state estimation are disclosed. An example method includes determining that a vehicle is approaching an upcoming traffic signal. The method may further include determining a state of one or more traffic signals other than the upcoming traffic signal. Additionally, the method may also include determining an estimate of a state of the upcoming traffic signal based on a relationship between the state of the one or more traffic signals other than the upcoming traffic signal and the state of the upcoming traffic signal.

Claims (44)

1. A method for controlling a vehicle, the method comprising:

obtaining, by a computing device, an image of a detected traffic signal;

obtaining, by the computing device, a state of a traffic signal other than the detected traffic signal;

determining, by the computing device, a relationship between the state of the traffic signal other than the detected traffic signal and a state of the detected traffic signal;

determining, by the computing device, an estimate of the state of the detected traffic signal based on the image of the detected traffic signal and the relationship; and

providing instructions for controlling motion of the vehicle in accordance with the estimate of the state of the detected traffic signal.

2. The method of claim 1 , wherein obtaining the state of the traffic signal other than the detected traffic signal comprises obtaining the state of the traffic signal other than the detected traffic signal from another vehicle.

3. The method of claim 2 , wherein the state of the traffic signal other than the detected traffic signal comprises an observed state of the traffic signal other than the detected traffic signal obtained by the other vehicle.

4. The method of claim 1 , wherein obtaining the state of the traffic signal other than the detected traffic signal comprises obtaining the state of the traffic signal other than the detected traffic signal from a fixed sensor in an environment of the vehicle.

5. The method of claim 1 , wherein the relationship comprises a relationship between the state of the traffic signal other than the detected traffic signal, the state of the detected traffic signal, and a time of day.

6. The method of claim 1 , wherein providing the instructions comprises sending the estimate of the state of the detected traffic signal to a control device.

7. The method of claim 6 , wherein the control device is configured to control the vehicle in an autonomous mode.

8. The method of claim 1 , wherein the estimate comprises a prediction of when the state of the detected traffic signal will change.

9. The method of claim 1 , wherein:

the detected traffic signal is an upcoming traffic signal that the vehicle is approaching, and

the traffic signal other than the detected traffic signal is located within a distance threshold of the detected traffic signal.

10. The method of claim 1 , further comprising:

detecting an uncertainty in the image of the detected traffic signal; and

based on detecting the uncertainty in the image of the detected traffic signal, obtaining the state of the traffic signal other than the detected traffic signal.

11. A non-transitory computer-readable medium having stored therein instructions executable by a computing device to cause the computing device to perform functions comprising:

obtaining an image of a detected traffic signal;

obtaining a state of a traffic signal other than the detected traffic signal;

determining a relationship between the state of the traffic signal other than the detected traffic signal and a state of the detected traffic signal;

determining an estimate of the state of the detected traffic signal based on the image of the detected traffic signal and the relationship; and

providing instructions for controlling motion of a vehicle in accordance with the estimate of the state of the detected traffic signal.

12. The non-transitory computer-readable medium of claim 11 , wherein obtaining the state of the traffic signal other than the detected traffic signal comprises obtaining the state of the traffic signal other than the detected traffic signal from another vehicle.

13. The non-transitory computer-readable medium of claim 12 , wherein the state of the traffic signal other than the detected traffic signal comprises an observed state of the traffic signal other than the detected traffic signal obtained by the other vehicle.

14. The non-transitory computer-readable medium of claim 11 , wherein obtaining the state of the traffic signal other than the detected traffic signal comprises obtaining the state of the traffic signal other than the detected traffic signal from a fixed sensor in an environment of the vehicle.

15. The non-transitory computer-readable medium of claim 11 , wherein the estimate comprises a prediction of when the state of the detected traffic signal will change.

16. The non-transitory computer-readable medium of claim 11 , wherein the functions further comprise:

detecting an uncertainty in the image of the detected traffic signal; and

based on detecting the uncertainty in the image of the detected traffic signal, obtaining the state of the traffic signal other than the detected traffic signal.

17. A controller comprising:

at least one processor;

a memory; and

instructions stored in the memory and executable by the at least one processor to cause the controller to perform functions comprising:

obtaining an image of a detected traffic signal,

obtaining a state of a traffic signal other than the detected traffic signal,

determining a relationship between the state of the traffic signal other than the detected traffic signal and a state of the detected traffic signal,

determining an estimate of the state of the detected traffic signal based on the image of the detected traffic signal and the relationship, and

providing instructions for controlling motion of a vehicle in accordance with the estimate of the state of the detected traffic signal.

18. The controller of claim 17 , wherein obtaining the state of the traffic signal other than the detected traffic signal comprises obtaining the state of the traffic signal other than the detected traffic signal from another vehicle.

19. The controller of claim 18 , wherein the state of the traffic signal other than the detected traffic signal comprises an observed state of the traffic signal other than the detected traffic signal obtained by the other vehicle.

20. The controller of claim 17 , wherein obtaining the state of the traffic signal other than the detected traffic signal comprises obtaining the state of the traffic signal other than the detected traffic signal from a fixed sensor in an environment of the vehicle.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 21, 2021
From: FERGUSON, DAVID I.; TEMPLETON, BRADLEY
To: GOOGLE INC.
Reel/Frame 054990/0978 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 21, 2021
From: GOOGLE INC.
To: WAYMO HOLDING INC.
Reel/Frame 055068/0777 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 21, 2021
From: WAYMO HOLDING INC.
To: WAYMO LLC
Reel/Frame 055068/0818 →
Continuity (6)
Continuation 16257735 · Jan 25, 2019
Continuation 15839124 · Dec 12, 2017
Continuation 15653716 · Jul 19, 2017
Continuation 14843705 · Sep 2, 2015
Continuation 13622418 · Sep 19, 2012
Related Publication 20210166044A1 · Jun 3, 2021