IP Library Granted Patent US 11,845,472
Granted Patent B2
US 11,845,472 · App. 17/941,142 · Granted Dec 19, 2023

Inferring state of traffic signal and other aspects of a vehicle's environment based on surrogate data

Inventors: Peter Lombrozo (Santa Cruz, CA); Eric Teller (San Francisco, CA); Bradley Templeton (Sunnyvale, CA)
Assignee: Waymo LLC
B60W60/0027B60W30/09B60W30/18159B60W40/00B60W60/0017G01C21/26G01C21/30G01S13/88G01S15/88G01S17/88G06V20/584B60W2050/0075B60W2554/00B60W2554/20B60W2554/406B60W2556/10
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,845,472
App. No.
17/941,142
Granted
Dec 19, 2023
Kind
B2
Abstract

A vehicle configured to operate in an autonomous mode can obtain sensor data from one or more sensors observing one or more aspects of an environment of the vehicle. At least one aspect of the environment of the vehicle that is not observed by the one or more sensors could be inferred based on the sensor data. The vehicle could be controlled in the autonomous mode based on the at least one inferred aspect of the environment of the vehicle.

Claims (30)

1. A method for controlling a vehicle operating in an autonomous mode, the vehicle comprising a camera, the method comprising:

responsive to a state of a traffic light being unobservable by the camera, inferring, by a computer system, the state of the traffic light based on data relating to one or more other vehicles, wherein the one or more other vehicles include an oncoming vehicle in an oncoming lane; and

controlling, by the computer system, a speed of the vehicle based on the inferred state of the traffic light.

2. The method of claim 1 , wherein controlling the speed of the vehicle based on the inferred state of the traffic light comprises controlling the vehicle to decelerate based on the inferred state of the traffic light being red.

3. The method of claim 1 , wherein the data relating to one or more other vehicles comprises at least one of a speed of another vehicle, a heading of another vehicle, a position of another vehicle, an acceleration of another vehicle, or a deceleration of another vehicle.

4. The method of claim 1 , wherein the state of the traffic light is unobservable by the camera because the traffic light is obscured by another vehicle.

5. The method of claim 1 , wherein controlling the speed of the vehicle based on the inferred state of the traffic light comprises controlling the vehicle to go through an intersection based on the inferred state of the traffic light being green.

6. The method of claim 1 , wherein controlling the speed of the vehicle based on the inferred state of the traffic light comprises controlling the vehicle to go through an intersection based on the inferred state of the traffic light being green and additional data confirming the inferred state of the traffic light.

7. The method of claim 1 , wherein the traffic light is for traffic heading in a first direction in a first lane and for traffic heading in a second direction in the oncoming lane, wherein the vehicle is heading in the first direction in the first lane.

8. A vehicle, comprising:

a camera; and

a controller, wherein the controller is configured to perform operations comprising:

determining that a state of a traffic light is unobservable by the camera;

responsive to determining that the state of a traffic light is unobservable by the camera, inferring the state of the traffic light based on data relating to one or more other vehicles, wherein the one or more other vehicles include an oncoming vehicle in an oncoming lane; and

controlling a speed of the vehicle based on the inferred state of the traffic light.

9. The vehicle of claim 8 , wherein controlling the speed of the vehicle based on the inferred state of the traffic light comprises controlling the vehicle to decelerate based on the inferred state of the traffic light being red.

10. The vehicle of claim 8 , wherein the data relating to one or more other vehicles comprises at least one of a speed of another vehicle, a heading of another vehicle, a position of another vehicle, an acceleration of another vehicle, or a deceleration of another vehicle.

11. The vehicle of claim 8 , wherein the state of the traffic light is unobservable by the camera because the traffic light is obscured by another vehicle.

12. The vehicle of claim 8 , wherein controlling the speed of the vehicle based on the inferred state of the traffic light comprises controlling the vehicle to go through an intersection based on the inferred state of the traffic light being green.

13. The vehicle of claim 8 , wherein controlling the speed of the vehicle based on the inferred state of the traffic light comprises controlling the vehicle to go through an intersection based on the inferred state of the traffic light being green and additional data confirming the inferred state of the traffic light.

14. A non-transitory computer readable medium having stored therein programming instructions executable by a computer system to cause the computer system to perform functions, the functions comprising:

controlling a vehicle in an autonomous mode, the vehicle comprising a camera, wherein controlling the vehicle in the autonomous mode comprises:

responsive to a state of a traffic light being unobservable by the camera, inferring the state of the traffic light based on data relating to one or more other vehicles, wherein the one or more other vehicles include an oncoming vehicle in an oncoming lane; and

controlling a speed of the vehicle based on the inferred state of the traffic light.

15. The non-transitory computer readable medium of claim 14 , wherein controlling the speed of the vehicle based on the inferred state of the traffic light comprises controlling the vehicle to decelerate based on the inferred state of the traffic light being red.

16. The non-transitory computer readable medium of claim 14 , wherein the data relating to one or more other vehicles comprises at least one of a speed of another vehicle, a heading of another vehicle, a position of another vehicle, an acceleration of another vehicle, or a deceleration of another vehicle.

17. The non-transitory computer readable medium of claim 14 , wherein the state of the traffic light is unobservable by the camera because the traffic light is obscured by another vehicle.

18. The non-transitory computer readable medium of claim 14 , wherein controlling the speed of the vehicle based on the inferred state of the traffic light comprises controlling the vehicle to go through an intersection based on the inferred state of the traffic light being green.

19. The non-transitory computer readable medium of claim 14 , wherein controlling the speed of the vehicle based on the inferred state of the traffic light comprises controlling the vehicle to go through an intersection based on the inferred state of the traffic light being green and additional data confirming the inferred state of the traffic light.

20. The non-transitory computer readable medium of claim 14 , wherein the traffic light is for traffic heading in a first direction in a first lane and for traffic heading in a second direction in the oncoming lane, wherein the vehicle is heading in the first direction in the first lane.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 15, 2022
From: LOMBROZO, PETER; TELLER, ERIC; TEMPLETON, BRADLEY
To: GOOGLE INC.
Reel/Frame 061110/0501 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 15, 2022
From: GOOGLE INC.
To: WAYMO HOLDING INC.
Reel/Frame 061449/0540 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 15, 2022
From: WAYMO HOLDING INC.
To: WAYMO LLC
Reel/Frame 061449/0568 →
Continuity (7)
Continuation 17063331 · Oct 5, 2020
Continuation 16415697 · May 17, 2019
Continuation 15724428 · Oct 4, 2017
Continuation 15087390 · Mar 31, 2016
Continuation 14308409 · Jun 18, 2014
Continuation 13486886 · Jun 1, 2012
Related Publication 20230004159A1 · Jan 5, 2023
Cited By (1)
US 12,428,035