IP Library Granted Patent US 10,831,196
Granted Patent B2
US 10,831,196 · App. 16/415,697 · Granted Nov 10, 2020

Inferring state of traffic signal and other aspects of a vehicle's environment based on surrogate data

Inventors: Peter Lombrozo (Santa Cruz, CA); Eric Teller (San Francisco, CA); Bradley Templeton (Sunnyvale, CA)
Assignee: Waymo LLC
G05D1/0088B60W30/09B60W30/12B60W30/16B60W40/00G01C21/26G01C21/30G01S13/88G01S15/88G01S17/88G06K9/00825B60W2050/0089B60W2554/00
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,831,196
App. No.
16/415,697
Granted
Nov 10, 2020
Kind
B2
Abstract

A vehicle configured to operate in an autonomous mode can obtain sensor data from one or more sensors observing one or more aspects of an environment of the vehicle. At least one aspect of the environment of the vehicle that is not observed by the one or more sensors could be inferred based on the sensor data. The vehicle could be controlled in the autonomous mode based on the at least one inferred aspect of the environment of the vehicle.

Claims (29)

1. A method, comprising:

obtaining sensor data from one or more sensors observing an environment of a vehicle, wherein the one or more sensors are operationally associated with the vehicle, wherein the vehicle is configured to operate in an autonomous mode, wherein the environment includes a metering light at a highway on-ramp, wherein the metering light is not observed by the one or more sensors;

inferring, by an inference system, at least one aspect of the metering light based on the sensor data; and

controlling the vehicle in the autonomous mode based on the inferred at least one aspect of the metering light.

2. The method of claim 1 , wherein inferring at least one aspect of the metering light based on the sensor data comprises at least one of inferring an interval time of the metering light or inferring a current state of the metering light.

3. The method of claim 1 , wherein the sensor data comprises vehicle-related sensor data related to one or more other vehicles on the highway on-ramp, and wherein inferring at least one aspect of the metering light based on the sensor data comprises inferring an interval time of the metering light based on the vehicle-related sensor data.

4. The method of claim 3 , wherein the vehicle-related sensor data comprises data indicative of a rate of advancement of the one or more other vehicles.

5. The method of claim 3 , wherein the vehicle-related sensor data comprises data indicative of a wait time of the one or more other vehicles.

6. The method of claim 3 , wherein the vehicle-related sensor data comprises data indicative of a departure interval of the one or more other vehicles.

7. The method of claim 1 , wherein the sensor data comprises data indicative of a previous transition of the metering light, and wherein inferring at least one aspect of the metering light based on the sensor data comprises inferring a current state of the metering light based on an interval time of the metering light and an elapsed time since the previous transition of the metering light.

8. A non-transitory computer readable medium having stored therein instructions executable by a computer system to cause the computer system to perform functions, the functions comprising:

obtaining sensor data from one or more sensors observing an environment of a vehicle, wherein the one or more sensors are operationally associated with the vehicle, wherein the vehicle is configured to operate in an autonomous mode, wherein the environment includes a metering light at a highway on-ramp, wherein the metering light is not observed by the one or more sensors;

inferring at least one aspect of the metering light based on the sensor data; and

controlling the vehicle in the autonomous mode based on the inferred at least one aspect of the metering light.

9. The non-transitory computer readable medium of claim 8 , wherein inferring at least one aspect of the metering light based on the sensor data comprises at least one of inferring an interval time of the metering light or inferring a current state of the metering light.

10. The non-transitory computer readable medium of claim 8 , wherein the sensor data comprises vehicle-related sensor data related to one or more other vehicles on the highway on-ramp, and wherein inferring at least one aspect of the metering light based on the sensor data comprises inferring an interval time of the metering light based on the vehicle-related sensor data.

11. The non-transitory computer readable medium of claim 10 , wherein the vehicle-related sensor data comprises data indicative of a rate of advancement of the one or more other vehicles.

12. The non-transitory computer readable medium of claim 10 , wherein the vehicle-related sensor data comprises data indicative of a wait time of the one or more other vehicles.

13. The non-transitory computer readable medium of claim 10 , wherein the vehicle-related sensor data comprises data indicative of a departure interval of the one or more other vehicles.

14. The non-transitory computer readable medium of claim 8 , wherein the sensor data comprises data indicative of a previous transition of the metering light, and wherein inferring at least one aspect of the metering light based on the sensor data comprises inferring a current state of the metering light based on an interval time of the metering light and an elapsed time since the previous transition of the metering light.

15. A vehicle, comprising:

one or more sensors configured to acquire sensor data regarding an environment of a vehicle, wherein the vehicle is configured to operate in an autonomous mode, wherein the environment includes a metering light at a highway on-ramp, wherein the metering light is not observed by the one or more sensors;

an inference system, wherein the inference system is configured to infer at least one aspect of the metering light based on the sensor data; and

a control system, wherein the control system is configured to control the vehicle in the autonomous mode based on the inferred at least one aspect of the metering light.

16. The vehicle of claim 15 , wherein the inference system is configured to infer at least one of an interval time of the metering light or a current state of the metering light.

17. The vehicle of claim 15 , wherein the sensor data comprises vehicle-related sensor data related to one or more other vehicles on the highway on-ramp, and wherein the inference system is configured to infer an interval time of the metering light based on the vehicle-related sensor data.

18. The vehicle of claim 17 , wherein the vehicle-related data comprises data indicative of a rate of advancement of the one or more other vehicles, a wait time of the one or more other vehicles, or a departure interval of the one or more other vehicles.

19. The vehicle of claim 15 , wherein the sensor data comprises data indicative of a previous transition of the metering light, and wherein the inference system is configured to infer a current state of the metering light based on an interval time of the metering light and an elapsed time since the previous transition of the metering light.

20. The vehicle of claim 15 , wherein the one or more sensors include at least one of a camera, a radar system, or a lidar system.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 7, 2021
From: LOMBROZO, PETER; TELLER, ERIC; TEMPLETON, BRADLEY
To: GOOGLE INC.
Reel/Frame 054847/0300 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 7, 2021
From: GOOGLE INC.
To: WAYMO HOLDING INC.
Reel/Frame 054919/0448 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 7, 2021
From: WAYMO HOLDING INC.
To: WAYMO LLC
Reel/Frame 054919/0520 →
Continuity (5)
Continuation 15724428 · Oct 4, 2017
Continuation 15087390 · Mar 31, 2016
Continuation 14308409 · Jun 18, 2014
Continuation 13486886 · Jun 1, 2012
Related Publication 20190271983A1 · Sep 5, 2019
Cited By (2)
US 12,384,410 US 12,428,035