IP Library Granted Patent US 10,059,334
Granted Patent B1
US 10,059,334 · App. 15/278,338 · Granted Aug 28, 2018

Automated system and method for modeling the behavior of vehicles and other agents

Inventors: Jiajun Zhu (Palo Alto, CA); David I. Ferguson (San Francisco, CA); Dmitri A. Dolgov (Los Altos, CA)
Assignee: Waymo LLC
B60W30/09B60W30/0956B60W50/0097G05D1/0088G08G1/166G05D1/0289
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,059,334
App. No.
15/278,338
Granted
Aug 28, 2018
Kind
B1
Abstract

A method and apparatus are provided for determining one or more behavior models used by an autonomous vehicle to predict the behavior of detected objects. The autonomous vehicle may collect and record object behavior using one or more sensors. The autonomous vehicle may then communicate the recorded object behavior to a server operative to determine the behavior models. The server may determine the behavior models according to a given object classification, actions of interest performed by the object, and the object's perceived surroundings.

Claims (42)

1. A method of maneuvering a vehicle, the method comprising:

receiving, by one or more processors, object data, wherein the object data comprises a location of an object in an environment of the vehicle;

identifying, from the object data, a classification of the object;

identifying a behavior of interest corresponding to an action taken by the object based on the object data and on map information identifying a road element corresponding to the location of the object;

retrieving from memory, a behavior model for objects configured to predict how another object, having the same classification as the object, will behave based on the classification; and

maneuvering the vehicle, by the one or more processors, based on the behavior model and the identified behavior of interest,

wherein the object data further includes movement information for the object and identifying the behavior of interest is further based on a comparison between the road element and the movement information and the comparison indicates that the object has performed the behavior of interest.

2. The method of claim 1 , wherein the road element comprise a first lane of traffic, and wherein the action taken indicates that the object has changed from a second lane of traffic to the first lane of traffic.

3. The method of claim 1 , wherein the classification corresponds to a road vehicle.

4. The method of claim 1 , wherein the classification corresponds to a pedestrian.

5. The method of claim 1 , wherein the behavior model includes paths of travel for one or more previously monitored objects, and the method further comprises:

using the behavior model to identify a plurality of probabilities for potential actions of the object, and

wherein maneuvering the vehicle includes avoiding a trajectory for at least one of the potential actions.

6. The method of claim 5 , further comprising updating the behavior model by adjusting the plurality of probabilities based on the behavior of interest.

7. The method of claim 1 , further comprising creating, by the one or more processors, an initial behavior model for the object based on the object data and the map information, when a behavior model does not exist for a classification for the object.

8. The method of claim 1 , wherein the behavior model provides information based on weather conditions.

9. A system for maneuvering a vehicle, the system comprising one or more processors configured to:

receive object data, wherein the object data comprises a location of an object in an environment of the vehicle;

identify, from the object data, a classification of the object;

identify a behavior of interest corresponding to an action taken by the object based on the object data and on map information identifying a road element corresponding to the location of the object;

retrieve from memory, a behavior model for objects configured to predict how another object, having the same classification as the object, will behave based on the classification; and

maneuver the vehicle based on the behavior model and the identified behavior of interest,

wherein the object data further includes movement information for the object, and the one or more processors are further configured to identify the behavior of interest further based on a comparison between the road element and the movement information and the comparison indicates that the object has performed the behavior of interest.

10. The system of claim 9 , further comprising the vehicle.

11. The system of claim 9 , further comprising the memory, and wherein the memory further stores the map information.

12. The system of claim 9 , wherein the road element comprise a first lane of traffic, and wherein the action taken indicates that the object has changed from a second lane of traffic to the first lane of traffic.

13. The system of claim 9 , wherein the classification corresponds to a road vehicle.

14. The system of claim 9 , wherein the classification corresponds to a pedestrian.

15. The system of claim 9 , wherein the behavior model includes paths of travel for one or more previously monitored objects, and the one or more processors are further configured to:

use the behavior model to identify a plurality of probabilities for potential actions of the object, and

to maneuver the vehicle by avoiding a trajectory for at least one of the potential actions.

16. The system of claim 15 , wherein the one or more processors are further configured to update the behavior model by adjusting the plurality of probabilities based on the behavior of interest.

17. The system of claim 9 , further comprising creating an initial behavior model for the object based on the object data and the map information, when a behavior model does not exist for a classification for the object.

18. The system of claim 9 , wherein the behavior model provides information based on weather conditions.

19. A non-transitory, computer readable recording medium on which instructions are stored, the instructions, when executed by one or more processors, cause the one or more processors to perform a method of maneuvering a vehicle, the method comprising:

receiving object data, wherein the object data comprises a location of an object in an environment of the vehicle;

identifying, from the object data, a classification of the object;

identifying a behavior of interest corresponding to an action taken by the object based on the object data and on map information identifying a road element corresponding to the location of the object;

retrieving from memory, a behavior model for objects configured to predict how another object, having the same classification as the object, will behave based on the classification; and

maneuvering the vehicle based on the behavior model and the identified behavior of interest,

wherein the object data further includes movement information for the object and identifying the behavior of interest is further based on a comparison between the road element and the movement information and the comparison indicates that the object has performed the behavior of interest.

20. The medium of claim 18 , further comprising creating an initial behavior model for the object based on the object data and the map information, when a behavior model does not exist for a classification for the object.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 28, 2017
From: WAYMO HOLDING INC.
To: WAYMO LLC
Reel/Frame 042108/0021 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 27, 2017
From: GOOGLE INC.
To: WAYMO HOLDING INC.
Reel/Frame 042099/0935 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 7, 2016
From: ZHU, JIAJUN; FERGUSON, DAVID I.; DOLGOV, DMITRI A.
To: GOOGLE INC.
Reel/Frame 040589/0727 →
Continuity (1)
Continuation 13446494 · Apr 13, 2012
Cited By (13)
US 12,234,811 US 12,236,327 US 12,241,458 US 12,249,238 US 12,270,386 US 12,307,347 US 12,383,066 US 12,434,705 US 12,589,512 US 12,625,228 US 12,638,578 US 12,670,794 US 12,709,205