IP Library Granted Patent US 11,685,360
Granted Patent B2
US 11,685,360 · App. 17/102,409 · Granted Jun 27, 2023

Planning for unknown objects by an autonomous vehicle

Inventors: Emilio Frazzoli (Newton, MA); Baoxing Qin (Singapore, SG)
Assignee: Motional AD LLC
B60W10/184B60W10/04B60W10/10B60W10/20B60W40/04G08G1/163G08G1/165G08G1/166B60W2420/42B60W2420/52B60W2552/00B60W2554/00B60W2555/20B60W2555/60B60W2556/10
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,685,360
App. No.
17/102,409
Granted
Jun 27, 2023
Kind
B2
Abstract

Among other things, a world model is maintained of an environment of a vehicle. A hypothetical object in the environment that cannot be perceived by sensors of the vehicle is included in the world model.

Claims (53)

1. A method comprising:

receiving, using at least one processor and based on data collected by one or more sensors of a vehicle, a model of an environment comprising one or more objects that are detectable by the one or more sensors;

determining, using the at least one processor and based on at least the collected data, one or more hypothetical objects in the environment that are undetectable by the one or more sensors;

adding, using the at least one processor, the one or more hypothetical objects to the model; and

controlling, using the at least one processor and based on the model to which the one or more hypothetical objects have been added, movement of the vehicle in the environment.

2. The method of claim 1 , wherein the one or more objects of the environment are observable from the vehicle, wherein the one or more hypothetical objects are unobservable from the vehicle.

3. The method of claim 1 , wherein the one or more sensors comprise a light detection and ranging (LIDAR) sensor.

4. The method of claim 3 , wherein the determining of the one or more hypothetical objects comprises:

receiving, using the at least one processor, a collection of points output by the LIDAR sensor;

determining, using the at least one processor and based on a ground elevation, that a first point in a particular vertical slice of the collection of points that is perpendicular to a ground plane characterizes a ground location; and

determining, using the at least one processor, that a different second point in the particular vertical slice of the collection of points characterizes an object that obscures the ground location, wherein the object that obscures the ground location is one of the one or more hypothetical objects.

5. The method of claim 1 , wherein the adding of the one or more hypothetical objects to the model comprises:

receiving, using the at least one processor, data describing a configuration of a region that is undetectable by the one or more sensors; and

placing, using the at least one processor and based on the configuration of the region, the one or more hypothetical objects at one or more respective locations in the model.

6. The method of claim 5 , wherein the hypothetical object is a vehicle, wherein the undetectable region comprises an unobservable road in the environment, wherein placing the vehicle at a respective location comprises placing the vehicle on an unperceived segment of the road.

7. The method of claim 1 , wherein:

the controlling is based on motion characteristics of the one or more hypothetical objects;

the motion characteristics comprise at least one of an orientation, a direction of motion, a speed, or a trajectory of motion of the one or more hypothetical objects; and

the orientation, direction, or speed are based on at least one of map data, geographic data, traffic data, or traffic law data.

8. The method of claim 1 , wherein the controlling comprises avoiding a collision with the one or more objects and the one or more hypothetical objects.

9. A system comprising:

at least one programmable processor; and

a machine-readable medium storing instructions that, when executed by the at least one processor, cause the at least one programmable processor to perform operations comprising:

receiving, based on data collected by one or more sensors of a vehicle, a model of an environment comprising one or more objects that are detectable by the one or more sensors;

determining, based on at least the collected data, one or more hypothetical objects in the environment that are undetectable by the one or more sensors;

adding the one or more hypothetical objects to the model; and

controlling, based on the model to which the one or more hypothetical objects have been added, movement of the vehicle in the environment.

10. A non-transitory computer program product storing instructions that, when executed by at least one programmable processor, cause the at least one programmable processor to perform operations comprising:

receiving, based on data collected by one or more sensors of a vehicle, a model of an environment comprising one or more objects that are detectable by the one or more sensors;

determining, based on at least the collected data, one or more hypothetical objects in the environment that are undetectable by the one or more sensors;

adding the one or more hypothetical objects to the model; and

controlling, based on the model to which the one or more hypothetical objects have been added, movement of the vehicle in the environment.

11. The system of claim 9 , wherein the one or more objects of the environment are observable from the vehicle, wherein the one or more hypothetical objects are unobservable from the vehicle.

12. The system of claim 9 , wherein the one or more sensors comprise a light detection and ranging (LIDAR) sensor.

13. The system of claim 12 , wherein the determining of the one or more hypothetical objects comprises:

receiving, using the at least one processor, a collection of points output by the LIDAR sensor;

determining, using the at least one processor and based on a ground elevation, that a first point in a particular vertical slice of the collection of points that is perpendicular to a ground plane characterizes a ground location; and

determining, using the at least one processor, that a different second point in the particular vertical slice of the collection of points characterizes an object that obscures the ground location, wherein the object that obscures the ground location is one of the one or more hypothetical objects.

14. The system of claim 9 , wherein the adding of the one or more hypothetical objects to the model comprises:

receiving, using the at least one processor, data describing a configuration of a region that is undetectable by the one or more sensors; and

placing, using the at least one processor and based on the configuration of the region, the one or more hypothetical objects at one or more respective locations in the model.

15. The system of claim 14 , wherein the hypothetical object is a vehicle, wherein the undetectable region comprises an unobservable road in the environment, wherein placing the vehicle at a respective location comprises placing the vehicle on an unperceived segment of the road.

16. The system of claim 9 , wherein:

the controlling is based on motion characteristics of the one or more hypothetical objects;

the motion characteristics comprise at least one of an orientation, a direction of motion, a speed, or a trajectory of motion of the one or more hypothetical objects; and

the orientation, direction, or speed are based on at least one of map data, geographic data, traffic data, or traffic law data.

17. The system of claim 9 , wherein the controlling comprises avoiding a collision with the one or more objects and the one or more hypothetical objects.

18. The non-transitory computer program product of claim 10 , wherein the one or more objects of the environment are observable from the vehicle, wherein the one or more hypothetical objects are unobservable from the vehicle.

19. The non-transitory computer program product of claim 10 , wherein the one or more sensors comprise a light detection and ranging (LIDAR) sensor.

20. The non-transitory computer program product of claim 19 , wherein the determining of the one or more hypothetical objects comprises:

receiving, using the at least one processor, a collection of points output by the LIDAR sensor;

determining, using the at least one processor and based on a ground elevation, that a first point in a particular vertical slice of the collection of points that is perpendicular to a ground plane characterizes a ground location; and

determining, using the at least one processor, that a different second point in the particular vertical slice of the collection of points characterizes an object that obscures the ground location, wherein the object that obscures the ground location is one of the one or more hypothetical objects.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 11, 2021
From: FRAZZOLI, EMILIO; QIN, BAOXING
To: NUTONOMY INC.
Reel/Frame 054872/0238 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 11, 2021
From: MOTIONAL AD INC.
To: MOTIONAL AD LLC
Reel/Frame 054872/0385 →
CHANGE OF NAME Recorded Jan 11, 2021
From: NUTONOMY INC.
To: MOTIONAL AD INC.
Reel/Frame 055865/0156 →
Continuity (3)
Continuation 16125993 · Sep 10, 2018
Continuation 15451747 · Mar 7, 2017
Related Publication 20210078562A1 · Mar 18, 2021
Cited By (5)
US 12,228,936 US 12,252,153 US 12,409,824 US 12,594,967 US 12,662,159