IP Library › Granted Patent US 11,403,526
Granted Patent B2
US 11,403,526 · App. 17/013,422 · Granted Aug 2, 2022

Decision making for autonomous vehicle motion control

Inventors: Joshua D. Redding (San Jose, CA); Luke B. Johnson (Sunnyvale, CA); Martin Levihn (San Jose, CA); Nicolas F. Meuleau (San Francisco, CA); Sebastian Brechtel (Zurich, CH)
Assignee: Apple Inc.
G06N3/08B60W30/00G05B13/027G05D1/0088G06F16/9027G06N3/02G06N5/003G06N7/005G05D2201/0213
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,403,526
App. No.
17/013,422
Granted
Aug 2, 2022
Kind
B2
Abstract

A behavior planner for a vehicle generates a plurality of conditional action sequences of the vehicle using a tree search algorithm and heuristics obtained from one or more machine learning models. Each sequence corresponds to a sequence of anticipated states of the vehicle. At least some of the action sequences are provided to a motion selector of the vehicle. The motion selector generates motion-control directives based on the received conditional action sequences and on data received from one or more sensors of the vehicle, and transmits the directives to control subsystems of the vehicle.

Claims (40)

1. A method, comprising:

obtaining, at a first rate at a motion selector of a vehicle, one or more conditional action sequences generated with respect to the vehicle, wherein individual ones of the conditional action sequences correspond to a respective set of anticipated states of the vehicle;

identifying one or more motion-control directives at the motion selector, based at least in part on (a) the one or more conditional action sequences and (b) a set of sensor data obtained at a second rate that exceeds the first rate; and

transmitting, by the motion selector, the one or more motion-control directives to one or more motion control subsystems of the vehicle.

2. The method as recited in claim 1 , further comprising:

generating at least one conditional action sequence of the one or more conditional action sequences using at least a Monte Carlo Tree Search algorithm.

3. The method as recited in claim 1 , further comprising:

generating at least one conditional action sequence of the one or more conditional action sequences using at least one machine learning model.

4. The method as recited in claim 1 , further comprising:

generating at least one conditional action sequence of the one or more conditional action sequences using at least an analysis of recorded driver behavior.

5. The method as recited in claim 1 , further comprising:

generating at least one conditional action sequence of the one or more conditional action sequences based at least in part on an anticipated social interaction.

6. The method as recited in claim 1 , further comprising:

generating at least one conditional action sequence of the one or more conditional action sequences based at least in part on statistical analysis of a set of actions taken under a particular set of driving conditions.

7. The method as recited in claim 1 , wherein identifying the one or more action control directives comprises identifying at least one action control directive based at least in part on an occupant comfort consideration.

8. A system, comprising:

a motion selector of a vehicle implemented at one or more computing devices;

wherein the motion selector is configured to:

obtain, at a first rate, one or more conditional action sequences generated with respect to the vehicle, wherein individual ones of the conditional action sequences correspond to a respective set of anticipated states of the vehicle;

identify one or more motion-control directives, based at least in part on (a) the one or more conditional action sequences and (b) a set of sensor data obtained at a second rate that exceeds the first rate; and

transmit the one or more motion-control directives to one or more motion control subsystems of the vehicle.

9. The system as recited in claim 8 , wherein the motion selector is configured to transmit the one or more motion control directives to the one or more motion control subsystems at a rate which differs from the first rate.

10. The system as recited in claim 8 , wherein at least one motion-control directive of the one or more motion-control directives is identified based at least in part on an emergency response rule.

11. The system as recited in claim 8 , wherein the one or more motion control subsystems comprise one or more of: (a) a braking system, (b) an acceleration system or (c) a turn controller.

12. The system as recited in claim 8 , wherein the motion selector is further configured to:

prior to identifying the one or more motion control directives,

determine one or more non-drivable regions with respect to the vehicle; and

generate a trajectory for the vehicle based at least in part on analysis of the one or more non-drivable regions.

13. The system as recited in claim 8 , wherein at least conditional action sequence of the one or more conditional action sequence is obtained at the motion selector from a data center.

14. The system as recited in claim 8 , wherein at least one sensor of the one or more sensors comprises one or more of: (a) an externally-oriented camera, (b) an occupant-oriented sensor, (c) a physiological signal detector, (d) a Global Positioning System (GPS) device, (e) a radar devices or (f) a LIDAR device.

15. One or more non-transitory computer-accessible storage media storing program instructions that when executed on or across one or more processors implements a motion selector of a vehicle, wherein the motion selector is configured to:

obtain, at a first rate, one or more conditional action sequences generated with respect to the vehicle, wherein individual ones of the conditional action sequences correspond to a respective set of anticipated states of the vehicle;

identify one or more motion-control directives, based at least in part on (a) the one or more conditional action sequences and (b) a set of sensor data obtained at a second rate that exceeds the first rate; and

transmit the one or more motion-control directives to one or more motion control subsystems of the vehicle.

16. The one or more non-transitory computer-accessible storage media as recited in claim 15 , wherein the motion selector is configured to transmit the one or more motion control directives to the one or more motion control subsystems at a rate which differs from the first rate.

17. The one or more non-transitory computer-accessible storage media as recited in claim 15 , wherein at least one motion-control directive of the one or more motion-control directives is identified based at least in part on an emergency response rule.

18. The one or more non-transitory computer-accessible storage media as recited in claim 15 , wherein the one or more motion control subsystems comprise one or more of: (a) a braking system, (b) an acceleration system or (c) a turn controller.

19. The one or more non-transitory computer-accessible storage media as recited in claim 15 , wherein the motion selector is further configured to:

generate a modified version of a first trajectory based on one or more occupant comfort considerations, wherein the one or more motion-control directives are identified based at least in part on the modified version of the first trajectory.

20. The one or more non-transitory computer-accessible storage media as recited in claim 15 , wherein at least conditional action sequence of the one or more conditional action sequence is obtained at the motion selector from a data center.

Continuity (3)
Continuation 15713326 · Sep 22, 2017
Provisional Application 62398938 · Sep 23, 2016
Related Publication 20200401892A1 · Dec 24, 2020