IP Library Granted Patent US 10,353,390
Granted Patent B2
US 10,353,390 · App. 15/632,208 · Granted Jul 16, 2019

Trajectory generation and execution architecture

Inventors: Gary Linscott (Cupertino, CA); Robert Edward Somers (Sunnyvale, CA); Joona Markus Petteri Kiiski (Cupertino, CA); Marin Kobilarov (Mountain View, CA); Timothy Caldwell (Mountain View, CA); Jacob Lee Askeland (San Jose, CA); Ashutosh Gajanan Rege (San Jose, CA); Joseph Funke (Redwood City, CA)
Assignee: Zoox, Inc.
G05D1/0088B60W30/09G01C21/3407G05D1/0055G05D1/0212G05D1/0223G05D1/0272G05D1/0274G06N3/04G06N3/08G05D2201/0213
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,353,390
App. No.
15/632,208
Filed
Jun 23, 2017
Granted
Jul 16, 2019
Kind
B2
Art Unit
3662
USPC
701/301
Abstract

Techniques for generating and executing trajectories to guide autonomous vehicles are described. In an example, a first computer system associated with an autonomous vehicle can generate, at a first operational frequency, a route to guide the autonomous vehicle from a current location to a target location. The first computer system can further determine, at a second operational frequency, an instruction for guiding the autonomous vehicle along the route and can generate, at a third operational frequency, a trajectory based at least partly on the instruction and real-time processed sensor data. A second computer system that is associated with the autonomous vehicle and is in communication with the first computer system can execute, at a fourth operational frequency, the trajectory to cause the autonomous vehicle to travel along the route. The separation of the first computer system and the second computer system can provide enhanced safety, redundancy, and optimization.

Claims (86)

1. A system embodied in an autonomous vehicle, the system comprising:

a first computer system comprising:

one or more first processors; and

one or more first computer readable storage media communicatively coupled to the one or more first processors and storing one or more first modules including instructions that are executable by the one or more first processors, the one or more first modules comprising:

a route planning module configured to generate a route between a current location of the autonomous vehicle and a target location of the autonomous vehicle, the route planning module operating at a first operational frequency;

a decision module configured to generate an instruction based on the route, the instruction including a sequence of actions to guide the autonomous vehicle along at least a portion of the route, the decision module operating at a second operational frequency; and

a trajectory module configured to:

access real-time processed sensor data; and

generate an output trajectory based at least in part on the instruction and the real-time processed sensor data, the trajectory module operating at a third operational frequency; and

a second computer system comprising:

one or more second processors; and

one or more second computer readable storage media communicatively coupled to the one or more second processors and storing one or more second modules including instructions that are executable by the one or more second processors, the one or more second modules comprising an execution module configured to generate one or more signals for causing the autonomous vehicle to drive along the output trajectory, the execution module operating at a fourth operational frequency.

2. The system of claim 1 , wherein the one or more second modules include a fallback determination module, the fallback determination module configured to:

receive, from the first computer system, a fallback trajectory for causing the autonomous vehicle perform a safety maneuver; and

store the fallback trajectory for a predetermined period of time,

wherein the fallback determination module operates at the fourth operational frequency.

3. The system of claim 2 , wherein the fallback determination module is further configured to:

determine an occurrence of an event warranting a fallback action; and

access the fallback trajectory.

4. The system of claim 1 , wherein the one or more second modules include a fallback determination module, the fallback determination module configured to:

determine an occurrence of an event warranting a fallback action; and

generate a fallback trajectory for causing the autonomous vehicle to perform a safety maneuver,

wherein the fallback determination module operates at the fourth operational frequency.

5. The system of claim 1 , wherein the execution module is further configured to:

receive a fallback trajectory for causing the autonomous vehicle to perform a safety maneuver; and

execute the fallback trajectory to cause the autonomous vehicle to perform the safety maneuver.

6. The system of claim 1 , wherein the fourth operational frequency is higher than the first operational frequency, the second operational frequency, and the third operational frequency.

7. The system of claim 1 , wherein:

the third operational frequency is higher than the first operational frequency and the second operational frequency; and

the third operational frequency is lower than the fourth operational frequency.

8. The system of claim 1 , wherein the first operational frequency is lower than the second operational frequency, the third operational frequency, and the fourth operational frequency.

9. A method implemented by a transportable computer system, the method comprising:

determining a current location of the transportable computer system;

determining a target location for the transportable computer system;

receiving, from one or more sensors associated with the transportable computer system, real-time processed sensor data;

determining, at a first operational frequency, a route to guide the transportable computer system from the current location to the target location;

determining, at a second operational frequency, an instruction for guiding the transportable computer system along at least a portion of the route based at least in part on the real-time processed sensor data;

generating, at a third operational frequency, a trajectory based at least in part on the real-time processed sensor data and the instruction; and

executing, at a fourth operational frequency, the trajectory to cause the transportable computer system to travel along the route.

10. The method of claim 9 , wherein:

the determining the route is performed by a first computer system associated with the transportable computer system;

the determining the instruction for guiding the transportable computer system along at least the portion of the route is performed by the first computer system; and

the generating the trajectory is performed by the first computer system.

11. The method of claim 10 , wherein the executing the trajectory to cause the transportable computer system to travel along the route is performed by a second computer system associated with the transportable computer system, the second computer system being different than the first computer system.

12. The method of claim 9 , wherein the instruction comprises a policy and generating the trajectory based at least in part on the real-time processed sensor data comprises generating the trajectory based on the policy.

13. The method of claim 9 , further comprising:

generating, at the second operational frequency, a fallback instruction for causing the transportable computer system to perform a fallback action;

generating, at the third operational frequency, a fallback trajectory based on the fallback instruction; and

outputting the fallback trajectory with the trajectory at a substantially same time.

14. The method of claim 9 , further comprising:

determining an occurrence of an event warranting a fallback action;

generating, at the fourth operational frequency, a fallback trajectory for causing the transportable computer system to perform the fallback action; and

executing the fallback trajectory to cause the transportable computer system to perform the fallback action.

15. A system comprising:

one or more processors; and

one or more computer readable storage media communicatively coupled to the one or more processors and storing one or more modules including instructions that are executable by the one or more processors, the one or more first modules comprising:

a route planning module configured to generate a route between a current location of the system and a target location of the system, the route planning module operating at a first operational frequency;

a decision module configured to generate an instruction based on the route, the instruction including a sequence of actions to guide the system along the route, the decision module operating at a second operational frequency;

a trajectory module configured to:

access real-time processed sensor data; and

generate an output trajectory based at least in part on the instruction and the real-time processed sensor data, the trajectory module operating at a third operational frequency; and

an execution module configured to generate one or more signals for causing the system to move along the output trajectory, the execution module operating at a fourth operational frequency.

16. The system of claim 15 , wherein the route planning module, the decision module, and the trajectory module are associated with a first computer system of the system and the execution module is associated with a second computer system of the system that is separate from the first computer system.

17. The system of claim 16 , the one or more modules further comprising a fallback determination module associated with the second computer system, the fallback determination module configured to:

determine an occurrence of an event warranting a fallback action;

access a fallback trajectory for causing the system to perform the fallback action; and

cause the fallback trajectory to be executed to cause the system to perform the fallback action.

18. The system of claim 17 , wherein the event comprises:

an object is within a threshold distance of the system;

an object is predicted to be within a threshold distance of the system;

an absence of communication between the first computer system and the second computer system;

a confusion level associated with the system is above a confusion threshold;

a failure associated with a sensor of the system;

a malfunction of a component associated with the system;

a change in an occupancy status associated with the system;

a change in a status of a drivable surface associated with the trajectory; or

a probability of a collision exceeds a threshold probability.

19. The system of claim 15 , wherein:

the first operational frequency is less than the second operational frequency;

the second operational frequency is less than the third operational frequency; and

the third operational frequency is less than the fourth operational frequency.

20. The system of claim 15 , wherein the decision module is further configured to:

access an executed trajectory;

compare the executed trajectory with the output trajectory;

generate feedback data based at least in part on comparing the executed trajectory and the output trajectory; and

updating at one or more of a model or an algorithm based at least in part on the feedback data.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 14, 2017
From: LINSCOTT, GARY; SOMERS, ROBERT EDWARD; KIISKI, JOONA MARKUS PETTERI; KOBILAROV, MARIN; CALDWELL, TIMOTHY; ASKELAND, JACOB LEE; REGE, ASHUTOSH GAJANAN; FUNKE, JOSEPH
To: ZOOX, INC.
Reel/Frame 043541/0087 →
Continuity (2)
Provisional Application 62465724 · Mar 1, 2017
Related Publication 20180251126A1 · Sep 6, 2018
Cited By (8)
US 1,075,837 US 1,075,838 US 1,085,115 US 1,137,256 US 12,209,869 US 12,269,462 US 12,384,410 US 12,481,066