Human supervision of an automated driving system
The present disclosure provides systems and methods that enable human supervision of a highly capable automated driving system. In particular, the systems and methods of the present disclosure enable a human (e.g., a passenger, driver/operator, or remote supervisor of an autonomous vehicle) to easily and quickly transition control of the autonomous vehicle from a primary motion plan that controls the vehicle towards a primary destination to a secondary motion plan that controls the vehicle to a safe state. As such, the systems and methods of the present disclosure enable advanced human supervision of autonomous vehicle behavior in which a human can cause an autonomous vehicle to operate in a risk-reduced manner or otherwise maneuver to a safe state, without requiring the human to actually assume manual control of the vehicle.
1. A computing system, comprising:
one or more processors; and
one or more non-transitory computer-readable media that collectively store instructions that, when executed by the one or more processors, cause the computing system to perform operations, the operations comprising:
receiving data representing a first motion plan for an autonomous vehicle and a second motion plan for the autonomous vehicle,
wherein the first motion plan is determined based at least in part on sensor data, and wherein the second motion plan is determined based at least in part on the sensor data and is separately determinable from the first motion plan;
prior to receiving an input from a passenger of the autonomous vehicle, issuing one or more first control signals to control the autonomous vehicle according to the first motion plan;
determining that the input is received from the passenger of the autonomous vehicle; and
in response to determining that the input is received, issuing one or more second control signals to abort the first motion plan and to control the autonomous vehicle according to the second motion plan.
2. The computing system of claim 1 , wherein the first motion plan controls the autonomous vehicle towards a first destination and the second motion plan controls the autonomous vehicle towards a second destination that is different than the first destination.
3. The computing system of claim 1 , wherein:
the second motion plan comprises an emergency motion plan; and
the input from the passenger of the autonomous vehicle comprises an input indicative of an emergency event.
4. The computing system of claim 1 , wherein:
the first motion plan is one of a plurality of first motion plans respectively for a plurality of time periods;
the second motion plan is one of a plurality of second motion plans respectively for the plurality of time periods;
issuing one or more first control signals comprises issuing the one or more first control signals to control the autonomous vehicle according to the first motion plans for each time period prior to receipt of the input from the passenger of the autonomous vehicle; and
issuing one or more second control signals comprises issuing the one or more second control signals to control the autonomous vehicle according to the second motion plans for each time period subsequent to receipt of the input from the passenger of the autonomous vehicle.
5. The computing system of claim 4 , wherein the plurality of second motion plans respectively control the autonomous vehicle to a plurality of different locations.
6. The computing system of claim 5 , wherein the input from the passenger corresponds to one of the plurality of different locations, and wherein the one or more second controls signals are issued to control the autonomous vehicle according to the second motion plan that corresponds to the input.
7. The computing system of claim 1 , wherein control of the autonomous vehicle according to the second motion plan brings the autonomous vehicle to rest while remaining within a current lane.
8. The computing system of claim 1 , wherein control of the autonomous vehicle according to the second motion plan causes the autonomous vehicle to exit a current lane.
9. The computing system of claim 1 , wherein the first motion plan is determined based at least in part on a first set of cost functions, and the second motion plan is determined based at least in part on a second set of cost functions.
10. The computing system of claim 1 , wherein the second motion plan controls the autonomous vehicle to a safe state.
11. The computing system of claim 10 , wherein the first motion plan comprises a first trajectory that moves the autonomous vehicle towards a first destination, and the second motion plan comprises a second trajectory that moves the autonomous vehicle to the safe state.
12. An autonomous vehicle, the autonomous vehicle comprising:
one or more processors; and
one or more non-transitory computer-readable media that collectively store instructions that, when executed by the one or more processors, cause the one or more processors to perform operations, the operations comprising:
receiving data representing a first motion plan for the autonomous vehicle and a second motion plan for the autonomous vehicle, wherein the first motion plan is determined based at least in part on sensor data, and wherein the second motion plan is determined based at least in part on the sensor data and is separately determinable from the first motion plan;
prior to receiving an input from a passenger of the autonomous vehicle, issuing one or more first control signals to control the autonomous vehicle according to the first motion plan;
determining that the input is received from the passenger of the autonomous vehicle; and
in response to determining that the input is received, issuing one or more second control signals to abort the first motion plan and to control the autonomous vehicle according to the second motion plan.
13. The autonomous vehicle of claim 12 , wherein the first motion plan is determined via a first motion planning module and the second motion plan is determined via a second motion planning module.
14. The autonomous vehicle of claim 12 , wherein the second motion plan controls the autonomous vehicle to a safe state.
15. The autonomous vehicle of claim 12 , wherein:
the second motion plan comprises an emergency motion plan; and
the input from the passenger of the autonomous vehicle comprises an input indicative of an emergency event.
16. The autonomous vehicle of claim 12 , wherein the second motion plan is one of a plurality of second motion plans, wherein the plurality of second motion plans respectively control the autonomous vehicle to a plurality of different locations, and wherein the input from the passenger corresponds to one of the plurality of different locations.
17. The autonomous vehicle of claim 12 , wherein control of the autonomous vehicle according to the second motion plan brings the autonomous vehicle to rest while remaining within a current lane.
18. The autonomous vehicle of claim 12 , wherein control of the autonomous vehicle according to the second motion plan causes the autonomous vehicle to exit a flow of traffic.
19. The autonomous vehicle of claim 12 , wherein the first motion plan controls the autonomous vehicle towards a first destination and the second motion plan controls the autonomous vehicle towards a second destination that is different than the first destination.
20. A computer implemented method implemented comprising:
receiving, by a computing system comprising one or more computing devices, data representing the first motion plan for an autonomous vehicle and the second motion plan for the autonomous vehicle,
wherein the first motion plan is determined based at least in part on sensor data, and wherein the second motion plan is determined based at least in part on the sensor data and is separately determinable from the first motion plan;
prior to receiving an input from a user of the autonomous vehicle, issuing one or more first control signals to control the autonomous vehicle according to the first motion plan;
determining that the input is received from the user of the autonomous vehicle; and
in response to determining that the input is received, issuing one or more second control signals to abort the first motion plan and to control the autonomous vehicle according to the second motion plan.