Normalization of intelligent transport system handling characteristics
In a vehicle system that can receive remote support from a remote support server (e.g., interfacing with a human or computer teleoperator), a local normalization engine locally normalizes operation of the vehicle based on locally available sensor data that may not be accessible to the remote support server. The local normalization engine applies transformations to control commands received from the remote support server to transform the command to compensate for conditions that are locally sensed and may be unknown to the remote support server. Alternatively, or in addition, the local normalization engine controls auxiliary functions of the vehicle (e.g., by activating one or more auxiliary actuators) that may not be under direct control of the remote support server.
1. A method for controlling a vehicle comprising:
obtaining primary sensor data from a primary sensor array of a vehicle;
communicating the primary sensor data to a remote support server;
receiving from the remote support server, control commands for controlling a drive system of the vehicle;
obtaining auxiliary sensor data from an auxiliary sensor array of the vehicle;
determining an intended effect of the control commands under default vehicle conditions;
determining, based on sensed conditions derived from the auxiliary sensor data, a transformation that when applied to the control commands is predicted to achieve the intended effect under the sensed conditions;
transforming the control commands based on the transformation to generate transformed control data; and
controlling a primary actuator array based on the transformed control commands to control driving of the vehicle.
2. The method of claim 1 , wherein the auxiliary sensor data includes at least one set of auxiliary data different from the primary sensor data, wherein the auxiliary data is available locally at the vehicle and is not provided to the remote support server.
3. The method of claim 1 , wherein transforming the control commands comprises transforming at least one a steering command, an acceleration command, and a braking command.
4. The method of claim 1 , wherein transforming the control commands comprises:
applying a machine-learned model to transform the control commands based on the sensed conditions.
5. A method for controlling a vehicle comprising:
obtaining primary sensor data from a primary sensor array of a vehicle;
communicating the primary sensor data to a remote support server;
receiving from the remote support server, control commands for controlling a drive system of the vehicle;
obtaining auxiliary sensor data from an auxiliary sensor array of the vehicle;
transforming the control commands based on sensed conditions derived from the auxiliary sensor data to generate transformed control data; and
controlling a primary actuator array based on the transformed control commands to control driving of the vehicle;
determining, based on the auxiliary sensor data, that a state parameter of the vehicle is outside a predefined range;
generating vehicle stabilization commands that operate to restore the state parameter to within the predefined range; and
controlling an auxiliary actuator array to execute the vehicle stabilization commands.
6. The method of claim 5 , wherein the auxiliary actuator array includes at least one actuator that is not under direct control of the remote support server.
7. The method of claim 5 , wherein the auxiliary sensor data includes at least one set of auxiliary data different from the primary sensor data, wherein the auxiliary data is available locally at the vehicle and is not provided to the remote support server.
8. The method of claim 5 , wherein transforming the control commands comprises transforming at least one a steering command, an acceleration command, and a braking command.
9. A method for controlling a vehicle comprising:
obtaining primary sensor data from a primary sensor array of a vehicle;
communicating the primary sensor data to a remote support server;
receiving from the remote support server, first control commands for controlling a drive system of the vehicle;
transforming the first control commands based on an initial transformation parameter to generate first transformed control commands;
controlling a primary actuator array based on the first transformed control commands to control driving of the vehicle;
obtaining auxiliary sensor data from an auxiliary sensor array of the vehicle;
determining, based on the auxiliary sensor data, an error between planned motion of the vehicle and sensed motion of the vehicle;
adjusting the initial transformation parameter based on the error to generate an updated transformation parameter;
receiving from the remote support server, second control commands for controlling the drive system of the vehicle;
transforming the second control commands based on the updated transformation parameter to generate second transformed control commands; and
controlling the primary actuator array based on the second transformed control commands to control driving of the vehicle.
10. The method of claim 9 , wherein the auxiliary sensor data includes at least one set of auxiliary data different from the primary sensor data, wherein the auxiliary data is available locally at the vehicle and is not provided to the remote support server.
11. The method of claim 9 , wherein transforming the first control commands comprises transforming at least one a steering command, an acceleration command, and a braking command.
12. A non-transitory computer-readable storage medium storing instructions for controlling a vehicle, the instructions when executed by a processor cause the processor to perform steps including:
obtaining primary sensor data from a primary sensor array of a vehicle;
communicating the primary sensor data to a remote support server;
receiving from the remote support server, control commands for controlling a drive system of the vehicle;
obtaining auxiliary sensor data from an auxiliary sensor array of the vehicle;
determining an intended effect of the control commands under default vehicle conditions;
determining, based on sensed conditions derived from the auxiliary sensor data, a transformation that when applied to the control commands is predicted to achieve the intended effect under the sensed conditions;
transforming the control commands based on the transformation to generate transformed control data; and
controlling a primary actuator array based on the transformed control commands to control driving of the vehicle.
13. The non-transitory computer-readable storage medium of claim 12 , wherein the auxiliary sensor data includes at least one set of auxiliary data different from the primary sensor data, wherein the auxiliary data is available locally at the vehicle and is not provided to the remote support server.
14. The non-transitory computer-readable storage medium of claim 12 , wherein transforming the control commands comprises transforming at least one a steering command, an acceleration command, and a braking command.
15. The non-transitory computer-readable storage medium of claim 12 , wherein transforming the control commands comprises:
applying a machine-learned model to transform the control commands based on the sensed conditions.
16. A non-transitory computer-readable storage medium storing instructions for controlling a vehicle, the instructions when executed by a processor cause the processor to perform steps including:
obtaining primary sensor data from a primary sensor array of a vehicle;
communicating the primary sensor data to a remote support server;
receiving from the remote support server, control commands for controlling a drive system of the vehicle;
obtaining auxiliary sensor data from an auxiliary sensor array of the vehicle;
transforming the control commands based on sensed conditions derived from the auxiliary sensor data to generate transformed control data; and
controlling a primary actuator array based on the transformed control commands to control driving of the vehicle;
determining, based on the auxiliary sensor data, that a state parameter of the vehicle is outside a predefined range;
generating vehicle stabilization commands that operate to restore the state parameter to within the predefined range; and
controlling an auxiliary actuator array to execute the vehicle stabilization commands.
17. The non-transitory computer-readable storage medium of claim 16 , wherein the auxiliary actuator array includes at least one actuator that is not under direct control of the remote support server.
18. The non-transitory computer-readable storage medium of claim 16 , wherein transforming the control commands comprises transforming at least one a steering command, an acceleration command, and a braking command.
19. A non-transitory computer-readable storage medium storing instructions for controlling a vehicle, the instructions when executed by a processor cause the processor to perform steps including:
obtaining primary sensor data from a primary sensor array of a vehicle;
communicating the primary sensor data to a remote support server;
receiving from the remote support server, first control commands for controlling a drive system of the vehicle;
transforming the first control commands based on an initial transformation parameter to generate first transformed control commands;
controlling a primary actuator array based on the first transformed control commands to control driving of the vehicle;
obtaining auxiliary sensor data from an auxiliary sensor array of the vehicle;
determining, based on the auxiliary sensor data, an error between planned motion of the vehicle and sensed motion of the vehicle;
adjusting the initial transformation parameter based on the error to generate an updated transformation parameter;
receiving from the remote support server, second control commands for controlling the drive system of the vehicle;
transforming the second control commands based on the updated transformation parameter to generate second transformed control commands; and
controlling the primary actuator array based on the second transformed control commands to control driving of the vehicle.
20. The non-transitory computer-readable storage medium of claim 19 , wherein transforming the first control commands comprises transforming at least one a steering command, an acceleration command, and a braking command.