Using transmission sensor(s) in localization of an autonomous vehicle
Systems and methods for using transmission sensor(s) in localization of an autonomous vehicle (“AV”) are described herein. Some implementations receive instance(s) of transmission sensor data generated by transmission sensor(s) of the AV, generate pose instance(s) of a pose of the AV based on the instance(s) of the transmission sensor data, and cause the AV to be controlled based on the pose instance(s). In some of those implementations, the pose instance(s) can be generated based on steering data the AV that indicates steering angle(s) of the autonomous, and that temporally correspond to the instance(s) of the transmission sensor data. In various implementations, the pose instance(s) may only be generated or utilized based on the instance(s) of the transmission sensor data (and optionally the steering data) in response to detecting an adverse event at the AV.
1. A method for localization of an autonomous vehicle (AV), the method comprising:
receiving a transmission sensor data instance generated by a transmission sensor of the AV;
determining steering data of the AV that indicates a steering angle of the AV, and that temporally corresponds to the transmission sensor data instance, wherein determining the steering data of the AV comprises:
receiving, from a steering sensor of the AV, a steering sensor data instance generated by the steering sensor of the AV;
processing, using a transmission model, the transmission sensor data instance and the steering sensor data instance, along with one or more properties of the AV, to generate output that indicates a road-wheel angle of a simulated center wheel of the AV; and
using the road-wheel angle of the simulated center wheel of the AV as the steering data of the AV;
generating, based on the transmission sensor data instance and based on the steering data of the AV that temporally corresponds to the transmission sensor data instance, a pose instance of a pose of the AV; and
causing the AV to be controlled based on the pose instance of the AV.
2. The method of claim 1 , further comprising:
detecting an adverse event at the AV,
wherein causing the AV to be controlled based on the pose instance of the AV, that is generated based on the transmission sensor data instance, is in response to detecting the adverse event at the AV.
3. The method of claim 2 , wherein detecting the adverse event comprises detecting that one or more wheel encoders of the AV have failed.
4. The method of claim 2 , wherein causing the AV to be controlled based on the pose instance of the AV comprises causing the AV to perform a controlled stop based on the pose instance of the AV.
5. The method of claim 2 , further comprising:
prior to detecting the adverse event at the AV:
receiving a first sensor data instance generated by one or more first sensors of the AV, wherein the one or more first sensors of the AV do not include the transmission sensor;
generating, based on the first sensor data instance, a prior pose instance of the pose of the AV; and
causing the AV to be controlled based on the prior pose instance of the AV.
6. The method of claim 1 , further comprising
comparing the pose instance to an additional pose instance of the pose of the AV, wherein the additional pose instance is generated based on an IMU data instance generated by one or more IMUs of the AV and a wheel encoder data instance generated by one or more wheel encoders of the AV, and wherein both the IMU data instance and the wheel encoder data instance temporally correspond to the transmission sensor data instance;
determining, based on the comparing, an error in the additional pose instance; and
wherein causing the AV to be controlled based on the pose instance of the AV is in response to determining the error in the additional pose instance satisfies an error threshold.
7. An autonomous vehicle (AV) control system comprising:
at least one processor; and
at least one memory storing instructions that are operable, when executed by the at least one processor, cause the at least one processor to perform operations comprising:
receiving a transmission sensor data instance generated by a transmission sensor of the AV;
determining steering data of the AV that indicates a steering angle of the AV, and that temporally corresponds to the transmission sensor data instance, wherein determining the steering data of the AV comprises:
receiving, from one or more IMUs of the AV, an IMU data instance generated by one or more of the IMUs of the AV;
processing, using a transmission model, the transmission sensor data instance and the IMU data instance, along with one or more properties of the AV, to generate output that indicates a road-wheel angle of a simulated center wheel of the AV; and
using the road-wheel angle of the simulated center wheel of the AV as the steering data of the AV;
generating, based on the transmission sensor data instance and based on the steering data of the AV that temporally corresponds to the transmission sensor data instance, a pose instance of a pose of the AV; and
causing the AV to be controlled based on the pose instance of the AV.
8. The AV control system of claim 7 , wherein the operations further comprise:
detecting an adverse event at the AV,
wherein causing the AV to be controlled based on the pose instance of the AV, that is generated based on the transmission sensor data instance, is in response to detecting the adverse event at the AV.
9. The AV control system of claim 8 , wherein detecting the adverse event comprises detecting that one or more wheel encoders of the AV have failed.
10. The AV control system of claim 8 , wherein causing the AV to be controlled based on the pose instance of the AV comprises causing the AV to perform a controlled stop based on the pose instance of the AV.
11. The AV control system of claim 8 , wherein the operations further comprise:
prior to detecting the adverse event at the AV:
receiving a first sensor data instance generated by one or more first sensors of the AV, wherein the one or more first sensors of the AV do not include the transmission sensor;
generating, based on the first sensor data instance, a prior pose instance of the pose of the AV; and
causing the AV to be controlled based on the prior pose instance of the AV.
12. An autonomous vehicle (AV) comprising:
one or more sensors;
at least one processor; and
at least one memory storing instructions that are operable, when executed by the at least one processor, cause the at least one processor to perform operations comprising:
receiving, from a first sensor of the one or more sensors, a transmission sensor data instance generated by the first sensor of the AV;
determining steering data of the AV that indicates a steering angle of the AV, and that temporally corresponds to the transmission sensor data instance, wherein determining the steering data of the AV comprises:
receiving, from one or more IMUs of the AV, an IMU data instance generated by one or more of the IMUs of the AV;
processing, using a transmission model, the transmission sensor data instance and the IMU data instance, along with one or more properties of the AV, to generate output that indicates a first road-wheel angle of a first front wheel of the AV and a second road-wheel angle of a second front wheel of the AV; and
using the first road-wheel angle of the first front wheel of the AV and the second road-wheel angle of the second front wheel of the AV as the steering data of the AV;
generating, based on the transmission sensor data instance and based on the steering data of the AV that temporally corresponds to the transmission sensor data instance, a pose instance of a pose of the AV; and
causing the AV to be controlled based on the pose instance of the AV.
13. The AV of claim 12 , wherein the operations further comprise:
detecting an adverse event at the AV,
wherein causing the AV to be controlled based on the pose instance of the AV, that is generated based on the transmission sensor data instance, is in response to detecting the adverse event at the AV.
14. The AV of claim 13 , wherein the operations further comprise:
prior to detecting the adverse event at the AV:
receiving a first sensor data instance generated by one or more first sensors of the AV, wherein the one or more first sensors of the AV do not include the transmission sensor;
generating, based on the first sensor data instance, a prior pose instance of the pose of the AV; and
causing the AV to be controlled based on the prior pose instance of the AV.