Assisted perception for autonomous vehicles
Disclosed herein are systems and methods for providing supplemental identification abilities to an autonomous vehicle system. The sensor unit of the vehicle may be configured to receive data indicating an environment of the vehicle, while the control system may be configured to operate the vehicle. The vehicle may also include a processing unit configured to analyze the data indicating the environment to determine at least one object having a detection confidence below a threshold. Based on the at least one object having a detection confidence below a threshold, the processor may communicate at least a subset of the data indicating the environment for further processing. The vehicle is also configured to receive an indication of an object confirmation of the subset of the data. Based on the object confirmation of the subset of the data, the processor may alter the control of the vehicle by the control system.
1. An apparatus comprising:
a wireless communication system of the apparatus configured to communicate with a remote computer system, wherein the communication system is configured to:
transmit a preliminary object identification of at least one object of an environment of the apparatus from the apparatus to the remote computer system, wherein the preliminary object identification is based on a detected object having a confidence below a confidence threshold;
receive a course of action from the remote computer system;
a control system of the apparatus, configured to operate the apparatus in an autonomous operation mode based on instructions to control the apparatus; and
one or more processors of the apparatus configured to:
determine, based on data from one or more sensors, the preliminary object identification of at least one object of the environment;
stopping the vehicle based on the preliminary object identification; and
provide instructions to the control system based on the course of action.
2. The apparatus of claim 1 , wherein the one or more processors are further configured to determine at least one proposed course of action and wherein the communication system is further configured to transmit the at least one proposed course of action.
3. The apparatus of claim 2 , wherein the at least one proposed course of action comprising passing an obstacle.
4. The apparatus of claim 1 , further comprising at least one sensor of the apparatus configured to receive data, wherein the data represents objects of an environment of the autonomous vehicle.
5. The apparatus of claim 4 , wherein:
the wireless communication system is further configured to receive a request to adjust a sensor position from the remote computer system;
the one or more processors are further configured to adjust a sensor position; and
the communication system is further configured to transmit sensor data from a sensor having the adjusted sensor position to the remote computer system.
6. The apparatus of claim 4 , wherein the at least one sensor comprises at least one of a LIDAR sensor, a camera sensor, a microphone, and a radar sensor.
7. The apparatus of claim 1 , wherein the course of action comprises instructions to switch a mode of the autonomous vehicle to a human-controlled mode.
8. A method comprising:
operating an autonomous vehicle by a control system;
determine, based on data from one or more sensors of the autonomous vehicle, a preliminary object identification of at least one object of the environment by a processor of the autonomous vehicle, wherein the preliminary object identification is based on a detected object having a confidence below a confidence threshold;
stopping, by a control system of the autonomous vehicle, the vehicle based on the preliminary object identification;
transmitting, by a communication system of the autonomous vehicle, a preliminary object identification of at least one object of an environment of the apparatus to a remote computer system;
receiving, by the communication system of the autonomous vehicle, a course of action from the remote computer system; and
provide instructions to the control system based on the course of action.
9. The method of claim 8 , further comprising:
determining, by the processor, at least one proposed course of action; and
transmitting, by the communication system, the at least one proposed course of action to the remote computer system.
10. The method of claim 9 , wherein the at least one proposed course of action comprising passing an obstacle.
11. The method of claim 8 , further comprising receiving data, by the processor, from at least one sensor, wherein the data represents objects of an environment of the autonomous vehicle.
12. The method of claim 11 , further comprising:
receiving a request, by the communication system, to adjust a sensor position from the remote computer system;
adjusting a sensor position of the at least one sensor; and
transmitting, by the communication system, sensor data from a sensor having the adjusted sensor position to the remote computer system.
13. The method of claim 11 , wherein transmitting a preliminary object identification comprises transmitting sensor data of the object.
14. The method of claim 8 , wherein the course of action comprises switching a mode of the autonomous vehicle to a human-controlled mode.
15. An article of manufacture including a non-transitory computer-readable medium having stored thereon instructions that, when executed by at least one processor in a vehicle system, causes the vehicle system to perform operations comprising:
operating the autonomous vehicle by a control system;
determine, based on data from one or more sensors, the preliminary object identification of at least one object of the environment, wherein the preliminary object identification is based on a detected object having a confidence below a confidence threshold;
stopping the vehicle based on the preliminary object identification;
transmitting a preliminary object identification of at least one object of an environment of the apparatus to a remote computer system;
receiving a course of action from the remote computer system; and
provide instructions to the control system based on the course of action.
16. The article of manufacture according to claim 15 , further comprising:
determining at least one proposed course of action; and
transmitting the at least one proposed course of action to the remote computer system.
17. The article of manufacture according to claim 16 , wherein the at least one proposed course of action comprising passing an obstacle.
18. The article of manufacture according to claim 15 , further comprising receiving, by a communication system, data from at least one sensor, wherein the data represents objects of an environment of the autonomous vehicle.
19. The article of manufacture according to claim 18 , further comprising:
receiving a request to adjust a sensor position from the remote computer system;
adjusting a sensor position for the at least one sensor; and
transmitting sensor data from a sensor having the adjusted sensor position to the remote computer system.
20. The article of manufacture according to claim 15 , wherein the course of action comprises switching a mode of the autonomous vehicle to a human-controlled mode.