Method and system for switching between local and remote guidance instructions for autonomous vehicles
Disclosed herein are system, method, and computer program product embodiments for switching between local and remote guidance instructions for autonomous vehicles. For example, the method includes, in response to monitoring one or more actions of objects detected in a scene in which the autonomous robotic system is moving, causing the autonomous robotic system to slow or cease movement in the scene. The method includes detecting a trigger condition based on movement of the autonomous robotic system in the scene. In response to the one or more monitored actions and detecting the trigger condition, the method includes transmitting a remote guidance request to a remote server. After transmitting the remote guidance request, the method includes receiving remote guidance instructions from the remote server and causing the autonomous robotic system to begin operating according to the remote guidance instructions.
1. A method of guiding an autonomous robotic system, the method comprising, by a processor:
monitoring one or more actions of one or more objects detected in a scene in which the autonomous robotic system is moving to predict trajectories of the one or more objects;
in response to a trajectory of at least one detected object predicted to cause the autonomous robotic system to slow or cease movement at a future point in time, transmitting a remote guidance request to a remote server;
after transmitting the remote guidance request, receiving remote guidance instructions from the remote server; and
causing the autonomous robotic system to begin operating according to the remote guidance instructions, wherein operating according to the remote guidance instructions comprises:
reducing a minimum allowable buffer size within which the autonomous robotic system may approach one or more of the objects,
reducing a maximum allowable speed of the autonomous robotic system,
causing the autonomous robotic system to move in the scene according to the minimum allowable buffer size and the maximum allowable speed while receiving a plurality of keepalive messages from the remote server, and
in response to not receiving an expected keepalive message, reverting the minimum allowable buffer size and the maximum allowable speed to previous values.
2. The method of claim 1 , wherein operating according to the remote guidance instructions comprises:
reducing a minimum allowable buffer size within which the autonomous robotic system may approach one or more of the objects;
reducing a maximum allowable speed of the autonomous robotic system;
causing the autonomous robotic system to move in the scene according to the minimum allowable buffer size and the maximum allowable speed; and
after at least a threshold amount of time or distance, reverting the minimum allowable buffer size and the maximum allowable speed to previous values.
3. The method of claim 2 , wherein reducing the minimum allowable buffer size comprises reducing the minimum allowable buffer size by approximately 50%.
4. The method of claim 2 , wherein the minimum allowable buffer size includes a first distance from the autonomous robotic system in one direction relative to an orientation of the autonomous robotic system and a second distance from the autonomous robotic system in another direction relative to the orientation of the autonomous robotic system, wherein the first distance and the second distance are different.
5. The method of claim 1 , further comprising, in response to losing communication with the remote server, causing the autonomous robotic system to cease operating according to the remote guidance instructions.
6. The method of claim 1 , further comprising, in response to receiving instructions from the remote server to cease operating according to the remote guidance instructions, causing the autonomous robotic system to cease operating according to the remote guidance instructions.
7. The method of claim 1 , further comprising, in response to operating according to the remote guidance instructions for a threshold period of time, causing the autonomous robotic system to cease operating according to the remote guidance instructions.
8. The method of claim 1 , further comprising transmitting perception data to the remote server while operating according to the remote guidance instructions.
9. An autonomous robotic system comprising:
a processor; and
a memory that stores programming instructions that are configured to cause the processor to guide the autonomous robotic system by:
monitoring one or more actions of one or more objects detected in a scene in which the autonomous robotic system is moving to predict trajectories of the one or more objects;
in response to a trajectory of at least one detected object predicted to cause the autonomous robotic system to slow or cease movement at a future point in time, transmitting a remote guidance request to a remote server;
after transmitting the remote guidance request, receiving remote guidance instructions from the remote server; and
causing the autonomous robotic system to begin operating according to the remote guidance instructions, wherein operating according to the remote guidance instructions comprises:
reducing a minimum allowable buffer size within which the autonomous robotic system may approach one or more of the objects,
reducing a maximum allowable speed of the autonomous robotic system,
causing the autonomous robotic system to move in the scene according to the minimum allowable buffer size and the maximum allowable speed while receiving a plurality of keepalive messages from the remote server, and
in response to not receiving an expected keepalive message, reverting the minimum allowable buffer size and the maximum allowable speed to previous values.
10. The autonomous robotic system of claim 9 , wherein the programming instructions are further configured to cause the processor to guide the autonomous robotic system by:
reducing a minimum allowable buffer size within which the autonomous robotic system may approach one or more of the objects;
reducing a maximum allowable speed of the autonomous robotic system;
causing the autonomous robotic system to move in the scene according to the minimum allowable buffer size and the maximum allowable speed; and
after at least a threshold amount of time or distance, reverting the minimum allowable buffer size and the maximum allowable speed to previous values.
11. The autonomous robotic system of claim 10 , wherein reducing the minimum allowable buffer size comprises reducing the minimum allowable buffer size by approximately 50%.
12. The autonomous robotic system of claim 10 , wherein the minimum allowable buffer size includes a first distance from the autonomous robotic system in one direction relative to an orientation of the autonomous robotic system and a second distance from the autonomous robotic system in another direction relative to the orientation of the autonomous robotic system, wherein the first distance and the second distance are different.
13. The autonomous robotic system of claim 9 , wherein the programming instructions are further configured to cause the processor to guide the autonomous robotic system by, in response to losing communication with the remote server, causing the autonomous robotic system to cease operating according to the remote guidance instructions.
14. The autonomous robotic system of claim 9 , wherein the programming instructions are further configured to cause the processor to guide the autonomous robotic system by, in response to receiving instructions from the remote server to cease operating according to the remote guidance instructions, causing the autonomous robotic system to cease operating according to the remote guidance instructions.
15. The autonomous robotic system of claim 9 , wherein the programming instructions are further configured to cause the processor to guide the autonomous robotic system by, in response to operating according to the remote guidance instructions for a threshold period of time, causing the autonomous robotic system to cease operating according to the remote guidance instructions.
16. A non-transitory computer-readable medium having instructions stored thereon that, when executed by at least one computing device, cause the at least one computing device to perform operations comprising:
monitoring one or more actions of one or more objects detected in a scene in which an autonomous robotic system is moving, to predict trajectories of the one or more objects;
in response to a trajectory of at least one detected object predicted to cause the autonomous robotic system to slow or cease movement at a future point in time, transmitting a remote guidance request to a remote server;
after transmitting the remote guidance request, receiving remote guidance instructions from the remote server; and
causing the autonomous robotic system to begin operating according to the remote guidance instructions, wherein operating according to the remote guidance instructions comprises:
reducing a minimum allowable buffer size within which the autonomous robotic system may approach one or more of the objects,
reducing a maximum allowable speed of the autonomous robotic system,
causing the autonomous robotic system to move in the scene according to the minimum allowable buffer size and the maximum allowable speed while receiving a plurality of keepalive messages from the remote server, and
in response to not receiving an expected keepalive message, reverting the minimum allowable buffer size and the maximum allowable speed to previous values.
17. The method of claim 1 , wherein causing the autonomous robotic system to begin operating according to the remote guidance instructions comprises causing the autonomous robotic system to begin operating with no human intervention.
18. The autonomous robotic system of claim 9 , wherein the programming instructions configured to cause the processor to guide the autonomous robotic system by causing the autonomous robotic system to begin operating according to the remote guidance instructions comprise programming instructions configured to cause the processor to guide the autonomous robotic system by causing the autonomous robotic system to begin operating according to the remote guidance instructions with no human intervention.