Techniques for navigating vehicles using teleoperator instructions

1. An autonomous vehicle comprising:

a sensor;

one or more processors; and

memory storing instructions that, when executed by the one or more processors, configure the autonomous vehicle to perform operations comprising:

receiving sensor data from the sensor at a first location;

determining, based at least in part on the sensor data, that progress of the autonomous vehicle is impeded by an object;

transmitting the sensor data to one or more computing devices associated with a remote operator;

transmitting, to the one or more computing devices, an indication that a portion of the sensor data represents the object that is impeding the progress of autonomous vehicle;

receiving an instruction associated with navigating the autonomous vehicle;

based at least in part on the instruction and at the autonomous vehicle, determining a set of controls to begin navigating from the first location to a second location along the route;

and causing the autonomous vehicle to be controlled by the set of controls.

2. The autonomous vehicle as recited in claim 1 , the operations further comprising:

determining, while navigating to the second location, that the object begins moving; and

based at least in part on the determining that the object begins moving, causing the autonomous vehicle to yield to the object.

3. The autonomous vehicle as recited in claim 1 , the operations further comprising:

receiving, from the one or more computing devices, an additional indication of an area that surrounds the object;

determining, while navigating to the second location, that the object is located outside of the area; and

based at least in part on the object being located outside of the area, causing the autonomous vehicle to yield to the object.

4. The autonomous vehicle as recited in claim 1 , the operations further comprising:

storing data representing one or more policies associated with navigating the autonomous vehicle, the one or more policies including at least one of:

a first policy to yield to objects that arrive at an intersection before the autonomous vehicle; or

a second policy to stay in a driving lane when navigating; and

based at least in part on the instruction, determining to temporarily forego following at least one of the one or more policies.

5. The autonomous vehicle as recited in claim 1 , the operations further comprising:

setting a first action associated with the object, the first action being to follow the object; and

based at least in part on the instruction, setting a second action associated with the object, the second action being to cease following the object.

6. A method comprising:

receiving sensor data from a sensor on a vehicle;

determining, based at least in part on the sensor data, that progress of the vehicle along a route is impeded by an object in the environment;

transmitting at least a portion of the sensor data to one or more computing devices associated with a remote operator;

generating indicator data that identifies the object;

transmitting the indicator data to the one or more computing devices associated with the remote operator;

receiving, from the one or more computing devices, an instruction altering a policy associated with the object; and

based at least in part on the instruction, causing the vehicle to navigate to a location.

7. The method as recited in claim 6 , wherein:

the indicator data indicates that the vehicle is yielding to the object; and

the altering the policy comprises instructing the vehicle to stop yielding to the object.

8. The method as recited in claim 6 , further comprising:

determining, while navigating to the location, that the object begins moving; and

based at least in part on the determining that the object begins moving, causing the vehicle to yield to the object.

9. The method as recited in claim 6 , further comprising:

receiving, from the one or more computing devices, an area that surrounds the object;

determining, while navigating to the location, that the object is located outside of the area; and

based at least in part on the object being located outside of the area, causing the vehicle to yield to the object.

10. The method as recited in claim 6 , wherein:

the policy comprises at least one of:

a first policy to yield to objects that arrive at an intersection before the vehicle, or

a second policy to stay in a driving lane when navigating, and

the altering the policy comprises determining to temporarily forego following at least one of the first policy or the second policy.

11. The method as recited in claim 10 , further comprising, after navigating to the location, determining to again follow the first policy or the second policy.

12. The method as recited in claim 6 , further comprising:

setting a first action associated with the object, the first action being to follow the object,

wherein the altering the policy comprises setting a second action associated with the object, the second action being to cease following the object.

13. The method as recited in claim 6 , further comprising determining whether to impede progress of the vehicle to another object based at least in part on the progress.

14. The method as recited in claim 6 , wherein the indicator data that identifies the object comprises data identifying an additional portion of the sensor data that represents the object.

15. The method as recited in claim 6 , further comprising:

based at least in part on the instruction, altering the policy associated with the object; and

based at least in part on the altering of the policy, determining an action for how to proceed to the location,

wherein the causing the vehicle to navigate to the location is based at least in part on the action.

16. One or more non-transitory computer-readable media storing instructions that, when executed by one or more processors, cause one or more computing devices to perform operations comprising:

receiving sensor data from a sensor on a vehicle;

determining, based at least in part on the sensor data, that an object has caused the vehicle to be impeded from navigating to a location;

transmitting at least a portion of the sensor data to one or more computing devices associated with a remote operator;

receiving, from the one or more computing devices, an instruction to alter a policy with respect to the object;

based at least in part on altering the policy with respect to the object, determining an action for causing the vehicle to navigate to the location; and

causing, based at least in part on the action, the vehicle to navigate to the location.

17. The one or more non-transitory computer-readable media as recited in claim 16 , the operations further comprising transmitting, to the one or more computing devices, an indication that the object has caused the vehicle to be impeded from navigating to the location.

18. The one or more non-transitory computer-readable media as recited in claim 16 , the operations further comprising:

determining, while navigating to the location, that the object begins moving; and

based at least in part on the determining that the object begins moving, causing the vehicle to perform an additional action.

19. The one or more non-transitory computer-readable media as recited in claim 16 , the operations further comprising:

receiving, from the one or more computing devices, an area associated with the object;

determining, while navigating to the location, that the object is located outside of the area; and

based at least in part on the object being located outside of the area, causing the vehicle to perform an additional action.

20. The one or more non-transitory computer-readable media as recited in claim 16 , wherein:

the policy comprises one or more of:

a first policy to yield to objects that arrive at an intersection before the vehicle, or

a second policy to stay in a driving lane when navigating, and

the operations further comprise, based at least in part on the instruction, determining to temporarily forego following at least one of the first policy or the second policy.