Operation of an autonomous vehicle based on availability of navigational information
The subject matter described in this specification is directed to a computer system and techniques for operating an autonomous vehicle (AV) based on the availability of navigation information. In one example, while the AV is in an autonomous mode, first data is obtained from a first sensor and second data is obtained from a second sensor. A location of the AV is determined based on the first data and the second data. If navigational information is not available for the determined location, an alert is provided that the AV will exit the autonomous mode.
1. A system, comprising:
one or more computer processors; and
one or more non-transitory storage media storing instructions which, when executed by the one or more computer processors, cause the one or more computer processors to perform operations comprising:
operating a vehicle in an autonomous mode, wherein operating the vehicle in the autonomous mode comprises:
receiving sensor data associated with one or more objects within an environment of the vehicle;
causing control of at least one of steering, throttling or ignition of the vehicle based on the sensor data to navigate the vehicle to a destination;
determining a first geographic location of the vehicle using location data from a location sensor;
determining a second geographic location of the vehicle using the first geographic location, imaging data from an imaging sensor, and a semantic map comprising a map with annotated features, wherein the second geographic location is more precise than the first geographic location;
determining a predicted location of the vehicle based on the second geographic location of the vehicle;
in accordance with a determination that the annotated features of the semantic map are not available for determining geographical locations at the predicted location, providing an alert that the vehicle will exit the autonomous mode; and
in accordance with a determination that no operator control is detected after providing the alert:
maintaining operation of the vehicle in the autonomous mode; and
re-routing the vehicle by navigating the vehicle on a route that keeps the vehicle within an area in which the annotated features of the semantic map are available for determining geographical locations.
2. The system of claim 1 , wherein the instructions further cause the one or more computer processors to perform operations comprising:
in accordance with a determination that the annotated features of the semantic map are available for the predicted location, continuing operating the vehicle in the autonomous mode.
3. The system of claim 1 , wherein the instructions further cause the one or more computer processors to perform operations comprising:
in accordance with a determination that operator control is detected after providing the alert:
ceasing the autonomous mode; and
initiating an operator assisted mode.
4. The system of claim 3 , wherein the instructions further cause the one or more computer processors to perform operations comprising:
while the vehicle is operating in the operator assisted mode:
receiving one or more commands for navigating the vehicle from a navigation system remote from the vehicle; and
navigating the vehicle according to the one or more commands.
5. The system of claim 3 , wherein the instructions further cause the one or more computer processors to perform operations comprising:
while the vehicle is operating in the operator assisted mode:
capturing one or more features of the environment; and
providing the one or more captured features to a server to update the semantic map.
6. The system of claim 3 , wherein the instructions further cause the one or more computer processors to perform operations comprising:
while the vehicle is operating in the operator assisted mode:
obtaining first data from the location sensor;
obtaining second data from the imaging sensor;
determining a predicted third geographic location based on the first data obtained from the location sensor and the second data obtained from the imaging sensor;
in accordance with a determination that the annotated features of the semantic map are not available for determining geographical locations at the predicted third geographic location:
maintaining the operator assisted mode; and
in accordance with a determination that the annotated features of the semantic map are available for determining geographical locations at the predicted third geographic location:
ceasing the operator assisted mode; and
initiating the autonomous mode.
7. The system of claim 1 , wherein the predicted location of the vehicle based on the second geographic location of the vehicle is a predicted future location of the vehicle.
8. The system of claim 1 , wherein the instructions further cause the one or more computer processors to perform operations comprising:
determining that the annotated features of the semantic map are not available for determining geographical locations based on a determination that the imaging data from the imaging sensor or the location data from the location sensor is unavailable or inaccurate, wherein the location sensor is a GPS sensor.
9. The system of claim 1 , wherein the instructions further cause the one or more computer processors to perform operations comprising:
determining that the annotated features of the semantic map are not available for determining geographical locations based on a determination that the imaging data from the imaging sensor does not match data from the semantic map.
10. A method, comprising:
operating a vehicle in an autonomous mode, wherein operating the vehicle in the autonomous mode comprises:
receiving sensor data associated with one or more objects within an environment of the vehicle; and
causing control of at least one of steering, throttling or ignition of the vehicle based on the sensor data to navigate the vehicle to a destination;
determining a first geographic location of the vehicle using location data from a location sensor;
determining a second geographic location of the vehicle using the first geographic location, imaging data from an imaging sensor, and a semantic map comprising a map with annotated features, wherein the second geographic location is more precise than the first geographic location;
determining a predicted location of the vehicle based on the second geographic location of the vehicle;
in accordance with a determination that the annotated features of the semantic map are not available for determining geographical locations at the predicted location, providing an alert that the vehicle will exit the autonomous mode; and
in accordance with a determination that no operator control is detected after providing the alert:
maintaining operation of the vehicle in the autonomous mode; and
re-routing the vehicle by navigating the vehicle on a route that keeps the vehicle within an area in which the annotated features of the semantic map are available for determining geographical locations.
11. The method of claim 10 , further comprising:
in accordance with a determination that the annotated features of the semantic map are available for the predicted location, continuing operating the vehicle in the autonomous mode.
12. The method of claim 10 , further comprising:
in accordance with the determination that the annotated features of the semantic map are not available for determining geographical locations at the predicted location, navigating the vehicle without the imaging data from the imaging sensor.
13. The method of claim 10 , wherein the annotated features of the semantic map are not available for determining geographical locations at the predicted location when the predicted location corresponds to a region without the semantic map.
14. The method of claim 10 , further comprising:
in accordance with a determination that operator control is detected after providing the alert:
ceasing the autonomous mode; and
initiating an operator assisted mode.
15. The method of claim 14 , further comprising:
while the vehicle is operating in the operator assisted mode:
receiving one or more commands for navigating the vehicle from a navigation system remote from the vehicle; and
navigating the vehicle according to the one or more commands.
16. The method of claim 14 , further comprising:
while the vehicle is operating in the operator assisted mode:
capturing one or more features of the environment; and
providing the one or more captured features to a server to update the semantic map.
17. One or more non-transitory storage media storing instructions which, when executed by one or more computing devices, cause the one or more computing devices to perform operations comprising:
operating a vehicle in an autonomous mode, wherein operating the vehicle in the autonomous mode comprises:
receiving sensor data associated with one or more objects within an environment of the vehicle; and
causing control of at least one of steering, throttling or ignition of the vehicle based on the sensor data to navigate the vehicle to a destination;
determining a first geographic location of the vehicle using location data from a location sensor;
determining a second geographic location of the vehicle using the first geographic location, imaging data from an imaging sensor, and a semantic map comprising a map with annotated features, wherein the second geographic location is more precise than the first geographic location;
determining a predicted location of the vehicle based on the second geographic location of the vehicle;
in accordance with a determination that the annotated features of the semantic map are not available for determining geographical locations at the predicted location, providing an alert that the vehicle will exit the autonomous mode; and
in accordance with a determination that no operator control is detected after providing the alert:
maintaining operation of the vehicle in the autonomous mode; and
re-routing the vehicle by navigating the vehicle on a route that keeps the vehicle within an area in which the annotated features of the semantic map are available for determining geographical locations.