Image and video compression for remote vehicle assistance
View Patent ↗A vehicle may receive one or more images of an environment of the vehicle. The vehicle may also receive a map of the environment. The vehicle may also match at least one feature in the one or more images with corresponding one or more features in the map. The vehicle may also identify a given area in the one or more images that corresponds to a portion of the map that is within a threshold distance to the one or more features. The vehicle may also compress the one or more images to include a lower amount of details in areas of the one or more images other than the given area. The vehicle may also provide the compressed images to a remote system, and responsively receive operation instructions from the remote system.
1. A method comprising:
receiving, by a vehicle, one or more images of an environment of the vehicle;
receiving, by the vehicle, a map of the environment;
matching at least one feature in the one or more images with corresponding one or more features in the map;
based on the matching, identifying a given area in the one or more images that corresponds to a portion of the map that is within a threshold distance to the one or more features;
compressing, by the vehicle, the one or more images to include a lower amount of details in areas of the one or more images other than the given area;
providing, by the vehicle, the compressed images to a remote system; and
responsive to providing the compressed images, receiving operation instructions for the vehicle from the remote system.
2. The method of claim 1 , further comprising:
altering the received one or more images by replacing areas of the one or more images other than the given area with a given color, wherein compressing the one or more images comprises compressing the altered images.
3. The method of claim 1 , further comprising:
blurring, by the vehicle, areas of the one or more images other than the given area, wherein compressing the one or more images comprises compressing the blurred images.
4. The method of claim 1 , further comprising:
compressing, by the vehicle, an unaltered version of the received one or more images to generate one or more intermediate images; and
reducing, by the vehicle, an amount of details in areas of the intermediate images that correspond to areas of the received one or more images other than the given area, wherein compressing the one or more images comprises providing one or more final images having the reduced amount of details.
5. The method of claim 1 , wherein the one or more images are indicative of a video stream from a camera coupled to the vehicle.
6. The method of claim 1 , further comprising:
receiving, by the vehicle from the remote system, configuration data indicative of the threshold distance.
7. The method of claim 1 , wherein receiving the operation instructions comprises receiving an input from a human operator.
8. A vehicle comprising:
a camera coupled to the vehicle and configured to capture one or more images of an environment of the vehicle;
one or more processors; and
data storage configured to store instructions executable by the one or more processors to cause the vehicle to:
obtain the one or more images of the environment from the camera;
receive a map of the environment;
match at least one feature in the one or more images with corresponding one or more features in the map;
based on the match, identify a given area in the one or more images that corresponds to a a portion of the map that is within a threshold distance to the one or more features;
compress the one or more images to include a lower amount of details in areas of the one or more images other than the given area;
provide the compressed images to a remote system; and
responsive to providing the compressed images, receive operation instructions for the vehicle from the remote system.
9. The vehicle of claim 8 , wherein the instructions executable by the one or more processors further cause the vehicle to:
alter the received one or more images by replacing areas of the one or more images other than the given area with a given color, wherein compressing the one or more images comprises compressing the altered images.
10. The vehicle of claim 8 , wherein the instructions executable by the one or more processors further cause the vehicle to:
blur areas of the one or more images other than the given area, wherein compressing the one or more images comprises compressing the blurred images.
11. The vehicle of claim 8 , wherein the instructions executable by the one or more processors further cause the vehicle to:
compress an unaltered version of the received one or more images to generate one or more intermediate images; and
reduce an amount of details in areas of the intermediate images that correspond to areas of the received one or more images other than the given area, wherein compressing the one or more images comprises providing one or more final images having the reduced amount of details.
12. The vehicle of claim 8 , wherein the one or more images are indicative of a video stream from the camera.
13. The vehicle of claim 8 , wherein the instructions executable by the one or more processors further cause the vehicle to:
receive, from the remote system, configuration data indicative of the threshold distance.
14. The vehicle of claim 8 , wherein receiving the operation instructions comprises receiving an input from a human operator.
15. A non-transitory computer readable medium having stored therein instructions, that when executed by a device, cause the device to perform functions, the functions comprising:
receiving one or more images of an environment of the device;
receiving a map of the environment;
matching at least one feature in the one or more images with corresponding one or more features in the map;
based on the matching, identifying a given area in the one or more images that corresponds to a portion of the map that is within a threshold distance to the one or more features;
compressing the one or more images to include a lower amount of details in areas of the one or more images other than the given area;
providing the compressed images to a remote system; and
responsive to providing the compressed images, receiving operation instructions for the device from the remote system.
16. The non-transitory computer readable medium of claim 15 , the functions further comprising:
altering the received one or more images by replacing areas of the one or more images other than the given area with a given color, wherein compressing the one or more images comprises compressing the altered images.
17. The non-transitory computer readable medium of claim 15 , the functions further comprising:
blurring areas of the one or more images other than the given area, wherein compressing the one or more images comprises compressing the blurred images.
18. The non-transitory computer readable medium of claim 15 , the functions further comprising:
compressing an unaltered version of the received one or more images to generate one or more intermediate images; and
reducing an amount of details in areas of the intermediate images that correspond to areas of the received one or more images other than the given area, wherein compressing the one or more images comprises providing one or more final images having the reduced amount of details.
19. The non-transitory computer readable medium of claim 15 , wherein the one or more images are indicative of a video stream from a camera mounted to the device.
20. The non-transitory computer readable medium of claim 15 , the functions further comprising:
receiving, from the remote system, configuration data indicative of the threshold distance.