Image and video compression for remote vehicle assistance
A vehicle may receive one or more images of an environment of the vehicle. The vehicle may also receive a map of the environment. The vehicle may also match at least one feature in the one or more images with corresponding one or more features in the map. The vehicle may also identify a given area in the one or more images that corresponds to a a portion of the map that is within a threshold distance to the one or more features. The vehicle may also compress the one or more images to include a lower amount of details in areas of the one or more images other than the given area. The vehicle may also provide the compressed images to a remote system, and responsively receive operation instructions from the remote system.
1. A method comprising:
receiving, by a vehicle, an image of an environment of the vehicle;
identifying, by the vehicle, a driving decision for which a remote system is to provide assistance;
defining, by the vehicle, an area of interest within the image that is relevant to making the driving decision for the vehicle;
compressing, by the vehicle, the image to include a lower amount of detail in areas of the image other than the defined area of interest;
providing, by the vehicle, the compressed image to the remote system; and
responsive to providing the compressed image, receiving operation instructions for the vehicle from the remote system, wherein the operation instructions comprise the driving decision.
2. The method of claim 1 , further comprising:
altering the received image by replacing areas of the image other than the defined area of interest with a given color, wherein compressing the image comprises compressing the altered image; or
blurring, by the vehicle, areas of the image other than the defined area of interest, wherein compressing the image comprises compressing the blurred image.
3. The method of claim 1 , wherein the driving decision comprises instructions to the vehicle to slow down or change lanes.
4. The method of claim 1 , further comprising:
compressing, by the vehicle, an unaltered version of the received image to generate an intermediate image; and
reducing, by the vehicle, an amount of details in areas of the intermediate image that correspond to areas of the received image other than the defined area of interest, wherein compressing the image comprises providing a final image having the reduced amount of details.
5. The method of claim 1 , wherein the area of interest comprises a road on which the vehicle is driving or an immediate vicinity of the road on which the vehicle is driving.
6. The method of claim 1 , further comprising:
receiving, by the vehicle from the remote system, configuration data indicative of a threshold distance, wherein the area of interest within the image is defined based on the threshold distance.
7. The method of claim 1 , wherein receiving the operation instructions comprises receiving an input from a human operator, and wherein the image is indicative of a video stream from a camera coupled to the vehicle.
8. A vehicle comprising:
a camera configured to capture an image of an environment of the vehicle;
one or more processors; and
data storage configured to store instructions executable by the one or more processors to cause the vehicle to:
obtain the image from the camera;
identify a driving decision for which a remote system is to provide assistance;
define an area of interest within the image that is relevant to making the driving decision for the vehicle;
compress the image to include a lower amount of detail in areas of the image other than the defined area of interest;
provide the compressed image to the remote system; and
responsive to providing the compressed image, receive operation instructions for the vehicle from the remote system, wherein the operation instructions comprise the driving decision.
9. The vehicle of claim 8 , wherein the instructions executable by the one or more processors further cause the vehicle to:
alter the received image by replacing areas of the image other than the defined area of interest with a given color, wherein compressing the image comprises compressing the altered image; or
blur areas of the image other than the defined area of interest, wherein compressing the image comprises compressing the blurred image.
10. The vehicle of claim 8 , wherein the driving decision comprises instructions to the vehicle to slow down or change lanes.
11. The vehicle of claim 8 , wherein the instructions executable by the one or more processors further cause the vehicle to:
compress an unaltered version of the received image to generate an intermediate image; and
reduce an amount of details in areas of the intermediate image that correspond to areas of the received image other than the defined area of interest, wherein compressing the image comprises providing a final image having the reduced amount of details.
12. The vehicle of claim 8 , wherein the area of interest comprises a road on which the vehicle is driving or an immediate vicinity of the road on which the vehicle is driving.
13. The vehicle of claim 8 , wherein the instructions executable by the one or more processors further cause the vehicle to:
receive, from the remote system, configuration data indicative of a threshold distance, wherein the area of interest within the image is defined based on the threshold distance.
14. The vehicle of claim 8 , wherein receiving the operation instructions comprises receiving an input from a human operator, and wherein the image is indicative of a video stream from a camera coupled to the vehicle.
15. A non-transitory computer-readable medium having stored therein instructions, that when executed by a device, cause the device to perform functions, the functions comprising:
receiving an image of an environment of a vehicle associated with the device;
identifying a driving decision for the vehicle for which a remote system is to provide assistance;
defining an area of interest within the image that is relevant to making the driving decision for the vehicle;
compressing the image to include a lower amount of detail in areas of the image other than the defined area of interest;
providing the compressed image to the remote system; and
responsive to providing the compressed image, receiving operation instructions for the device from the remote system, wherein the operation instructions comprise the driving decision.
16. The non-transitory computer-readable medium of claim 15 , the functions further comprising:
altering the received image by replacing areas of the image other than the defined area of interest with a given color, wherein compressing the image comprises compressing the altered image; or
blurring areas of the image other than the defined area of interest, wherein compressing the image comprises compressing the blurred image.
17. The non-transitory computer-readable medium of claim 15 , wherein the driving decision comprises instructions to the vehicle to slow down or change lanes.
18. The non-transitory computer-readable medium of claim 15 , the functions further comprising:
compressing an unaltered version of the received image to generate an intermediate image; and
reducing an amount of details in areas of the intermediate image that correspond to areas of the received image other than the defined area of interest, wherein compressing the image comprises providing a final image having the reduced amount of details.
19. The non-transitory computer-readable medium of claim 15 , wherein the area of interest comprises a road on which the vehicle is driving or an immediate vicinity of the road on which the vehicle is driving.
20. The non-transitory computer-readable medium of claim 15 , the functions further comprising:
receiving, from the remote system, configuration data indicative of a threshold distance, wherein the area of interest within the image is defined based on the threshold distance.