Collaborative relationship between a vehicle and a UAV
Exemplary embodiments described in this disclosure are generally directed to a collaborative relationship between a vehicle and a UAV. In one exemplary implementation, a computer that is provided in the vehicle uses images captured by an imaging system in the UAV together with images captured by an imaging system in the vehicle, to modify a suspension system of the vehicle based on a nature of the terrain located below, or ahead, of the vehicle. The computer may, for example, modify a suspension system before the vehicle reaches a rock or a pothole on the ground ahead. In another exemplary implementation, the computer may generate an augmented reality image that includes a 3D model of the vehicle rendered on an image of a terrain located below, or ahead of, the vehicle. The augmented reality image may be used by a driver of the vehicle to drive the vehicle over such terrain.
1. A method comprising:
receiving, by a computer of a vehicle and from an unmanned aerial vehicle (UAV) in communication with the vehicle, at least a first image of a first section of a ground surface;
capturing, by an imaging system of the vehicle, at least a second image of a second section of the ground surface located below the vehicle, the second image including at least a part of the first section of the ground surface;
generating, by the computer and based on the first image and the second image, terrain information of the ground surface;
modifying, by the computer and based the terrain information, at least one driving characteristic of the vehicle;
spatially matching the first image to the second image by identifying at least a first topographic feature that is present in each of the first image and the second image;
generating a first topographic representation of the first image and a second topographic representation of the second image, wherein the first topographic representation includes the first topographical feature and the second topographic representation includes the first topographical feature;
spatially aligning the first topographic representation of the first image with the second topographic representation of the second image based on a location of the first topographic feature in the first topographic representation and a location of the first topographic feature in the second topographic representation;
determining, by the computer located in the vehicle, at least one of an angular orientation of a chassis of the vehicle with respect to the ground surface and an angle of a wheel of the vehicle with respect to the chassis of the vehicle;
generating, based on spatially aligning the first topographic representation to the second topographic representation and by the computer located in the vehicle, an augmented reality image that combines a contour of a part of the vehicle and a rendering of a terrain area below the vehicle including a combined topographic representation based on the first topographic representation and the second topographic representation; and
displaying the augmented reality image on a display of an infotainment system in the vehicle, wherein the contour of the part of the vehicle is a semi-transparent top-down representation of the vehicle that includes an outline of a chassis of the vehicle and wheels of the vehicle, and wherein a portion of the rendering of the terrain located behind the contour in the augmented reality image is visible through the contour.
2. The method of claim 1 , wherein utilizing the terrain information to modify at least one driving characteristic of the vehicle comprises modifying a functional characteristic of a suspension system of the vehicle.
3. The method of claim 1 , wherein the ground surface is one of: a part of an off- road area or a part of a paved road.
4. The method of claim 1 , wherein generating the augmented reality image comprises:
determining, by the computer located in the vehicle, a disposition of one or more components of the vehicle.
5. The method of claim 4 , wherein the disposition of one or more components of the vehicle includes an angular orientation of a chassis of the vehicle with respect to the ground surface, and an angle of a wheel of the vehicle with respect to the chassis of the vehicle.
6. A vehicle comprising:
an imaging system; and
a computer comprising:
at least one memory that stores computer-executable instructions; and
at least one processor configured to access the at least one memory and execute the computer-executable instructions to at least:
receive, from an unmanned aerial vehicle (UAV) in communication with the vehicle, at least a first image of a first section of a ground surface;
capture, by the imaging system, at least a second image of a second section of the ground surface located below the vehicle, the second image including at least a part of the first section of the ground surface;
spatially match the first image to the second image by identifying at least a first topographic feature that is present in each of the first image and the second image;
generating a first topographic representation of the first image and a second topographic representation of the second image, wherein the first topographic representation includes the first topographical feature and the second topographic representation includes the first topographical feature;
spatially align the first topographic representation of the first image with the second topographic representation of the second image based on a location of the first topographic feature in the first topographic representation and a location of the first topographic feature in the second topographic representation;
generate terrain information of the ground surface by processing the first image and the second image;
utilize the terrain information to modify at least one driving characteristic of the vehicle;
determine, by the computer located in the vehicle, at least one of an angular orientation of a chassis of the vehicle with respect to the ground surface and an angle of a wheel of the vehicle with respect to the chassis of the vehicle;
generate, based on spatially aligning the first topographic representation to the second topographic representation and by the computer located in the vehicle, an augmented reality image that combines a contour of a part of the vehicle and a rendering of a terrain area below the vehicle including a combined topographic representation based on the first topographic representation and the second topographic representation; and
display the augmented reality image on a display of an infotainment system in the vehicle, wherein the contour of the part of the vehicle is a semi-transparent p- down representation of the vehicle that includes an outline of a chassis of the vehicle and wheels of the vehicle, and wherein a portion of the rendering of the terrain located behind the contour in the augmented reality image is visible through the contour.
7. The vehicle of claim 6 , wherein processing the first image and the second image for generating the terrain information comprises spatially matching the first image to the second image by identifying at least a first feature that is present in each of the first image and the second image and spatially aligning a first topographic representation in the first image to a second topographic representation in the second image.
8. The vehicle of claim 6 , wherein utilizing the terrain information to modify at least one driving characteristic of the vehicle comprises modifying a functional characteristic of a suspension system of the vehicle.
9. The vehicle of claim 6 , wherein the ground surface is one of: a part of an off- road area or a part of a paved road.
10. The vehicle of claim 6 , wherein the at least one processor is further configured to access the at least one memory and execute additional computer-executable instructions to at least:
determine at least one of an angular orientation of a chassis of the vehicle with respect to the ground surface and an angle of a wheel of the vehicle with respect to the chassis of the vehicle for generating the augmented reality image.
11. The method of claim 1 , wherein the contour of the part of the vehicle is scaled to match a dimension of one or more objects present in the first image.
12. A system comprising:
at least one memory that stores computer-executable instructions; and
at least one processor configured to access the at least one memory and execute the computer-executable instructions to at least:
receive, by a computer of a vehicle and from an unmanned aerial vehicle (UAV) in communication with the vehicle, at least a first image of a first section of a ground surface;
capture, by an imaging system of the vehicle, at least a second image of a second section of the ground surface located below the vehicle, the second image including at least a part of the first section of the ground surface;
generate, by the computer and based on the first image and the second image, terrain information of the ground surface;
modify, by the computer and based the terrain information, at least one driving characteristic of the vehicle;
spatially match the first image to the second image by identifying at least a first topographic feature that is present in each of the first image and the second image;
generate a first topographic representation of the first image and a second topographic representation of the second image, wherein the first topographic representation includes the first topographical feature and the second topographic representation includes the first topographical feature;
spatially align the first topographic representation of the first image with the second topographic representation of the second image based on a location of the first topographic feature in the first topographic representation and a location of the first topographic feature in the second topographic representation;
determine, by the computer located in the vehicle, at least one of an angular orientation of a chassis of the vehicle with respect to the ground surface and an angle of a wheel of the vehicle with respect to the chassis of the vehicle;
generate, based on spatially aligning the first topographic representation to the second topographic representation and by the computer located in the vehicle, an augmented reality image that combines a contour of a part of the vehicle and a rendering of a terrain area below the vehicle including a combined topographic representation based on the first topographic representation and the second topographic representation; and
display the augmented reality image on a display of an infotainment system in the vehicle, wherein the contour of the part of the vehicle is a semi-transparent top-down representation of the vehicle that includes an outline of a chassis of the vehicle and wheels of the vehicle, and wherein a portion of the rendering of the terrain located behind the contour in the augmented reality image is visible through the contour.
13. The system of claim 12 , wherein the at least one processor is further configured to execute the computer-executable instructions to:
utilize, by the computer, the terrain information to modify at least one driving characteristic of the vehicle.
14. The system of claim 13 , wherein the ground surface is one of a part of an off-road area or a part of a paved road, and wherein utilizing the terrain information to modify at least one driving characteristic of the vehicle comprises modifying a functional characteristic of a suspension system of the vehicle.
15. The system of claim 13 , wherein utilizing the terrain information to modify at least one driving characteristic of the vehicle comprises modifying a functional characteristic of a suspension system of the vehicle.