Monocular depth estimation parameter assistance and augmentation
Systems and methods are provided to determine optimal (image analysis) parameters for generating or adapting/adjusting a monocular depth estimation (MDE) depth map based on various factors, such as vehicle operating conditions, environmental conditions, road conditions, etc. After determining the optimal parameters to use, the optimal parameters can be stored on a cloud server or an edge server along with the vehicle location for use when another vehicle approaches the location to perform MDE without needing to independently determine the optimal parameters to use. Moreover, the use of such optimal image analysis parameters, enable a richer/enhanced view of the environment/area around or about a vehicle, where image analysis parameters may be used to more accurately interpret or otherwise characterize a depth map.
1 . A method, comprising:
generating a depth map from an image of a scene;
identifying a portion of the scene corresponding to a road segment;
identifying a point of interest in the scene;
adjusting the depth map to de-emphasize the road segment;
determining an optimal image analysis parameter for the scene; and
transmitting, to a remote server, the optimal image analysis parameter and a geographic location at which the image was obtained.
2 . The method of claim 1 , further comprising extracting the road segment from the adjusted depth map.
3 . The method of claim 2 , wherein adjusting the depth map to de-emphasize the road segment is performed pursuant to extraction of the road segment from the depth map upon identification of the road segment.
4 . The method of claim 1 , further comprising prioritizing the identification of the point of interest relative to one or more other points of interest.
5 . The method of claim 1 , further comprising adjusting the depth map to emphasize the identified point of interest, wherein adjusting the depth map to emphasize the identified point of interest comprises highlighting the identified point of interest in a manner that visually emphasizes the identified point of interest to an operator of a vehicle, wherein the vehicle will encounter the identified point of interest while traversing the road segment.
6 . The method of claim 1 , wherein generating the depth map comprises generating the depth map using a monocular depth estimation (MDE) component based on the image of the scene received from a camera of a vehicle.
7 . The method of claim 6 , further comprising determining an operational parameter associated with the camera.
8 . The method of claim 7 , wherein determining the optimal image analysis parameter comprises generating a parameter value to offset at least one of the determined operational parameter and at least one aspect of the generated depth map.
9 . The method of claim 8 , wherein use of the determined optimal image analysis parameter increases accuracy of the generated depth map.
10 . A method, comprising:
receiving, at a first vehicle, an optimal image analysis parameter output by a remote server, the first vehicle traversing a road segment, the received optimal image analysis parameter having been generated pursuant to a second vehicle having previously traversed the road segment;
generating, at the first vehicle, a depth map from an image of a scene; and
adjusting, using the received optimal image analysis parameter, the depth map to de-emphasize the road segment.
11 . The method of claim 10 , wherein adjusting the depth map to de-emphasize the road segment is performed pursuant to extraction of the road segment from the depth map upon identification of the road segment.
12 . The method of claim 10 , further comprising prioritizing identification of a point of interest in the scene relative to one or more other points of interest.
13 . The method of claim 10 , further comprising adjusting the depth map to emphasize an identified point of interest in the scene, wherein adjusting the depth map to emphasize the identified point of interest comprises highlighting the identified point of interest in a manner that visually emphasizes the identified point of interest to an operator of the first vehicle, wherein the first vehicle will encounter the identified point of interest while traversing the road segment.
14 . The method of claim 10 , wherein generating the depth map comprises generating the depth map using a monocular depth estimation (MDE) component based on the image of the scene received from a camera of the first vehicle.
15 . The method of claim 14 , further comprising determining an operational parameter associated with the camera.
16 . The method of claim 15 , wherein the received optimal image analysis parameter comprises a parameter value to offset at least one of the determined operational parameter and at least one aspect of the generated depth map.
17 . The method of claim 16 , wherein use of the received optimal image analysis parameter increases accuracy of the generated depth map.
18 . The method of claim 1 , further comprising transmitting the determined optimal image analysis parameter to a remote server.
19 . The method of claim 18 , wherein the determined optimal image analysis parameter is transmitted to the remote server along with a location of a vehicle, the determined optimal image analysis parameter being associated with the location of the vehicle.
20 . The method of claim 18 , wherein transmitting the determined optimal image analysis parameter to the remote server is performed by a vehicle.