Estimating object properties using visual image data
A system is comprised of one or more processors coupled to memory. The one or more processors are configured to receive image data based on an image captured using a camera of a vehicle and to utilize the image data as a basis of an input to a trained machine learning model to at least in part identify a distance of an object from the vehicle. The trained machine learning model has been trained using a training image and a correlated output of an emitting distance sensor.
1. A system, comprising:
one or more processors configured to:
receive sensor data based on an image captured using a sensor of a vehicle, the sensor data representing at least one object in an environment of the vehicle;
provide the sensor data as an input to a trained machine learning model to cause the trained machine learning model to generate an output representing at least one property of the at least one object in the environment, the at least one property comprising a velocity vector corresponding to the at least one object in the environment of the vehicle,
wherein the trained machine learning model was trained using a training image and a correlated output of an emitting distance sensor; and
determine a predicted maneuver of the one or more objects in the environment of the vehicle based on the velocity vector.
2. The system of claim 1 , wherein the output representing the at least one property of the at least one object in the environment further comprises at least one of a distance of the object relative to the sensor or a direction of the objective relative to the environment.
3. The system of claim 1 , wherein the at least one object comprises the at least one object or at least one agent,
wherein the at least one property comprises at least one property of the at least one object or at least one property of the at least one agent, the at least one agent comprising a pedestrian or a second vehicle that is moving relative to the vehicle, and
wherein the one or more processors are further configured to:
provide the sensor data as the input to the trained machine learning model to cause the trained machine learning model to generate the output representing the at least one property of the at least one object or the at least one property of the at least one agent in the environment.
4. The system of claim 3 , wherein the one or more processors are further configured to:
cause a vehicle control module to control operation of the vehicle based on the at least one property of the at least one object or the at least one property of the at least one agent in the environment.
5. The system of claim 1 , wherein the one or more processors receive the sensor data based on generation of the sensor data by: at least one vision sensor, at least one camera, at least one fisheye camera, at least one lidar sensor, at least one ultrasonic sensor, or at least one radar sensor.
6. The system of claim 1 , wherein the one or more processors are further configured to:
normalize the sensor data; and
wherein the one or more processors that provide the image data as the basis of the input to the trained machine learning model are configured to:
provide the sensor data as the input to the trained machine learning model based on normalizing the sensor data.
7. A non-transitory computer storage media storing instructions that, when executed by a system of one or more processors, cause the one or more processors to perform operations comprising:
receiving sensor data based on an image captured using a sensor of a vehicle, the sensor data representing at least one object in an environment of the vehicle; and
providing the sensor data as an input to a trained machine learning model to cause the trained machine learning model to generate an output representing at least one property of the at least one object in the environment, the at least one property comprising a velocity vector corresponding to the at least one object in the environment of the vehicle,
wherein the trained machine learning model was trained using a training image and a correlated output of an emitting distance sensor; and
determining a predicted maneuver of the one or more objects in the environment of the vehicle based on the velocity vector.
8. The non-transitory computer storage media of claim 7 , wherein the output representing the at least one property of the at least one object in the environment further comprises at least one of a distance of the object relative to the sensor or a direction of the objective relative to the environment.
9. The non-transitory computer storage media of claim 7 , wherein the at least one object comprises the at least one object or at least one agent,
wherein the at least one property comprises at least one property of the at least one object or at least property of the at least one agent, the at least one agent comprises a pedestrian or a second vehicle that is moving relative to the vehicle, and
wherein the instructions cause the one or more processors to:
provide the sensor data as the input to the trained machine learning model to cause the trained machine learning model to generate the output representing the at least one property of the at least one object or the at least one property of the at least one agent in the environment.
10. The non-transitory computer storage media of claim 7 , wherein instructions cause the one or more processors to receive the sensor data based on generation of the sensor data by: at least one vision sensor, at least one camera, at least one fisheye camera, at least one lidar sensor, at least one ultrasonic sensor, or at least one radar sensor.
11. The non-transitory computer storage media of claim 7 , wherein the instructions cause the one or more processors to:
normalize the sensor data; and
wherein the instructions that cause the one or more processors to provide the image data as the input to the trained machine learning model cause the one or more processors to:
provide the sensor data as the input to the trained machine learning model based on normalizing the sensor data.
12. The non-transitory computer storage media of claim 7 , wherein the instructions further cause the one or more processors to:
cause a vehicle control module to control operation of the vehicle based on the at least one property of the at least one object or the at least one property of at least one agent in the environment.
13. A method comprising:
receiving sensor data based on an image captured using a sensor of a vehicle, the sensor data representing at least one object in an environment of the vehicle;
providing the sensor data as an input to a trained machine learning model to cause the trained machine learning model to generate an output representing at least one property of the at least one object in the environment, the at least one property comprising a velocity vector corresponding to the at least one object in the environment of the vehicle,
wherein the trained machine learning model was trained using a training image and a correlated output of an emitting distance sensor, and
determining a predicted maneuver of the at least one object in the environment of the vehicle based on the velocity vector.
14. The method of claim 13 , wherein the output representing the at least one property of the at least one object in the environment further comprises at least one of a distance of the object relative to the sensor or a direction of the objective relative to the environment.
15. The method of claim 13 , wherein the at least one object comprises the at least one object or at least one agent,
wherein the at least one property comprises at least one property of the at least one object or at least one property of the at least one agent, the at least one agent comprising a pedestrian or a second vehicle that is moving relative to the vehicle,
the method comprising:
providing the sensor data as the input to the trained machine learning model to cause the trained machine learning model to generate the output representing the at least one property of the at least one object or the at least one property of the at least one agent in the environment.
16. The method of claim 13 , wherein receiving the sensor data is based on generation of the sensor data by: at least one vision sensor, at least one camera, at least one fisheye camera, at least one lidar sensor, at least one ultrasonic sensor, or at least one radar sensor.
17. The method of claim 13 , further comprising:
normalizing the sensor data; and
wherein providing the image data as the input to the trained machine learning model comprises:
providing the sensor data as the input to the trained machine learning model based on normalizing the sensor data.