System and method for calibrating camera data using a second image sensor from a second vehicle
Systems and methods for implementing one or more autonomous features for autonomous and semi-autonomous control of one or more vehicles are provided. More specifically, image data may be obtained from an image acquisition device and processed utilizing one or more machine learning models to identify, track, and extract one or more features of the image utilized in decision making processes for providing steering angle and/or acceleration/deceleration input to one or more vehicle controllers. In some instances, techniques may be employed such that the autonomous and semi-autonomous control of a vehicle may change between vehicle follow and lane follow modes. In some instances, at least a portion of the machine learning model may be updated based on one or more conditions.
1. A method comprising:
receiving a first image from a first image acquisition device mounted to a first vehicle that is moving;
identifying one or more first features in the first image;
obtaining one or more first parameters associated with the identified one or more first features;
sending the first image and the one or more first parameters associated with the identified one or more first features to a second image acquisition device mounted to a second vehicle;
preparing calibration information, based on the first image, for one or more of the identified one or more first features from/by the second image acquisition device, the calibration information including at least a suggested location for a vanishing point;
receiving the calibration information at the first image acquisition device and
calibrating the first image acquisition device based on the one or more first parameters and the calibration information from the second image acquisition device by comparing the one or more of the identified second features from the second image acquisition device with the one or more identified first features from the first image acquisition device.
2. The method of claim 1 , wherein one or more first features in the first image comprises an object.
3. The method of claim 2 , wherein the one or more first parameters associated with the identified one or more first features comprises a location of the object in the first image.
4. The method of claim 3 , wherein the location is a number of pixels from a vanishing point in the first image.
5. The method of claim 4 , wherein the one or more first parameters associated with the identified one or more first features comprises a data structure describing the object in the first image.
6. The method of claim 5 , wherein the data structure comprises one or more of a height of the object, a width of the object, a center of a bounding box outlining the object in the first image, and/or a location of the center in the first image.
7. The method of claim 6 , wherein the second vehicle also sends a location of the second vehicle when the calibration information for the second image acquisition device was obtained.
8. The method of claim 7 , wherein calibrating the first image acquisition device occurs periodically.
9. The method of claim 8 , wherein the calibration information includes pitch and yaw of the first image acquisition device.
10. The method of claim 9 , wherein the pitch is a first number of pixels, in a vertical direction, a center of an image is from the vanishing point, and wherein the yaw is a second number of pixels, in a horizontal direction, the center of an image is from the vanishing point.
11. A system comprising:
a memory;
a processor in communication with the memory, wherein the processor executes instructions stored in the memory, which cause the processor to execute a method, the method comprising:
receiving a first image from a first image acquisition device mounted to a first vehicle that is moving;
identifying one or more first features in the first image;
obtaining one or more first parameters associated with the identified one or more first features;
sending the first image and the one or more first parameters associated with the identified one or more first features to a second image acquisition device mounted to a second vehicle;
preparing calibration information, based on the first image, for one or more of the identified one or more first features from the second image acquisition device, the calibration information including at least a suggested location for a vanishing point;
receiving the calibration information at the first image acquisition device and
calibrating the first image acquisition device based the one or more first parameters and the calibration information from the second image acquisition device by comparing the one or more of the identified second features from the second image acquisition device with the one or more identified first features from the first image acquisition device.
12. The system of claim 11 , wherein one or more first features in the first image comprises an object, wherein the one or more first parameters associated with the identified one or more first features comprises a location of the object in the first image, and wherein the location is a number of pixels from a vanishing point in the first image.
13. The system of claim 11 , wherein the second vehicle also sends a location of the second vehicle when the calibration information for the second image acquisition device was obtained.
14. The system of claim 11 , wherein calibrating the first image acquisition device occurs periodically.
15. The system of claim 11 , wherein the calibration information includes pitch and yaw of the first image acquisition device, wherein the pitch is a first number of pixels, in a vertical direction, a center of an image is from the vanishing point, and wherein the yaw is a second number of pixels, in a horizontal direction, the center of an image is from the vanishing point.
16. A non-transitory computer readable medium having stored thereon instructions, which when executed by a processor cause the processor to execute a method, the method comprising:
receiving a first image from a first image acquisition device mounted to a first vehicle that is moving;
identifying one or more first features in the first image;
obtaining one or more first parameters associated with the identified one or more first features;
sending the first image and the one or more first parameters associated with the identified one or more first features to a second image acquisition device mounted to a second vehicle;
preparing calibration information for one or more of the identified one or more first features from a second image acquisition device, the calibration information including at least a suggested location for a vanishing point;
receiving the calibration information at the first image acquisition device and
calibrating the first image acquisition device based the one or more first parameters and the calibration information from the second image acquisition device by comparing the one or more of the identified second features from the second image acquisition device with the one or more identified first features from the first image acquisition device.
17. The non-transitory computer readable medium of claim 16 , wherein one or more first features in the first image comprises an object, wherein the one or more first parameters associated with the identified one or more first features comprises a location of the object in the first image, and wherein the location is a number of pixels from a vanishing point in the first image.
18. The non-transitory computer readable medium of claim 16 , wherein the second vehicle also sends a location of the second vehicle when the calibration information for the second image acquisition device was obtained.
19. The non-transitory computer readable medium of claim 16 , wherein calibrating the first image acquisition device occurs periodically.
20. The non-transitory computer readable medium of claim 16 , wherein the calibration information includes pitch and yaw of the first image acquisition device, wherein the pitch is a first number of pixels, in a vertical direction, a center of an image is from a vanishing point, and wherein the yaw is a second number of pixels, in a horizontal direction, the center of an image is from the vanishing point.