Systems and methods for dynamic object tracking using a single camera mounted on a vehicle
A self-contained, low-cost, low-weight guidance system for vehicles is provided. The guidance system can include an optical camera, a case, a processor, a connection between the processor and an on-board control system, and computer algorithms running on the processor. The guidance system can be integrated with a vehicle control system through “plug and play” functionality or a more open Software Development Kit. The computer algorithms re-create 3D structures as the vehicle travels and continuously updates a 3D model of the environment. The guidance system continuously identifies and tracks terrain, static objects, and dynamic objects through real-time camera images. The guidance system can receive inputs from the camera and the onboard control system. The guidance system can be used to assist vehicle navigation and to avoid possible collisions. The guidance system can communicate with the control system and provide navigational direction to the control system.
1. A method for dynamic object tracking, comprising:
identifying, by one or more processors, a first image of a sequence of images, the first image including a first plurality of pixels, the sequence of images detected by an image capture device of the moveable entity at a plurality of times as the moveable entity operates, each image of the sequence of images associated with a respective velocity or acceleration of the moveable entity;
identifying, by the one or more processors, at least one point of interest mapped to at least one respective pixel of the first plurality of pixels;
determining, by the one or more processors, at least one parameter value of the at least one respective pixel;
tracking, by the one or more processors, across remaining images of the sequence of images based on the at least one parameter value, movement of the at least one point of interest, the remaining images detected by the image capture device at a subset of the plurality of times subsequent to detection of the first image;
determining, by the one or more processors, that the at least one point of interest represents at least a portion of a dynamic object based on the movement of the at least one point of interest and the respective velocity or acceleration of the moveable entity associated with at least one of the sequence of images; and
identifying, by the one or more processors, from at least one image of the sequence of images, a plurality of representative pixels that represent the dynamic object.
2. The method of claim 1 , further comprising:
identifying, by the one or more processors, at least one second point of interest in the remaining images; and
tracking, by the one or more processors, across the remaining images, movement of the at least one second point of interest to identify additional dynamic objects in the sequence of images.
3. The method of claim 1 , further comprising:
receiving, by the one or more processors, the respective velocity or acceleration data of the movable entity from at least one sensor of the moveable entity.
4. The method of claim 1 , further comprising associating, by the one or more processors, the velocity or acceleration of the moveable entity to each image of the sequence of images as each image is captured.
5. The method of claim 3 , further comprising determining, by the one or more processors, the movement of the at least one point of interest based on the velocity or acceleration data.
6. The method of claim 1 , further comprising determining, by the one or more processors, the movement of the at least one point of interest by comparing a pixel location of the at least one respective pixel in the first image with a pixel location associated with the at least one point of interest in a second image of the remaining images.
7. The method of claim 1 , further comprising determining, by the one or more processors, that the at least one point of interest represents a static object responsive to the movement of the at least one point of interest being less than a threshold.
8. The method of claim 1 , wherein the image capture device is a first image capture device, the method further comprising determining, by the one or more processors, the sequence of images using a plurality of first images from the first image capture device and a plurality of second images from a second image capture device.
9. The method of claim 1 , further comprising outputting, by the one or more processors, an instruction to cause a movable entity coupled with the image capture device to avoid a collision with the dynamic object.
10. The method of claim 1 , further comprising tracking, by the one or more processors, the dynamic object using an expected movement profile of the dynamic object.
11. A system, comprising:
one or more processors configured to:
identify a first image of a sequence of images, the first image including a first plurality of pixels, the sequence of images detected by-an image capture device of the moveable entity at a plurality of times as the moveable entity operates, each image of the sequence of images associated with a respective velocity or acceleration of the moveable entity;
identify at least one point of interest mapped to at least one respective pixel of the first plurality of pixels;
determine at least one parameter value of the at least one respective pixel;
track, across remaining images of the sequence of images based on the at least one parameter value, movement of the at least one point of interest, the remaining images detected by the image capture device at a subset of the plurality of times subsequent to detection of the first image; and
determine that the at least one point of interest represents at least a portion of a dynamic object based on the movement of the at least one point of interest and the respective velocity or acceleration of the moveable entity associated with at least one of the sequence of images.
12. The system of claim 11 , wherein the one or more processors are configured to:
identify at least one second point of interest in the remaining images; and
track, across the remaining images, movement of the at least one second point of interest to identify additional dynamic objects in the sequence of images.
13. The system of claim 11 , wherein the one or more processors are configured to receive the respective velocity or acceleration data of the movable entity from at least one sensor of the moveable entity.
14. The system of claim 11 , wherein the one or more processors are configured to associate the respective velocity or acceleration of the moveable entity to each image of the sequence of images as each image is captured.
15. The system of claim 13 , wherein the one or more processors are configured to determine the movement of the at least one point of interest based on the velocity or acceleration data.
16. The system of claim 11 , wherein the one or more processors are configured to determine the movement of the at least one point of interest by comparing a pixel location of the at least one respective pixel in the first image with a pixel location associated with the at least one point of interest in a second image of the remaining images.
17. The system of claim 11 , wherein the one or more processors are configured to determine that the at least one point of interest represents a static object responsive to the movement of the at least one point of interest being less than a threshold.
18. The system of claim 11 , further comprising a plurality of image capture devices, and wherein the one or more processors are configured to determine the sequence of images by at least one of stitching or merging respective images from each image capture device of the plurality of image capture devices.
19. The system of claim 11 , wherein the one or more processors are configured to output an instruction to cause a movable entity coupled with the image capture device to avoid a collision with the dynamic object.
20. The system of claim 11 , wherein the one or more processors are configured to track the dynamic object using an expected movement profile of the dynamic object.