Visual object tracker

1. A method for tracking a trailer coupler positioned behind a tow vehicle, the method comprising:

receiving, at data processing hardware, one or more images from a camera positioned on a back portion of the tow vehicle and in communication with the data processing hardware;

determining, at the data processing hardware, a trailer coupler position within the one or more images, the trailer coupler position associated with the trailer coupler;

receiving, at the data processing hardware, vehicle sensor data from one or more vehicle sensors in communication with the data processing hardware;

determining, at the data processing hardware, vehicle motion data based on the received vehicle sensor data;

determining, at the data processing hardware, an updated coupler position based on the trailer coupler position and the vehicle motion data; and

determining a pixel velocity of the trailer coupler within the one or more images based on the vehicle motion data and a previous coupler position;

wherein the updated coupler position is based on the pixel velocity and the previous coupler position.

2. The method of claim 1 , wherein the vehicle motion data includes a vehicle pose, a vehicle linear speed, and a vehicle angular speed.

3. The method of claim 1 , wherein the one or more vehicle sensors include at least one of a steering wheel angle sensor, wheel encoders, inertial measuring unit, radar, and global positioning system receiver.

4. The method of claim 1 , wherein the pixel velocity is based on a coupler height in a real-world coordinate system.

5. The method of claim 4 , further comprising:

determining the coupler height from a predetermined range;

determining a first pixel point location associated with the trailer coupler based on the pixel velocity;

determining a second pixel point location associated with the trailer coupler based on the one or more images;

comparing the first pixel point location and the second pixel point location; and

adjusting the coupler height based on the compared first and second pixel point locations.

6. The method of claim 1 , further comprising:

storing, at memory hardware in communication with the data processing hardware, the updated coupler position; and

retrieving the updated coupler position as the previous coupler position when one or more updated images are received.

7. The method of claim 1 , further comprising:

determining a coupler location in a world coordinate based on the updated coupler position; and

transmitting instructions to a drive system of the tow vehicle, the instructions causing the tow vehicle to autonomously maneuver in a rearward direction towards the coupler location.

8. A system for tracking a trailer coupler positioned behind a tow vehicle, the system comprising:

data processing hardware; and

memory hardware in communication with the data processing hardware, the memory hardware storing instructions that when executed on the data processing hardware cause the data processing hardware to perform operations comprising:

receiving one or more images from a camera positioned on a back portion of the tow vehicle and in communication with the data processing hardware;

determining a trailer coupler position within the one or more images, the trailer coupler position associated with the trailer coupler;

receiving vehicle sensor data from one or more vehicle sensors in communication with the data processing hardware;

determining vehicle motion data based on the received vehicle sensor data;

determining an updated coupler position based on the trailer coupler position and the vehicle motion data; and

determining a pixel velocity of the trailer coupler within the one or more images based on the vehicle motion data and a previous coupler position;

wherein the updated coupler position is based on the pixel velocity and the previous coupler position.

9. The system of claim 8 , wherein the vehicle motion data includes a vehicle pose, a vehicle linear speed, and a vehicle angular speed.

10. The system of claim 8 , wherein the one or more vehicle sensors include at least one of a steering wheel angle sensor, wheel encoders, inertial measuring unit, radar, and global positioning system receiver.

11. The system of claim 8 , wherein the pixel velocity is based on a coupler height in a real-world coordinate system.

12. The system of claim 11 , wherein the operations further include:

determining the coupler height from a predetermined range;

determining a first pixel point location associated with the trailer coupler based on the pixel velocity;

determining a second pixel point location associated with the trailer coupler based on the one or more images;

comparing the first pixel point location and the second pixel point location; and adjusting the coupler height based on the compared first and second pixel point locations.

13. The system of claim 8 , wherein the operations further include:

storing the updated coupler position at the memory hardware; and

retrieving the updated coupler position as the previous coupler position when one or more updated images are received.

14. The system of claim 8 , wherein the operations further include:

determining a coupler location in a world coordinate based on the updated coupler position; and

transmitting instructions to a drive system of the tow vehicle, the instructions causing the tow vehicle to autonomously maneuver in a rearward direction towards the coupler location.