Vehicular trailer hitching assist system with hitch ball location estimation
A vehicular trailer hitching assist system includes a camera disposed at a rear portion of a vehicle and viewing a hitch ball of a trailer hitch of the vehicle. The system determines a position of the hitch ball within frames of image data, and determines an angle based on a lateral offset distance of the camera relative to the longitudinal centerline of the vehicle and a lateral offset distance of the hitch ball relative to the longitudinal centerline of the vehicle. The system determines height of the hitch ball based on the determined angle and the lateral offset distance of the camera and the lateral offset distance of the hitch ball. The system determines a hitch-ball ground position based on the determined height of the hitch ball. The system utilizes the determined height of the hitch ball and the determined hitch-ball ground position during a hitching maneuver of the vehicle.
1. A vehicular trailer hitching assist system, the vehicular trailer hitching assist system comprising:
a camera disposed at a rear portion of a vehicle equipped with the vehicular trailer hitching assist system and viewing rearward of the vehicle, the camera viewing a hitch ball of a trailer hitch of the vehicle;
wherein the camera comprises a CMOS imaging array, and wherein the CMOS imaging array comprises at least one million photosensors arranged in rows and columns;
wherein the camera captures frames of image data;
an electronic control unit (ECU) comprising electronic circuitry and associated software;
wherein the electronic circuitry of the ECU comprises an image processor for processing image data captured by the camera;
wherein the vehicular trailer hitching assist system, responsive to image processing at the ECU of image data captured by the camera, determines a position of the hitch ball of the trailer hitch within frames of captured image data;
wherein the vehicular trailer hitching assist system, responsive to determining the position of the hitch ball within frames of captured image data, determines an angle of the hitch ball relative to the camera based on (i) a lateral offset distance of the camera relative to a longitudinal centerline of the vehicle, (ii) a lateral offset distance of the hitch ball relative to the longitudinal centerline of the vehicle and (iii) image processing at the ECU of image data captured by the camera;
wherein the vehicular trailer hitching assist system determines height of the hitch ball from the ground based on (i) the determined angle of the hitch ball relative to the camera, (ii) the lateral offset distance of the camera, and (iii) the lateral offset distance of the trailer hitch;
wherein the vehicular trailer hitching assist system determines a hitch-ball ground position based on the determined height of the hitch ball, and wherein the determined hitch-ball ground position is a location on the ground below the hitch ball;
wherein the vehicular trailer hitching assist system, at least in part responsive to image processing at the ECU of image data captured by the camera, determines a trailer tongue of a trailer that is to be hitched to the hitch ball of the vehicle; and
wherein the vehicular trailer hitching assist system utilizes the determined height of the hitch ball from the ground and the determined hitch-ball ground position during a hitching maneuver of the vehicle to assist in maneuvering the vehicle toward the trailer tongue of the trailer for hitching the trailer tongue of the trailer to the hitch ball of the vehicle.
2. The vehicular trailer hitching assist system of claim 1 , wherein the lateral offset distance of the trailer hitch is zero and the lateral offset distance of the camera is non-zero.
3. The vehicular trailer hitching assist system of claim 1 , wherein the lateral offset distance of the trailer hitch is non-zero and the lateral distance offset of the camera is zero.
4. The vehicular trailer hitching assist system of claim 1 , wherein the camera comprises a rear backup camera of the vehicle.
5. The vehicular trailer hitching assist system of claim 1 , wherein the vehicular trailer hitching assist system determines an average hitch-ball ground position based on an average of a plurality of determined heights of the hitch ball from the ground as determined via processing at the ECU of a plurality of frames of captured image data.
6. The vehicular trailer hitching assist system of claim 1 , wherein, during the hitching maneuver of the vehicle, the vehicular trailer hitching assist system maneuvers the vehicle toward the trailer tongue of the trailer to be hitched to the hitch ball of the vehicle based at least in part on the determined hitch-ball ground position of the hitch ball and the determined trailer tongue of the trailer that is to be hitched to the hitch ball of the vehicle.
7. The vehicular trailer hitching assist system of claim 1 , comprising a video display screen disposed in the vehicle and viewable by a driver of the vehicle, the video display screen displaying video images derived at least in part from image data captured by the camera during the hitching maneuver of the vehicle, wherein the vehicular trailer hitching assist system generates a graphic overlay for display at the video display screen based at least in part on the determined hitch-ball ground position of the hitch ball and the determined trailer tongue of the trailer that is to be hitched to the hitch ball of the vehicle, and wherein the graphic overlay provides guidance for the driver during the hitching maneuver of the vehicle.
8. The vehicular trailer hitching assist system of claim 1 , wherein the vehicular trailer hitching assist system determines the position of the hitch ball within frames of captured image data using a machine-learning feature detection algorithm.
9. The vehicular trailer hitching assist system of claim 1 , wherein the vehicular trailer hitching assist system determines the angle of the hitch ball relative to the camera based on a projective ray passing through the determined position of the hitch ball based on a camera projection matrix.
10. The vehicular trailer hitching assist system of claim 1 , wherein the angle of the hitch ball relative to the camera is determined between (i) a first line that intersects a camera mounting position and the determined position of the hitch ball and (ii) a second line that is parallel to the ground and intersects the camera mounting position.
11. The vehicular trailer hitching assist system of claim 1 , wherein the vehicular trailer hitching assist system determines the position of the hitch ball within frames of image data based on a triangular relationship between the determined angle of the hitch ball relative to the camera, the lateral offset distance of the camera, and the lateral offset distance of the trailer hitch.
12. The vehicular trailer hitching assist system of claim 1 , wherein the vehicular trailer hitching assist system determines the hitch-ball ground position using camera projection geometry.
13. The vehicular trailer hitching assist system of claim 1 , wherein the vehicular trailer hitching assist system determines the position of the hitch ball within frames of image data using a plurality of different algorithms, and wherein the vehicular trailer hitching assist system averages the determined positions of the hitch ball as determined using the plurality of different algorithms.
14. A vehicular trailer hitching assist system, the vehicular trailer hitching assist system comprising:
a rear backup camera disposed at a rear portion of a vehicle equipped with the vehicular trailer hitching assist system and viewing rearward of the vehicle, the rear backup camera viewing a hitch ball of a trailer hitch of the vehicle;
wherein the rear backup camera comprises a CMOS imaging array, and wherein the CMOS imaging array comprises at least one million photosensors arranged in rows and columns;
wherein the rear backup camera captures frames of image data;
an electronic control unit (ECU) comprising electronic circuitry and associated software;
wherein the electronic circuitry of the ECU comprises an image processor for processing image data captured by the rear backup camera;
wherein the vehicular trailer hitching assist system, responsive to image processing at the ECU of image data captured by the rear backup camera, determines a position of the hitch ball of the trailer hitch within frames of captured image data;
wherein the vehicular trailer hitching assist system, responsive to determining the position of the hitch ball within frames of captured image data, determines an angle of the hitch ball relative to the rear backup camera based on (i) a lateral offset distance of the rear backup camera relative to a longitudinal centerline of the vehicle, (ii) a lateral offset distance of the hitch ball relative to the longitudinal centerline of the vehicle and (iii) image processing at the ECU of image data captured by the camera;
wherein the vehicular trailer hitching assist system determines height of the hitch ball from the ground based on (i) the determined angle of the hitch ball relative to the rear backup camera, (ii) the lateral offset distance of the rear backup camera, and (iii) the lateral offset distance of the trailer hitch;
wherein the vehicular trailer hitching assist system determines a hitch-ball ground position based on the determined height of the hitch ball, and wherein the determined hitch-ball ground position is a location on the ground below the hitch ball;
wherein the vehicular trailer hitching assist system, at least in part responsive to image processing at the ECU of image data captured by the rear backup camera, determines a trailer tongue of a trailer that is to be hitched to the hitch ball of the vehicle;
wherein the vehicular trailer hitching assist system determines an average hitch-ball ground position based on an average of a plurality of determined heights of the hitch ball from the ground as determined via processing at the ECU of a plurality of frames of captured image data; and
wherein the vehicular trailer hitching assist system utilizes the determined height of the hitch ball from the ground and the determined hitch-ball ground position during a hitching maneuver of the vehicle to assist in maneuvering the vehicle toward the trailer tongue of the trailer for hitching the trailer tongue of the trailer to the hitch ball of the vehicle.
15. The vehicular trailer hitching assist system of claim 14 , wherein the lateral offset distance of the trailer hitch is zero and the lateral offset distance of the rear backup camera is non-zero.
16. The vehicular trailer hitching assist system of claim 14 , wherein the lateral offset distance of the trailer hitch is non-zero and the lateral distance offset of the rear backup camera is zero.
17. The vehicular trailer hitching assist system of claim 14 , wherein, during the hitching maneuver of the vehicle, the vehicular trailer hitching assist system maneuvers the vehicle toward the trailer tongue of the trailer to be hitched to the hitch ball of the vehicle based at least in part on the determined hitch-ball ground position of the hitch ball and the determined trailer tongue of the trailer that is to be hitched to the hitch ball of the vehicle.
18. The vehicular trailer hitching assist system of claim 14 , comprising a video display screen disposed in the vehicle and viewable by a driver of the vehicle, the video display screen displaying video images derived at least in part from image data captured by the rear backup camera during the hitching maneuver of the vehicle, wherein the vehicular trailer hitching assist system generates a graphic overlay for display at the video display screen based at least in part on the determined hitch-ball ground position of the hitch ball and the determined trailer tongue of the trailer that is to be hitched to the hitch ball of the vehicle, and wherein the graphic overlay provides guidance for the driver during the hitching maneuver of the vehicle.
19. A vehicular trailer hitching assist system, the vehicular trailer hitching assist system comprising:
a camera disposed at a rear portion of a vehicle equipped with the vehicular trailer hitching assist system and viewing rearward of the vehicle, the camera viewing a hitch ball of a trailer hitch of the vehicle;
wherein the camera comprises a CMOS imaging array, and wherein the CMOS imaging array comprises at least one million photosensors arranged in rows and columns;
wherein the camera captures frames of image data;
an electronic control unit (ECU) comprising electronic circuitry and associated software;
wherein the electronic circuitry of the ECU comprises an image processor for processing image data captured by the camera;
wherein the vehicular trailer hitching assist system, responsive to image processing at the ECU of image data captured by the camera, determines a position of the hitch ball of the trailer hitch within frames of captured image data;
wherein the vehicular trailer hitching assist system determines the position of the hitch ball within frames of captured image data using a machine-learning feature detection algorithm;
wherein the vehicular trailer hitching assist system, responsive to determining the position of the hitch ball within frames of captured image data, determines an angle of the hitch ball relative to the camera based on (i) a lateral offset distance of the camera relative to a longitudinal centerline of the vehicle, (ii) a lateral offset distance of the hitch ball relative to the longitudinal centerline of the vehicle and (iii) image processing at the ECU of image data captured by the camera;
wherein the vehicular trailer hitching assist system determines height of the hitch ball from the ground based on (i) the determined angle of the hitch ball relative to the camera, (ii) the lateral offset distance of the camera, and (iii) the lateral offset distance of the trailer hitch;
wherein the vehicular trailer hitching assist system determines a hitch-ball ground position based on the determined height of the hitch ball, and wherein the determined hitch-ball ground position is a location on the ground below the hitch ball;
wherein the vehicular trailer hitching assist system determines the hitch-ball ground position using camera projection geometry;
wherein the vehicular trailer hitching assist system, at least in part responsive to image processing at the ECU of image data captured by the camera, determines a trailer tongue of a trailer that is to be hitched to the hitch ball of the vehicle; and
wherein the vehicular trailer hitching assist system utilizes the determined height of the hitch ball from the ground and the determined hitch-ball ground position during a hitching maneuver of the vehicle to assist in maneuvering the vehicle toward the trailer tongue of the trailer for hitching the trailer tongue of the trailer to the hitch ball of the vehicle.
20. The vehicular trailer hitching assist system of claim 19 , wherein the vehicular trailer hitching assist system determines the angle of the hitch ball relative to the camera based on a projective ray passing through the determined position of the hitch ball based on a camera projection matrix.
21. The vehicular trailer hitching assist system of claim 19 , wherein the angle of the hitch ball relative to the camera is determined between (i) a first line that intersects a camera mounting position and the determined position of the hitch ball and (ii) a second line that is parallel to the ground and intersects the camera mounting position.