Hitch assist trailer, coupler and hitchball detection and tracking method
A hitch assistance system for assisting in maneuvering a vehicle toward a trailer includes a sensing system that includes an image sensor and a controller. The controller is configured to: identify a position of a coupler of the trailer based on image data received from the image sensor by utilizing a coupler detection model trained based on a library of images depicting couplers; control movement of the vehicle toward an aligned position based on the identified position of the coupler, wherein a hitch ball of the vehicle is aligned with the coupler of the trailer; determine a prospective location of the coupler in image data based on sensor data received from the sensing system; and crop image data based on the determined prospective location of the coupler.
1 . A hitch assistance system for assisting in maneuvering a vehicle toward a trailer, comprising:
a sensing system that includes an image sensor; and
a controller configured to:
identify a position of a coupler of the trailer based on image data received from the image sensor by utilizing a coupler detection model trained based on a library of images depicting couplers;
control movement of the vehicle toward an aligned position based on the identified position of the coupler, wherein a hitch ball of the vehicle is aligned with the coupler of the trailer;
determine a prospective location of the coupler in the image data based on sensor data received from the sensing system;
crop the image data based on the determined prospective location of the coupler; and
determine a hitch ball center point based on the image data by utilizing a hitch ball center detection model trained based on a library of images including a plurality of images respectively depicting hitch balls, wherein the hitch ball depicted in at least one of the plurality of images has a generally circular outline based on the perspective of the at least one image, and wherein the at least one image includes a hitch ball center point indication overlay that is positioned at a location within the at least one image that is offset from the radial center of the generally circular outline.
2 . The hitch assistance system of claim 1 , wherein the controller is configured to crop the image data based on the determined prospective location of the coupler, such that a portion of the image data that does not include the prospective location of the coupler is not utilized by the controller to control movement of the vehicle.
3 . The hitch assistance system of claim 1 , wherein the image data corresponding with the determined prospective location of the coupler is uncropped.
4 . The hitch assistance system of claim 3 , wherein the controller is configured to identify a position of the coupler based on the uncropped image data that corresponds with the determined prospective location of the coupler.
5 . The hitch assistance system of claim 1 , wherein the sensing system further comprises:
a proximity sensor, wherein the controller is further configured to identify the trailer in an exterior environment of the vehicle based on at least one of sensor data received from the proximity sensor and the image data received from the image sensor.
6 . The hitch assistance system of claim 5 , wherein the controller is further configured to determine a trailer heading direction of the trailer based on at least one of the sensor data received from the proximity sensor and the image data received from the image sensor by utilizing a trailer detection model trained based on a library of images respectively depicting trailers.
7 . The hitch assistance system of claim 1 , wherein the plurality of images respectively depicting hitch balls include hitch ball center point indication overlays, respectively.
8 . The hitch assistance system of claim 1 , wherein the hitch ball center point indication overlay of the at least one image is positioned at a location within the at least one image that is above the radial center of the generally circular outline.
9 . A hitch assistance system for a vehicle, comprising:
a sensing system that includes an image sensor; and
a controller configured to determine a hitch ball center point based on image data received from the image sensor by utilizing a hitch ball center detection model trained based on a library of images including a plurality of images, each of the plurality of images depicting a hitch ball and a hitch ball center point indication overlay, wherein the hitch ball depicted in at least one of the plurality of images has a generally circular outline based on the perspective of the at least one image, and the hitch ball center point indication overlay of the at least one image is positioned at a location within the at least one image that is offset from the radial center of the generally circular outline.
10 . The hitch assistance system of claim 9 , wherein the hitch ball center point indication overlay of the at least one image is positioned at a location within the at least one image that is above the radial center of the generally circular outline.
11 . The hitch assistance system of claim 9 , wherein the controller is further configured to:
identify a position of a coupler of a trailer based on the image data received from the image sensor by utilizing a coupler detection model trained based on a library of images depicting couplers;
control movement of the vehicle toward an aligned position based on the identified position of the coupler, wherein a hitch ball of the vehicle is aligned with the coupler of the trailer;
determine a subsequent location of the coupler in the image data based on sensor data received from the sensing system; and
crop the image data based on the determined subsequent location of the coupler.
12 . The hitch assistance system of claim 11 , wherein the controller is configured to crop the image data based on the determined subsequent location of the coupler, such that a portion of the image data that does not include the subsequent location of the coupler is not utilized by the controller to control movement of the vehicle.
13 . The hitch assistance system of claim 11 , wherein the controller is further configured to:
identify the trailer in an exterior environment of the vehicle based on the sensor data received from the sensing system; and
determine a trailer heading direction based on the image data received from the image sensor by utilizing a trailer detection model trained based on a library of images depicting trailers.
14 . A hitch assistance system for assisting in maneuvering a vehicle into alignment with a trailer, comprising:
a sensing system that includes a proximity sensor and an image sensor; and
a controller configured to:
determine a hitch ball center point based on image data received from the image sensor by utilizing a hitch ball center detection model trained based on a library of images including a plurality of images, each of the plurality of images depicting a hitch ball and a hitch ball center point indication overlay positioned at a location that is offset from the radial center of a generally circular outline of the hitch ball;
identify the trailer in an exterior environment of the vehicle based on sensor data received from the sensing system;
determine a trailer heading direction based on the image data received from the image sensor by utilizing a trailer detection model trained based on a library of images depicting trailers;
identify a position of a coupler of the trailer based on the image data received from the image sensor by utilizing a coupler detection model trained based on a library of images depicting couplers;
control movement of the vehicle toward an aligned position, wherein a hitch ball of the vehicle is aligned with the coupler of the trailer;
determine a future location of the coupler in the image data based on the sensor data received from the sensing system pertaining to the movement of the vehicle and the identified position of the coupler; and
crop the image data based on the determined future location of the coupler, such that a portion of the image data that does not include the future location of the coupler is not utilized by the controller to control the movement of the vehicle.
15 . The hitch assistance system of claim 1 , wherein the trailer is a target trailer, wherein the controller is configured to identify a plurality of trailers in an exterior environment of the vehicle based on the sensor data received from the sensing system, and wherein the controller is configured to identify the target trailer of the plurality of trailers based on a heading direction of the vehicle relative to the plurality of trailers as determined based on the sensor data received from the sensing system.
16 . The hitch assistance system of claim 1 , wherein the controller is further configured to:
determine a height of the coupler.
17 . The hitch assistance system of claim 9 , wherein the controller is further configured to:
identify a trailer in an exterior environment of the vehicle based on sensor data received from the sensing system, wherein the trailer includes a coupler;
identify a type of the coupler based on image data received from the image sensor by utilizing a coupler detection model trained based on a library of images depicting couplers;
identify a position of the coupler of the trailer based on the image data received from the image sensor by utilizing the coupler detection model; and
control movement of the vehicle toward an aligned position based on the identified position of the coupler, wherein a hitch ball of the vehicle is aligned with the coupler of the trailer.
18 . The hitch assistance system of claim 17 , wherein the controller is further configured to:
identify a type of the trailer based on the image data received from the image sensor by utilizing a trailer detection model trained based on a library of images depicting trailers.
19 . The hitch assistance system of claim 14 , wherein the hitch ball center point indication overlay is positioned at a location that is above the radial center of the generally circular outline of the hitch ball for each of the plurality of images.
20 . The hitch assistance system of claim 14 , wherein the generally circular outline of the hitch ball of each of the plurality of images is based on the perspective of the image of the plurality of images to which the generally circular outline corresponds.