Vehicular trailering assist system with automatic trailer recognition
A vehicular trailering assist system includes a camera disposed at a vehicle and viewing at least rearward of the vehicle. The vehicular trailering assist system transforms captured image data into a bird's-eye view of the hitch of the trailer, and accesses a plurality of stored trailer templates, with each respective trailer template being generated during a previous calibration of the system for a respective trailer. The vehicular trailering assist system generates a matching score based on a comparison between a stored trailer template and the transformed bird's-eye view. The vehicular trailering assist system, responsive to determining that the matching score for one of the plurality of stored trailer templates exceeds a threshold matching score, tracks a trailer angle of the trailer using the one plurality of stored trailer templates.
1. A vehicular trailering assist system, the vehicular trailering assist system comprising:
a camera disposed at a vehicle equipped with the vehicular trailering assist system, the camera viewing at least rearward of the vehicle, wherein the camera is operable to capture frames of image data;
wherein the camera comprises a CMOS imaging array, and wherein the CMOS imaging array comprises at least one million photosensors arranged in rows and columns;
an electronic control unit (ECU) comprising electronic circuitry and associated software;
wherein image data captured by the camera is transferred to and are processed at the ECU;
wherein the vehicular trailering assist system, with a trailer hitched to the vehicle and with the camera viewing at least a hitch of the trailer that hitches the trailer to the vehicle, and via processing at the ECU of image data captured by the camera and transferred to the ECU, transforms image data captured by the camera into a transformed bird's-eye view of the hitch of the trailer;
wherein the vehicular trailering assist system accesses a plurality of stored trailer templates, and wherein each respective stored trailer template of the plurality of stored trailer templates was generated during a previous calibration of the system for a respective trailer associated with the respective stored trailer template;
wherein the vehicular trailering assist system, for at least one stored trailer template of the plurality of stored trailer templates, generates a matching score based on a comparison between the at least one stored trailer template and the transformed bird's-eye view of the hitch of the trailer;
wherein the vehicular trailering assist system determines that the matching score for one of the at least one stored trailer template is greater than a threshold matching score; and
wherein the vehicular trailering assist system, responsive to determining that the matching score for the one of the at least one stored trailer template is greater than the threshold matching score, tracks a trailer angle of the trailer using the one of the at least one stored trailer template.
2. The vehicular trailering assist system of claim 1 , wherein the transformed bird's-eye view of the hitch of the trailer comprises a bow transformation removing rotational motion of the hitch in the image data.
3. The vehicular trailering assist system of claim 1 , wherein the vehicular trailering assist system generates respective matching scores based on comparison between respective stored trailer templates of the plurality of stored trailer templates and the transformed bird's-eye view of the hitch of the trailer, and wherein the matching score for the one of the at least one stored trailer template is the highest matching score.
4. The vehicular trailering assist system of claim 1 , wherein the vehicular trailering assist system determines the matching score based on determining a respective column score for each of a plurality of columns of the transformed bird's-eye view of the hitch of the trailer.
5. The vehicular trailering assist system of claim 4 , wherein each column is associated with a respective trailer angle of the trailer relative to the vehicle.
6. The vehicular trailering assist system of claim 4 , wherein the matching score is based on the highest column score of each respective column score.
7. The vehicular trailering assist system of claim 1 , wherein the vehicular trailering assist system generates the matching score by applying a dilation to the respective stored trailer template and removing edges from the transformed bird's-eye view of the hitch of the trailer.
8. The vehicular trailering assist system of claim 7 , wherein the vehicular trailering assist system removes edges from the transformed bird's-eye view of the hitch of the trailer based on a dot product between the respective stored trailer template and the transformed bird's-eye view of the hitch of the trailer.
9. The vehicular trailering assist system of claim 7 , wherein the vehicular trailering assist system removes edges using a connected component algorithm.
10. The vehicular trailering assist system of claim 7 , wherein a number of edges removed is based on a total number of edges in the transformed bird's-eye view of the hitch of the trailer.
11. The vehicular trailering assist system of claim 1 , wherein the transformed bird's-eye view of the hitch of the trailer is representative of at least a portion of the trailer.
12. A vehicular trailering assist system, the vehicular trailering assist system comprising:
a camera disposed at a vehicle equipped with the vehicular trailering assist system, the camera viewing at least rearward of the vehicle, wherein the camera is operable to capture frames of image data;
wherein the camera comprises a CMOS imaging array, and wherein the CMOS imaging array comprises at least one million photosensors arranged in rows and columns;
an electronic control unit (ECU) comprising electronic circuitry and associated software;
wherein image data captured by the camera is transferred to and are processed at the ECU;
wherein the vehicular trailering assist system, with a trailer hitched to the vehicle and with the camera viewing at least a hitch of the trailer that hitches the trailer to the vehicle, and via processing at the ECU of image data captured by the camera and transferred to the ECU, transforms image data captured by the camera into a transformed bird's-eye view of the hitch of the trailer, and wherein the transformed bird's-eye view of the hitch of the trailer comprises a bow transformation removing rotational motion of the hitch in the image data;
wherein the vehicular trailering assist system accesses a plurality of stored trailer templates, and wherein each respective stored trailer template of the plurality of stored trailer templates was generated during a previous calibration of the system for a respective trailer associated with the respective stored trailer template;
wherein the vehicular trailering assist system, for at least one stored trailer template of the plurality of stored trailer templates, generates a matching score based on a comparison between the at least one stored trailer template and the transformed bird's-eye view of the hitch of the trailer, and wherein the vehicular trailering assist system determines the matching score based on determining a respective column score for each of a plurality of columns of the transformed bird's-eye view of the hitch of the trailer;
wherein the vehicular trailering assist system determines that the matching score for one of the at least one stored trailer template is greater than a threshold matching score; and
wherein the vehicular trailering assist system, responsive to determining that the matching score for the one of the at least one stored trailer template is greater than the threshold matching score, tracks a trailer angle of the trailer using the one of the at least one stored trailer template.
13. The vehicular trailering assist system of claim 12 , wherein the vehicular trailering assist system generates respective matching scores based on comparison between respective stored trailer templates of the plurality of stored trailer templates and the transformed bird's-eye view of the hitch of the trailer, and wherein the matching score for the one of the at least one stored trailer template is the highest matching score.
14. The vehicular trailering assist system of claim 12 , wherein each column is associated with a respective trailer angle of the trailer relative to the vehicle.
15. The vehicular trailering assist system of claim 12 , wherein the matching score is based on the highest column score of each respective column score.
16. The vehicular trailering assist system of claim 12 , wherein the transformed bird's-eye view of the hitch of the trailer is representative of at least a portion of the trailer.
17. A vehicular trailering assist system, the vehicular trailering assist system comprising:
a camera disposed at a vehicle equipped with the vehicular trailering assist system, the camera viewing at least rearward of the vehicle, wherein the camera is operable to capture frames of image data;
wherein the camera comprises a CMOS imaging array, and wherein the CMOS imaging array comprises at least one million photosensors arranged in rows and columns;
an electronic control unit (ECU) comprising electronic circuitry and associated software;
wherein image data captured by the camera is transferred to and are processed at the ECU;
wherein the vehicular trailering assist system, with a trailer hitched to the vehicle and with the camera viewing at least a hitch of the trailer that hitches the trailer to the vehicle, and via processing at the ECU of image data captured by the camera and transferred to the ECU, transforms image data captured by the camera into a transformed bird's-eye view of the hitch of the trailer;
wherein the vehicular trailering assist system accesses a plurality of stored trailer templates, and wherein each respective stored trailer template of the plurality of stored trailer templates was generated during a previous calibration of the system for a respective trailer associated with the respective stored trailer template;
wherein the vehicular trailering assist system generates respective matching scores based on comparison between respective stored trailer templates of the plurality of stored trailer templates and the transformed bird's-eye view of the hitch of the trailer, and wherein the vehicular trailering assist system generates the respective matching scores by applying a dilation to the respective stored trailer template and removing edges from the transformed bird's-eye view of the hitch of the trailer;
wherein the vehicular trailering assist system determines a highest matching score from the respective matching scores;
wherein the vehicular trailering assist system determines that the highest matching score is greater than a threshold matching score; and
wherein the vehicular trailering assist system, responsive to determining that the highest matching score is greater than the threshold matching score, tracks a trailer angle of the trailer using the respective stored trailer template with the highest matching score.
18. The vehicular trailering assist system of claim 17 , wherein the vehicular trailering assist system removes edges from the transformed bird's-eye view of the hitch of the trailer based on a dot product between the respective stored trailer template and the transformed bird's-eye view of the hitch of the trailer.
19. The vehicular trailering assist system of claim 17 , wherein the vehicular trailering assist system removes edges using a connected component algorithm.
20. The vehicular trailering assist system of claim 17 , wherein a number of edges removed is based on a total number of edges in the transformed bird's-eye view of the hitch of the trailer.