IP Library Granted Patent US 11,613,208
Granted Patent B2
US 11,613,208 · App. 16/947,379 · Granted Mar 28, 2023

Trailer hitching assist system with trailer coupler detection

Inventors: Akbar Assa (Richmond Hill, CA); Shweta Suresh Daga (Maharashtra, IN); Brijendra Kumar Bharti (Brampton, CA); Guruprasad Mani Iyer Shankaranarayanan (Mississauga, CA); Jyothi P. Gali (Rochester Hills, MI); Anoop S. Mann (Brampton, CA); Alexander Velichko (Toronto, CA)
Assignee: MAGNA ELECTRONICS INC.
B60R1/00G06F18/2155G06F18/2411G06V20/56B60R2300/10B60R2300/20B60R2300/607B60R2300/802B60R2300/808B60R2300/8086
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,613,208
App. No.
16/947,379
Granted
Mar 28, 2023
Kind
B2
Abstract

A trailering assist system for a vehicle includes a camera disposed at a rear portion of a vehicle and having a field of view rearward of the vehicle, the field of view encompassing at least a portion of a trailer rearward of the vehicle. The camera captures image data, which is representative of at least a front profile of the trailer, which includes a trailer coupler of the trailer. An ECU includes an image processor that processes image data captured by the camera. The ECU, responsive to image processing of captured image data, determines a location of the front profile of the trailer relative to the vehicle. Responsive to determining the location of the front profile, the ECU determines a plurality of outline landmarks that represent a shape of the front profile of the trailer. Based on the determined outline landmarks, the ECU determines a location of the trailer coupler.

Claims (44)

1. A vehicular trailering assist system, the vehicular trailering assist system comprising:

a camera disposed at a rear portion of a vehicle equipped with the vehicular trailering assist system, the camera having a field of view at least rearward of the vehicle, the camera viewing at least a portion of a trailer that is spaced from the vehicle at a distance from the vehicle;

wherein the camera captures image data, and wherein the image data captured by the camera is representative of at least a front profile of the trailer, the front profile of the trailer comprising a trailer coupler of the trailer;

an electronic control unit (ECU) comprising electronic circuitry and associated software;

wherein the electronic circuitry comprises an image processor operable to process image data captured by the camera;

wherein the ECU, responsive to image processing at the ECU of image data captured by the camera, determines a location of the front profile of the trailer relative to the vehicle;

wherein, responsive to determining the location of the front profile of the trailer relative to the vehicle, the ECU determines a plurality of outline landmarks corresponding to an outline of the front profile of the trailer, and wherein the plurality of outline landmarks are representative of a shape of the front profile of the trailer; and

wherein, based at least in part on the determined plurality of outline landmarks, the ECU determines a location of the trailer coupler.

2. The vehicular trailering assist system of claim 1 , wherein the ECU determines the location of the front profile of the trailer using a two-stage classifier.

3. The vehicular trailering assist system of claim 2 , wherein a first stage of the two-stage classifier comprises a linear Support Vector Machine and a second stage of the two-stage classifier comprises a nonlinear Support Vector Machine.

4. The vehicular trailering assist system of claim 1 , wherein, the ECU generates a bounding box that estimates the location of the front profile of the trailer for further processing.

5. The vehicular trailering assist system of claim 1 , wherein the ECU determines the plurality of outline landmarks using a detector model, and wherein the detector model is based on an ensemble of regression trees.

6. The vehicular trailering assist system of claim 5 , wherein the detector model is trained on annotated image data, the annotated image data comprising outline landmarks.

7. The vehicular trailering assist system of claim 1 , wherein the ECU repeats determination of the location of the front profile of the trailer and the plurality of outline landmarks via processing at the ECU of consecutive frames of image data captured by the camera.

8. The vehicular trailering assist system of claim 7 , wherein the ECU repeats determination of the location of the front profile of the trailer and the plurality of outline landmarks via processing at the ECU of five consecutive frames of image data captured by the camera.

9. The vehicular trailering assist system of claim 1 , wherein the ECU, responsive to determining the plurality of outline landmarks, determines the location of the trailer coupler using an unsupervised learning method.

10. The vehicular trailering assist system of claim 9 , wherein the unsupervised learning method comprises a mixture model or a K-Means method.

11. The vehicular trailering assist system of claim 1 , wherein, responsive to detecting the location of the trailer coupler, the ECU performs a reversing maneuver of the vehicle towards the detected trailer coupler location.

12. The vehicular trailering assist system of claim 1 , wherein the location of the trailer coupler is one of the plurality of outline landmarks.

13. The vehicular trailering assist system of claim 1 , wherein the ECU, responsive to determining the location of the trailer coupler, displays the location of the trailer coupler on a display device disposed within the interior of the vehicle.

14. A vehicular trailering assist system, the vehicular trailering assist system comprising:

a camera disposed at a rear portion of a vehicle equipped with the vehicular trailering assist system, the camera having a field of view at least rearward of the vehicle, the camera viewing at least a portion of a trailer that is spaced from the vehicle at a distance from the vehicle;

wherein the camera captures image data, and wherein the image data captured by the camera is representative of at least a front profile of the trailer, the front profile of the trailer comprising a trailer coupler of the trailer;

an electronic control unit (ECU) comprising electronic circuitry and associated software;

wherein the electronic circuitry comprises an image processor operable to process image data captured by the camera;

wherein the ECU, responsive to image processing at the ECU of image data captured by the camera, determines a location of the front profile of the trailer relative to the vehicle;

wherein the ECU determines the location of the front profile of the trailer using a two-stage classifier;

wherein, responsive to determining the location of the front profile of the trailer relative to the vehicle, the ECU determines a plurality of outline landmarks corresponding to an outline of the front profile of the trailer, and wherein the plurality of outline landmarks are representative of a shape of the front profile of the trailer;

wherein the ECU determines the plurality of outline landmarks using a detector model, and wherein the detector model is based on an ensemble of regression trees; and

wherein, based at least in part on the determined plurality of outline landmarks, the ECU determines a location of the trailer coupler.

15. The vehicular trailering assist system of claim 14 , wherein a first stage of the two-stage classifier comprises a linear Support Vector Machine and a second stage of the two-stage classifier comprises a nonlinear Support Vector Machine.

16. The vehicular trailering assist system of claim 14 , wherein, responsive to determining the location of the trailer, the ECU generates a bounding box that estimates the location of the front profile of the trailer for further processing.

17. The vehicular trailering assist system of claim 14 , wherein the ECU repeats determination of the location of the trailer and the plurality of outline landmarks via processing at the ECU of consecutive frames of image data captured by the camera.

18. A vehicular trailering assist system, the vehicular trailering assist system comprising:

a camera disposed at a rear portion of a vehicle equipped with the vehicular trailering assist system, the camera having a field of view at least rearward of the vehicle, the camera viewing at least a portion of a trailer that is spaced from the vehicle at a distance from the vehicle;

wherein the camera captures image data, and wherein the image data captured by the camera is representative of at least a front profile of the trailer, the front profile of the trailer comprising a trailer coupler of the trailer;

an electronic control unit (ECU) comprising electronic circuitry and associated software;

wherein the electronic circuitry comprises an image processor operable to process image data captured by the camera;

wherein the ECU, responsive to image processing at the ECU of image data captured by the camera, determines a location of the front profile of the trailer relative to the vehicle;

wherein, responsive to determining the location of the front profile of the trailer relative to the vehicle, the ECU determines a plurality of outline landmarks corresponding to an outline of the front profile of the trailer, and wherein the plurality of outline landmarks are representative of a shape of the front profile of the trailer;

wherein the ECU repeats determination of the location of the front profile of the trailer and the plurality of outline landmarks via processing at the ECU of consecutive frames of image data captured by the camera; and

wherein, based at least in part on the determined plurality of outline landmarks from the consecutive frames of image data captured by the camera, the ECU determines a location of the trailer coupler using an unsupervised learning method.

19. The vehicular trailering assist system of claim 18 , wherein the unsupervised learning method comprises a mixture model or a K-Means method.

20. The vehicular trailering assist system of claim 18 , wherein the location of the trailer coupler is one of the plurality of outline landmarks.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 21, 2023
From: ASSA, AKBAR; DAGA, SHWETA SURESH; BHARTI, BRIJENDRA KUMAR; SHANKARANARAYANAN, GURUPRASAD MANI IYER; GALI, JYOTHI P.; MANN, ANOOP S.; VELICHKO, ALEXANDER
To: MAGNA ELECTRONICS INC.
Reel/Frame 062750/0567 →
Continuity (2)
Provisional Application 62880194 · Jul 30, 2019
Related Publication 20210034902A1 · Feb 4, 2021
Cited By (1)
US 12,246,646