IP Library Granted Patent US 11,787,339
Granted Patent B2
US 11,787,339 · App. 16/947,386 · Granted Oct 17, 2023

Trailer hitching assist system with trailer coupler detection

Inventors: Shweta Suresh Daga (Maharashtra, IN); Jigneshkumar Natvarlal Vasoya (Gujarat, IN)
Assignee: Magna Electronics Inc.
B60R1/00G06F18/2148G06V10/22G06V10/44G06V10/764G06V10/7747G06V20/56B60R2300/10B60R2300/20B60R2300/808B60R2300/8086
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,787,339
App. No.
16/947,386
Granted
Oct 17, 2023
Kind
B2
Abstract

A trailer assist system for a vehicle includes a camera disposed at a rear portion of a vehicle and having a field of view exterior and at least rearward of the vehicle, the field of view encompassing at least a portion of a trailer coupler of a trailer stationary a distance from the vehicle. The camera captures image data that is representative of at least the trailer coupler of the trailer. An ECU includes an image processor operable to process image data captured by the camera. The ECU, responsive to image processing at the ECU of image data captured by the camera, determines a location of the trailer coupler using a detector model, which is based on an ensemble regression tree algorithm.

Claims (33)

1. A vehicular trailering assist system, the trailer assist system comprising:

a camera disposed at a rear portion of a vehicle equipped with the vehicular trailering assist system, the camera having a field of view at least rearward of the vehicle, the camera viewing at least a portion of a trailer coupler of a trailer that is spaced from the vehicle at a distance from the vehicle;

an electronic control unit (ECU) comprising electronic circuitry and associated software;

wherein the electronic circuitry comprises an image processor operable to process image data captured by the camera

wherein the ECU, responsive to image processing at the control of image data captured by the camera, determines a location of the trailer coupler using a detector model, and wherein the detector model is based on an ensemble regression tree algorithm; and

wherein the detector model is trained on annotated image data, the annotated image data comprising outline landmarks representative of portions of the trailer coupler, and wherein the outline landmarks represent at least one selected from the group consisting of (i) a left corner of the trailer coupler, (ii) a right corner of the trailer coupler, and (iii) a coupling point of the trailer coupler.

2. The vehicular trailering assist system of claim 1 , wherein the ECU, based on the outline landmarks, determines at least part of a shape of the trailer coupler.

3. The vehicular trailering assist system of claim 1 , wherein the outline landmarks represent each of (i) the left corner of the trailer coupler, (ii) the right corner of the trailer coupler, and (iii) the coupling point of the trailer coupler.

4. The vehicular trailering assist system of claim 1 , wherein the detector model is trained on a cascade of at least one regression tree.

5. The vehicular trailering assist system of claim 4 , wherein the at least one regression tree comprises a feature of intensity values.

6. The vehicular trailering assist system of claim 1 , wherein, responsive to detecting the location of the trailer coupler, the ECU performs a reversing maneuver of the vehicle towards the determined trailer coupler location.

7. The vehicular trailering assist system of claim 1 , wherein the ECU, responsive to determining the location of the trailer coupler, displays the location of the trailer coupler on a display device disposed within the interior of the vehicle.

8. The vehicular trailering assist system of claim 1 , wherein the ECU determines the location of the trailer coupler of the trailer using a two-stage classifier.

9. The vehicular trailering assist system of claim 1 , wherein the ECU repeats determination of the location of the trailer coupler via processing at the ECU of consecutive frames of image data captured by the camera.

10. A vehicular trailering assist system, the trailer assist system comprising:

a camera disposed at a rear portion of a vehicle equipped with the vehicular trailering assist system, the camera having a field of view at least rearward of the vehicle, the camera viewing at least a portion of a trailer coupler of a trailer that is spaced from the vehicle at a distance from the vehicle;

an electronic control unit (ECU) comprising electronic circuitry and associated software;

wherein the electronic circuitry comprises an image processor operable to process image data captured by the camera;

wherein the ECU, responsive to image processing at the control of image data captured by the camera, determines a plurality of outline landmarks representative of portions of the trailer coupler of the trailer, and wherein the plurality of outline landmarks represent at least one selected from the group consisting of (i) a left corner of the trailer coupler, (ii) a right corner of the trailer coupler, and (iii) a coupling point of the trailer coupler;

wherein the ECU, based on the plurality of outline landmarks, determines at least part of a shape of the trailer coupler; and

wherein the ECU, responsive to determining at least the shape of the trailer coupler, determines a location of the trailer coupler using a detector model.

11. The vehicular trailering assist system of claim 10 , wherein the detector model is trained on annotated image data, the annotated image data comprising the outline landmarks representative of portions of the trailer coupler.

12. The vehicular trailering assist system of claim 10 , wherein the outline landmarks represent each of (i) the left corner of the trailer coupler, (ii) the right corner of the trailer coupler, and (iii) the coupling point of the trailer coupler.

13. The vehicular trailering assist system of claim 10 , wherein the ECU determines the location of the trailer coupler of the trailer using a two-stage classifier.

14. The vehicular trailering assist system of claim 10 , wherein the ECU repeats determination of the location of the trailer coupler via processing at the ECU of consecutive frames of image data captured by the camera.

15. A vehicular trailering assist system, the trailer assist system comprising:

a camera disposed at a rear portion of a vehicle equipped with the vehicular trailering assist system, the camera having a field of view at least rearward of the vehicle, the camera viewing at least a portion of a trailer coupler of a trailer that is spaced from the vehicle at a distance from the vehicle;

an electronic control unit (ECU) comprising electronic circuitry and associated software;

wherein the electronic circuitry comprises an image processor operable to process image data captured by the camera;

wherein the ECU, responsive to image processing at the control of image data captured by the camera, determines a plurality of outline landmarks representative of portions of the trailer coupler of the trailer, and wherein the outline landmarks represent at least one selected from the group consisting of (i) a left corner of the trailer coupler, (ii) a right corner of the trailer coupler, and (iii) a coupling point of the trailer coupler;

wherein the ECU, based on the plurality of outline landmarks, determines a shape of the trailer coupler;

wherein the ECU, responsive to determining the shape of the trailer coupler, determines a location of the trailer coupler using a detector model, and wherein the detector model is based on an ensemble regression tree algorithm; and

wherein, responsive to detecting the location of the trailer coupler, the ECU performs a reversing maneuver of the vehicle towards the determined trailer coupler location.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 30, 2020
From: DAGA, SHWETA SURESH; VASOYA, JIGNESHKUMAR NATVARLAL
To: MAGNA ELECTRONICS INC.
Reel/Frame 053356/0180 →
Continuity (3)
Provisional Application 62883202 · Aug 6, 2019
Provisional Application 62880194 · Jul 30, 2019
Related Publication 20210034903A1 · Feb 4, 2021
Cited By (1)
US 12,212,894