IP Library › Granted Patent US 12,043,175
Granted Patent B2
US 12,043,175 · App. 17/517,838 · Granted Jul 23, 2024

Trailer rear camera sensing mechanisms and methods

Inventors: Yun Qian Miao (Waterloo, CA); Halit Zengin (Bowmanville, CA); Akram M. Abdel-Rahman (Ajax, CA); Todd W. Nelson (Brighton, MI)
Assignee: GM Global Technology Operations LLC
B60R1/002B60T7/20B60T8/248B60W30/08G06V20/588B60D1/62B60R11/04B60R2300/80B60T2230/06
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,043,175
App. No.
17/517,838
Granted
Jul 23, 2024
Kind
B2
Abstract

Systems for detecting movement of a trailer having a rearward facing camera and linked to a tow vehicle. The systems include taking a first image and a second image with the camera and comparing the images. A first amount of trailer movement is determined between the second image and the first image. The systems may also take additional images and determine a second amount of trailer movement occurring between the additional images. Tracking the first amount and the second amount of trailer movement determines an amount of trailer sway. The determined trailer sway may be compared to a maximum allowable sway and, if the movement is greater than the maximum allowable sway, mitigating sway of the trailer with the tow vehicle.

Claims (56)

1. A method of detecting movement of a trailer having a rearward facing camera and linked to a tow vehicle, further comprising:

taking a first image with the camera;

taking a second image with the camera;

comparing the second image to the first image;

determining a first amount of trailer movement occurring between the second image and the first image;

taking a third image with the camera;

taking a fourth image with the camera;

comparing the fourth image to the third image;

determining a second amount of trailer movement occurring between the fourth image and the third image;

tracking the first amount and the second amount of trailer movement to determine a trailer sway;

comparing the determined trailer sway to a maximum allowable sway;

if the determined trailer sway is greater than the maximum allowable sway, mitigating the determined trailer sway with the tow vehicle;

wherein mitigating the determined trailer sway involves the tow vehicle executing one or more of differential braking, active rear steering, or active front steering;

using one or more of a front camera or sensors of the tow vehicle to determine whether the first amount or the second amount of trailer movement of the trailer is in response to movement of the tow vehicle; and

if the first amount or the second amount of trailer movement of the trailer is in response to movement of the tow vehicle, not mitigating sway, even if the movement of the trailer is greater than the maximum allowable sway.

2. The method of claim 1 , wherein the first amount of trailer movement is a first lateral amount of trailer movement, and further comprising:

determining a first longitudinal amount of trailer movement occurring between the second image and the first image.

3. The method of claim 2 , wherein the second amount of trailer movement is a second lateral amount of trailer movement, and further comprising:

determining a second longitudinal amount of trailer movement occurring between the fourth image and the third image.

4. A method of detecting movement of a trailer having a rearward facing camera and linked to a tow vehicle, comprising:

taking a first image with the camera;

taking a second image with the camera;

comparing the second image to the first image;

determining a first amount of trailer movement occurring between the second image and the first image;

taking a third image with the camera;

taking a fourth image with the camera;

comparing the fourth image to the third image;

determining a second amount of trailer movement occurring between the fourth image and the third image;

tracking the first amount and the second amount of trailer movement to determine a trailer sway;

determining a lateral velocity of the camera from one or more of the first image, the second image, the third image, and the fourth image;

determining a forward velocity of the camera from one or more of the first image, the second image, the third image, and the fourth image; and

determining a trailer length of the trailer based upon the determined lateral velocity and the determined forward velocity of the camera.

5. The method of claim 4 , wherein mitigating the determined trailer sway further includes trailer uniform braking or trailer differential braking.

6. A non-transitory computer-readable medium of including contents that are configured to cause a computing system to perform a method of detecting movement of a trailer having a rearward facing camera, the method comprising:

taking a first image with the rearward facing camera;

taking a second image with the rearward facing camera;

comparing the second image to the first image;

determining a first amount of trailer movement occurring between the second image and the first image;

taking a third image with the rearward facing camera;

taking a fourth image with the rearward facing camera;

comparing the fourth image to the third image;

determining a second amount of trailer movement occurring between the fourth image and the third image;

tracking the first amount and the second amount of trailer movement to determine a trailer sway;

comparing the determined trailer sway to a maximum allowable sway; and

if the movement is greater than the maximum allowable sway, mitigating sway of the trailer with a tow vehicle attached to the trailer, wherein mitigating trailer sway of the trailer involves the tow vehicle executing one or more of differential braking, active rear steering, or active front steering;

determining a location of one or more lane markings in the first image;

determining a location of the trailer relative to the one or more lane markings in the first image;

determining a location of one or more lane markings in the second image; and

determining a location of the trailer relative to the one or more lane markings in the second image; and

determining a second amount of trailer movement occurring relative to the lane markings between the second image and the first image.

7. The non-transitory computer-readable medium of claim 6 , further comprising:

determining a lateral velocity of the rearward facing camera from one or more of the first image and the second image;

determining a forward velocity of the rearward facing camera from one or more of the first image and the second image; and

determining a trailer length of the trailer based upon the determined lateral velocity and the determined forward velocity of the rearward facing camera.

8. The method of claim 4 , further comprising: determining a location of one or more lane markings in the first image; and determining a location of the trailer relative to the one or more lane markings in the first image.

9. The method of claim 8 , determining a location of one or more lane markings in the second image; and determining a location of the trailer relative to the one or more lane markings in the second image; and determining a second amount of trailer movement occurring relative to the one or more lane markings between the second image and the first image.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 3, 2021
From: MIAO, YUN QIAN; ZENGIN, HALIT; ABDEL-RAHMAN, AKRAM M.; NELSON, TODD W.
To: GM GLOBAL TECHNOLOGY OPERATIONS LLC
Reel/Frame 058005/0861 →
Continuity (1)
Related Publication 20230137098A1 · May 4, 2023