IP Library › Granted Patent US 11,662,196
Granted Patent B2
US 11,662,196 · App. 15/929,535 · Granted May 30, 2023

Trailer angle detection system using rear camera of vehicle

Inventors: Harold E. Joseph (Brampton, CA); Joshua Teichroeb (Mississauga, CA); Alexander Velichko (Toronto, CA); Jyothi P. Gali (Rochester Hills, MI); Guruprasad Mani Iyer Shankaranarayanan (Mississauga, CA)
Assignee: MAGNA ELECTRONICS INC.
G06V20/56B60R1/003B60R11/04G01B11/26B60R2300/10B60R2300/20B60R2300/607B60R2300/806
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,662,196
App. No.
15/929,535
Granted
May 30, 2023
Kind
B2
Abstract

A vehicular trailer assist system includes a control that includes an image processor for processing image data captured by the camera representative of at least a portion of a trailer hitched to the vehicle. The control determines whether the trailer has been previously hitched to the vehicle. Responsive to the trailer not being previously hitched, the control operates in a trailer initial calibration mode. Responsive to the control recognizing the trailer, the control operates in a recognized trailer calibration mode. The control obtains calibration data unique to the hitched trailer. The control, responsive to obtaining the calibration data, processes image data captured by the camera using the calibration data to locate the current position of the trailer relative to the vehicle. The control, responsive to locating the current position of the trailer relative to the vehicle, determines a trailer angle based on the located current position.

Claims (51)

1. A trailer assist system for a vehicle, the trailer assist system comprising:

a camera disposed at a rear portion of a vehicle and viewing exterior and at least rearward of the vehicle, wherein at least a portion of a trailer hitched to the vehicle is viewed by the camera;

a control comprising electronic circuitry and associated software;

wherein the electronic circuitry of the control comprises an image processor for processing image data captured by the camera, wherein image data captured by the camera is representative of at least the portion of the trailer hitched to the vehicle that is viewed by the camera;

wherein the control, responsive to image processing of image data captured by the camera, determines whether the trailer has been previously hitched to the vehicle;

responsive to the control determining that the trailer has not been previously hitched to the vehicle, the control operates in a trailer initial calibration mode, wherein the trailer initial calibration mode comprises generating a view transformation, wherein the view transformation symmetrically transforms the image data around a hitch position of the trailer hitched to the vehicle such that features of the view transformation move horizontally instead of rotationally;

wherein the control, while operating in the trailer initial calibration mode, generates calibration data unique to the hitched trailer based on the view transformation;

responsive to the control recognizing the trailer and determining that the trailer has been previously hitched to the vehicle, the control operates in a recognized trailer calibration mode;

wherein the control, while operating in the recognized trailer calibration mode, obtains the calibration data unique to the hitched trailer;

wherein the control processes image data captured by the camera using the obtained calibration data to locate a current position of the trailer relative to the vehicle; and

wherein the control determines a trailer angle of the trailer relative to the vehicle based on the located current position of the trailer relative to the vehicle.

2. The trailer assist system of claim 1 , wherein the control, responsive to locating the current position of the trailer, determines at least one dimension of the trailer.

3. The trailer assist system of claim 2 , wherein the at least one dimension of the trailer comprises at least one selected from the group consisting of (i) trailer height, (ii) trailer length, (iii) trailer width and (iv) beam length.

4. The trailer assist system of claim 1 , wherein the recognized trailer calibration mode comprises retrieving calibration data generated when the trailer was previously hitched to the vehicle.

5. The trailer assist system of claim 1 , wherein the initial trailer calibration mode comprises instructing a driver of the vehicle to travel in a straight line for a threshold period of time.

6. The trailer assist system of claim 5 , wherein the control extracts features from image data captured by the camera while the vehicle travels in a straight line to generate a feature extracted image.

7. The trailer assist system of claim 6 , wherein the view transformation transforms a perspective of the feature extracted image into a bird's eye view perspective.

8. The trailer assist system of claim 6 , wherein the extracted features are stored in memory for later use when performing the recognized trailer calibration mode when towing the trailer.

9. The trailer assist system of claim 1 , wherein the control locates the trailer by comparing calibration data to image data captured by the camera.

10. The trailer assist system of claim 9 , wherein the control compares a feature matrix from the calibration data to a feature matrix extracted from the image data captured by the camera.

11. The trailer assist system of claim 9 , wherein the control generates a matching score based on the comparison of the calibration data to the image data captured by the camera.

12. A trailer assist system for a vehicle, the trailer assist system comprising:

a camera disposed at a rear portion of a vehicle and viewing exterior and at least rearward of the vehicle, wherein at least a portion of a trailer hitched to the vehicle is viewed by the camera;

a control comprising electronic circuitry and associated software;

wherein the electronic circuitry of the control comprises an image processor for processing image data captured by the camera, wherein image data captured by the camera is representative of at least the portion of the trailer hitched to the vehicle that is viewed by the camera;

wherein the control, responsive to image processing of image data captured by the camera, determines whether the trailer has been previously hitched to the vehicle;

responsive to the control determining that the trailer has not been previously hitched to vehicle, the control operates in a trailer initial calibration mode where the control extracts features from image data captured by the camera while the vehicle travels in a straight line to generate a feature extracted image;

wherein the trailer initial calibration mode comprises generating a view transformation, and wherein the view transformation symmetrically transforms the feature extracted image around a hitch position of the trailer hitched to the vehicle such that hitch point rotation of the view transformation is represented with horizontal movement instead of rotational movement;

wherein the control, while operating in the trailer initial calibration mode, generates calibration data unique to the hitched trailer based on the view transformation;

responsive to the control recognizing the trailer and determining that the trailer has been previously hitched to the vehicle, the control operates in a recognized trailer calibration mode;

wherein the control, while operating in the recognized trailer calibration mode, obtains the calibration data unique to the hitched trailer;

wherein the control processes image data captured by the camera using the obtained calibration data to locate a current position of the trailer relative to the vehicle;

wherein the control, responsive to locating the current position of the trailer, determines at least two dimensions of the trailer; and

wherein the control determines a trailer angle of the trailer relative to the vehicle based on the located current position of the trailer relative to the vehicle.

13. The trailer assist system of claim 12 , wherein the at least two dimensions of the trailer comprises at least two selected from the group consisting of (i) trailer height, (ii) trailer length, (iii) trailer width and (iv) beam length.

14. The trailer assist system of claim 12 , wherein the recognized trailer calibration mode comprises retrieving calibration data generated when the trailer was previously hitched to the vehicle.

15. A trailer assist system for a vehicle, the trailer assist system comprising:

a camera disposed at a rear portion of a vehicle and viewing exterior and at least rearward of the vehicle, wherein at least a portion of a trailer hitched to the vehicle is viewed by the camera;

a control comprising electronic circuitry and associated software;

wherein the electronic circuitry of the control comprises an image processor for processing image data captured by the camera, wherein image data captured by the camera is representative of at least the portion of the trailer hitched to the vehicle that is viewed by the camera;

wherein the control, responsive to image processing of image data captured by the camera, determines whether the trailer has been previously hitched to the vehicle;

responsive to the control determining that the trailer has not been previously hitched to vehicle, the control operates in a trailer initial calibration mode where the control extracts features from image data captured by the camera while the vehicle travels in a straight line to generate a feature extracted image;

wherein the trailer initial calibration mode comprises generating a view transformation with a bird's eye view perspective, and wherein the view transformation symmetrically transforms the feature extracted image around a hitch position of the trailer hitched to the vehicle such that hitch point rotation of the view transformation is represented with horizontal movement instead of rotational movement;

wherein the control, while operating in the trailer initial calibration mode, generates calibration data unique to the hitched trailer based on the view transformation;

responsive to the control recognizing the trailer and determining that the trailer has been previously hitched to the vehicle, the control operates in a recognized trailer calibration mode;

wherein the control, while operating in the recognized trailer calibration mode, obtains the calibration data unique to the hitched trailer;

wherein the control processes image data captured by the camera using the obtained calibration data to locate a current position of the trailer relative to the vehicle;

wherein the control, responsive to locating the current position of the trailer, determines (i) trailer height, (ii) trailer length, (iii) trailer width and (iv) beam length; and

wherein the control determines a trailer angle of the trailer relative to the vehicle based on the located current position of the trailer relative to the vehicle.

16. The trailer assist system of claim 15 , wherein the control locates the trailer by comparing calibration data to image data captured by the camera.

17. The trailer assist system of claim 16 , wherein the control compares a feature matrix from the calibration data to a feature matrix extracted from the image data captured by the camera.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 8, 2020
From: JOSEPH, HAROLD E.; TEICHROEB, JOSHUA; VELICHKO, ALEXANDER; GALI, JYOTHI P.; SHANKARANARAYANAN, GURUPRASAD MANI IYER
To: MAGNA ELECTRONICS INC.
Reel/Frame 052609/0404 →
Continuity (2)
Provisional Application 62844834 · May 8, 2019
Related Publication 20200356788A1 · Nov 12, 2020
Cited By (1)
US 12,377,783