IP Library Granted Patent US 10,346,705
Granted Patent B2
US 10,346,705 · App. 15/628,030 · Granted Jul 9, 2019

Method and apparatus for estimating articulation angle

Inventors: Mohammad Naserian (Windsor, CA); Shuqing Zeng (Sterling Heights, MI); Allan Lewis (Windsor, CA)
Assignee: GM GLOBAL TECHNOLOGY OPERATIONS LLC
G06K9/3208B60D1/36B60D1/62B60R1/00B60R1/003H04N7/181B60D1/40B60R2300/808G06K9/2009H04N7/183
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,346,705
App. No.
15/628,030
Granted
Jul 9, 2019
Kind
B2
Abstract

A method and apparatus for trailer recognition are provided. The method includes detecting a face of a trailer in a first and second image, taken at first and second distances respectively, generating a bounding box around the face of the trailer in the first and second images, determining a first and second set of feature points in the bounding boxes of the first and second images, determining a correspondence between the first set of feature points and the second set of feature points and a correspondence between corners of the bounding boxes and estimating at least one dimension of the trailer by performing a least squares analysis to solve for three-dimensional real world coordinates of the first and second set of features points and the corners of the bounding boxes. The method may assist an operator of a vehicle in aligning the vehicle hitch with a trailer coupler.

Claims (42)

1. A method for trailer recognition, the method comprising:

detecting a face of a trailer based on a first image of the trailer taken at a first distance and generating a first bounding box around the detected face of the trailer in the first image;

detecting the face of trailer based on a second image of the trailer taken at a second distance and generating a second bounding box around the detected face of the trailer in the second image;

determining a first set of feature points in the first bounding box and a second set of feature points in the second bounding box that correspond to the first set of feature points;

determining a correspondence between the first set of feature points and the second set of feature points and a correspondence between first corners of the first bounding box and second corners of the second bounding box; and

estimating at least one dimension of the trailer by performing a least squares analysis to solve for three-dimensional real world coordinates of the first and second set of features points and the first and second corners of the first and second bounding boxes.

2. The method of claim 1 , further comprising:

determining an articulation angle of the trailer with respect to a line through a center of a vehicle based on the estimated at least one dimension.

3. The method of claim 2 , wherein the determining the articulation angle comprises determining the articulation angle based on the estimated at least one dimension and a distance between the trailer and the vehicle, and

wherein the estimated at least one dimension comprises a width of the trailer.

4. The method of claim 3 , wherein the distance is determined from an information provided by at least one from among an accelerometer, a speedometer, an ultrasonic sensor, an odometer, a radar sensor, and a wheel speed sensor.

5. The method of claim 2 , wherein the determining the articulation angle comprises determining the articulation angle based on the three-dimensional real world coordinates.

6. The method of claim 1 , wherein the estimated at least one dimension comprises a height and a width of the trailer.

7. The method of claim 1 , further comprising:

receiving the first image of the trailer taken at the first distance and the second image of the trailer taken at the second distance from a camera facing a rear of the vehicle.

8. The method of claim 7 , wherein the camera comprises a center high mount stop lamp (CHMSL) camera.

9. The method of claim 1 , wherein the determining the correspondence between the first set of feature points and the second set of feature points comprises determining a rotation matrix corresponding to an articulation angle of the trailer with respect to a line through a center of the vehicle, and

wherein the correspondence between the first set of feature points and the second set of feature points and the correspondence between the first corners of the first bounding box and the second corners of the second bounding box is determined based on the rotation matrix.

10. A non-transitory computer readable medium comprising instructions executable by a computer to perform the method of claim 1 .

11. An apparatus for trailer recognition, the apparatus comprising:

at least one memory comprising computer executable instructions; and

at least one processor configured to read and execute the computer executable instructions, the computer executable instructions causing the at least one processor to:

detect a face of a trailer based on a first image of the trailer taken at a first distance and generate a first bounding box around the detected face of the trailer in the first image;

detect the face of trailer based on a second image of the trailer taken at a second distance and generate a second bounding box around the detected face of the trailer in the second image;

determine a first set of feature points in the first bounding box and a second set of feature points in the second bounding box that correspond to the first set of feature points;

determine a correspondence between the first set of feature points and the second set of feature points and a correspondence between first corners of the first bounding box and second corners of the second bounding box; and

estimate at least one dimension of the trailer by performing a least squares analysis to solve for three-dimensional real world coordinates of the first and second set of features points and the first and second corners of the first and second bounding boxes.

12. The apparatus of claim 11 , wherein the computer executable instructions cause the at least one processor to determine an articulation angle of the trailer with respect to a line through a center of a vehicle based on the estimated at least one dimension.

13. The apparatus of claim 12 , wherein the computer executable instructions cause the at least one processor to determine the articulation angle by determining the articulation angle based on the estimated at least one dimension and a distance between the trailer and the vehicle, and

wherein the estimated at least one dimension comprises a width of the trailer.

14. The apparatus of claim 13 , further comprising:

at least one from among an accelerometer, a speedometer, an ultrasonic sensor, an odometer, a radar sensor, and a wheel speed sensor,

wherein the computer executable instructions cause the at least one processor to determine the distance from an information provided by the at least one from among an accelerometer, a speedometer, an ultrasonic sensor, an odometer, a radar sensor, and a wheel speed sensor.

15. The apparatus of claim 11 , wherein the computer executable instructions cause the at least one processor to determine the angle based on the three-dimensional real world coordinates.

16. The apparatus of claim 11 , wherein the estimated at least one dimension comprises a height and a width of the trailer.

17. The apparatus of claim 11 , further comprising:

a camera facing a rear of the vehicle,

wherein the computer executable instructions cause the at least one processor to receive the first image of the trailer taken at the first distance and the second image of the trailer taken at the second distance from the camera.

18. The apparatus of claim 17 , wherein the camera comprises a center high mount stop lamp (CHMSL) camera.

19. The apparatus of claim 11 , wherein the computer executable instructions cause the at least one processor to determine the correspondence between the first set of feature points and the second set of feature points by determining a rotation matrix corresponding to an articulation angle of the trailer with respect to a line through a center of the vehicle, and

wherein the correspondence between the first set of feature points and the second set of feature points and the correspondence between the first corners of the first bounding box and the second corners of the second bounding box is determined based on the rotation matrix.

20. The apparatus of claim 11 , wherein the computer executable instructions cause the at least one processor to estimate at least one dimension of the trailer based on a focal length of a camera that captured the first image and the second image.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 20, 2017
From: NASERIAN, MOHAMMAD; ZENG, SHUQING; LEWIS, ALLAN
To: GM GLOBAL TECHNOLOGY OPERATIONS LLC
Reel/Frame 042759/0282 →
Continuity (1)
Related Publication 20180365509A1 · Dec 20, 2018
Cited By (2)
US 12,384,295 US 12,428,023