IP Library Granted Patent US 11,407,363
Granted Patent B2
US 11,407,363 · App. 16/735,219 · Granted Aug 9, 2022

Method for calculating a tow hitch position

Inventor: Robin Plowman (Southwick, GB)
Assignee: Continental Automotive GmbH
B60R11/04G06T7/73G06T7/97G06T2207/30252
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,407,363
App. No.
16/735,219
Granted
Aug 9, 2022
Kind
B2
Abstract

A method for calculating a tow hitch position of a trailer is presented. A first and a second image of the trailer is captured and a trailer rotation and translation relative to a known zero pose of the trailer based on the captured first and second images is calculated. The rotation axes of the trailer in the first and second image is calculated based on the calculated trailer rotations and translations. An intersection of the first and second rotation axis is calculated to determine a ray to the tow hitch position. The ray to the tow hitch position and a geometrical condition are used to calculate the tow hitch position.

Claims (45)

1. A method for calculating a vector to a tow hitch position of a vehicle attached to a trailer via the tow hitch, the method comprising:

capturing a first image of the trailer in a first position and a second image of the trailer in a second position using an image capture device;

calculating a trailer rotation and a trailer translation relative to the image capture device between the first position and the second position;

calculating a first rotation axis of the trailer between the first image and the second image based on the calculated trailer rotation and trailer translation;

repeating the capturing of the first and second images, the calculating of the trailer rotation and the trailer translation, and the calculating of the first rotation axis with a third image and a fourth image of the trailer thereby calculating a second rotation axis of the trailer between the third image and the fourth image; and

determining an intersection of the first and second rotation axis, and determining a vector to the tow hitch position based upon the determined intersection,

wherein determining the intersection of the first and second rotation axes comprises calculating a line of intersection between a first plane and a second plane, wherein the first plane is defined by a location of the image capture device and the first rotation axis, and the second plane is defined by the image capture device location and the second rotation axis.

2. The method of claim 1 , wherein the calculating of the trailer rotation and trailer translation further comprises:

calculating a trailer angle based on the determined vector to the tow hitch position as an input.

3. The method of claim 1 , wherein the method further comprises:

calculating the tow hitch position based on the determined vector to the tow hitch position and a geometrical condition.

4. The method of claim 3 , wherein the geometrical condition includes a known extrinsic camera position of a camera capturing the first and second images and that the tow hitch position is central at a vehicle, which draws the trailer.

5. The method of claim 1 , wherein the calculating of the trailer rotation and trailer translation further comprises:

comparing the captured first image with the captured second image of the trailer, and

identifying positions of features of the trailer in the captured first image relative to their positions in the captured second image.

6. The method of claim 1 , wherein the calculating of the trailer rotation and trailer translation further comprises:

projecting the calculated first and second rotation axis into an image.

7. The method of claim 1 , wherein a yaw, pitch and roll rotation of the trailer between the first position in the first image and the second position in the second image is expressed by the first rotation axis.

8. The method of claim 1 , wherein the first rotation axis includes pitch, yaw and roll rotation of the trailer between the first image and the second image, and the second rotation axis includes pitch, yaw and roll rotation of the trailer between the third image and the fourth image.

9. A calculation unit of a vehicle for calculating a tow hitch position of a trailer, wherein the calculation unit includes a processor and non-transitory computer readable medium having program instructions which when executed by the processor instructs the calculation unit to perform:

calculating a trailer rotation and a trailer translation based on a captured first image of the trailer in a first pose and a captured second image of the trailer in a second pose;

calculating a first rotation axis of the trailer between the first pose and the second pose based on the calculated trailer rotation and trailer translation;

repeating the calculating of the trailer rotation and the trailer translation and the calculating of the first rotation axis with a captured third image of the trailer in a third pose and a fourth image in a fourth pose thereby calculating a second rotation axis of the trailer; and

determining an intersection of the first and second rotation axis, and determining a ray to the tow hitch position based upon the determined intersection,

wherein determining the intersection of the first and second rotation axes comprises calculating a line of intersection between a first plane and a second plane, wherein the first plane is defined by a location of the image capture device and the first rotation axis, and the second plane is defined by the image capture device location and the second rotation axis.

10. The calculation unit of claim 9 , wherein the program instructions when executed by the processor further instructs the calculation unit to use the ray to the tow hitch position and a geometrical condition to calculate the tow hitch position.

11. The calculation unit of claim 9 , wherein the calculating of the trailer rotation and trailer translation further comprises calculating a trailer angle based on the determined vector to the tow hitch position as an input.

12. The calculation unit of claim 9 , wherein the program instructions, when executed by the processor, instruct the calculation unit to calculate the tow hitch position based on the determined vector to the tow hitch position and a geometrical condition.

13. The calculation unit of claim 12 , wherein the geometrical condition includes a known extrinsic camera position of a camera capturing the first and second images and that the tow hitch position is central at a vehicle, which draws the trailer.

14. The calculation unit of claim 9 , wherein the calculating of the trailer rotation and trailer translation further comprises:

comparing the captured first image with the captured second image of the trailer, and

identifying positions of features of the trailer in the captured first image relative to their positions in the captured second image.

15. The calculation unit of claim 9 , wherein the calculating of the trailer rotation and trailer translation further comprises projecting the calculated first and second rotation axis into an image.

16. The calculation unit of claim 9 , wherein a yaw, pitch and roll rotation of the trailer between the first position in the first image and the second position in the second image is expressed by the first rotation axis.

17. A vehicle comprising:

a camera for capturing images of a trailer; and

a calculation unit including a processor and memory having program instructions which when executed by the processor instructs the calculation unit to perform:

calculating a trailer rotation and a trailer translation based on a captured first image of the trailer in a first pose and a captured second image of the trailer in a second pose;

calculating a first rotation axis of the trailer between the first pose and the second pose based on the calculated trailer rotation and trailer translation;

repeating steps the calculating of the trailer rotation and the trailer translation, and the calculating of the first rotation axis with a captured third image of the trailer in a third pose and a fourth image in a fourth pose thereby calculating a second rotation axis of the trailer; and

determining an intersection of the first and second rotation axis, and determining a ray to the tow hitch position based upon the determined intersection,

wherein determining the intersection of the first and second rotation axes comprises calculating a line of intersection between a first plane and a second plane, wherein the first plane is defined by a location of the image capture device and the first rotation axis, and the second plane is defined by the image capture device location and the second rotation axis.

18. The vehicle of claim 17 , wherein the calculation unit is further configured for calculating the tow hitch position using the ray to the tow hitch position and a geometrical condition.

19. A program element, which when being executed on a processor, instructs the processor to perform the method of claim 1 .

20. A non-transitory computer readable medium on which a program element according to claim 10 is stored.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 7, 2025
From: CONTINENTAL AUTOMOTIVE GMBH
To: CONTINENTAL AUTONOMOUS MOBILITY GERMANY GMBH
Reel/Frame 070438/0643 →
CORRECTIVE ASSIGNMENT TO CORRECT THE THE NAME OF THE RECEIVING PARTY DATA HAS A TYPO GONTINENTAL AUTOMOTIVE GMBH NEEDS TO BE CHANGED TO CONTINENTAL AUTOMOTIVE GMBH PREVIOUSLY RECORDED AT REEL: 056892 FRAME: 0025. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Jun 10, 2022
From: PLOWMAN, ROBIN
To: CONTINENTAL AUTOMOTIVE GMBH
Reel/Frame 060330/0258 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 17, 2021
From: PLOWMAN, ROBIN
To: GONTINENTAL AUTOMOTIVE GMBH
Reel/Frame 056892/0023 →